2024-08-08T23:14:44.958 INFO:root:teuthology version: 0.0.1.dev425+g43b8805 2024-08-08T23:14:44.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-08T23:14:45.067 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499 branch: wip-yuri7-testing-2024-08-08-0804-squid description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7844499' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri7-testing-2024-08-08-0804-squid ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-squid slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2024-08-08-0804-squid sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 998 sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 sleep_before_teardown: 0 subset: 111/120000 suite: rgw suite_branch: wip-yuri7-testing-2024-08-08-0804-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzQpybGMENjjzglsfE/Lfhuk9QkJV3wsepfQQmQi9b09M1e+BWBYMtXBiJ6frK766Rk7pJX7Dud2Y98B7gqEr4= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDinDENQyF67dIa3FV4nUB1u7fgo43JTTiDs/uaFDL5tGN9ScM/zOsoxlZmQeR/6p1U85A5utE98+8Eknika4i8= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-squid rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-squid force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 43b88056bcf6a0548bdd2d0502e56290cbae52df timestamp: 2024-08-08_23:01:55 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-08T23:14:45.067 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa; will attempt to use it 2024-08-08T23:14:45.068 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks 2024-08-08T23:14:45.068 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-08T23:14:45.071 INFO:teuthology.task.internal:Checking packages... 2024-08-08T23:14:45.094 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0a88632b45f25ae38493667c7dbd155f6e59b499' 2024-08-08T23:14:45.094 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-08T23:14:45.094 INFO:teuthology.packaging:ref: None 2024-08-08T23:14:45.094 INFO:teuthology.packaging:tag: None 2024-08-08T23:14:45.095 INFO:teuthology.packaging:branch: wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:14:45.095 INFO:teuthology.packaging:sha1: 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:14:45.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:14:45.239 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:14:45.241 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-08T23:14:45.249 INFO:teuthology.task.internal:no buildpackages task found 2024-08-08T23:14:45.249 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-08T23:14:45.263 INFO:teuthology.task.internal:Saving configuration 2024-08-08T23:14:45.280 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-08T23:14:45.292 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-08T23:14:45.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-08 23:09:12.955428', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINqGiQTNYUH76hYnGRreIJWRx3BdXeFTATLuVVkGPw3a'} 2024-08-08T23:14:45.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-08 23:09:12.956351', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMId2AWRViyyTy24oAsWJfYJycfa6fhociTBexqYA61m'} 2024-08-08T23:14:45.343 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-08T23:14:45.354 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-08-08T23:14:45.354 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-08-08T23:14:45.354 INFO:teuthology.run_tasks:Running task console_log... 2024-08-08T23:14:45.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5d03dcd000>, signals=[15]) 2024-08-08T23:14:45.424 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-08T23:14:45.437 INFO:teuthology.task.internal:Opening connections... 2024-08-08T23:14:45.437 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:14:45.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:14:45.531 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:14:45.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:14:45.611 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-08T23:14:45.618 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-08-08T23:14:45.624 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-08-08T23:14:45.624 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="22.04" 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=jammy 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-08T23:14:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-08T23:14:45.673 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-08T23:14:45.673 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-08T23:14:45.673 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=jammy 2024-08-08T23:14:45.673 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-08-08T23:14:45.697 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-08-08T23:14:45.702 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-08-08T23:14:45.703 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-08-08T23:14:45.749 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-08T23:14:45.750 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-08-08T23:14:45.750 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-08-08T23:14:45.773 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-08T23:14:45.787 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-08T23:14:45.799 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-08T23:14:45.800 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-08-08T23:14:45.802 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-08-08T23:14:45.807 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-08T23:14:45.818 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-08T23:14:45.818 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-08-08T23:14:45.849 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-08-08T23:14:45.859 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-08T23:14:45.922 INFO:teuthology.run_tasks:Running task kernel... 2024-08-08T23:14:45.941 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-08T23:14:45.941 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-08T23:14:45.942 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-08T23:14:45.942 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-08T23:14:45.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:14:45.947 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-08-08T23:14:45.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:14:45.948 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-08-08T23:14:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:5.15.0-56-generic 2024-08-08T23:14:45.992 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.15.0-56-generic 2024-08-08T23:14:45.992 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2024-08-08T23:14:45.994 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-08-08T23:14:45.994 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.15.0-56-generic 2024-08-08T23:14:45.995 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-08-08T23:14:46.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-08-08T23:14:46.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-08-08T23:14:46.276 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-08T23:14:46.391 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:14:46.421 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:14:46.422 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-08T23:14:46.472 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-08T23:14:46.479 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-08T23:14:46.490 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [519 kB] 2024-08-08T23:14:46.557 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,712 kB] 2024-08-08T23:14:46.595 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [283 kB] 2024-08-08T23:14:46.597 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.1 kB] 2024-08-08T23:14:46.597 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,226 kB] 2024-08-08T23:14:46.615 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-08T23:14:46.616 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [383 kB] 2024-08-08T23:14:46.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-08T23:14:46.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [620 kB] 2024-08-08T23:14:46.623 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [888 kB] 2024-08-08T23:14:46.628 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [174 kB] 2024-08-08T23:14:46.629 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-08T23:14:46.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-08T23:14:46.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-08T23:14:46.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-08T23:14:46.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-08T23:14:46.834 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-08T23:14:46.836 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-08T23:14:46.858 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [519 kB] 2024-08-08T23:14:46.971 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [678 kB] 2024-08-08T23:14:46.975 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,930 kB] 2024-08-08T23:14:47.146 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,712 kB] 2024-08-08T23:14:47.166 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,930 kB] 2024-08-08T23:14:47.288 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [678 kB] 2024-08-08T23:14:47.318 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [283 kB] 2024-08-08T23:14:47.322 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [341 kB] 2024-08-08T23:14:47.324 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [341 kB] 2024-08-08T23:14:47.330 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.1 kB] 2024-08-08T23:14:47.331 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-08T23:14:47.333 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,226 kB] 2024-08-08T23:14:47.336 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-08T23:14:47.337 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-08T23:14:47.338 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,301 kB] 2024-08-08T23:14:47.338 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-08T23:14:47.339 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-08T23:14:47.340 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,301 kB] 2024-08-08T23:14:47.403 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [396 kB] 2024-08-08T23:14:47.411 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-08T23:14:47.412 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [724 kB] 2024-08-08T23:14:47.422 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [396 kB] 2024-08-08T23:14:47.422 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [383 kB] 2024-08-08T23:14:47.427 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-08T23:14:47.427 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,110 kB] 2024-08-08T23:14:47.429 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-08T23:14:47.430 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [620 kB] 2024-08-08T23:14:47.440 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [888 kB] 2024-08-08T23:14:47.442 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,110 kB] 2024-08-08T23:14:47.451 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [724 kB] 2024-08-08T23:14:47.464 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [259 kB] 2024-08-08T23:14:47.466 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [259 kB] 2024-08-08T23:14:47.468 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [174 kB] 2024-08-08T23:14:47.470 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [25.9 kB] 2024-08-08T23:14:47.471 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-08T23:14:47.472 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [25.9 kB] 2024-08-08T23:14:47.474 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,772 B] 2024-08-08T23:14:47.474 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-08T23:14:47.474 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-08T23:14:47.483 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-08T23:14:47.483 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-08T23:14:47.484 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-08T23:14:47.486 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-08T23:14:47.487 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,772 B] 2024-08-08T23:14:47.491 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-08T23:14:47.533 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-08T23:14:47.533 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-08-08T23:14:47.534 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-08-08T23:14:47.553 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-08T23:14:47.553 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-08-08T23:14:47.554 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-08-08T23:14:47.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-08-08T23:14:47.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-08T23:14:47.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-08-08T23:14:47.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-08T23:14:47.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-08T23:14:47.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-08-08T23:14:47.558 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-08T23:14:47.564 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-08T23:14:47.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-08-08T23:14:47.568 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-08T23:14:47.615 INFO:teuthology.orchestra.run.smithi083.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-08T23:14:47.649 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-08T23:14:47.649 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-08T23:14:52.834 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 15.4 MB in 2s (7,467 kB/s) 2024-08-08T23:14:53.535 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 15.4 MB in 3s (5,660 kB/s) 2024-08-08T23:14:54.270 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:14:54.288 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-08T23:14:54.352 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:14:54.560 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-08-08T23:14:54.561 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-08-08T23:14:54.736 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:14:54.736 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:14:54.737 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:14:54.737 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:14:54.737 INFO:teuthology.orchestra.run.smithi196.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-08T23:14:54.737 INFO:teuthology.orchestra.run.smithi196.stdout: python2.7-minimal 2024-08-08T23:14:54.737 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:14:54.738 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-08-08T23:14:54.738 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-08T23:14:54.738 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.15.0-118-generic 2024-08-08T23:14:54.739 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.15.0-118-generic linux-modules-extra-5.15.0-118-generic 2024-08-08T23:14:54.740 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-08-08T23:14:54.740 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-08T23:14:54.740 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-08-08T23:14:54.740 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2024-08-08T23:14:54.790 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-08-08T23:14:54.790 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-08T23:14:54.790 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.15.0-118-generic linux-modules-5.15.0-118-generic 2024-08-08T23:14:54.791 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.15.0-118-generic 2024-08-08T23:14:54.791 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-08-08T23:14:54.792 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-08T23:14:54.971 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 330 not upgraded. 2024-08-08T23:14:54.971 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 113 MB of archives. 2024-08-08T23:14:54.971 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-08T23:14:54.971 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-118-generic amd64 5.15.0-118.128 [22.6 MB] 2024-08-08T23:14:55.075 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:14:55.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-08T23:14:55.146 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:14:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-08-08T23:14:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-08-08T23:14:55.489 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: python2.7-minimal 2024-08-08T23:14:55.490 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:14:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-08-08T23:14:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-08T23:14:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-generic linux-image-5.15.0-118-generic 2024-08-08T23:14:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-5.15.0-118-generic linux-modules-extra-5.15.0-118-generic 2024-08-08T23:14:55.493 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-08-08T23:14:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-08T23:14:55.493 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2024-08-08T23:14:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: thermald 2024-08-08T23:14:55.544 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-08-08T23:14:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: linux-headers-5.15.0-118 linux-headers-5.15.0-118-generic 2024-08-08T23:14:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.15.0-118-generic linux-modules-5.15.0-118-generic 2024-08-08T23:14:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: linux-modules-extra-5.15.0-118-generic 2024-08-08T23:14:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages will be upgraded: 2024-08-08T23:14:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-08T23:14:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:3 upgraded, 5 newly installed, 0 to remove and 330 not upgraded. 2024-08-08T23:14:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 113 MB of archives. 2024-08-08T23:14:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-08T23:14:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-118-generic amd64 5.15.0-118.128 [22.6 MB] 2024-08-08T23:14:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-118-generic amd64 5.15.0-118.128 [11.5 MB] 2024-08-08T23:14:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-118-generic amd64 5.15.0-118.128 [64.0 MB] 2024-08-08T23:14:56.384 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-118-generic amd64 5.15.0-118.128 [11.5 MB] 2024-08-08T23:14:56.737 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-118-generic amd64 5.15.0-118.128 [64.0 MB] 2024-08-08T23:14:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.118.118 [1,694 B] 2024-08-08T23:14:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.118.118 [2,466 B] 2024-08-08T23:14:56.916 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118 all 5.15.0-118.128 [12.4 MB] 2024-08-08T23:14:57.065 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118-generic amd64 5.15.0-118.128 [2,876 kB] 2024-08-08T23:14:57.087 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.118.118 [2,322 B] 2024-08-08T23:14:57.555 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 113 MB in 2s (70.7 MB/s) 2024-08-08T23:14:57.737 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-5.15.0-118-generic. 2024-08-08T23:14:58.964 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.118.118 [1,694 B] 2024-08-08T23:14:58.965 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.118.118 [2,466 B] 2024-08-08T23:14:58.965 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118 all 5.15.0-118.128 [12.4 MB] 2024-08-08T23:14:59.798 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-08T23:14:59.802 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../0-linux-modules-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:14:59.866 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-118-generic amd64 5.15.0-118.128 [2,876 kB] 2024-08-08T23:14:59.893 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:14:59.953 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.118.118 [2,322 B] 2024-08-08T23:15:00.348 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 113 MB in 5s (22.0 MB/s) 2024-08-08T23:15:00.529 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.15.0-118-generic. 2024-08-08T23:15:02.128 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-image-5.15.0-118-generic. 2024-08-08T23:15:02.149 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../1-linux-image-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:02.293 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:02.485 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-08T23:15:02.489 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:02.551 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:02.956 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-118-generic. 2024-08-08T23:15:02.976 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:03.264 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:05.010 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.15.0-118-generic. 2024-08-08T23:15:05.032 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:05.115 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:05.555 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-118-generic. 2024-08-08T23:15:05.575 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:05.622 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:09.843 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../3-linux-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:09.943 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:10.259 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:10.389 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-image-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:10.700 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.15.0-118. 2024-08-08T23:15:10.723 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../5-linux-headers-5.15.0-118_5.15.0-118.128_all.deb ... 2024-08-08T23:15:10.758 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-08T23:15:12.028 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:12.611 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-118. 2024-08-08T23:15:12.936 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.15.0-118_5.15.0-118.128_all.deb ... 2024-08-08T23:15:12.980 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-08T23:15:16.403 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package linux-headers-5.15.0-118-generic. 2024-08-08T23:15:16.440 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../6-linux-headers-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:16.478 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:18.915 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-118-generic. 2024-08-08T23:15:18.951 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.15.0-118-generic_5.15.0-118.128_amd64.deb ... 2024-08-08T23:15:18.989 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:19.775 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:19.917 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking linux-headers-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:20.234 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-08T23:15:20.380 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:20.506 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-headers-generic (5.15.0.118.118) ... 2024-08-08T23:15:20.635 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:21.618 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.118.118_amd64.deb ... 2024-08-08T23:15:21.984 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.15.0.118.118) over (5.15.0.56.54) ... 2024-08-08T23:15:22.130 INFO:teuthology.orchestra.run.smithi083.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:22.130 INFO:teuthology.orchestra.run.smithi083.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:22.130 INFO:teuthology.orchestra.run.smithi083.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:22.130 INFO:teuthology.orchestra.run.smithi083.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:22.755 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:22.976 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-118 (5.15.0-118.128) ... 2024-08-08T23:15:23.106 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:23.232 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.15.0.118.118) ... 2024-08-08T23:15:23.344 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:24.156 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:24.662 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:24.662 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:24.662 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:24.662 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:24.822 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:25.540 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-image-generic (5.15.0.118.118) ... 2024-08-08T23:15:25.674 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up linux-generic (5.15.0.118.118) ... 2024-08-08T23:15:25.801 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:25.864 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-08T23:15:25.865 INFO:teuthology.orchestra.run.smithi083.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:26.231 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:27.615 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.15.0.118.118) ... 2024-08-08T23:15:27.726 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.15.0.118.118) ... 2024-08-08T23:15:27.845 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.15.0-118-generic (5.15.0-118.128) ... 2024-08-08T23:15:28.626 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-08T23:15:28.626 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:40.132 INFO:teuthology.orchestra.run.smithi083.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-08T23:15:40.133 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub' 2024-08-08T23:15:40.171 INFO:teuthology.orchestra.run.smithi083.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-08T23:15:40.212 INFO:teuthology.orchestra.run.smithi083.stdout:Generating grub configuration file ... 2024-08-08T23:15:40.511 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:40.535 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:40.811 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:40.816 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:40.889 INFO:teuthology.orchestra.run.smithi083.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-08T23:15:40.894 INFO:teuthology.orchestra.run.smithi083.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-08T23:15:41.039 INFO:teuthology.orchestra.run.smithi083.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-08T23:15:41.040 INFO:teuthology.orchestra.run.smithi083.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-08T23:15:41.040 INFO:teuthology.orchestra.run.smithi083.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-08T23:15:41.086 INFO:teuthology.orchestra.run.smithi083.stdout:done 2024-08-08T23:15:41.556 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 21 2024-08-08T23:15:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.15.0.118.118 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2024-08-08T23:15:41.576 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2024-08-08T23:15:41.576 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-118-generic 2024-08-08T23:15:41.577 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-08T23:15:41.577 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-08T23:15:41.577 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-08T23:15:41.577 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-08-08T23:15:41.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get clean 2024-08-08T23:15:41.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-08-08T23:15:41.882 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-08T23:15:42.003 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:15:42.098 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-08T23:15:42.165 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-08T23:15:42.634 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-08T23:15:42.634 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2024-08-08T23:15:42.645 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-08T23:15:42.667 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2024-08-08T23:15:42.945 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:42.961 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:43.258 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:43.264 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:43.335 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-08T23:15:43.339 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:15:43.340 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-08T23:15:43.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-08T23:15:43.412 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:15:43.505 INFO:teuthology.orchestra.run.smithi196.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-08T23:15:43.505 INFO:teuthology.orchestra.run.smithi196.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-08T23:15:43.505 INFO:teuthology.orchestra.run.smithi196.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-08T23:15:43.536 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-08-08T23:15:43.598 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-08-08T23:15:43.598 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-08-08T23:15:43.764 INFO:teuthology.orchestra.run.smithi083.stdout:linux-image-generic is already the newest version (5.15.0.118.118). 2024-08-08T23:15:43.764 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:15:43.764 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:15:43.764 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:15:43.764 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:15:43.765 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:15:43.765 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:15:43.765 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:15:43.804 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 0 newly installed, 0 to remove and 330 not upgraded. 2024-08-08T23:15:43.805 DEBUG:teuthology.orchestra.run.smithi083:> dpkg -s linux-image-generic 2024-08-08T23:15:43.861 INFO:teuthology.orchestra.run.smithi083.stdout:Package: linux-image-generic 2024-08-08T23:15:43.861 INFO:teuthology.orchestra.run.smithi083.stdout:Status: install ok installed 2024-08-08T23:15:43.861 INFO:teuthology.orchestra.run.smithi083.stdout:Priority: optional 2024-08-08T23:15:43.861 INFO:teuthology.orchestra.run.smithi083.stdout:Section: kernel 2024-08-08T23:15:43.861 INFO:teuthology.orchestra.run.smithi083.stdout:Installed-Size: 21 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Maintainer: Ubuntu Kernel Team 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: amd64 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Source: linux-meta 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Version: 5.15.0.118.118 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Recommends: thermald 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout:Description: Generic Linux kernel image 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout: This package will always depend on the latest generic kernel image 2024-08-08T23:15:43.862 INFO:teuthology.orchestra.run.smithi083.stdout: available. 2024-08-08T23:15:43.863 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-08-08T23:15:43.907 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.fF4LDefXfs 2024-08-08T23:15:43.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fF4LDefXfs 2024-08-08T23:15:43.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.fF4LDefXfs 2024-08-08T23:15:44.024 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-08-08T23:15:44.040 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.118.118 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-08T23:15:44.041 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-08-08T23:15:44.042 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-08-08T23:15:44.042 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-08-08T23:15:44.042 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-08-08T23:15:44.042 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-118-generic 2024-08-08T23:15:44.042 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-08T23:15:44.042 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-08T23:15:44.042 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-08T23:15:44.042 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2024-08-08T23:15:44.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-08-08T23:15:44.076 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.fF4LDefXfs is 10KB 2024-08-08T23:15:44.089 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.fF4LDefXfs 2024-08-08T23:15:44.094 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-08T23:15:44.151 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:15:44.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-08T23:15:44.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-08T23:15:44.218 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-118-generic 2024-08-08T23:15:44.218 DEBUG:teuthology.orchestra.run.smithi083:> sudo update-grub 2024-08-08T23:15:44.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-08-08T23:15:44.339 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:15:44.346 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-08T23:15:44.363 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-08T23:15:44.458 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-08T23:15:45.503 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub' 2024-08-08T23:15:45.504 INFO:teuthology.orchestra.run.smithi083.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-08T23:15:45.506 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-08-08T23:15:45.690 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:45.696 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:45.742 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:15:45.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-08T23:15:45.825 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:15:45.939 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:45.944 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:45.985 INFO:teuthology.orchestra.run.smithi083.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-08T23:15:45.991 INFO:teuthology.orchestra.run.smithi083.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-08T23:15:46.031 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-08-08T23:15:46.032 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-08-08T23:15:46.107 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-08T23:15:46.107 INFO:teuthology.orchestra.run.smithi083.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-08T23:15:46.107 INFO:teuthology.orchestra.run.smithi083.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-08T23:15:46.130 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-08-08T23:15:46.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-08-08T23:15:46.217 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.15.0.118.118). 2024-08-08T23:15:46.217 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:15:46.217 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:15:46.217 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:15:46.217 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:15:46.218 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:15:46.218 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:15:46.218 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:15:46.260 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 330 not upgraded. 2024-08-08T23:15:46.262 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-08-08T23:15:46.277 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.118.118 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-118), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-118-generic, linux-modules-extra-5.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-08-08T23:15:46.278 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-08-08T23:15:46.279 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-08-08T23:15:46.279 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-08-08T23:15:46.325 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.MQMVP0be2x 2024-08-08T23:15:46.325 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MQMVP0be2x 2024-08-08T23:15:46.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.MQMVP0be2x 2024-08-08T23:15:46.503 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.MQMVP0be2x is 10KB 2024-08-08T23:15:46.516 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.MQMVP0be2x 2024-08-08T23:15:46.521 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-08T23:15:46.576 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:15:46.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-08T23:15:46.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-08T23:15:46.644 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-118-generic 2024-08-08T23:15:46.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2024-08-08T23:15:47.871 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-08-08T23:15:47.872 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-08T23:15:47.874 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-08-08T23:15:48.048 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-118-generic 2024-08-08T23:15:48.054 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-118-generic 2024-08-08T23:15:48.290 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-08T23:15:48.296 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-08T23:15:48.339 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-08T23:15:48.344 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-08T23:15:48.488 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-08T23:15:48.488 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-08T23:15:48.489 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-08T23:15:48.501 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-08-08T23:15:48.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-08-08T23:16:16.167 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-08T23:16:16.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:16:16.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:16:18.521 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-08T23:16:18.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:16:18.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:16:50.783 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-08-08T23:16:53.091 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-08-08T23:16:59.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:16:59.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:17:02.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:17:02.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:17:18.176 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-08-08T23:17:20.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-08-08T23:17:30.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:17:30.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:17:31.041 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-08-08T23:17:31.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:17:31.735 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-118-generic"... 2024-08-08T23:17:31.735 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-08-08T23:17:31.780 INFO:teuthology.orchestra.run.smithi083.stdout:5.15.0-118-generic 2024-08-08T23:17:31.780 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-118-generic vs 5.15.0-118-generic 2024-08-08T23:17:31.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-08T23:17:31.780 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-08T23:17:32.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:17:32.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:17:32.782 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-08T23:17:32.809 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-08T23:17:32.877 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-08-08T23:17:32.898 DEBUG:teuthology.parallel:result is None 2024-08-08T23:17:32.943 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-08-08T23:17:33.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:17:33.718 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-118-generic"... 2024-08-08T23:17:33.718 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-08-08T23:17:33.764 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-118-generic 2024-08-08T23:17:33.764 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-118-generic vs 5.15.0-118-generic 2024-08-08T23:17:33.764 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-08T23:17:33.765 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-08T23:17:34.766 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-08T23:17:34.766 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-08T23:17:34.927 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-08-08T23:17:34.946 DEBUG:teuthology.parallel:result is None 2024-08-08T23:17:34.947 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-08T23:17:34.956 INFO:teuthology.task.internal:Creating test directory... 2024-08-08T23:17:34.956 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-08T23:17:34.958 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-08T23:17:34.964 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-08T23:17:35.045 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-08T23:17:35.056 INFO:teuthology.task.internal:Creating archive directory... 2024-08-08T23:17:35.056 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-08T23:17:35.058 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-08T23:17:35.155 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-08T23:17:35.161 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-08T23:17:35.223 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-08T23:17:35.226 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-08T23:17:35.253 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-08T23:17:35.254 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-08T23:17:35.262 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-08T23:17:35.262 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-08T23:17:35.264 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-08T23:17:35.271 INFO:teuthology.task.internal:Configuring sudo... 2024-08-08T23:17:35.271 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-08T23:17:35.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-08T23:17:35.338 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-08T23:17:35.348 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-08T23:17:35.348 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-08T23:17:35.377 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-08T23:17:35.384 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-08T23:17:35.429 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-08T23:17:35.476 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:17:35.476 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-08T23:17:35.540 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-08T23:17:35.592 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-08T23:17:35.641 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:17:35.641 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-08T23:17:35.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-08-08T23:17:35.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-08-08T23:17:35.795 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-08T23:17:35.803 INFO:teuthology.task.internal:Starting timer... 2024-08-08T23:17:35.803 INFO:teuthology.run_tasks:Running task pcp... 2024-08-08T23:17:35.813 INFO:teuthology.run_tasks:Running task selinux... 2024-08-08T23:17:35.824 DEBUG:teuthology.task.selinux:Excluding smithi083: OS 'ubuntu' does not support SELinux 2024-08-08T23:17:35.824 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-08-08T23:17:35.824 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-08T23:17:35.824 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-08T23:17:35.824 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-08T23:17:35.825 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-08T23:17:35.833 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-08T23:17:35.846 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-08T23:17:35.847 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-08T23:25:00.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-08-08T23:25:00.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:25:00.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:25:00.467 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-08-08T23:25:00.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-08-08T23:25:00.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:25:00.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-08T23:25:00.630 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-08-08T23:25:00.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-08-08T23:25:00.706 INFO:teuthology.run_tasks:Running task clock... 2024-08-08T23:25:00.716 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-08T23:25:00.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-08T23:25:00.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-08T23:25:00.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-08T23:25:00.719 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-08T23:25:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Command line: ntpd -gq 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: ---------------------------------------------------- 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: ntp-4 is maintained by Network Time Foundation, 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: corporation. Support and training for ntp-4 are 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: available at https://www.nwtime.org/support 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: ---------------------------------------------------- 2024-08-08T23:25:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: proto: precision = 0.063 usec (-24) 2024-08-08T23:25:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: basedate set to 2022-02-04 2024-08-08T23:25:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: gps base set to 2022-02-06 (week 2196) 2024-08-08T23:25:00.749 INFO:teuthology.orchestra.run.smithi083.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-08T23:25:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-08T23:25:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: restrict ::: KOD does nothing without LIMITED. 2024-08-08T23:25:00.750 INFO:teuthology.orchestra.run.smithi083.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen and drop on 0 v6wildcard [::]:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen normally on 2 lo 127.0.0.1:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen normally on 3 enp3s0f1 172.21.15.83:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen normally on 4 lo [::1]:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce91%5]:123 2024-08-08T23:25:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:00 ntpd[18373]: Listening on routing socket on fd #22 for interface updates 2024-08-08T23:25:00.775 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-08T23:25:00.776 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Command line: ntpd -gq 2024-08-08T23:25:00.776 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: ---------------------------------------------------- 2024-08-08T23:25:00.776 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: ntp-4 is maintained by Network Time Foundation, 2024-08-08T23:25:00.776 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-08T23:25:00.776 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: corporation. Support and training for ntp-4 are 2024-08-08T23:25:00.777 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: available at https://www.nwtime.org/support 2024-08-08T23:25:00.777 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: ---------------------------------------------------- 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: proto: precision = 0.060 usec (-24) 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: basedate set to 2022-02-04 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: gps base set to 2022-02-06 (week 2196) 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-08T23:25:00.778 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: restrict ::: KOD does nothing without LIMITED. 2024-08-08T23:25:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-08T23:25:00.779 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen and drop on 0 v6wildcard [::]:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen normally on 2 lo 127.0.0.1:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen normally on 4 lo [::1]:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-08-08T23:25:00.780 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:00 ntpd[18372]: Listening on routing socket on fd #22 for interface updates 2024-08-08T23:25:01.747 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:01 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:01.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:01 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:02.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:02 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:02.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:02.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:02 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:03.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:03.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:03.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:03 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:04.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:04.750 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.751 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.751 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:04.751 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:04 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:04.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:04.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:04.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:04.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:04 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:05.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:05 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:05.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:05.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:05.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:05 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:06.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:06.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:06 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:06.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:06 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:07.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:07 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:07.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:07.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:07.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:07.778 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:07 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:08.748 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:08.749 INFO:teuthology.orchestra.run.smithi083.stdout: 8 Aug 23:25:08 ntpd[18373]: ntpd: time slew -0.001822 s 2024-08-08T23:25:08.749 INFO:teuthology.orchestra.run.smithi083.stdout:ntpd: time slew -0.001822s 2024-08-08T23:25:08.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-08T23:25:08.749 INFO:teuthology.orchestra.run.smithi083.stderr: 8 Aug 23:25:08 ntpd[18373]: can't open /var/log/ntpstats/loopstats.20240808: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240808: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-08T23:25:08.776 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240808: Permission denied 2024-08-08T23:25:08.777 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Aug 23:25:08 ntpd[18372]: ntpd: time slew +0.000124 s 2024-08-08T23:25:08.777 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew +0.000124s 2024-08-08T23:25:08.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-08T23:25:08.777 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Aug 23:25:08 ntpd[18372]: can't open /var/log/ntpstats/loopstats.20240808: Permission denied 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.803 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.823 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-08-08T23:25:08.823 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-08-08T23:25:08.823 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.824 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.824 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.824 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-08T23:25:08.824 INFO:teuthology.run_tasks:Running task install... 2024-08-08T23:25:08.833 DEBUG:teuthology.task.install:project ceph 2024-08-08T23:25:08.833 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'}} 2024-08-08T23:25:08.833 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'} 2024-08-08T23:25:08.833 INFO:teuthology.task.install:Using flavor: default 2024-08-08T23:25:08.839 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-08T23:25:08.839 INFO:teuthology.task.install:extra packages: [] 2024-08-08T23:25:08.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-key list | grep Ceph 2024-08-08T23:25:08.840 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-08-08T23:25:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-08T23:25:08.926 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-08T23:25:08.927 INFO:teuthology.orchestra.run.smithi083.stdout:uid [ unknown] Ceph.com (release key) 2024-08-08T23:25:08.927 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-08T23:25:08.927 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-08-08T23:25:08.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:25:08.933 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-08T23:25:08.963 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-08T23:25:08.963 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-08-08T23:25:08.964 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-08T23:25:08.964 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-08-08T23:25:08.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:25:09.077 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default/ 2024-08-08T23:25:09.078 INFO:teuthology.task.install.deb:Package version is 19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:25:09.111 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default/ 2024-08-08T23:25:09.111 INFO:teuthology.task.install.deb:Package version is 19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:25:09.187 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:25:09.187 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-08T23:25:09.202 DEBUG:teuthology.orchestra.run.smithi083:> sudo apt-get update 2024-08-08T23:25:09.220 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:25:09.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-08T23:25:09.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-08-08T23:25:09.372 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-08T23:25:09.400 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-08T23:25:09.426 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy InRelease 2024-08-08T23:25:09.447 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-08-08T23:25:09.453 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy InRelease 2024-08-08T23:25:09.469 INFO:teuthology.orchestra.run.smithi083.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-08T23:25:09.474 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-08-08T23:25:09.490 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-08-08T23:25:09.496 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-08T23:25:09.497 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:25:09.517 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-08T23:25:09.518 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-08T23:25:09.525 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-08T23:25:09.546 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-08-08T23:25:09.575 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-08T23:25:09.607 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-08T23:25:09.655 INFO:teuthology.orchestra.run.smithi083.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-08T23:25:09.685 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-08T23:25:09.798 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 28.9 kB in 0s (70.6 kB/s) 2024-08-08T23:25:09.832 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 28.9 kB in 0s (69.5 kB/s) 2024-08-08T23:25:10.844 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:25:10.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.0-1345-g0a88632b-1jammy cephadm=19.1.0-1345-g0a88632b-1jammy ceph-mds=19.1.0-1345-g0a88632b-1jammy ceph-mgr=19.1.0-1345-g0a88632b-1jammy ceph-common=19.1.0-1345-g0a88632b-1jammy ceph-fuse=19.1.0-1345-g0a88632b-1jammy ceph-test=19.1.0-1345-g0a88632b-1jammy ceph-volume=19.1.0-1345-g0a88632b-1jammy radosgw=19.1.0-1345-g0a88632b-1jammy python3-rados=19.1.0-1345-g0a88632b-1jammy python3-rgw=19.1.0-1345-g0a88632b-1jammy python3-cephfs=19.1.0-1345-g0a88632b-1jammy python3-rbd=19.1.0-1345-g0a88632b-1jammy libcephfs2=19.1.0-1345-g0a88632b-1jammy libcephfs-dev=19.1.0-1345-g0a88632b-1jammy librados2=19.1.0-1345-g0a88632b-1jammy librbd1=19.1.0-1345-g0a88632b-1jammy rbd-fuse=19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:25:10.876 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:25:10.892 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.0-1345-g0a88632b-1jammy cephadm=19.1.0-1345-g0a88632b-1jammy ceph-mds=19.1.0-1345-g0a88632b-1jammy ceph-mgr=19.1.0-1345-g0a88632b-1jammy ceph-common=19.1.0-1345-g0a88632b-1jammy ceph-fuse=19.1.0-1345-g0a88632b-1jammy ceph-test=19.1.0-1345-g0a88632b-1jammy ceph-volume=19.1.0-1345-g0a88632b-1jammy radosgw=19.1.0-1345-g0a88632b-1jammy python3-rados=19.1.0-1345-g0a88632b-1jammy python3-rgw=19.1.0-1345-g0a88632b-1jammy python3-cephfs=19.1.0-1345-g0a88632b-1jammy python3-rbd=19.1.0-1345-g0a88632b-1jammy libcephfs2=19.1.0-1345-g0a88632b-1jammy libcephfs-dev=19.1.0-1345-g0a88632b-1jammy librados2=19.1.0-1345-g0a88632b-1jammy librbd1=19.1.0-1345-g0a88632b-1jammy rbd-fuse=19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:25:10.914 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:25:10.955 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:25:11.104 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-08-08T23:25:11.104 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-08-08T23:25:11.162 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-08-08T23:25:11.163 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-08-08T23:25:11.290 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:25:11.290 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:25:11.291 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:25:11.291 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:25:11.291 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:25:11.291 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:25:11.291 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-08T23:25:11.294 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-08T23:25:11.295 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet zip 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-08T23:25:11.296 INFO:teuthology.orchestra.run.smithi083.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-08T23:25:11.297 INFO:teuthology.orchestra.run.smithi083.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-08T23:25:11.297 INFO:teuthology.orchestra.run.smithi083.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-08T23:25:11.297 INFO:teuthology.orchestra.run.smithi083.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-08T23:25:11.297 INFO:teuthology.orchestra.run.smithi083.stdout:Recommended packages: 2024-08-08T23:25:11.297 INFO:teuthology.orchestra.run.smithi083.stdout: btrfs-tools 2024-08-08T23:25:11.360 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:25:11.360 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:25:11.361 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:25:11.361 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:25:11.361 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:25:11.361 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:25:11.361 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:25:11.363 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-08-08T23:25:11.363 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-08T23:25:11.363 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-08T23:25:11.363 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-08T23:25:11.364 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet zip 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-08T23:25:11.365 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-08T23:25:11.366 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-08T23:25:11.366 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-08T23:25:11.366 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-08-08T23:25:11.366 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-08-08T23:25:11.399 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-08-08T23:25:11.399 INFO:teuthology.orchestra.run.smithi083.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-08T23:25:11.399 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-08T23:25:11.399 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-08T23:25:11.400 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-08T23:25:11.401 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-08T23:25:11.402 INFO:teuthology.orchestra.run.smithi083.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-08T23:25:11.457 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 118 newly installed, 0 to remove and 317 not upgraded. 2024-08-08T23:25:11.457 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 181 MB of archives. 2024-08-08T23:25:11.458 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-08T23:25:11.458 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-08T23:25:11.464 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-08T23:25:11.465 INFO:teuthology.orchestra.run.smithi196.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-08T23:25:11.467 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-08T23:25:11.468 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-08T23:25:11.469 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-08T23:25:11.469 INFO:teuthology.orchestra.run.smithi196.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-08T23:25:11.527 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 118 newly installed, 0 to remove and 317 not upgraded. 2024-08-08T23:25:11.527 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 181 MB of archives. 2024-08-08T23:25:11.527 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-08T23:25:11.527 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-08T23:25:11.539 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.0-1345-g0a88632b-1jammy [3,586 kB] 2024-08-08T23:25:11.545 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-08T23:25:11.549 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-08T23:25:11.569 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-08T23:25:11.610 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.0-1345-g0a88632b-1jammy [3,586 kB] 2024-08-08T23:25:11.616 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-08T23:25:11.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-08T23:25:11.624 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-08T23:25:11.629 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-08T23:25:11.636 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-08T23:25:11.641 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-08T23:25:11.645 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-08T23:25:11.645 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-08T23:25:11.646 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-08T23:25:11.655 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-08T23:25:11.657 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-08T23:25:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-08T23:25:11.660 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-08T23:25:11.662 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-08T23:25:11.665 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-08T23:25:11.678 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-08T23:25:11.680 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-08T23:25:11.681 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-08T23:25:11.681 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-08T23:25:11.682 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-08T23:25:11.682 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-08T23:25:11.683 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-08T23:25:11.683 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-08T23:25:11.695 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-08T23:25:11.697 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-08T23:25:11.697 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-08T23:25:11.699 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-08T23:25:11.712 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-08T23:25:11.714 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-08T23:25:11.717 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-08T23:25:11.717 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-08T23:25:11.718 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-08T23:25:11.718 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-08T23:25:11.718 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-08T23:25:11.718 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-08T23:25:11.718 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-08T23:25:11.719 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-08T23:25:11.719 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-08T23:25:11.720 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-08T23:25:11.722 INFO:teuthology.orchestra.run.smithi083.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.0-1345-g0a88632b-1jammy [3,241 kB] 2024-08-08T23:25:11.726 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-08T23:25:11.728 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-08T23:25:11.730 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-08T23:25:11.732 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-08T23:25:11.732 INFO:teuthology.orchestra.run.smithi083.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-08T23:25:11.732 INFO:teuthology.orchestra.run.smithi083.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-08T23:25:11.734 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-08T23:25:11.736 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-08T23:25:11.749 INFO:teuthology.orchestra.run.smithi083.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-08T23:25:11.750 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-08T23:25:11.751 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-08T23:25:11.752 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-08T23:25:11.752 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-08T23:25:11.754 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-08T23:25:11.754 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-08T23:25:11.755 INFO:teuthology.orchestra.run.smithi083.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-08T23:25:11.755 INFO:teuthology.orchestra.run.smithi083.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-08T23:25:11.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-08T23:25:11.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-08T23:25:11.755 INFO:teuthology.orchestra.run.smithi083.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-08T23:25:11.756 INFO:teuthology.orchestra.run.smithi083.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-08T23:25:11.757 INFO:teuthology.orchestra.run.smithi083.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-08T23:25:11.759 INFO:teuthology.orchestra.run.smithi083.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-08T23:25:11.759 INFO:teuthology.orchestra.run.smithi083.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-08T23:25:11.766 INFO:teuthology.orchestra.run.smithi083.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-08T23:25:11.767 INFO:teuthology.orchestra.run.smithi083.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-08T23:25:11.768 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-08T23:25:11.769 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-08T23:25:11.783 INFO:teuthology.orchestra.run.smithi083.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-08T23:25:11.784 INFO:teuthology.orchestra.run.smithi083.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-08T23:25:11.784 INFO:teuthology.orchestra.run.smithi083.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-08T23:25:11.785 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-08T23:25:11.787 INFO:teuthology.orchestra.run.smithi083.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-08T23:25:11.788 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-08T23:25:11.788 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-08T23:25:11.789 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-08T23:25:11.789 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-08T23:25:11.790 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-08T23:25:11.791 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-08T23:25:11.791 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-08T23:25:11.803 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-08T23:25:11.804 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-08T23:25:11.805 INFO:teuthology.orchestra.run.smithi083.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.0-1345-g0a88632b-1jammy [719 kB] 2024-08-08T23:25:11.818 INFO:teuthology.orchestra.run.smithi083.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.0-1345-g0a88632b-1jammy [357 kB] 2024-08-08T23:25:11.820 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-08T23:25:11.824 INFO:teuthology.orchestra.run.smithi083.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.0-1345-g0a88632b-1jammy [32.8 kB] 2024-08-08T23:25:11.824 INFO:teuthology.orchestra.run.smithi083.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.0-1345-g0a88632b-1jammy [180 kB] 2024-08-08T23:25:11.825 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-08T23:25:11.826 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-08T23:25:11.826 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.0-1345-g0a88632b-1jammy [3,241 kB] 2024-08-08T23:25:11.826 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-08T23:25:11.827 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-08T23:25:11.827 INFO:teuthology.orchestra.run.smithi083.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.0-1345-g0a88632b-1jammy [67.6 kB] 2024-08-08T23:25:11.828 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-08T23:25:11.828 INFO:teuthology.orchestra.run.smithi083.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.0-1345-g0a88632b-1jammy [333 kB] 2024-08-08T23:25:11.830 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-08T23:25:11.831 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-08T23:25:11.837 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-08T23:25:11.838 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-08T23:25:11.839 INFO:teuthology.orchestra.run.smithi083.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-08T23:25:11.840 INFO:teuthology.orchestra.run.smithi083.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-08T23:25:11.841 INFO:teuthology.orchestra.run.smithi083.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-08T23:25:11.842 INFO:teuthology.orchestra.run.smithi083.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-08T23:25:11.843 INFO:teuthology.orchestra.run.smithi083.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-08T23:25:11.853 INFO:teuthology.orchestra.run.smithi083.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.0-1345-g0a88632b-1jammy [6,877 kB] 2024-08-08T23:25:11.854 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-08T23:25:11.855 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-08T23:25:11.856 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-08T23:25:11.858 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-08T23:25:11.860 INFO:teuthology.orchestra.run.smithi083.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-08T23:25:11.862 INFO:teuthology.orchestra.run.smithi083.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-08T23:25:11.862 INFO:teuthology.orchestra.run.smithi083.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-08T23:25:11.877 INFO:teuthology.orchestra.run.smithi083.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-08T23:25:11.877 INFO:teuthology.orchestra.run.smithi083.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-08T23:25:11.877 INFO:teuthology.orchestra.run.smithi083.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-08T23:25:11.878 INFO:teuthology.orchestra.run.smithi083.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-08T23:25:11.878 INFO:teuthology.orchestra.run.smithi083.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-08T23:25:11.878 INFO:teuthology.orchestra.run.smithi083.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-08T23:25:11.893 INFO:teuthology.orchestra.run.smithi083.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-08T23:25:11.894 INFO:teuthology.orchestra.run.smithi083.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-08T23:25:11.897 INFO:teuthology.orchestra.run.smithi083.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-08T23:25:11.910 INFO:teuthology.orchestra.run.smithi083.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-08T23:25:11.911 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-08T23:25:11.911 INFO:teuthology.orchestra.run.smithi083.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-08T23:25:11.912 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-08T23:25:11.912 INFO:teuthology.orchestra.run.smithi083.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-08T23:25:11.913 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-08T23:25:11.913 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-08T23:25:11.914 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-08T23:25:11.915 INFO:teuthology.orchestra.run.smithi083.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-08T23:25:11.917 INFO:teuthology.orchestra.run.smithi083.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-08T23:25:11.918 INFO:teuthology.orchestra.run.smithi083.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-08T23:25:11.918 INFO:teuthology.orchestra.run.smithi083.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-08T23:25:11.927 INFO:teuthology.orchestra.run.smithi083.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-08T23:25:11.928 INFO:teuthology.orchestra.run.smithi083.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-08T23:25:11.930 INFO:teuthology.orchestra.run.smithi083.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-08T23:25:11.931 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-08T23:25:11.933 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-08T23:25:11.933 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-08T23:25:11.935 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.0-1345-g0a88632b-1jammy [719 kB] 2024-08-08T23:25:11.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-08T23:25:11.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-08T23:25:11.945 INFO:teuthology.orchestra.run.smithi083.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-08T23:25:11.947 INFO:teuthology.orchestra.run.smithi083.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-08T23:25:11.947 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-08T23:25:11.948 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-08T23:25:11.948 INFO:teuthology.orchestra.run.smithi083.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-08T23:25:11.948 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-08T23:25:11.949 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-08T23:25:11.949 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-08T23:25:11.949 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-08T23:25:11.950 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.0-1345-g0a88632b-1jammy [357 kB] 2024-08-08T23:25:11.953 INFO:teuthology.orchestra.run.smithi083.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-08T23:25:11.954 INFO:teuthology.orchestra.run.smithi083.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-08T23:25:11.962 INFO:teuthology.orchestra.run.smithi083.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-08T23:25:11.964 INFO:teuthology.orchestra.run.smithi083.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-08T23:25:11.964 INFO:teuthology.orchestra.run.smithi083.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-08T23:25:11.965 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-08T23:25:11.967 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-08T23:25:11.970 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-08T23:25:11.978 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.0-1345-g0a88632b-1jammy [32.8 kB] 2024-08-08T23:25:11.979 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.0-1345-g0a88632b-1jammy [180 kB] 2024-08-08T23:25:11.982 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-08T23:25:11.983 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.0-1345-g0a88632b-1jammy [67.6 kB] 2024-08-08T23:25:11.984 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-08T23:25:11.984 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-08T23:25:11.984 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.0-1345-g0a88632b-1jammy [333 kB] 2024-08-08T23:25:11.987 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-08T23:25:11.989 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-08T23:25:11.990 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-08T23:25:11.991 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-08T23:25:11.991 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.0-1345-g0a88632b-1jammy [6,877 kB] 2024-08-08T23:25:11.999 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-08T23:25:12.000 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-08T23:25:12.003 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-08T23:25:12.017 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-08T23:25:12.018 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-08T23:25:12.018 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-08T23:25:12.020 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-08T23:25:12.020 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-08T23:25:12.026 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-08T23:25:12.026 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-08T23:25:12.034 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-08T23:25:12.036 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-08T23:25:12.037 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-08T23:25:12.068 INFO:teuthology.orchestra.run.smithi083.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.0-1345-g0a88632b-1jammy [112 kB] 2024-08-08T23:25:12.071 INFO:teuthology.orchestra.run.smithi083.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.0-1345-g0a88632b-1jammy [472 kB] 2024-08-08T23:25:12.081 INFO:teuthology.orchestra.run.smithi083.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.0-1345-g0a88632b-1jammy [25.9 MB] 2024-08-08T23:25:12.236 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.0-1345-g0a88632b-1jammy [112 kB] 2024-08-08T23:25:12.239 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.0-1345-g0a88632b-1jammy [472 kB] 2024-08-08T23:25:12.249 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.0-1345-g0a88632b-1jammy [25.9 MB] 2024-08-08T23:25:12.984 INFO:teuthology.orchestra.run.smithi083.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.0-1345-g0a88632b-1jammy [5,135 kB] 2024-08-08T23:25:13.073 INFO:teuthology.orchestra.run.smithi083.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.0-1345-g0a88632b-1jammy [245 kB] 2024-08-08T23:25:13.076 INFO:teuthology.orchestra.run.smithi083.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.0-1345-g0a88632b-1jammy [124 kB] 2024-08-08T23:25:13.079 INFO:teuthology.orchestra.run.smithi083.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.0-1345-g0a88632b-1jammy [1,555 kB] 2024-08-08T23:25:13.141 INFO:teuthology.orchestra.run.smithi083.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.0-1345-g0a88632b-1jammy [6,124 kB] 2024-08-08T23:25:13.213 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.0-1345-g0a88632b-1jammy [5,135 kB] 2024-08-08T23:25:13.307 INFO:teuthology.orchestra.run.smithi083.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.0-1345-g0a88632b-1jammy [22.7 MB] 2024-08-08T23:25:13.314 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.0-1345-g0a88632b-1jammy [245 kB] 2024-08-08T23:25:13.319 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.0-1345-g0a88632b-1jammy [124 kB] 2024-08-08T23:25:13.331 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.0-1345-g0a88632b-1jammy [1,555 kB] 2024-08-08T23:25:13.380 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.0-1345-g0a88632b-1jammy [6,124 kB] 2024-08-08T23:25:13.591 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.0-1345-g0a88632b-1jammy [22.7 MB] 2024-08-08T23:25:14.117 INFO:teuthology.orchestra.run.smithi083.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.0-1345-g0a88632b-1jammy [14.1 kB] 2024-08-08T23:25:14.118 INFO:teuthology.orchestra.run.smithi083.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.0-1345-g0a88632b-1jammy [877 kB] 2024-08-08T23:25:14.136 INFO:teuthology.orchestra.run.smithi083.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.0-1345-g0a88632b-1jammy [2,461 kB] 2024-08-08T23:25:14.178 INFO:teuthology.orchestra.run.smithi083.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.0-1345-g0a88632b-1jammy [794 kB] 2024-08-08T23:25:14.188 INFO:teuthology.orchestra.run.smithi083.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.0-1345-g0a88632b-1jammy [152 kB] 2024-08-08T23:25:14.189 INFO:teuthology.orchestra.run.smithi083.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.0-1345-g0a88632b-1jammy [2,327 kB] 2024-08-08T23:25:14.256 INFO:teuthology.orchestra.run.smithi083.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.0-1345-g0a88632b-1jammy [8,625 kB] 2024-08-08T23:25:14.448 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.0-1345-g0a88632b-1jammy [14.1 kB] 2024-08-08T23:25:14.448 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.0-1345-g0a88632b-1jammy [877 kB] 2024-08-08T23:25:14.466 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.0-1345-g0a88632b-1jammy [2,461 kB] 2024-08-08T23:25:14.509 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.0-1345-g0a88632b-1jammy [794 kB] 2024-08-08T23:25:14.511 INFO:teuthology.orchestra.run.smithi083.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.0-1345-g0a88632b-1jammy [14.2 kB] 2024-08-08T23:25:14.512 INFO:teuthology.orchestra.run.smithi083.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.0-1345-g0a88632b-1jammy [51.3 MB] 2024-08-08T23:25:14.518 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.0-1345-g0a88632b-1jammy [152 kB] 2024-08-08T23:25:14.520 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.0-1345-g0a88632b-1jammy [2,327 kB] 2024-08-08T23:25:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.0-1345-g0a88632b-1jammy [8,625 kB] 2024-08-08T23:25:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.0-1345-g0a88632b-1jammy [14.2 kB] 2024-08-08T23:25:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.0-1345-g0a88632b-1jammy [51.3 MB] 2024-08-08T23:25:16.409 INFO:teuthology.orchestra.run.smithi083.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.0-1345-g0a88632b-1jammy [125 kB] 2024-08-08T23:25:16.412 INFO:teuthology.orchestra.run.smithi083.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.0-1345-g0a88632b-1jammy [39.0 kB] 2024-08-08T23:25:16.413 INFO:teuthology.orchestra.run.smithi083.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.0-1345-g0a88632b-1jammy [13.6 MB] 2024-08-08T23:25:16.668 INFO:teuthology.orchestra.run.smithi083.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.0-1345-g0a88632b-1jammy [91.4 kB] 2024-08-08T23:25:16.695 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.0-1345-g0a88632b-1jammy [125 kB] 2024-08-08T23:25:16.698 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.0-1345-g0a88632b-1jammy [39.0 kB] 2024-08-08T23:25:16.699 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.0-1345-g0a88632b-1jammy [13.6 MB] 2024-08-08T23:25:16.890 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-08-08-0804-squid/0a88632b45f25ae38493667c7dbd155f6e59b499/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.0-1345-g0a88632b-1jammy [91.4 kB] 2024-08-08T23:25:17.239 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 181 MB in 5s (34.4 MB/s) 2024-08-08T23:25:17.406 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-08T23:25:17.464 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 181 MB in 5s (33.4 MB/s) 2024-08-08T23:25:17.503 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-08T23:25:17.509 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-08T23:25:17.588 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-08T23:25:17.626 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-08T23:25:17.726 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-08T23:25:17.732 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-08T23:25:17.816 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-08T23:25:17.934 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-08T23:25:17.960 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-08T23:25:18.000 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-08T23:25:18.136 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-08T23:25:18.162 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-08T23:25:18.203 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-08T23:25:18.328 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-08T23:25:18.354 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-08T23:25:18.395 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-08T23:25:18.489 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-08T23:25:18.515 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-08T23:25:18.556 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-08T23:25:18.832 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-08T23:25:18.859 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:18.908 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:18.993 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-08T23:25:19.019 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:19.068 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:19.327 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-08T23:25:19.353 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:19.393 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:19.479 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-08T23:25:19.505 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:19.545 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:19.705 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-08T23:25:19.731 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:19.763 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:19.865 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-08T23:25:19.891 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-08T23:25:19.932 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:25:20.117 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-08T23:25:20.143 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-08T23:25:20.183 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-08T23:25:20.293 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-08T23:25:20.319 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-08T23:25:20.359 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-08T23:25:20.528 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librados2. 2024-08-08T23:25:20.554 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../007-librados2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:20.594 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librados2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:20.679 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-08-08T23:25:20.705 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-librados2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:20.745 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librbd1. 2024-08-08T23:25:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../008-librbd1_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:21.097 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librbd1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:21.165 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-08-08T23:25:21.180 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-librbd1_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:21.215 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:21.517 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs2. 2024-08-08T23:25:21.543 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../009-libcephfs2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:21.583 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:21.651 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-08-08T23:25:21.677 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-libcephfs2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:21.718 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:21.886 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rados. 2024-08-08T23:25:21.912 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../010-python3-rados_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:21.953 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rados (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.003 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-08-08T23:25:22.018 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-python3-rados_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:22.061 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.280 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-08T23:25:22.306 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:22.347 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-argparse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.373 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-08T23:25:22.399 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:22.439 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.583 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cephfs. 2024-08-08T23:25:22.598 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../012-python3-cephfs_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:22.633 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cephfs (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.641 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-08-08T23:25:22.657 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-python3-cephfs_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:22.692 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:22.953 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-08T23:25:22.979 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:23.019 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:23.028 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-08T23:25:23.054 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:23.094 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:23.339 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-08T23:25:23.365 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-08T23:25:23.405 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-08T23:25:23.406 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-08T23:25:23.432 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-08T23:25:23.474 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-08T23:25:23.717 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-prettytable. 2024-08-08T23:25:23.743 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-08T23:25:23.783 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-08T23:25:23.827 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-08-08T23:25:23.853 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-08T23:25:24.019 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rbd. 2024-08-08T23:25:24.034 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../016-python3-rbd_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:24.046 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-08T23:25:24.078 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rbd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:24.414 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-08T23:25:24.440 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-08T23:25:24.480 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-08T23:25:24.488 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-08-08T23:25:24.503 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-rbd_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:24.538 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:24.759 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-08T23:25:24.773 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-08T23:25:24.817 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-08T23:25:24.882 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-08T23:25:24.908 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-08T23:25:24.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-08T23:25:25.120 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-08T23:25:25.135 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-08T23:25:25.170 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-08T23:25:25.227 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-08T23:25:25.242 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-08T23:25:25.285 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-08T23:25:25.481 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua5.1. 2024-08-08T23:25:25.508 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-08T23:25:25.548 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-08T23:25:25.579 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-08T23:25:25.594 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-08T23:25:25.637 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-08T23:25:25.901 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-any. 2024-08-08T23:25:25.924 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-08-08T23:25:25.927 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-08T23:25:25.939 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-08T23:25:25.968 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-08T23:25:25.973 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-08T23:25:26.212 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package zip. 2024-08-08T23:25:26.228 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-08T23:25:26.262 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking zip (3.0-12build2) ... 2024-08-08T23:25:26.285 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-08-08T23:25:26.300 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-08T23:25:26.343 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-08T23:25:26.541 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package unzip. 2024-08-08T23:25:26.567 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-08T23:25:26.595 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-08-08T23:25:26.607 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-08T23:25:26.611 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-08T23:25:26.654 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-08-08T23:25:26.974 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-08-08T23:25:27.000 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-08T23:25:27.003 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package luarocks. 2024-08-08T23:25:27.029 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-08T23:25:27.040 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-08T23:25:27.069 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-08T23:25:27.402 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-08-08T23:25:27.428 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-08T23:25:27.444 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package librgw2. 2024-08-08T23:25:27.469 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-08T23:25:27.471 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../025-librgw2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:27.511 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking librgw2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:27.843 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-08-08T23:25:27.869 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-librgw2_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:27.909 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:28.021 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rgw. 2024-08-08T23:25:28.036 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../026-python3-rgw_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:28.071 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:28.425 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-08T23:25:28.451 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-08T23:25:28.461 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-08-08T23:25:28.488 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-python3-rgw_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:28.491 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-08T23:25:28.528 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:28.839 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-08T23:25:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-08T23:25:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-08T23:25:29.178 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libradosstriper1. 2024-08-08T23:25:29.204 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../028-libradosstriper1_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:29.209 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-08-08T23:25:29.235 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-libradosstriper1_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:29.245 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libradosstriper1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:29.451 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:29.623 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-common. 2024-08-08T23:25:29.649 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../029-ceph-common_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:29.681 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:29.921 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-08-08T23:25:29.947 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-ceph-common_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:29.987 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:31.079 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-base. 2024-08-08T23:25:31.105 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../030-ceph-base_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:31.155 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-base (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:31.434 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-08-08T23:25:31.460 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-ceph-base_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:31.510 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:31.725 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-08T23:25:31.751 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-08T23:25:31.791 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-08T23:25:32.061 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cheroot. 2024-08-08T23:25:32.087 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-08T23:25:32.096 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-08T23:25:32.119 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-08T23:25:32.122 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-08T23:25:32.163 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-08T23:25:32.397 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-08T23:25:32.413 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-08T23:25:32.455 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-08T23:25:32.490 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-08-08T23:25:32.517 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-08T23:25:32.565 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-08T23:25:32.767 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-08T23:25:32.793 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-08T23:25:32.833 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-08T23:25:32.952 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-08T23:25:32.978 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-08T23:25:33.027 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-08T23:25:33.137 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-08T23:25:33.163 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-08T23:25:33.203 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-08T23:25:33.396 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-08T23:25:33.423 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-08T23:25:33.471 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-08T23:25:33.765 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-08T23:25:33.773 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-tempora. 2024-08-08T23:25:33.791 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-08T23:25:33.799 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-08T23:25:33.831 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-08T23:25:33.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-08T23:25:34.139 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-08-08T23:25:34.144 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-portend. 2024-08-08T23:25:34.161 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-08T23:25:34.169 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-08T23:25:34.201 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-08T23:25:34.209 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-08T23:25:34.512 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-08T23:25:34.539 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-08T23:25:34.571 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-08-08T23:25:34.578 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-08T23:25:34.597 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-08T23:25:34.662 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-08T23:25:34.840 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-08T23:25:34.866 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-08T23:25:34.898 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-08T23:25:34.998 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-08T23:25:35.025 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-08T23:25:35.065 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-08T23:25:35.261 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-natsort. 2024-08-08T23:25:35.287 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-08T23:25:35.327 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-08T23:25:35.368 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-08T23:25:35.394 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-08T23:25:35.434 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-08T23:25:35.622 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-logutils. 2024-08-08T23:25:35.648 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-08T23:25:35.688 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-08T23:25:35.755 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-08-08T23:25:35.781 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-08T23:25:35.813 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-08T23:25:35.967 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-08T23:25:35.993 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-08T23:25:36.033 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-08T23:25:36.124 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-08-08T23:25:36.151 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-08T23:25:36.190 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-08T23:25:36.336 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-mako. 2024-08-08T23:25:36.363 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-08T23:25:36.402 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-08T23:25:36.493 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-08T23:25:36.520 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-08T23:25:36.560 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-08T23:25:36.764 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-08T23:25:36.791 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-08T23:25:36.831 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-08T23:25:36.879 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-08-08T23:25:36.906 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-08T23:25:36.946 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-08T23:25:37.126 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-08T23:25:37.152 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-08T23:25:37.184 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-08T23:25:37.223 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-08T23:25:37.239 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-08T23:25:37.273 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-08T23:25:37.512 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webob. 2024-08-08T23:25:37.535 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-08T23:25:37.538 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-08T23:25:37.561 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-08T23:25:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-08T23:25:37.601 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-08T23:25:37.879 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-08-08T23:25:37.906 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-08T23:25:37.931 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-waitress. 2024-08-08T23:25:37.945 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-08T23:25:37.958 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-08T23:25:38.001 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-08T23:25:38.318 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-tempita. 2024-08-08T23:25:38.332 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-08-08T23:25:38.344 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-08T23:25:38.358 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-08T23:25:38.384 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-08T23:25:38.410 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-08T23:25:38.679 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-paste. 2024-08-08T23:25:38.706 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-08T23:25:38.746 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-08T23:25:38.793 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-08-08T23:25:38.820 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-08T23:25:38.868 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-08T23:25:39.066 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-08T23:25:39.092 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-08T23:25:39.132 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-08T23:25:39.196 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-08-08T23:25:39.224 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-08T23:25:39.262 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-08T23:25:39.419 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-08T23:25:39.445 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-08T23:25:39.485 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-08T23:25:39.623 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-08T23:25:39.650 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-08T23:25:39.698 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-08T23:25:39.797 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-webtest. 2024-08-08T23:25:39.823 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-08T23:25:39.863 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-08T23:25:40.060 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-08T23:25:40.086 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-08T23:25:40.126 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-08T23:25:40.183 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pecan. 2024-08-08T23:25:40.209 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-08T23:25:40.249 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-08T23:25:40.404 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-08-08T23:25:40.431 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-08T23:25:40.470 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-08T23:25:40.630 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-certifi. 2024-08-08T23:25:40.656 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-08T23:25:40.696 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-08T23:25:40.773 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-08-08T23:25:40.800 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-08T23:25:40.840 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-08T23:25:41.007 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-idna. 2024-08-08T23:25:41.034 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-08T23:25:41.099 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-08T23:25:41.220 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-08-08T23:25:41.246 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-08T23:25:41.286 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-08T23:25:41.410 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-urllib3. 2024-08-08T23:25:41.437 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-08T23:25:41.477 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-08T23:25:41.606 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-08-08T23:25:41.632 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-08T23:25:41.672 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-08T23:25:41.764 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-requests. 2024-08-08T23:25:41.790 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-08T23:25:41.845 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-08T23:25:41.966 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-08-08T23:25:41.993 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-08T23:25:42.033 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-08T23:25:42.117 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-08T23:25:42.143 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-08T23:25:42.183 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-08T23:25:42.336 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-08-08T23:25:42.363 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-08T23:25:42.402 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-08T23:25:42.461 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-08T23:25:42.488 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:42.519 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-modules-core (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:42.714 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-08T23:25:42.741 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-08T23:25:42.772 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-08T23:25:42.908 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-08T23:25:42.934 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:42.974 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libsqlite3-mod-ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:43.067 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-08T23:25:43.082 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:43.117 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:43.269 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-08T23:25:43.296 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-08T23:25:43.327 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-08T23:25:43.496 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-08T23:25:43.523 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:43.563 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:43.630 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-openssl. 2024-08-08T23:25:43.657 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-08T23:25:43.697 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-08T23:25:43.840 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-08T23:25:43.856 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-08T23:25:43.890 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-08T23:25:44.033 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr. 2024-08-08T23:25:44.060 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../063-ceph-mgr_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:44.100 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:44.152 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-08-08T23:25:44.179 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-08T23:25:44.218 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-08T23:25:44.470 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mon. 2024-08-08T23:25:44.487 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../064-ceph-mon_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:44.520 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mon (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:44.547 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-08-08T23:25:44.573 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-ceph-mgr_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:44.711 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:46.016 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-osd. 2024-08-08T23:25:46.042 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../065-ceph-osd_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:46.049 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-08-08T23:25:46.075 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-ceph-mon_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:46.082 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-osd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:46.115 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:46.727 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-08-08T23:25:46.754 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-osd_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:46.794 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:47.135 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph. 2024-08-08T23:25:47.159 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../066-ceph_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:47.202 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:47.497 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-fuse. 2024-08-08T23:25:47.526 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../067-ceph-fuse_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:47.555 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:47.805 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-08-08T23:25:47.832 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:47.863 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:47.917 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mds. 2024-08-08T23:25:47.943 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../068-ceph-mds_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:47.983 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mds (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:48.157 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-08-08T23:25:48.184 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph-fuse_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:48.224 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:48.386 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package cephadm. 2024-08-08T23:25:48.413 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../069-cephadm_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:48.453 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:48.611 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-08-08T23:25:48.638 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph-mds_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:48.677 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:48.772 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-08T23:25:48.799 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-08T23:25:48.839 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-08T23:25:49.088 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-08-08T23:25:49.115 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-cephadm_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:25:49.141 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-08T23:25:49.157 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-08T23:25:49.171 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:49.200 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-08T23:25:49.457 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-08T23:25:49.472 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-08T23:25:49.507 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-08T23:25:49.851 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-08T23:25:49.867 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-08T23:25:49.909 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-08T23:25:50.180 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-babel. 2024-08-08T23:25:50.208 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-08T23:25:50.246 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-08T23:25:50.575 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-jinja2. 2024-08-08T23:25:50.602 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-08T23:25:50.641 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-08T23:25:50.931 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-08-08T23:25:50.959 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-08T23:25:50.986 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-08T23:25:50.997 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-08T23:25:51.014 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:51.052 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:51.309 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-08-08T23:25:51.336 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-08T23:25:51.367 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-08T23:25:51.406 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-08T23:25:51.433 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-08T23:25:51.472 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-08T23:25:51.678 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-08T23:25:51.705 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:51.736 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:51.775 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-routes. 2024-08-08T23:25:51.803 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-08T23:25:51.842 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-08T23:25:52.065 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-08T23:25:52.092 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-08T23:25:52.131 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-08T23:25:52.187 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-08T23:25:52.214 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:52.253 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-dashboard (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:52.393 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-08-08T23:25:52.419 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-08T23:25:52.459 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-08T23:25:52.762 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-08T23:25:52.789 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:52.820 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:53.525 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-08T23:25:53.541 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-08T23:25:53.584 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-08T23:25:54.075 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-08T23:25:54.079 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-joblib. 2024-08-08T23:25:54.091 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-08T23:25:54.108 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-08T23:25:54.142 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-08T23:25:54.354 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-08T23:25:54.662 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-08-08T23:25:54.689 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-08T23:25:54.716 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-08T23:25:54.728 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-08T23:25:54.744 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-08T23:25:54.782 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-08T23:25:55.054 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-sklearn. 2024-08-08T23:25:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-08T23:25:55.098 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-08T23:25:55.112 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-08T23:25:55.125 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-08T23:25:55.164 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-08T23:25:55.684 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-08-08T23:25:55.711 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-08T23:25:55.759 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-08T23:25:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-08T23:25:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:55.964 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:56.409 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-08T23:25:56.436 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:25:56.561 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:25:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-cachetools. 2024-08-08T23:25:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-08T23:25:57.001 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-08T23:25:57.313 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-08T23:25:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-08T23:25:57.379 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-08T23:25:57.480 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-08-08T23:25:57.508 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-08T23:25:57.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-08T23:25:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-08T23:25:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-08T23:25:57.791 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-08T23:25:57.825 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-08T23:25:57.852 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-08T23:25:57.883 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-08T23:25:58.102 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-rsa. 2024-08-08T23:25:58.130 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-08T23:25:58.161 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-08T23:25:58.169 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-08T23:25:58.177 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-08T23:25:58.219 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-08T23:25:58.440 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-google-auth. 2024-08-08T23:25:58.467 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-08T23:25:58.506 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-08T23:25:58.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-08-08T23:25:58.549 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-08T23:25:58.589 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-08T23:25:58.826 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-08T23:25:58.853 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-08T23:25:58.893 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-08T23:25:58.934 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-08-08T23:25:58.961 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-08T23:25:59.000 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-08T23:25:59.213 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-websocket. 2024-08-08T23:25:59.240 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-08T23:25:59.279 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-08T23:25:59.320 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-08T23:25:59.347 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-08T23:25:59.387 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-08T23:25:59.600 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-08T23:25:59.627 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-08T23:25:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-08T23:25:59.698 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-08-08T23:25:59.725 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-08T23:25:59.764 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-08T23:26:00.093 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-08T23:26:00.120 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-08T23:26:00.159 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-08T23:26:00.399 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-08T23:26:00.425 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:26:00.463 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-mgr-k8sevents (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:00.766 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-08T23:26:00.794 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-08T23:26:00.833 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-08T23:26:00.848 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-08T23:26:00.864 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:26:00.906 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:01.153 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-08T23:26:01.181 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-08T23:26:01.219 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-08T23:26:01.236 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-08T23:26:01.263 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-08T23:26:01.302 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-08T23:26:01.489 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package jq. 2024-08-08T23:26:01.505 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-08T23:26:01.547 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-08T23:26:01.605 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-08T23:26:01.633 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-08T23:26:01.663 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-08T23:26:01.800 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package socat. 2024-08-08T23:26:01.816 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-08T23:26:01.858 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-08T23:26:01.891 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-08-08T23:26:01.906 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-08T23:26:01.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-08T23:26:02.136 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package xmlstarlet. 2024-08-08T23:26:02.152 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-08T23:26:02.194 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-08T23:26:02.201 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-08-08T23:26:02.217 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-08T23:26:02.260 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-08T23:26:02.507 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-test. 2024-08-08T23:26:02.523 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../097-ceph-test_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:02.546 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-08-08T23:26:02.557 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-test (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:02.562 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-08T23:26:02.604 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-08T23:26:02.958 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-08-08T23:26:02.974 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-ceph-test_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:03.016 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:05.321 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package ceph-volume. 2024-08-08T23:26:05.348 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../098-ceph-volume_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:26:05.387 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking ceph-volume (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:05.488 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-08-08T23:26:05.515 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-ceph-volume_19.1.0-1345-g0a88632b-1jammy_all.deb ... 2024-08-08T23:26:05.554 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-08T23:26:05.666 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:05.699 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcephfs-dev (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:05.966 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-08T23:26:05.994 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-08T23:26:06.046 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-08T23:26:06.085 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-08T23:26:06.124 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:06.432 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-08T23:26:06.459 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-08T23:26:06.460 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-08T23:26:06.488 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-08T23:26:06.498 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-08T23:26:06.526 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-08T23:26:06.827 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package nvme-cli. 2024-08-08T23:26:06.847 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-08T23:26:06.855 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-08T23:26:06.872 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-08T23:26:06.885 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-08T23:26:06.914 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-08T23:26:07.258 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package pkg-config. 2024-08-08T23:26:07.284 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-08-08T23:26:07.285 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-08T23:26:07.312 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-08T23:26:07.315 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-08T23:26:07.351 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-08T23:26:07.569 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-08T23:26:07.584 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-08T23:26:07.627 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-08T23:26:07.798 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-08-08T23:26:07.826 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-08T23:26:07.864 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-08T23:26:08.072 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-08T23:26:08.100 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-08T23:26:08.117 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-08T23:26:08.138 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-08T23:26:08.144 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-08T23:26:08.183 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-08T23:26:08.424 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pastescript. 2024-08-08T23:26:08.452 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-08T23:26:08.491 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-08T23:26:08.620 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-08T23:26:08.648 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-08T23:26:08.686 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-08T23:26:08.811 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pluggy. 2024-08-08T23:26:08.839 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-08T23:26:08.877 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-08T23:26:08.989 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-08-08T23:26:09.017 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-08T23:26:09.055 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-08T23:26:09.156 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-psutil. 2024-08-08T23:26:09.172 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-08T23:26:09.205 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-08T23:26:09.384 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-08-08T23:26:09.411 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-08T23:26:09.450 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-08T23:26:09.534 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-py. 2024-08-08T23:26:09.561 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-08T23:26:09.600 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-08T23:26:09.719 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-08-08T23:26:09.736 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-08T23:26:09.769 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-08T23:26:09.887 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pygments. 2024-08-08T23:26:09.911 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-08T23:26:09.945 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-08T23:26:10.114 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-08-08T23:26:10.142 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-08T23:26:10.181 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-08T23:26:10.367 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-08T23:26:10.394 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-08T23:26:10.424 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-08T23:26:10.509 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-08-08T23:26:10.537 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-08T23:26:10.575 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-08T23:26:10.744 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-toml. 2024-08-08T23:26:10.772 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-08T23:26:10.810 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-08T23:26:10.979 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-08T23:26:10.995 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-08T23:26:11.029 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-08T23:26:11.122 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-pytest. 2024-08-08T23:26:11.150 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-08T23:26:11.188 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-08T23:26:11.332 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-08-08T23:26:11.360 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-08T23:26:11.398 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-08T23:26:11.534 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-simplejson. 2024-08-08T23:26:11.562 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-08T23:26:11.600 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-08T23:26:11.726 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-08-08T23:26:11.754 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-08T23:26:11.792 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-08T23:26:11.887 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-08T23:26:11.914 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-08T23:26:11.953 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-08T23:26:12.104 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-08-08T23:26:12.133 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-08T23:26:12.171 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-08T23:26:12.432 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-08T23:26:12.459 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-08T23:26:12.498 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-08T23:26:12.674 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package radosgw. 2024-08-08T23:26:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../116-radosgw_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:12.740 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking radosgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:13.269 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-08-08T23:26:13.297 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-radosgw_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:13.335 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:13.568 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package rbd-fuse. 2024-08-08T23:26:13.584 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../117-rbd-fuse_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:13.626 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking rbd-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:13.923 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-08T23:26:14.146 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-08-08T23:26:14.162 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-rbd-fuse_19.1.0-1345-g0a88632b-1jammy_amd64.deb ... 2024-08-08T23:26:14.173 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-08T23:26:14.196 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:14.299 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-08T23:26:14.475 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-08T23:26:14.562 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-08T23:26:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-08T23:26:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-08T23:26:14.894 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-08T23:26:15.117 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-08T23:26:15.328 INFO:teuthology.orchestra.run.smithi083.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-08T23:26:15.393 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:15.438 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-08T23:26:15.868 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-08T23:26:15.918 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user cephadm....done 2024-08-08T23:26:15.937 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:16.074 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-08T23:26:16.351 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-08T23:26:16.602 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-08T23:26:16.629 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-08-08T23:26:16.719 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-08T23:26:16.793 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-08T23:26:16.954 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-08T23:26:17.061 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-08T23:26:17.206 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-08T23:26:17.312 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-08T23:26:17.332 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-08T23:26:17.438 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-08T23:26:17.642 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-08T23:26:17.697 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-08T23:26:17.966 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-08T23:26:18.010 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-08T23:26:18.066 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-08T23:26:18.262 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-08T23:26:18.360 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-08T23:26:18.522 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-08T23:26:18.728 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-08T23:26:18.773 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-08T23:26:18.988 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-08T23:26:19.024 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-08T23:26:19.247 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-08T23:26:19.284 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-08T23:26:19.482 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-08T23:26:19.543 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-argparse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:19.716 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-08T23:26:19.861 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-08T23:26:19.970 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-08T23:26:19.975 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-08T23:26:20.080 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-08T23:26:20.189 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-08T23:26:20.352 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:20.440 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-08T23:26:20.612 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-08T23:26:20.737 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-08T23:26:20.859 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-08T23:26:20.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-08T23:26:20.888 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-08T23:26:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-08T23:26:20.988 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-08T23:26:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-08T23:26:21.234 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-08T23:26:21.404 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-08T23:26:21.505 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-08T23:26:21.635 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-08T23:26:21.663 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-08T23:26:21.753 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-08T23:26:21.781 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-08T23:26:21.885 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-08T23:26:22.050 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-08T23:26:22.245 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-08T23:26:22.359 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up zip (3.0-12build2) ... 2024-08-08T23:26:22.371 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-08T23:26:22.485 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-08T23:26:22.630 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-08T23:26:22.890 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-08T23:26:23.166 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-08-08T23:26:23.203 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-08T23:26:23.275 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-08T23:26:23.455 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-08T23:26:23.581 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-08T23:26:23.707 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-08T23:26:23.935 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-08T23:26:24.008 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-08T23:26:24.186 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-08T23:26:24.312 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-08T23:26:24.393 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-08T23:26:24.438 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-08T23:26:24.643 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-08T23:26:24.739 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-08T23:26:25.020 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-08T23:26:25.107 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-08T23:26:25.305 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-08T23:26:25.333 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-08T23:26:25.709 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-08T23:26:25.898 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-08T23:26:26.019 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-08T23:26:26.158 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-08T23:26:26.284 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:26.370 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-08T23:26:26.585 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-08T23:26:26.621 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-08T23:26:26.747 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:26.894 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-08T23:26:27.099 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-08T23:26:27.424 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-08T23:26:28.092 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-08T23:26:28.344 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:28.461 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-08T23:26:28.582 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-08T23:26:28.713 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-08T23:26:28.806 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:28.831 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-08T23:26:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-08T23:26:28.956 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-08T23:26:29.208 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-08T23:26:29.250 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-08T23:26:29.343 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-08T23:26:29.469 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-08T23:26:29.501 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-08T23:26:29.752 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:29.770 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-08T23:26:29.853 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-08T23:26:30.021 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-08T23:26:30.138 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-08T23:26:30.247 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:30.348 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-08T23:26:30.389 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-08T23:26:30.641 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-08T23:26:30.649 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-08T23:26:30.942 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-08T23:26:30.950 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-08T23:26:31.202 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-08T23:26:31.218 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-08T23:26:31.478 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-08T23:26:31.485 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-08T23:26:31.586 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-08T23:26:31.728 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-08T23:26:31.854 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-08T23:26:31.964 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-08T23:26:32.005 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-08T23:26:32.114 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-08T23:26:32.257 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-08T23:26:32.407 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-08T23:26:32.549 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-08T23:26:32.557 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-08T23:26:32.809 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-08T23:26:32.859 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-08T23:26:32.935 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-08T23:26:33.044 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-08T23:26:33.116 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-08T23:26:33.160 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-08T23:26:33.346 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-08T23:26:33.419 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-08T23:26:33.464 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-08T23:26:33.545 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-08T23:26:33.679 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-08T23:26:33.768 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-08T23:26:33.865 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-08T23:26:33.998 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-08T23:26:34.115 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-08T23:26:34.133 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-08T23:26:34.259 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-08T23:26:34.500 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-08T23:26:34.519 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:34.620 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-08T23:26:34.768 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-08T23:26:34.894 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-08T23:26:34.921 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-08T23:26:35.145 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-08T23:26:35.214 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-08T23:26:35.271 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-08T23:26:35.515 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-08T23:26:35.572 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-08T23:26:35.641 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-08T23:26:35.839 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-08T23:26:35.917 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-08T23:26:36.099 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-08T23:26:36.216 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-08T23:26:36.218 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-08T23:26:36.476 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-08T23:26:36.558 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-08T23:26:36.752 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-08T23:26:36.932 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-08T23:26:37.139 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-08T23:26:37.217 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-08T23:26:37.515 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-08T23:26:37.553 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-08T23:26:37.654 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librados2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:37.772 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libsqlite3-mod-ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:37.817 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-08T23:26:37.898 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-08T23:26:38.136 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-08T23:26:38.234 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.262 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.360 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libradosstriper1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.388 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.478 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-08T23:26:38.514 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-08T23:26:38.730 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librbd1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.850 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.857 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-modules-core (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.982 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:38.984 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.110 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-08T23:26:39.198 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-08T23:26:39.199 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-08T23:26:39.387 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.513 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.639 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.708 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcephfs-dev (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.834 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rados (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:39.849 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-08T23:26:39.849 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-08T23:26:39.952 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up librgw2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:40.070 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-08T23:26:40.365 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:40.541 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:40.642 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:41.094 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-08T23:26:41.301 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rbd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:41.427 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up rbd-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:41.553 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-rgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:41.662 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-cephfs (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:41.763 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.289 INFO:teuthology.orchestra.run.smithi083.stdout:Adding group ceph....done 2024-08-08T23:26:42.331 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.440 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.558 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.684 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.707 INFO:teuthology.orchestra.run.smithi083.stdout:Adding system user ceph....done 2024-08-08T23:26:42.810 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:42.876 INFO:teuthology.orchestra.run.smithi083.stdout:Setting system user ceph properties....done 2024-08-08T23:26:42.890 INFO:teuthology.orchestra.run.smithi083.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-08T23:26:43.027 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-08T23:26:43.345 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-08T23:26:43.352 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-08-08T23:26:43.745 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-08-08T23:26:43.840 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-test (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:43.914 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-08-08T23:26:43.932 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-08T23:26:43.974 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up radosgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:44.064 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-08T23:26:44.376 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-08T23:26:44.772 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-08T23:26:44.772 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-08T23:26:44.827 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:44.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:45.243 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-base (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:45.580 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-08T23:26:45.580 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-08T23:26:45.600 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-08T23:26:46.030 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:46.112 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mds (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:46.365 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-08T23:26:46.728 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-08T23:26:46.729 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-08T23:26:46.831 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:47.041 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-08T23:26:47.041 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-08T23:26:47.199 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:47.391 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-08T23:26:47.391 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-08T23:26:47.822 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:47.858 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-osd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:48.040 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-08T23:26:48.040 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-08T23:26:48.112 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-08T23:26:48.112 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-08T23:26:48.496 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:48.601 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-k8sevents (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:48.727 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-diskprediction-local (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:48.759 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-08T23:26:48.759 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-08T23:26:48.870 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mon (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.081 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-08T23:26:49.081 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-08T23:26:49.264 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.365 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.499 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.571 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.709 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-08T23:26:49.709 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-08T23:26:49.722 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.848 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-mgr-dashboard (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:49.983 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up ceph-volume (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:50.150 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:50.293 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:50.327 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-08T23:26:50.436 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-08T23:26:50.452 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:50.589 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-08T23:26:50.712 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.1.0-1345-g0a88632b-1jammy) ... 2024-08-08T23:26:51.056 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-08T23:26:51.165 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-08T23:26:51.317 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-08T23:26:51.665 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-08T23:26:52.395 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-08T23:26:52.568 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-08T23:26:52.571 DEBUG:teuthology.orchestra.run.smithi083:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-08-08T23:26:52.671 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:26:52.868 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-08-08T23:26:52.868 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-08-08T23:26:53.044 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:26:53.044 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:26:53.044 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:26:53.044 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:26:53.045 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:26:53.045 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:26:53.045 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:26:53.046 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-08-08T23:26:53.046 INFO:teuthology.orchestra.run.smithi083.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-08T23:26:53.046 INFO:teuthology.orchestra.run.smithi083.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-08T23:26:53.046 INFO:teuthology.orchestra.run.smithi083.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-08T23:26:53.047 INFO:teuthology.orchestra.run.smithi083.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-08-08T23:26:53.048 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-08-08T23:26:53.086 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-08-08T23:26:53.086 INFO:teuthology.orchestra.run.smithi083.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-08-08T23:26:53.087 INFO:teuthology.orchestra.run.smithi083.stdout: s3cmd 2024-08-08T23:26:53.138 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 35 newly installed, 0 to remove and 317 not upgraded. 2024-08-08T23:26:53.138 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 10.4 MB of archives. 2024-08-08T23:26:53.139 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-08-08T23:26:53.139 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-08-08T23:26:53.156 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-08-08T23:26:53.157 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-08-08T23:26:53.160 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-08-08T23:26:53.194 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-08-08T23:26:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-08T23:26:53.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-08-08T23:26:53.209 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-08-08T23:26:53.210 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-08-08T23:26:53.240 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-08-08T23:26:53.258 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-08-08T23:26:53.260 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-08-08T23:26:53.261 INFO:teuthology.orchestra.run.smithi083.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-08-08T23:26:53.262 INFO:teuthology.orchestra.run.smithi083.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-08-08T23:26:53.311 INFO:teuthology.orchestra.run.smithi083.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-08-08T23:26:53.312 INFO:teuthology.orchestra.run.smithi083.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-08-08T23:26:53.328 INFO:teuthology.orchestra.run.smithi083.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-08-08T23:26:53.329 INFO:teuthology.orchestra.run.smithi083.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-08-08T23:26:53.329 INFO:teuthology.orchestra.run.smithi083.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-08-08T23:26:53.330 INFO:teuthology.orchestra.run.smithi083.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-08-08T23:26:53.331 INFO:teuthology.orchestra.run.smithi083.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-08-08T23:26:53.333 INFO:teuthology.orchestra.run.smithi083.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-08-08T23:26:53.334 INFO:teuthology.orchestra.run.smithi083.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-08-08T23:26:53.340 INFO:teuthology.orchestra.run.smithi083.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-08-08T23:26:53.347 INFO:teuthology.orchestra.run.smithi083.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-08-08T23:26:53.348 INFO:teuthology.orchestra.run.smithi083.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-08-08T23:26:53.348 INFO:teuthology.orchestra.run.smithi083.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-08-08T23:26:53.365 INFO:teuthology.orchestra.run.smithi083.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-08-08T23:26:53.366 INFO:teuthology.orchestra.run.smithi083.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-08-08T23:26:53.366 INFO:teuthology.orchestra.run.smithi083.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-08-08T23:26:53.368 INFO:teuthology.orchestra.run.smithi083.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-08-08T23:26:53.372 INFO:teuthology.orchestra.run.smithi083.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-08-08T23:26:53.374 INFO:teuthology.orchestra.run.smithi083.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-08-08T23:26:53.388 INFO:teuthology.orchestra.run.smithi083.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-08-08T23:26:53.388 INFO:teuthology.orchestra.run.smithi083.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-08-08T23:26:53.405 INFO:teuthology.orchestra.run.smithi083.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-08-08T23:26:53.405 INFO:teuthology.orchestra.run.smithi083.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-08-08T23:26:53.405 INFO:teuthology.orchestra.run.smithi083.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-08-08T23:26:53.461 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-08-08T23:26:53.462 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-08-08T23:26:53.639 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:26:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:26:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:26:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:26:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:26:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:26:53.640 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:26:53.641 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-08-08T23:26:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-08T23:26:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-08T23:26:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-08-08T23:26:53.642 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-08-08T23:26:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-08-08T23:26:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-08-08T23:26:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-08-08T23:26:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-08-08T23:26:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-08T23:26:53.682 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-08T23:26:53.683 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-08T23:26:53.683 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-08T23:26:53.683 INFO:teuthology.orchestra.run.smithi196.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-08T23:26:53.683 INFO:teuthology.orchestra.run.smithi196.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-08-08T23:26:53.683 INFO:teuthology.orchestra.run.smithi196.stdout: s3cmd 2024-08-08T23:26:53.838 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 10.4 MB in 0s (33.3 MB/s) 2024-08-08T23:26:53.863 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 35 newly installed, 0 to remove and 317 not upgraded. 2024-08-08T23:26:53.863 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 10.4 MB of archives. 2024-08-08T23:26:53.864 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-08-08T23:26:53.864 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-08-08T23:26:53.915 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libapache-pom-java. 2024-08-08T23:26:53.946 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-08-08T23:26:53.947 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-08-08T23:26:53.963 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-08-08T23:26:53.993 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-08-08T23:26:53.999 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-08-08T23:26:54.072 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libapache-pom-java (18-1) ... 2024-08-08T23:26:54.126 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-08-08T23:26:54.197 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-08-08T23:26:54.205 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-08-08T23:26:54.325 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-08-08T23:26:54.339 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-08-08T23:26:54.354 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-08-08T23:26:54.391 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-08T23:26:54.432 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-08-08T23:26:54.433 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-08-08T23:26:54.436 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-08-08T23:26:54.581 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-08-08T23:26:54.581 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-08-08T23:26:54.625 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-08-08T23:26:54.626 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-08-08T23:26:54.627 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-08-08T23:26:54.628 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-08-08T23:26:54.629 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-08-08T23:26:54.635 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-08-08T23:26:54.636 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-08-08T23:26:54.644 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-08-08T23:26:54.672 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-08-08T23:26:54.677 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-08-08T23:26:54.679 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-08-08T23:26:54.710 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-08T23:26:54.728 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-08-08T23:26:54.730 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-08-08T23:26:54.730 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-08-08T23:26:54.732 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-08-08T23:26:54.733 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-08-08T23:26:54.737 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-08-08T23:26:54.744 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-08-08T23:26:54.758 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-08-08T23:26:54.840 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-08-08T23:26:54.840 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-08-08T23:26:54.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-08-08T23:26:54.874 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-08-08T23:26:54.874 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-08-08T23:26:54.946 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcdi-api-java. 2024-08-08T23:26:54.974 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-08-08T23:26:55.004 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-08-08T23:26:55.241 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcommons-cli-java. 2024-08-08T23:26:55.256 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-08-08T23:26:55.299 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-08-08T23:26:55.316 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 10.4 MB in 1s (8,753 kB/s) 2024-08-08T23:26:55.400 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libapache-pom-java. 2024-08-08T23:26:55.460 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-08-08T23:26:55.465 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-08-08T23:26:55.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libapache-pom-java (18-1) ... 2024-08-08T23:26:55.551 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcommons-parent-java. 2024-08-08T23:26:55.567 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-08-08T23:26:55.609 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-08-08T23:26:55.753 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-08-08T23:26:55.769 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-08-08T23:26:55.811 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-08T23:26:55.879 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcommons-io-java. 2024-08-08T23:26:55.906 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-08-08T23:26:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-08-08T23:26:56.063 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-08-08T23:26:56.079 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-08-08T23:26:56.122 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-08T23:26:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-08-08T23:26:56.214 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-08-08T23:26:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-08-08T23:26:56.357 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcdi-api-java. 2024-08-08T23:26:56.374 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-08-08T23:26:56.416 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-08-08T23:26:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-08-08T23:26:56.524 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-08-08T23:26:56.575 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-08T23:26:56.652 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-cli-java. 2024-08-08T23:26:56.668 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-08-08T23:26:56.702 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-08-08T23:26:56.828 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjsr305-java. 2024-08-08T23:26:56.855 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-08-08T23:26:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-08-08T23:26:56.954 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-parent-java. 2024-08-08T23:26:56.970 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-08-08T23:26:57.012 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-08-08T23:26:57.155 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libguava-java. 2024-08-08T23:26:57.184 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-08-08T23:26:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libguava-java (29.0-6) ... 2024-08-08T23:26:57.265 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-io-java. 2024-08-08T23:26:57.292 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-08-08T23:26:57.331 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-08-08T23:26:57.600 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-08-08T23:26:57.616 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-08-08T23:26:57.633 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libaopalliance-java. 2024-08-08T23:26:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-08-08T23:26:57.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-08-08T23:26:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-08-08T23:26:57.911 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libguice-java. 2024-08-08T23:26:57.919 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-08-08T23:26:57.923 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-08-08T23:26:57.935 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-08-08T23:26:57.960 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-08-08T23:26:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-08T23:26:58.222 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjsr305-java. 2024-08-08T23:26:58.249 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-08-08T23:26:58.288 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-08-08T23:26:58.348 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-08-08T23:26:58.370 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-08-08T23:26:58.414 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-08-08T23:26:58.541 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libguava-java. 2024-08-08T23:26:58.557 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-08-08T23:26:58.599 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libguava-java (29.0-6) ... 2024-08-08T23:26:58.675 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjansi-native-java. 2024-08-08T23:26:58.703 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-08-08T23:26:58.742 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-08-08T23:26:58.944 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libjansi-java. 2024-08-08T23:26:58.960 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-08-08T23:26:58.994 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libjansi-java (1.18-1) ... 2024-08-08T23:26:59.019 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaopalliance-java. 2024-08-08T23:26:59.035 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-08-08T23:26:59.069 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-08-08T23:26:59.213 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmaven-parent-java. 2024-08-08T23:26:59.241 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-08-08T23:26:59.279 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libguice-java. 2024-08-08T23:26:59.280 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-08-08T23:26:59.295 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-08-08T23:26:59.329 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-08-08T23:26:59.532 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-08-08T23:26:59.560 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-08-08T23:26:59.607 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-08-08T23:26:59.708 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-08-08T23:26:59.736 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-08-08T23:26:59.775 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-08-08T23:26:59.885 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-08-08T23:26:59.902 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-08-08T23:26:59.943 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-08-08T23:27:00.036 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjansi-native-java. 2024-08-08T23:27:00.052 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-08-08T23:27:00.094 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-08-08T23:27:00.196 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-08-08T23:27:00.224 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-08-08T23:27:00.262 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-08-08T23:27:00.346 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjansi-java. 2024-08-08T23:27:00.374 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-08-08T23:27:00.413 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjansi-java (1.18-1) ... 2024-08-08T23:27:00.608 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-08-08T23:27:00.624 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-08-08T23:27:00.665 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-parent-java. 2024-08-08T23:27:00.666 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-08T23:27:00.693 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-08-08T23:27:00.732 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-08-08T23:27:00.919 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-08-08T23:27:00.935 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-08-08T23:27:00.942 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-08-08T23:27:00.958 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-08-08T23:27:00.977 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-08-08T23:27:00.992 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-08-08T23:27:01.230 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-08-08T23:27:01.257 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-08-08T23:27:01.278 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-08-08T23:27:01.296 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-08-08T23:27:01.306 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-08-08T23:27:01.345 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-08-08T23:27:01.540 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-08-08T23:27:01.556 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-08-08T23:27:01.590 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-08-08T23:27:01.598 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-08-08T23:27:01.614 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-08-08T23:27:01.656 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-08-08T23:27:01.834 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-08-08T23:27:01.850 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-08-08T23:27:01.893 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-08-08T23:27:01.968 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-08-08T23:27:01.984 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-08-08T23:27:02.018 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-08T23:27:02.162 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-08-08T23:27:02.186 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-08-08T23:27:02.228 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-08T23:27:02.237 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-08-08T23:27:02.253 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-08-08T23:27:02.295 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-08-08T23:27:02.481 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libslf4j-java. 2024-08-08T23:27:02.497 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-08-08T23:27:02.539 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-08-08T23:27:02.548 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-08-08T23:27:02.564 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-08-08T23:27:02.606 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-08-08T23:27:02.810 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libsisu-inject-java. 2024-08-08T23:27:02.826 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-08-08T23:27:02.858 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-08-08T23:27:02.860 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-08-08T23:27:02.886 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-08-08T23:27:02.925 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-08-08T23:27:03.129 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-08-08T23:27:03.157 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-08-08T23:27:03.169 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-08-08T23:27:03.186 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-08-08T23:27:03.196 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-08-08T23:27:03.219 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-08-08T23:27:03.465 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libmaven3-core-java. 2024-08-08T23:27:03.468 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-08-08T23:27:03.481 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-08-08T23:27:03.485 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-08-08T23:27:03.522 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-08T23:27:03.523 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-08-08T23:27:03.782 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libslf4j-java. 2024-08-08T23:27:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-08-08T23:27:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-08-08T23:27:03.928 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libwagon-file-java. 2024-08-08T23:27:03.944 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-08-08T23:27:03.986 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-08-08T23:27:04.119 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsisu-inject-java. 2024-08-08T23:27:04.136 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-08-08T23:27:04.178 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-08-08T23:27:04.230 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-08-08T23:27:04.258 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-08-08T23:27:04.297 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-08-08T23:27:04.438 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-08-08T23:27:04.455 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-08-08T23:27:04.488 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-08-08T23:27:04.741 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package maven. 2024-08-08T23:27:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven3-core-java. 2024-08-08T23:27:04.769 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-08-08T23:27:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-08-08T23:27:04.816 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-08-08T23:27:04.816 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking maven (3.6.3-5) ... 2024-08-08T23:27:05.111 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package python3-magic. 2024-08-08T23:27:05.139 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-08-08T23:27:05.179 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-08-08T23:27:05.195 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-file-java. 2024-08-08T23:27:05.212 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-08-08T23:27:05.253 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-08-08T23:27:05.447 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package s3cmd. 2024-08-08T23:27:05.463 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-08-08T23:27:05.489 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-08-08T23:27:05.496 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-08-08T23:27:05.505 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-08-08T23:27:05.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-08-08T23:27:05.893 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-08-08T23:27:05.967 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package maven. 2024-08-08T23:27:05.983 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-08-08T23:27:06.017 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking maven (3.6.3-5) ... 2024-08-08T23:27:06.019 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-08-08T23:27:06.145 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-08-08T23:27:06.271 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-08-08T23:27:06.313 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-magic. 2024-08-08T23:27:06.339 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-08-08T23:27:06.378 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-08-08T23:27:06.397 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-08-08T23:27:06.506 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-08-08T23:27:06.615 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-08-08T23:27:06.664 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package s3cmd. 2024-08-08T23:27:06.692 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-08-08T23:27:06.730 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-08-08T23:27:06.733 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-08-08T23:27:06.859 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-08T23:27:06.985 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-08T23:27:07.146 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-08-08T23:27:07.146 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libapache-pom-java (18-1) ... 2024-08-08T23:27:07.236 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-08-08T23:27:07.238 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-08T23:27:07.362 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-08-08T23:27:07.363 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-08-08T23:27:07.489 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-08T23:27:07.504 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-08-08T23:27:07.598 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-08-08T23:27:07.622 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-08-08T23:27:07.707 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-08-08T23:27:07.723 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-08-08T23:27:07.824 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-08-08T23:27:07.941 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-08-08T23:27:07.967 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-08-08T23:27:08.085 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-08T23:27:08.093 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-08-08T23:27:08.210 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-08T23:27:08.219 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-08-08T23:27:08.336 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libapache-pom-java (18-1) ... 2024-08-08T23:27:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmaven-parent-java (31-2) ... 2024-08-08T23:27:08.437 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-08T23:27:08.471 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcommons-parent-java (43-1) ... 2024-08-08T23:27:08.538 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-08-08T23:27:08.589 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-08-08T23:27:08.664 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-08T23:27:08.690 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up s3cmd (2.2.0-1) ... 2024-08-08T23:27:08.790 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-08-08T23:27:08.916 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-08-08T23:27:08.983 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-08-08T23:27:09.109 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-08-08T23:27:09.175 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-08-08T23:27:09.235 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libguava-java (29.0-6) ... 2024-08-08T23:27:09.301 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-08-08T23:27:09.361 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-08-08T23:27:09.428 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-08-08T23:27:09.504 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-08-08T23:27:09.545 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-parent-java (31-2) ... 2024-08-08T23:27:09.629 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-08-08T23:27:09.646 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-parent-java (43-1) ... 2024-08-08T23:27:09.747 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-08-08T23:27:09.755 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-08-08T23:27:09.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up s3cmd (2.2.0-1) ... 2024-08-08T23:27:09.873 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libguice-java (4.2.3-2) ... 2024-08-08T23:27:09.991 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libjansi-java (1.18-1) ... 2024-08-08T23:27:10.100 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-08T23:27:10.183 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-08-08T23:27:10.308 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-08-08T23:27:10.360 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-08-08T23:27:10.434 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libguava-java (29.0-6) ... 2024-08-08T23:27:10.486 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up maven (3.6.3-5) ... 2024-08-08T23:27:10.561 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-08-08T23:27:10.703 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-08-08T23:27:10.743 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-08-08T23:27:10.804 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-08-08T23:27:10.815 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-08T23:27:10.914 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-08-08T23:27:11.023 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libguice-java (4.2.3-2) ... 2024-08-08T23:27:11.149 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjansi-java (1.18-1) ... 2024-08-08T23:27:11.275 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-08T23:27:11.401 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-08-08T23:27:11.526 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up maven (3.6.3-5) ... 2024-08-08T23:27:11.784 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-08-08T23:27:11.847 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-08T23:27:12.239 INFO:teuthology.orchestra.run.smithi083.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-08T23:27:12.246 DEBUG:teuthology.parallel:result is None 2024-08-08T23:27:13.403 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-08T23:27:13.409 DEBUG:teuthology.parallel:result is None 2024-08-08T23:27:13.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:27:13.559 DEBUG:teuthology.orchestra.run.smithi083:> dpkg-query -W -f '${Version}' ceph 2024-08-08T23:27:13.578 INFO:teuthology.orchestra.run.smithi083.stdout:19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:27:13.579 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:27:13.579 INFO:teuthology.task.install:The correct ceph version 19.1.0-1345-g0a88632b-1jammy is installed. 2024-08-08T23:27:13.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:27:13.717 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-08-08T23:27:13.737 INFO:teuthology.orchestra.run.smithi196.stdout:19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:27:13.737 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1345-g0a88632b-1jammy 2024-08-08T23:27:13.737 INFO:teuthology.task.install:The correct ceph version 19.1.0-1345-g0a88632b-1jammy is installed. 2024-08-08T23:27:13.739 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-08T23:27:13.740 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:13.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-08T23:27:13.754 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:13.754 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-08T23:27:13.791 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-08T23:27:13.791 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:13.791 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-08-08T23:27:13.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-08T23:27:13.860 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:13.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-08-08T23:27:13.874 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-08T23:27:13.930 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-08T23:27:13.930 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:13.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-08T23:27:13.943 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-08T23:27:13.996 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:13.996 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-08T23:27:14.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-08T23:27:14.065 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-08T23:27:14.065 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:14.065 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-08-08T23:27:14.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-08T23:27:14.133 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:14.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-08-08T23:27:14.147 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-08T23:27:14.201 INFO:teuthology.run_tasks:Running task ceph... 2024-08-08T23:27:14.282 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-08T23:27:14.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2024-08-08T23:27:14.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-08-08T23:27:14.298 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-08T23:27:14.298 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-08T23:27:14.339 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-08T23:27:14.353 INFO:tasks.ceph:Creating extra log directories... 2024-08-08T23:27:14.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-08T23:27:14.399 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-08T23:27:14.421 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-08T23:27:14.421 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-08T23:27:14.421 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499', 'branch': 'wip-yuri7-testing-2024-08-08-0804-squid', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7844499', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2024-08-08-0804-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-squid', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2024-08-08-0804-squid', 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 998, 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rgw', 'suite_branch': 'wip-yuri7-testing-2024-08-08-0804-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499', 'targets': {'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzQpybGMENjjzglsfE/Lfhuk9QkJV3wsepfQQmQi9b09M1e+BWBYMtXBiJ6frK766Rk7pJX7Dud2Y98B7gqEr4=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDinDENQyF67dIa3FV4nUB1u7fgo43JTTiDs/uaFDL5tGN9ScM/zOsoxlZmQeR/6p1U85A5utE98+8Eknika4i8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '0a88632b45f25ae38493667c7dbd155f6e59b499'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-squid', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-squid', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '43b88056bcf6a0548bdd2d0502e56290cbae52df', 'timestamp': '2024-08-08_23:01:55', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-08T23:27:14.422 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-08T23:27:14.455 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-08T23:27:14.460 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2024-08-08T23:27:14.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-08-08T23:27:14.516 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:14.516 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-08-08T23:27:14.563 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-08T23:27:14.564 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-08-08T23:27:14.610 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-08T23:27:14.610 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-08-08 23:21:30.096701975 +0000 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-08-08 23:21:30.092702012 +0000 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-08-08 23:21:30.092702012 +0000 2024-08-08T23:27:14.611 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-08-08T23:27:14.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-08T23:27:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-08-08T23:27:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-08-08T23:27:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000442634 s, 1.2 MB/s 2024-08-08T23:27:14.665 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-08T23:27:14.715 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-08-08T23:27:14.762 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-08T23:27:14.762 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:14.762 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-08-08T23:27:14.762 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:14.762 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-08-08 23:21:30.780695866 +0000 2024-08-08T23:27:14.763 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-08-08 23:21:30.560697831 +0000 2024-08-08T23:27:14.763 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-08-08 23:21:30.560697831 +0000 2024-08-08T23:27:14.763 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-08-08T23:27:14.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-08T23:27:14.816 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-08-08T23:27:14.816 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-08-08T23:27:14.816 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000382712 s, 1.3 MB/s 2024-08-08T23:27:14.817 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-08T23:27:14.868 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-08-08 23:21:31.212692007 +0000 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-08-08 23:21:30.984694044 +0000 2024-08-08T23:27:14.914 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-08-08 23:21:30.984694044 +0000 2024-08-08T23:27:14.915 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-08-08T23:27:14.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-08T23:27:14.967 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-08-08T23:27:14.967 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-08-08T23:27:14.967 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000369694 s, 1.4 MB/s 2024-08-08T23:27:14.968 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-08T23:27:15.015 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-08-08 23:21:31.680687827 +0000 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-08-08 23:21:31.444689935 +0000 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-08-08 23:21:31.448689899 +0000 2024-08-08T23:27:15.062 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-08-08T23:27:15.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-08T23:27:15.117 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-08-08T23:27:15.117 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-08-08T23:27:15.117 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000309559 s, 1.7 MB/s 2024-08-08T23:27:15.118 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-08T23:27:15.167 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:15.167 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:15.167 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-08-08T23:27:15.173 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-08T23:27:15.173 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-08-08 23:21:31.782802441 +0000 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-08-08 23:21:31.514804835 +0000 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-08-08 23:21:31.514804835 +0000 2024-08-08T23:27:15.224 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-08-08T23:27:15.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-08T23:27:15.277 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-08-08T23:27:15.277 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-08-08T23:27:15.277 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00044594 s, 1.1 MB/s 2024-08-08T23:27:15.279 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-08T23:27:15.328 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-08-08 23:21:32.278798010 +0000 2024-08-08T23:27:15.374 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-08-08 23:21:32.022800298 +0000 2024-08-08T23:27:15.375 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-08-08 23:21:32.022800298 +0000 2024-08-08T23:27:15.375 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-08-08T23:27:15.375 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-08T23:27:15.428 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-08-08T23:27:15.428 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-08-08T23:27:15.428 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000415103 s, 1.2 MB/s 2024-08-08T23:27:15.430 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-08T23:27:15.480 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-08-08T23:27:15.526 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-08T23:27:15.526 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-08-08 23:21:32.758793723 +0000 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-08-08 23:21:32.518795867 +0000 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-08-08 23:21:32.518795867 +0000 2024-08-08T23:27:15.527 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-08-08T23:27:15.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-08T23:27:15.580 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-08-08T23:27:15.581 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-08-08T23:27:15.581 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000449244 s, 1.1 MB/s 2024-08-08T23:27:15.582 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-08T23:27:15.632 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-08-08 23:21:33.042791187 +0000 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-08-08 23:21:33.038791222 +0000 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-08-08 23:21:33.038791222 +0000 2024-08-08T23:27:15.678 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-08-08T23:27:15.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-08T23:27:15.732 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-08-08T23:27:15.732 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-08-08T23:27:15.732 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000388604 s, 1.3 MB/s 2024-08-08T23:27:15.734 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-08T23:27:15.783 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:15.783 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-08T23:27:15.783 INFO:tasks.ceph:Generating config... 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] debug rgw = 20 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-08-08T23:27:15.785 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-08-08T23:27:15.786 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-08-08T23:27:15.786 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-08-08T23:27:15.786 INFO:tasks.ceph:[client] setgroup = ceph 2024-08-08T23:27:15.786 INFO:tasks.ceph:[client] setuser = ceph 2024-08-08T23:27:15.786 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-08-08T23:27:15.786 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-08-08T23:27:15.786 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-08-08T23:27:15.787 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-08-08T23:27:15.787 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-08-08T23:27:15.787 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-08T23:27:15.787 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-08-08T23:27:15.787 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-08T23:27:15.788 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-08T23:27:15.789 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-08-08T23:27:15.789 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-08T23:27:15.789 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-08-08T23:27:15.789 INFO:tasks.ceph:Setting up mon.a... 2024-08-08T23:27:15.789 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-08T23:27:15.824 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.keyring 2024-08-08T23:27:15.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-08T23:27:15.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-08T23:27:15.973 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]'), ('mon.b', '172.21.15.196')] 2024-08-08T23:27:15.973 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.196', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-08-08T23:27:15.974 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:15.974 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-08T23:27:16.022 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --add b 172.21.15.196 --print /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:16.108 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:27:16.108 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: generated fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 0 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:min_mon_release 17 (quincy) 2024-08-08T23:27:16.109 INFO:teuthology.orchestra.run.smithi083.stdout:election_strategy: 1 2024-08-08T23:27:16.110 INFO:teuthology.orchestra.run.smithi083.stdout:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:27:16.110 INFO:teuthology.orchestra.run.smithi083.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:27:16.110 INFO:teuthology.orchestra.run.smithi083.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:27:16.110 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-08T23:27:16.111 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-08T23:27:16.158 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a06244b8-ff5b-4931-b711-c5bff452d3eb... 2024-08-08T23:27:16.159 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-08T23:27:16.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2024-08-08T23:27:16.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2024-08-08T23:27:16.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.234 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.196" 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: mon client directed command retry = 5 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: ms inject socket failures = 5000 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: osd heartbeat grace = 40 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: osd_max_pg_log_entries = 10 2024-08-08T23:27:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: osd_min_pg_log_entries = 10 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: rgw override bucket index max shards = 1 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.236 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug trim objects = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.237 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2024-08-08T23:27:16.238 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: osd fast shutdown = False 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: osd shutdown pgref assert = True 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-08-08T23:27:16.239 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2024-08-08T23:27:16.240 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-08T23:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd crush smoke test = False 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = True 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-08T23:27:16.242 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: debug rgw = 20 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw bucket counters cache = True 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt require ssl = False 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt s3 kms backend = testing 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 datacache size = 10737418240 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 local datacache enabled = True 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw s3 auth use sts = True 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw sts key = abcdefghijklmnop 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw torrent flag = True 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: rgw user counters cache = True 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: setgroup = ceph 2024-08-08T23:27:16.243 INFO:teuthology.orchestra.run.smithi083.stdout: setuser = ceph 2024-08-08T23:27:16.244 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2024-08-08T23:27:16.244 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2024-08-08T23:27:16.244 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2024-08-08T23:27:16.245 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-08-08T23:27:16.245 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-08-08T23:27:16.245 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-08-08T23:27:16.246 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-08-08T23:27:16.247 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-08-08T23:27:16.248 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.196" 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: mon client directed command retry = 5 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: ms inject socket failures = 5000 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: osd heartbeat grace = 40 2024-08-08T23:27:16.249 INFO:teuthology.orchestra.run.smithi196.stdout: osd_max_pg_log_entries = 10 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd_min_pg_log_entries = 10 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: rgw override bucket index max shards = 1 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.250 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.251 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-08-08T23:27:16.252 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: osd fast shutdown = False 2024-08-08T23:27:16.253 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: osd shutdown pgref assert = True 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.254 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-08-08T23:27:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd crush smoke test = False 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-08-08T23:27:16.256 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = True 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: debug rgw = 20 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw bucket counters cache = True 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt require ssl = False 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt s3 kms backend = testing 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw d3n l1 datacache size = 10737418240 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw d3n l1 local datacache enabled = True 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw s3 auth use sts = True 2024-08-08T23:27:16.257 INFO:teuthology.orchestra.run.smithi196.stdout: rgw sts key = abcdefghijklmnop 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout: rgw torrent flag = True 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout: rgw user counters cache = True 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout: setgroup = ceph 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout: setuser = ceph 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-08-08T23:27:16.258 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-08-08T23:27:16.258 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-08T23:27:16.258 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-08T23:27:16.340 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-08T23:27:16.340 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:16.340 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-08T23:27:16.345 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:16.345 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-08T23:27:16.394 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:27:16.394 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:16.394 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-08T23:27:16.394 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-08T23:27:16.458 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:16.458 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:16.506 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:27:16.506 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:16.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-08T23:27:16.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-08T23:27:16.530 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:16.530 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:16.578 INFO:tasks.ceph:Setting up mon nodes... 2024-08-08T23:27:16.578 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-08T23:27:16.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-08T23:27:16.623 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-08T23:27:16.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-08T23:27:16.671 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-08T23:27:16.679 INFO:tasks.ceph:Setting up mds nodes... 2024-08-08T23:27:16.679 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-08T23:27:16.679 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-08T23:27:16.713 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-08T23:27:16.724 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-08T23:27:16.757 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-08T23:27:16.767 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-08T23:27:16.767 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-08T23:27:16.767 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-08T23:27:16.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:16.781 INFO:tasks.ceph:role: osd.0 2024-08-08T23:27:16.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:27:16.781 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:16.847 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:17.333 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-08-08T23:27:17.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-08-08T23:27:17.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-08T23:27:17.500 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-08T23:27:17.511 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:17.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:17.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-08T23:27:17.565 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:17.565 INFO:tasks.ceph:role: osd.1 2024-08-08T23:27:17.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:27:17.566 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:17.630 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:18.073 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-08-08T23:27:18.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-08-08T23:27:18.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-08T23:27:18.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-08T23:27:18.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:18.214 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:18.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-08T23:27:18.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:18.267 INFO:tasks.ceph:role: osd.2 2024-08-08T23:27:18.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:27:18.268 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:18.329 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:18.330 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:18.330 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:18.330 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:18.786 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-08-08T23:27:18.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-08-08T23:27:18.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-08T23:27:18.906 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-08T23:27:18.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:18.918 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:18.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-08T23:27:18.973 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:18.973 INFO:tasks.ceph:role: osd.3 2024-08-08T23:27:18.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:27:18.974 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-08T23:27:19.037 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:19.038 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:19.532 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-08-08T23:27:19.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-08-08T23:27:19.534 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-08T23:27:19.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-08T23:27:19.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:19.710 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:19.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:19.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.823+0000 7fe2aa1d37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-08T23:27:19.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.827+0000 7fe2aa1d37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-08T23:27:19.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.827+0000 7fe2aa1d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-08T23:27:19.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.827+0000 7fe2aa1d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-08T23:27:19.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.827+0000 7fe2aa1d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-08T23:27:19.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:19.827+0000 7fe2aa1d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-08T23:27:22.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-08T23:27:22.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:22.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-08T23:27:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-08T23:27:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-08T23:27:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-08T23:27:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-08T23:27:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:22.899+0000 7f61449da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-08T23:27:25.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-08T23:27:25.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.011+0000 7f10f8b637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-08T23:27:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.011+0000 7f10f8b637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-08T23:27:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.011+0000 7f10f8b637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-08T23:27:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.011+0000 7f10f8b637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-08T23:27:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.011+0000 7f10f8b637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-08T23:27:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:26.015+0000 7f10f8b637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-08T23:27:29.016 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-08T23:27:29.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:29.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.151+0000 7fe2c86ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-08T23:27:29.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.151+0000 7fe2c86ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-08T23:27:29.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.151+0000 7fe2c86ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-08T23:27:29.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.151+0000 7fe2c86ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-08T23:27:29.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.151+0000 7fe2c86ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-08T23:27:29.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:29.155+0000 7fe2c86ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-08T23:27:32.140 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-08T23:27:32.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-08T23:27:32.208 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:32.208 INFO:tasks.ceph:role: osd.4 2024-08-08T23:27:32.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:27:32.208 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-08T23:27:32.269 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:32.270 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:32.751 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-08-08T23:27:32.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-08-08T23:27:32.753 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-08T23:27:32.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-08T23:27:32.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:32.917 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:32.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-08T23:27:32.973 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:32.974 INFO:tasks.ceph:role: osd.5 2024-08-08T23:27:32.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:27:32.974 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-08T23:27:33.037 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:33.037 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:33.037 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:33.037 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:33.038 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:33.038 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:33.038 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:33.038 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:33.038 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:33.039 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:33.476 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-08-08T23:27:33.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-08-08T23:27:33.479 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-08T23:27:33.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-08T23:27:33.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:33.614 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:33.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-08T23:27:33.671 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:33.671 INFO:tasks.ceph:role: osd.6 2024-08-08T23:27:33.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:27:33.671 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:33.733 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:34.187 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-08-08T23:27:34.189 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-08-08T23:27:34.189 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-08T23:27:34.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-08T23:27:34.318 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:34.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:34.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-08T23:27:34.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-08T23:27:34.374 INFO:tasks.ceph:role: osd.7 2024-08-08T23:27:34.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:27:34.374 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-08-08T23:27:34.437 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-08T23:27:34.438 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-08T23:27:34.438 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-08T23:27:34.438 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-08T23:27:34.933 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-08-08T23:27:34.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-08-08T23:27:34.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-08T23:27:35.083 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-08T23:27:35.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:27:35.095 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-08-08T23:27:35.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:35.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.206+0000 7fe5d8aa97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-08T23:27:35.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.214+0000 7fe5d8aa97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-08T23:27:35.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.214+0000 7fe5d8aa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-08T23:27:35.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.214+0000 7fe5d8aa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-08T23:27:35.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.214+0000 7fe5d8aa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-08T23:27:35.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:35.214+0000 7fe5d8aa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-08T23:27:38.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-08T23:27:38.204 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:38.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.286+0000 7f444f6177c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-08T23:27:38.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.290+0000 7f444f6177c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-08T23:27:38.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.290+0000 7f444f6177c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-08T23:27:38.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.290+0000 7f444f6177c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-08T23:27:38.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.290+0000 7f444f6177c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-08T23:27:38.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:38.290+0000 7f444f6177c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-08T23:27:41.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-08T23:27:41.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:41.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-08T23:27:41.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-08T23:27:41.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-08T23:27:41.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-08T23:27:41.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-08T23:27:41.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:41.394+0000 7fd59fb047c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-08T23:27:44.373 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-08T23:27:44.431 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:44.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-08T23:27:44.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-08T23:27:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-08T23:27:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-08T23:27:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-08T23:27:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-08-08T23:27:44.510+0000 7fdfd75797c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-08T23:27:47.479 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-08T23:27:47.535 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-08T23:27:47.535 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-08T23:27:47.550 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-08T23:27:47.604 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-08T23:27:47.660 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-08T23:27:47.712 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.712 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-08T23:27:47.764 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:47.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-08T23:27:47.778 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:47.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-08T23:27:47.833 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:47.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-08T23:27:47.888 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:47.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-08T23:27:47.941 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:47.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-08T23:27:47.996 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:47.996 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-08T23:27:48.002 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:48.002 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-08T23:27:48.042 INFO:tasks.ceph:Adding keys to all mons... 2024-08-08T23:27:48.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-08T23:27:48.046 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-08T23:27:48.087 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBUVLVmHDJEJRAAMo8jdRSVvmE1pyXzcd+z6w== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBXVLVm37ZgMRAAToQTv91+Kqw7NJPO4wjPxQ== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBaVLVmskvUNRAAn0S6UVO1WT8Lk3EMMSeZWg== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBeVLVmp8kSARAAasUfPnHaedkg89Q03xvaFA== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBhVLVmmK1rCRAAqTRu4HaHGDYZlJMTZsaHMQ== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBUVLVmPdg2KBAAIOyvs4bSpmADam5ymddCpA== 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2024-08-08T23:27:48.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBnVLVmK6GuDBAANSpu6biq3NxgePMhXFpx/A== 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBqVLVmQ6B3ERAAKFWCBdzFss/j1oRtufhEbg== 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBtVLVmpJfPFxAAE/O1y8F0NRtzyko0RB3XgA== 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBwVLVmpxC2HhAAQ3OakdEx07sD1ImqZ0LrMw== 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBUVLVmcDSdKhAAM+XE6o10eWS9vxWWdrYksQ== 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2024-08-08T23:27:48.089 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBUVLVm2vVZLRAAxfEulEfP92t6Vm957zCXcA== 2024-08-08T23:27:48.095 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-08-08T23:27:48.095 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBUVLVmHDJEJRAAMo8jdRSVvmE1pyXzcd+z6w== 2024-08-08T23:27:48.095 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBXVLVm37ZgMRAAToQTv91+Kqw7NJPO4wjPxQ== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBaVLVmskvUNRAAn0S6UVO1WT8Lk3EMMSeZWg== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBeVLVmp8kSARAAasUfPnHaedkg89Q03xvaFA== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBhVLVmmK1rCRAAqTRu4HaHGDYZlJMTZsaHMQ== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBUVLVmPdg2KBAAIOyvs4bSpmADam5ymddCpA== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBnVLVmK6GuDBAANSpu6biq3NxgePMhXFpx/A== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBqVLVmQ6B3ERAAKFWCBdzFss/j1oRtufhEbg== 2024-08-08T23:27:48.096 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBtVLVmpJfPFxAAE/O1y8F0NRtzyko0RB3XgA== 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBwVLVmpxC2HhAAQ3OakdEx07sD1ImqZ0LrMw== 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBUVLVmcDSdKhAAM+XE6o10eWS9vxWWdrYksQ== 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2024-08-08T23:27:48.097 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBUVLVm2vVZLRAAxfEulEfP92t6Vm957zCXcA== 2024-08-08T23:27:48.098 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-08T23:27:48.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-08T23:27:48.188 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.189 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.274 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.354 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.397 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.438 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.484 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-08T23:27:48.521 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-08T23:27:48.571 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.614 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.661 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.787 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.874 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-08T23:27:48.920 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-08T23:27:48.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-08T23:27:49.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-08T23:27:49.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-08T23:27:49.092 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-08T23:27:49.092 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-08T23:27:49.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-08T23:27:49.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-08T23:27:49.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-08T23:27:49.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-08T23:27:49.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-08T23:27:49.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-08T23:27:49.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-08T23:27:49.544 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-08T23:27:49.554 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:49.556 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-08T23:27:49.601 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-08T23:27:49.602 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-08T23:27:49.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-08T23:27:49.605 INFO:tasks.ceph.mon.a:Started 2024-08-08T23:27:49.605 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-08T23:27:49.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-08T23:27:49.608 INFO:tasks.ceph.mon.c:Started 2024-08-08T23:27:49.608 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-08T23:27:49.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-08T23:27:49.647 INFO:tasks.ceph.mon.b:Started 2024-08-08T23:27:49.647 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-08T23:27:49.648 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-08T23:27:49.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-08T23:27:49.650 INFO:tasks.ceph.mgr.y:Started 2024-08-08T23:27:49.650 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-08T23:27:49.650 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-08T23:27:49.652 INFO:tasks.ceph.mgr.x:Started 2024-08-08T23:27:49.652 INFO:tasks.ceph:Setting crush tunables to default 2024-08-08T23:27:49.653 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd crush tunables default 2024-08-08T23:27:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:27:55.219+0000 7f003b7fe640 0 --2- 172.21.15.83:0/1540514938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024004810 0x7f0024004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-08T23:27:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-08-08T23:27:55.319 INFO:tasks.ceph:check_enable_crimson: False 2024-08-08T23:27:55.319 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-08T23:27:55.319 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:55.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-08T23:27:55.330 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:55.330 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-08T23:27:55.383 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:55.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-08T23:27:55.436 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:27:55.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-08T23:27:55.488 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:55.488 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-08T23:27:55.503 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:55.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-08T23:27:55.557 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:55.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-08T23:27:55.618 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-08-08T23:27:55.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-08T23:27:55.673 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 0e80d66f-48bc-41ec-9dbc-c24fc565982b 0 2024-08-08T23:27:55.936 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-08-08T23:27:55.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 7e4e1892-def2-4e57-8fc0-76c3c6467e3c 1 2024-08-08T23:27:55.987 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:55.985+0000 7f177ad20180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-08T23:27:56.003 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:55.999+0000 7f805e3da180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-08T23:27:56.157 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-08-08T23:27:56.173 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new d044d93e-576b-424f-995a-9a9d617505ee 2 2024-08-08T23:27:56.417 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-08-08T23:27:56.433 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 08787eed-34fe-4fe1-9f07-8ceb470278db 3 2024-08-08T23:27:56.485 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:56.485+0000 7f177ad20180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-08T23:27:56.511 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:56.507+0000 7f805e3da180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-08T23:27:56.636 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-08-08T23:27:56.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new bb7255bd-a742-4490-9dcd-09430444a014 4 2024-08-08T23:27:56.677 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:56.673+0000 7f177ad20180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-08T23:27:56.702 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:56.699+0000 7f805e3da180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-08T23:27:56.851 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-08-08T23:27:56.867 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 3c639281-b389-4488-a4c7-aac85062e839 5 2024-08-08T23:27:57.112 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-08-08T23:27:57.128 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 3bb04a5c-1ddd-40fd-b204-3955f0180a69 6 2024-08-08T23:27:57.253 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.251+0000 7f805e3da180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-08T23:27:57.254 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.253+0000 7f177ad20180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-08T23:27:57.307 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.303+0000 7f805e3da180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-08T23:27:57.309 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.305+0000 7f177ad20180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-08T23:27:57.326 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-08-08T23:27:57.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new fd4fc01a-92c4-48af-b6e4-b1e925461bea 7 2024-08-08T23:27:57.361 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.359+0000 7f805e3da180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-08T23:27:57.365 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.361+0000 7f177ad20180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-08T23:27:57.437 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.435+0000 7f805e3da180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-08T23:27:57.444 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.441+0000 7f177ad20180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-08T23:27:57.489 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.487+0000 7f805e3da180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-08T23:27:57.499 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.497+0000 7f177ad20180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-08T23:27:57.541 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-08-08T23:27:57.557 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-08T23:27:57.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-08T23:27:57.560 INFO:tasks.ceph.osd.0:Started 2024-08-08T23:27:57.560 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-08T23:27:57.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-08T23:27:57.562 INFO:tasks.ceph.osd.1:Started 2024-08-08T23:27:57.563 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-08T23:27:57.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-08T23:27:57.565 INFO:tasks.ceph.osd.2:Started 2024-08-08T23:27:57.565 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-08T23:27:57.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-08T23:27:57.567 INFO:tasks.ceph.osd.3:Started 2024-08-08T23:27:57.568 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-08T23:27:57.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-08T23:27:57.568 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.563+0000 7f805e3da180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-08T23:27:57.580 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.577+0000 7f177ad20180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-08T23:27:57.581 INFO:tasks.ceph.osd.4:Started 2024-08-08T23:27:57.581 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-08T23:27:57.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-08T23:27:57.583 INFO:tasks.ceph.osd.5:Started 2024-08-08T23:27:57.583 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-08T23:27:57.583 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-08T23:27:57.585 INFO:tasks.ceph.osd.6:Started 2024-08-08T23:27:57.585 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-08T23:27:57.585 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-08T23:27:57.587 INFO:tasks.ceph.osd.7:Started 2024-08-08T23:27:57.588 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-08T23:27:57.633 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.631+0000 7f805e3da180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-08T23:27:57.645 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.645+0000 7f177ad20180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-08T23:27:57.793 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.791+0000 7f805e3da180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-08T23:27:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:27:57.795 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":10,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:27:57.539489+0000","last_up_change":"0.000000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:27:57.803 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.801+0000 7f177ad20180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-08T23:27:57.811 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-08T23:27:57.811 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-08T23:27:57.856 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:57.855+0000 7f805e3da180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-08T23:27:57.863 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:57.861+0000 7f177ad20180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-08T23:27:58.218 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-08-08T23:27:58.215+0000 7f2b9d9837c0 -1 Falling back to public interface 2024-08-08T23:27:58.218 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-08-08T23:27:58.215+0000 7f7a2f1597c0 -1 Falling back to public interface 2024-08-08T23:27:58.218 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-08-08T23:27:58.215+0000 7f7a2e119640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-08-08T23:27:58.225 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-08-08T23:27:58.223+0000 7f2cc44e27c0 -1 Falling back to public interface 2024-08-08T23:27:58.226 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-08-08T23:27:58.225+0000 7f70a40e57c0 -1 Falling back to public interface 2024-08-08T23:27:58.227 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:27:58.225+0000 7f084a30b7c0 -1 Falling back to public interface 2024-08-08T23:27:58.227 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:27:58.225+0000 7f08492cb640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-08-08T23:27:58.227 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:27:58.225+0000 7f08492cb640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2024-08-08T23:27:58.227 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-08-08T23:27:58.225+0000 7f70a30a5640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6807/0: (98) Address already in use 2024-08-08T23:27:58.233 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-08-08T23:27:58.231+0000 7fe5b95bd7c0 -1 Falling back to public interface 2024-08-08T23:27:58.238 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-08-08T23:27:58.237+0000 7f92d9efb7c0 -1 Falling back to public interface 2024-08-08T23:27:58.238 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-08-08T23:27:58.237+0000 7f4a891757c0 -1 Falling back to public interface 2024-08-08T23:27:58.471 INFO:tasks.ceph.mgr.x.smithi196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-08T23:27:58.471 INFO:tasks.ceph.mgr.x.smithi196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-08T23:27:58.471 INFO:tasks.ceph.mgr.x.smithi196.stderr: from numpy import show_config as show_numpy_config 2024-08-08T23:27:58.540 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:58.537+0000 7f177ad20180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-08T23:27:58.565 INFO:tasks.ceph.mgr.y.smithi083.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-08T23:27:58.566 INFO:tasks.ceph.mgr.y.smithi083.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-08T23:27:58.566 INFO:tasks.ceph.mgr.y.smithi083.stderr: from numpy import show_config as show_numpy_config 2024-08-08T23:27:58.608 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:58.603+0000 7f805e3da180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-08T23:27:58.618 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-08T23:27:58.724 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:58.721+0000 7f177ad20180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-08T23:27:58.765 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:58.763+0000 7f805e3da180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-08T23:27:58.801 INFO:teuthology.misc.health.smithi083.stdout: 2024-08-08T23:27:58.801 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":10,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:27:57.539489+0000","last_up_change":"0.000000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:27:58.817 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-08T23:27:58.888 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:58.885+0000 7f177ad20180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-08T23:27:58.924 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:58.919+0000 7f805e3da180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-08T23:27:58.958 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:58.957+0000 7f177ad20180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-08T23:27:58.994 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:58.991+0000 7f805e3da180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-08T23:27:59.105 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:59.101+0000 7f177ad20180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-08T23:27:59.142 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:59.139+0000 7f805e3da180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-08T23:27:59.715 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:59.713+0000 7f177ad20180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-08T23:27:59.737 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:59.735+0000 7f805e3da180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-08T23:27:59.790 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:59.789+0000 7f177ad20180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-08T23:27:59.812 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:59.807+0000 7f805e3da180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-08T23:27:59.973 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:27:59.969+0000 7f177ad20180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-08T23:27:59.994 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:27:59.991+0000 7f805e3da180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-08T23:28:00.048 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:28:00.045+0000 7f177ad20180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-08T23:28:00.068 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:28:00.063+0000 7f805e3da180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-08T23:28:00.340 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:28:00.337+0000 7f177ad20180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-08T23:28:00.357 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:28:00.355+0000 7f805e3da180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-08T23:28:00.401 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:28:00.401+0000 7f177ad20180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-08T23:28:00.419 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-08-08T23:28:00.415+0000 7f805e3da180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-08T23:28:01.447 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:28:01.445+0000 7f1721858640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-08T23:28:01.450 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-08-08T23:28:01.449+0000 7f1721858640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-08T23:28:01.836 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-08-08T23:28:01.833+0000 7f70a40e57c0 -1 osd.4 0 log_to_monitors true 2024-08-08T23:28:01.912 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:28:01.909+0000 7f084a30b7c0 -1 osd.5 0 log_to_monitors true 2024-08-08T23:28:02.023 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-08-08T23:28:02.021+0000 7f4a891757c0 -1 osd.7 0 log_to_monitors true 2024-08-08T23:28:02.023 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-08-08T23:28:02.019+0000 7fe5b95bd7c0 -1 osd.0 0 log_to_monitors true 2024-08-08T23:28:02.029 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-08-08T23:28:02.029+0000 7f92d9efb7c0 -1 osd.6 0 log_to_monitors true 2024-08-08T23:28:02.029 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-08-08T23:28:02.027+0000 7f7a2f1597c0 -1 osd.3 0 log_to_monitors true 2024-08-08T23:28:02.079 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-08-08T23:28:02.075+0000 7f2cc44e27c0 -1 osd.1 0 log_to_monitors true 2024-08-08T23:28:02.131 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-08-08T23:28:02.127+0000 7f2b9d9837c0 -1 osd.2 0 log_to_monitors true 2024-08-08T23:28:05.579 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-08-08T23:28:05.575+0000 7f2b9a93f640 -1 osd.2 0 waiting for initial osdmap 2024-08-08T23:28:05.581 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-08-08T23:28:05.579+0000 7f2cbfc68640 -1 osd.1 0 waiting for initial osdmap 2024-08-08T23:28:05.601 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-08-08T23:28:05.599+0000 7f2b91750640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.604 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-08-08T23:28:05.603+0000 7fe5b4d43640 -1 osd.0 0 waiting for initial osdmap 2024-08-08T23:28:05.609 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-08-08T23:28:05.607+0000 7f2cb82af640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.624 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-08T23:28:05.637 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-08-08T23:28:05.635+0000 7fe5ad38a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.644 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:28:05.641+0000 7f0845a91640 -1 osd.5 0 waiting for initial osdmap 2024-08-08T23:28:05.647 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-08-08T23:28:05.645+0000 7f92d5681640 -1 osd.6 0 waiting for initial osdmap 2024-08-08T23:28:05.665 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-08-08T23:28:05.665+0000 7f4a86131640 -1 osd.7 0 waiting for initial osdmap 2024-08-08T23:28:05.669 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-08-08T23:28:05.669+0000 7f083e0d8640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.676 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-08-08T23:28:05.675+0000 7f7a2a8df640 -1 osd.3 0 waiting for initial osdmap 2024-08-08T23:28:05.692 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-08-08T23:28:05.689+0000 7f709f86b640 -1 osd.4 0 waiting for initial osdmap 2024-08-08T23:28:05.697 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-08-08T23:28:05.697+0000 7f92cdcc8640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.705 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-08-08T23:28:05.705+0000 7f4a7cf42640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.717 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-08-08T23:28:05.715+0000 7f7a22f26640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.718 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-08-08T23:28:05.717+0000 7f7097eb2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-08T23:28:05.912 INFO:teuthology.misc.health.smithi083.stdout: 2024-08-08T23:28:05.912 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":12,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:28:03.496130+0000","last_up_change":"0.000000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:28:05.929 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-08T23:28:12.737 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-08T23:28:13.038 INFO:teuthology.misc.health.smithi083.stdout: 2024-08-08T23:28:13.038 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":17,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:28:10.737758+0000","last_up_change":"2024-08-08T23:28:06.608801+0000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-08T23:28:08.475367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6825","nonce":3132935563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6827","nonce":3132935563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6831","nonce":3132935563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6829","nonce":3132935563}]},"public_addr":"172.21.15.83:6825/3132935563","cluster_addr":"172.21.15.83:6827/3132935563","heartbeat_back_addr":"172.21.15.83:6831/3132935563","heartbeat_front_addr":"172.21.15.83:6829/3132935563","state":["exists","up"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6817","nonce":3379310080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6819","nonce":3379310080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6823","nonce":3379310080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6821","nonce":3379310080}]},"public_addr":"172.21.15.83:6817/3379310080","cluster_addr":"172.21.15.83:6819/3379310080","heartbeat_back_addr":"172.21.15.83:6823/3379310080","heartbeat_front_addr":"172.21.15.83:6821/3379310080","state":["exists","up"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6801","nonce":3944119729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6803","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6805","nonce":3944119729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6811","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6813","nonce":3944119729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6807","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6809","nonce":3944119729}]},"public_addr":"172.21.15.83:6801/3944119729","cluster_addr":"172.21.15.83:6805/3944119729","heartbeat_back_addr":"172.21.15.83:6813/3944119729","heartbeat_front_addr":"172.21.15.83:6809/3944119729","state":["exists","up"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6804","nonce":3747846461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6808","nonce":3747846461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6815","nonce":3747846461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6812","nonce":3747846461}]},"public_addr":"172.21.15.83:6804/3747846461","cluster_addr":"172.21.15.83:6808/3747846461","heartbeat_back_addr":"172.21.15.83:6815/3747846461","heartbeat_front_addr":"172.21.15.83:6812/3747846461","state":["exists","up"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6803","nonce":4290006386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6808","nonce":4290006386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6815","nonce":4290006386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6812","nonce":4290006386}]},"public_addr":"172.21.15.196:6803/4290006386","cluster_addr":"172.21.15.196:6808/4290006386","heartbeat_back_addr":"172.21.15.196:6815/4290006386","heartbeat_front_addr":"172.21.15.196:6812/4290006386","state":["exists","up"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6802","nonce":988086196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6805","nonce":988086196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6813","nonce":988086196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6809","nonce":988086196}]},"public_addr":"172.21.15.196:6802/988086196","cluster_addr":"172.21.15.196:6805/988086196","heartbeat_back_addr":"172.21.15.196:6813/988086196","heartbeat_front_addr":"172.21.15.196:6809/988086196","state":["exists","up"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6818","nonce":2486835189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6821","nonce":2486835189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6828","nonce":2486835189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6825","nonce":2486835189}]},"public_addr":"172.21.15.196:6818/2486835189","cluster_addr":"172.21.15.196:6821/2486835189","heartbeat_back_addr":"172.21.15.196:6828/2486835189","heartbeat_front_addr":"172.21.15.196:6825/2486835189","state":["exists","up"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6819","nonce":921234627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6824","nonce":921234627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6831","nonce":921234627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6829","nonce":921234627}]},"public_addr":"172.21.15.196:6819/921234627","cluster_addr":"172.21.15.196:6824/921234627","heartbeat_back_addr":"172.21.15.196:6831/921234627","heartbeat_front_addr":"172.21.15.196:6829/921234627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.073646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.120684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.103877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.997039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.874510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.966339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.032834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.998505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:28:13.056 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-08T23:28:13.056 INFO:tasks.ceph:Creating RBD pool 2024-08-08T23:28:13.056 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd pool create rbd 8 2024-08-08T23:28:13.762 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'rbd' created 2024-08-08T23:28:13.789 DEBUG:teuthology.orchestra.run.smithi083:> rbd --cluster ceph pool init rbd 2024-08-08T23:28:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:16.824 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-08T23:28:16.825 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-08T23:28:16.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-08T23:28:16.825 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-08T23:28:16.826 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-08T23:28:17.228 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:17.246 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3816591878},{"type":"v1","addr":"172.21.15.196:6833","nonce":3816591878}]},"active_addr":"172.21.15.196:6833/3816591878","active_change":"2024-08-08T23:28:00.426151+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1998475628}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2069500799}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3737948128}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1915158177}]}]} 2024-08-08T23:28:17.250 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-08T23:28:17.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-08T23:28:17.251 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-08T23:28:17.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:17.552 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:28:16.782345+0000","last_up_change":"2024-08-08T23:28:06.608801+0000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-08T23:28:08.475367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-08T23:28:13.356950+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6825","nonce":3132935563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6827","nonce":3132935563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6831","nonce":3132935563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6829","nonce":3132935563}]},"public_addr":"172.21.15.83:6825/3132935563","cluster_addr":"172.21.15.83:6827/3132935563","heartbeat_back_addr":"172.21.15.83:6831/3132935563","heartbeat_front_addr":"172.21.15.83:6829/3132935563","state":["exists","up"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6817","nonce":3379310080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6819","nonce":3379310080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6823","nonce":3379310080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6821","nonce":3379310080}]},"public_addr":"172.21.15.83:6817/3379310080","cluster_addr":"172.21.15.83:6819/3379310080","heartbeat_back_addr":"172.21.15.83:6823/3379310080","heartbeat_front_addr":"172.21.15.83:6821/3379310080","state":["exists","up"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6801","nonce":3944119729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6803","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6805","nonce":3944119729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6811","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6813","nonce":3944119729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6807","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6809","nonce":3944119729}]},"public_addr":"172.21.15.83:6801/3944119729","cluster_addr":"172.21.15.83:6805/3944119729","heartbeat_back_addr":"172.21.15.83:6813/3944119729","heartbeat_front_addr":"172.21.15.83:6809/3944119729","state":["exists","up"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6804","nonce":3747846461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6808","nonce":3747846461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6815","nonce":3747846461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6812","nonce":3747846461}]},"public_addr":"172.21.15.83:6804/3747846461","cluster_addr":"172.21.15.83:6808/3747846461","heartbeat_back_addr":"172.21.15.83:6815/3747846461","heartbeat_front_addr":"172.21.15.83:6812/3747846461","state":["exists","up"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6803","nonce":4290006386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6808","nonce":4290006386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6815","nonce":4290006386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6812","nonce":4290006386}]},"public_addr":"172.21.15.196:6803/4290006386","cluster_addr":"172.21.15.196:6808/4290006386","heartbeat_back_addr":"172.21.15.196:6815/4290006386","heartbeat_front_addr":"172.21.15.196:6812/4290006386","state":["exists","up"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6802","nonce":988086196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6805","nonce":988086196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6813","nonce":988086196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6809","nonce":988086196}]},"public_addr":"172.21.15.196:6802/988086196","cluster_addr":"172.21.15.196:6805/988086196","heartbeat_back_addr":"172.21.15.196:6813/988086196","heartbeat_front_addr":"172.21.15.196:6809/988086196","state":["exists","up"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6818","nonce":2486835189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6821","nonce":2486835189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6828","nonce":2486835189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6825","nonce":2486835189}]},"public_addr":"172.21.15.196:6818/2486835189","cluster_addr":"172.21.15.196:6821/2486835189","heartbeat_back_addr":"172.21.15.196:6828/2486835189","heartbeat_front_addr":"172.21.15.196:6825/2486835189","state":["exists","up"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6819","nonce":921234627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6824","nonce":921234627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6831","nonce":921234627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6829","nonce":921234627}]},"public_addr":"172.21.15.196:6819/921234627","cluster_addr":"172.21.15.196:6824/921234627","heartbeat_back_addr":"172.21.15.196:6831/921234627","heartbeat_front_addr":"172.21.15.196:6829/921234627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.073646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.120684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.103877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.997039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.874510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.966339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.032834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.998505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:28:17.571 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-08T23:28:17.571 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-08T23:28:17.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:17.871 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-08T23:28:16.782345+0000","last_up_change":"2024-08-08T23:28:06.608801+0000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-08T23:28:08.475367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-08T23:28:13.356950+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6825","nonce":3132935563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6827","nonce":3132935563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6831","nonce":3132935563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6829","nonce":3132935563}]},"public_addr":"172.21.15.83:6825/3132935563","cluster_addr":"172.21.15.83:6827/3132935563","heartbeat_back_addr":"172.21.15.83:6831/3132935563","heartbeat_front_addr":"172.21.15.83:6829/3132935563","state":["exists","up"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6817","nonce":3379310080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6819","nonce":3379310080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6823","nonce":3379310080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6821","nonce":3379310080}]},"public_addr":"172.21.15.83:6817/3379310080","cluster_addr":"172.21.15.83:6819/3379310080","heartbeat_back_addr":"172.21.15.83:6823/3379310080","heartbeat_front_addr":"172.21.15.83:6821/3379310080","state":["exists","up"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6801","nonce":3944119729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6803","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6805","nonce":3944119729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6811","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6813","nonce":3944119729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6807","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6809","nonce":3944119729}]},"public_addr":"172.21.15.83:6801/3944119729","cluster_addr":"172.21.15.83:6805/3944119729","heartbeat_back_addr":"172.21.15.83:6813/3944119729","heartbeat_front_addr":"172.21.15.83:6809/3944119729","state":["exists","up"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6804","nonce":3747846461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6808","nonce":3747846461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6815","nonce":3747846461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6812","nonce":3747846461}]},"public_addr":"172.21.15.83:6804/3747846461","cluster_addr":"172.21.15.83:6808/3747846461","heartbeat_back_addr":"172.21.15.83:6815/3747846461","heartbeat_front_addr":"172.21.15.83:6812/3747846461","state":["exists","up"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6803","nonce":4290006386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6808","nonce":4290006386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6815","nonce":4290006386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6812","nonce":4290006386}]},"public_addr":"172.21.15.196:6803/4290006386","cluster_addr":"172.21.15.196:6808/4290006386","heartbeat_back_addr":"172.21.15.196:6815/4290006386","heartbeat_front_addr":"172.21.15.196:6812/4290006386","state":["exists","up"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6802","nonce":988086196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6805","nonce":988086196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6813","nonce":988086196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6809","nonce":988086196}]},"public_addr":"172.21.15.196:6802/988086196","cluster_addr":"172.21.15.196:6805/988086196","heartbeat_back_addr":"172.21.15.196:6813/988086196","heartbeat_front_addr":"172.21.15.196:6809/988086196","state":["exists","up"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6818","nonce":2486835189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6821","nonce":2486835189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6828","nonce":2486835189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6825","nonce":2486835189}]},"public_addr":"172.21.15.196:6818/2486835189","cluster_addr":"172.21.15.196:6821/2486835189","heartbeat_back_addr":"172.21.15.196:6828/2486835189","heartbeat_front_addr":"172.21.15.196:6825/2486835189","state":["exists","up"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6819","nonce":921234627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6824","nonce":921234627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6831","nonce":921234627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6829","nonce":921234627}]},"public_addr":"172.21.15.196:6819/921234627","cluster_addr":"172.21.15.196:6824/921234627","heartbeat_back_addr":"172.21.15.196:6831/921234627","heartbeat_front_addr":"172.21.15.196:6829/921234627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.073646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.120684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.103877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.997039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.874510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.966339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.032834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.998505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-08T23:28:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-08T23:28:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-08T23:28:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-08T23:28:17.890 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-08T23:28:17.890 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-08T23:28:17.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-08T23:28:17.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-08T23:28:17.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-08T23:28:18.130 INFO:teuthology.orchestra.run.smithi083.stdout:55834574852 2024-08-08T23:28:18.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-08T23:28:18.145 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-08-08T23:28:18.146 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-08T23:28:18.153 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.153 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-08T23:28:18.158 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-08-08T23:28:18.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-08T23:28:18.164 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.165 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-08T23:28:18.167 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.167 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-08T23:28:18.168 INFO:teuthology.orchestra.run.smithi083.stdout:55834574852 2024-08-08T23:28:18.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-08T23:28:18.173 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-08T23:28:18.644 INFO:teuthology.orchestra.run.smithi083.stdout:55834574850 2024-08-08T23:28:18.657 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.657 INFO:teuthology.orchestra.run.smithi083.stdout:55834574851 2024-08-08T23:28:18.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.4 2024-08-08T23:28:18.682 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:18.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2024-08-08T23:28:18.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2024-08-08T23:28:18.694 INFO:teuthology.orchestra.run.smithi083.stdout:55834574851 2024-08-08T23:28:18.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-08-08T23:28:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:55834574851 2024-08-08T23:28:18.717 INFO:teuthology.orchestra.run.smithi083.stdout:55834574851 2024-08-08T23:28:18.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-08-08T23:28:18.730 INFO:teuthology.orchestra.run.smithi083.stdout:55834574850 2024-08-08T23:28:18.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2024-08-08T23:28:18.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2024-08-08T23:28:18.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.2 2024-08-08T23:28:19.678 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-08T23:28:19.685 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-08T23:28:19.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-08T23:28:19.708 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-08T23:28:19.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-08T23:28:19.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-08T23:28:19.738 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-08T23:28:19.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-08T23:28:20.181 INFO:teuthology.orchestra.run.smithi083.stdout:55834574852 2024-08-08T23:28:20.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-08-08T23:28:20.211 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.230 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-08-08T23:28:20.233 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:20.243 INFO:teuthology.orchestra.run.smithi083.stdout:55834574855 2024-08-08T23:28:20.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-08-08T23:28:20.256 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-08T23:28:20.264 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-08-08T23:28:20.265 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.278 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:20.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-08-08T23:28:20.297 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.302 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:20.303 INFO:teuthology.orchestra.run.smithi083.stdout:55834574853 2024-08-08T23:28:20.305 INFO:teuthology.orchestra.run.smithi083.stdout:55834574852 2024-08-08T23:28:20.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-08-08T23:28:20.323 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-08T23:28:20.333 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-08-08T23:28:20.334 DEBUG:teuthology.parallel:result is None 2024-08-08T23:28:20.334 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-08T23:28:20.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-08T23:28:20.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:20.650 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-08T23:28:20.667 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-08T23:28:20.442998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219048,"kb_used_data":2852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2920448,"data_stored":1763478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.667383"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.170232+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-08T23:28:17.170232+0000","last_peered":"2024-08-08T23:28:17.170232+0000","last_clean":"2024-08-08T23:28:17.170232+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-08T23:28:17.170232+0000","last_undegraded":"2024-08-08T23:28:17.170232+0000","last_fullsized":"2024-08-08T23:28:17.170232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804804+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-08T23:28:16.804804+0000","last_peered":"2024-08-08T23:28:16.804804+0000","last_clean":"2024-08-08T23:28:16.804804+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-08T23:28:16.804804+0000","last_undegraded":"2024-08-08T23:28:16.804804+0000","last_fullsized":"2024-08-08T23:28:16.804804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.334366+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-08T23:28:17.334366+0000","last_peered":"2024-08-08T23:28:17.334366+0000","last_clean":"2024-08-08T23:28:17.334366+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-08T23:28:17.334366+0000","last_undegraded":"2024-08-08T23:28:17.334366+0000","last_fullsized":"2024-08-08T23:28:17.334366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804605+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-08T23:28:16.804605+0000","last_peered":"2024-08-08T23:28:16.804605+0000","last_clean":"2024-08-08T23:28:16.804605+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-08T23:28:16.804605+0000","last_undegraded":"2024-08-08T23:28:16.804605+0000","last_fullsized":"2024-08-08T23:28:16.804605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804792+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-08T23:28:16.804792+0000","last_peered":"2024-08-08T23:28:16.804792+0000","last_clean":"2024-08-08T23:28:16.804792+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-08T23:28:16.804792+0000","last_undegraded":"2024-08-08T23:28:16.804792+0000","last_fullsized":"2024-08-08T23:28:16.804792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.887363+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-08T23:28:16.887363+0000","last_peered":"2024-08-08T23:28:16.887363+0000","last_clean":"2024-08-08T23:28:16.887363+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-08T23:28:16.887363+0000","last_undegraded":"2024-08-08T23:28:16.887363+0000","last_fullsized":"2024-08-08T23:28:16.887363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.334495+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-08T23:28:17.334495+0000","last_peered":"2024-08-08T23:28:17.334495+0000","last_clean":"2024-08-08T23:28:17.334495+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-08T23:28:17.334495+0000","last_undegraded":"2024-08-08T23:28:17.334495+0000","last_fullsized":"2024-08-08T23:28:17.334495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.802147+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-08T23:28:16.802147+0000","last_peered":"2024-08-08T23:28:16.802147+0000","last_clean":"2024-08-08T23:28:16.802147+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-08T23:28:16.802147+0000","last_undegraded":"2024-08-08T23:28:16.802147+0000","last_fullsized":"2024-08-08T23:28:16.802147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.333515+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-08T23:28:17.333515+0000","last_peered":"2024-08-08T23:28:17.333515+0000","last_clean":"2024-08-08T23:28:17.333515+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-08T23:28:17.333515+0000","last_undegraded":"2024-08-08T23:28:17.333515+0000","last_fullsized":"2024-08-08T23:28:17.333515+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-08T23:28:20.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-08T23:28:20.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:20.943 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-08T23:28:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-08T23:28:20.442998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219048,"kb_used_data":2852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2920448,"data_stored":1763478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.667383"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.170232+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-08T23:28:17.170232+0000","last_peered":"2024-08-08T23:28:17.170232+0000","last_clean":"2024-08-08T23:28:17.170232+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-08T23:28:17.170232+0000","last_undegraded":"2024-08-08T23:28:17.170232+0000","last_fullsized":"2024-08-08T23:28:17.170232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804804+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-08T23:28:16.804804+0000","last_peered":"2024-08-08T23:28:16.804804+0000","last_clean":"2024-08-08T23:28:16.804804+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-08T23:28:16.804804+0000","last_undegraded":"2024-08-08T23:28:16.804804+0000","last_fullsized":"2024-08-08T23:28:16.804804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.334366+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-08T23:28:17.334366+0000","last_peered":"2024-08-08T23:28:17.334366+0000","last_clean":"2024-08-08T23:28:17.334366+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-08T23:28:17.334366+0000","last_undegraded":"2024-08-08T23:28:17.334366+0000","last_fullsized":"2024-08-08T23:28:17.334366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804605+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-08T23:28:16.804605+0000","last_peered":"2024-08-08T23:28:16.804605+0000","last_clean":"2024-08-08T23:28:16.804605+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-08T23:28:16.804605+0000","last_undegraded":"2024-08-08T23:28:16.804605+0000","last_fullsized":"2024-08-08T23:28:16.804605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.804792+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-08T23:28:16.804792+0000","last_peered":"2024-08-08T23:28:16.804792+0000","last_clean":"2024-08-08T23:28:16.804792+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-08T23:28:16.804792+0000","last_undegraded":"2024-08-08T23:28:16.804792+0000","last_fullsized":"2024-08-08T23:28:16.804792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.887363+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-08T23:28:16.887363+0000","last_peered":"2024-08-08T23:28:16.887363+0000","last_clean":"2024-08-08T23:28:16.887363+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-08T23:28:16.887363+0000","last_undegraded":"2024-08-08T23:28:16.887363+0000","last_fullsized":"2024-08-08T23:28:16.887363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.334495+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-08T23:28:17.334495+0000","last_peered":"2024-08-08T23:28:17.334495+0000","last_clean":"2024-08-08T23:28:17.334495+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-08T23:28:17.334495+0000","last_undegraded":"2024-08-08T23:28:17.334495+0000","last_fullsized":"2024-08-08T23:28:17.334495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:16.802147+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-08T23:28:16.802147+0000","last_peered":"2024-08-08T23:28:16.802147+0000","last_clean":"2024-08-08T23:28:16.802147+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-08T23:28:16.802147+0000","last_undegraded":"2024-08-08T23:28:16.802147+0000","last_fullsized":"2024-08-08T23:28:16.802147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-08T23:28:17.333515+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-08T23:28:17.333515+0000","last_peered":"2024-08-08T23:28:17.333515+0000","last_clean":"2024-08-08T23:28:17.333515+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-08T23:28:17.333515+0000","last_undegraded":"2024-08-08T23:28:17.333515+0000","last_fullsized":"2024-08-08T23:28:17.333515+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-08T23:28:20.960 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-08T23:28:20.960 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-08T23:28:20.960 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-08T23:28:20.961 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-08T23:28:21.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:28:21.262 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-08T23:28:21.279 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-08T23:28:21.280 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-08-08T23:28:21.292 INFO:teuthology.run_tasks:Running task rgw... 2024-08-08T23:28:21.329 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-08-08T23:28:21.329 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-08-08T23:28:21.329 INFO:tasks.rgw:Creating data pools 2024-08-08T23:28:21.329 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-08-08T23:28:21.329 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-08-08T23:28:21.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-08-08T23:28:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'default.rgw.buckets.data' created 2024-08-08T23:28:23.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-08-08T23:28:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-08-08T23:28:24.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-08-08T23:28:25.738 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'default.rgw.buckets.index' created 2024-08-08T23:28:25.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-08-08T23:28:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-08-08T23:28:26.773 DEBUG:tasks.rgw:Pools created 2024-08-08T23:28:26.773 INFO:tasks.rgw:Configuring compression type = random 2024-08-08T23:28:26.773 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-08-08T23:28:26.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-08-08T23:28:26.773 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-08-08T23:28:26.836 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:26.836 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:28.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:28.830+0000 7f503c1e0640 0 -- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5649c9455ee0 msgr2=0x5649c945dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-08-08T23:28:28.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:28.838+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:28.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:28.838+0000 7f503c9e1640 0 -- 172.21.15.83:0/293699867 >> [v2:172.21.15.83:6816/3379310080,v1:172.21.15.83:6817/3379310080] conn(0x5649c946dba0 msgr2=0x5649c946fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:28:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 realm 2024-08-08T23:28:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:28:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:29.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.042+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.046+0000 7f503eecd980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:28:29.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.046+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.050+0000 7f503eecd980 20 rados_obj.operate() r=0 bl.length=993 2024-08-08T23:28:29.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.050+0000 7f503eecd980 20 searching for the correct realm 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:28:29.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:29.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:28:29.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados_obj.operate() r=0 bl.length=436 2024-08-08T23:28:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 zone default found 2024-08-08T23:28:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 4 Realm: () 2024-08-08T23:28:29.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 zonegroup default 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:29.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:29.082+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:30.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:30.786+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:30.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:30.786+0000 7f503eecd980 20 rados->read ofs=0 len=0 2024-08-08T23:28:30.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:30.794+0000 7f503eecd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:30.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:30.794+0000 7f503eecd980 20 started sync module instance, tier type = 2024-08-08T23:28:30.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:30.794+0000 7f503eecd980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:28:32.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=0 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=1 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=2 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=3 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=4 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=5 2024-08-08T23:28:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=6 2024-08-08T23:28:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 add_watcher() i=7 2024-08-08T23:28:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 2 all 8 watchers are set, enabling cache 2024-08-08T23:28:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-08-08T23:28:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-08-08T23:28:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-08-08T23:28:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-08-08T23:28:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.850+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-08-08T23:28:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-08-08T23:28:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-08-08T23:28:32.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-08-08T23:28:32.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.854+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-08-08T23:28:32.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-08-08T23:28:32.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-08-08T23:28:32.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-08-08T23:28:32.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.858+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-08-08T23:28:32.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.862+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-08-08T23:28:32.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-08-08T23:28:32.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-08-08T23:28:32.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-08-08T23:28:32.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.866+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-08-08T23:28:32.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-08-08T23:28:32.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-08-08T23:28:32.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-08-08T23:28:32.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-08-08T23:28:32.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-08-08T23:28:32.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-08-08T23:28:32.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-08-08T23:28:32.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-08-08T23:28:32.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.870+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-08-08T23:28:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-08-08T23:28:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-08-08T23:28:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-08-08T23:28:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-08-08T23:28:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-08-08T23:28:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-08-08T23:28:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.874+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-08-08T23:28:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-08-08T23:28:32.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-08-08T23:28:32.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-08-08T23:28:32.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-08-08T23:28:32.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-08-08T23:28:32.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.878+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-08-08T23:28:32.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-08-08T23:28:32.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-08-08T23:28:32.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-08-08T23:28:32.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-08-08T23:28:32.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-08-08T23:28:32.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-08-08T23:28:32.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-08-08T23:28:32.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.882+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-08-08T23:28:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-08-08T23:28:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-08-08T23:28:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-08-08T23:28:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-08-08T23:28:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-08-08T23:28:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-08-08T23:28:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-08-08T23:28:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-08-08T23:28:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.886+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-08-08T23:28:32.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-08-08T23:28:32.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-08-08T23:28:32.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-08-08T23:28:32.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-08-08T23:28:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-08-08T23:28:32.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-08-08T23:28:32.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.890+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-08-08T23:28:32.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-08-08T23:28:32.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-08-08T23:28:32.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-08-08T23:28:32.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-08-08T23:28:32.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-08-08T23:28:32.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-08-08T23:28:32.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-08-08T23:28:32.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.894+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-08-08T23:28:32.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-08-08T23:28:32.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-08-08T23:28:32.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-08-08T23:28:32.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-08-08T23:28:32.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-08-08T23:28:32.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-08-08T23:28:32.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-08-08T23:28:32.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-08-08T23:28:32.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.898+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-08-08T23:28:32.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-08-08T23:28:32.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-08-08T23:28:32.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-08-08T23:28:32.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-08-08T23:28:32.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-08-08T23:28:32.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-08-08T23:28:32.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.902+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-08-08T23:28:32.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-08-08T23:28:32.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-08-08T23:28:32.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-08-08T23:28:32.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-08-08T23:28:32.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-08-08T23:28:32.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-08-08T23:28:32.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.906+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-08-08T23:28:32.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-08-08T23:28:32.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-08-08T23:28:32.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-08-08T23:28:32.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-08-08T23:28:32.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-08-08T23:28:32.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-08-08T23:28:32.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-08-08T23:28:32.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.910+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-08-08T23:28:32.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-08-08T23:28:32.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-08-08T23:28:32.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-08-08T23:28:32.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-08-08T23:28:32.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-08-08T23:28:32.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.914+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-08-08T23:28:32.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-08-08T23:28:32.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-08-08T23:28:32.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-08-08T23:28:32.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-08-08T23:28:32.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-08-08T23:28:32.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-08-08T23:28:32.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.918+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-08-08T23:28:32.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-08-08T23:28:32.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-08-08T23:28:32.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.922+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-08-08T23:28:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-08-08T23:28:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-08-08T23:28:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-08-08T23:28:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-08-08T23:28:32.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-08-08T23:28:32.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-08-08T23:28:32.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-08-08T23:28:32.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-08-08T23:28:32.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-08-08T23:28:32.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-08-08T23:28:32.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-08-08T23:28:32.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.926+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.930+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-08-08T23:28:32.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.930+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-08-08T23:28:32.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.930+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.930+0000 7f503eecd980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-08-08T23:28:32.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.930+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-08-08T23:28:32.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.934+0000 7f503eecd980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-08T23:28:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.942+0000 7f4eef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:28:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.942+0000 7f503eecd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:32.942+0000 7f503eecd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:35.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.810+0000 7f503eecd980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-08-08T23:28:35.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.810+0000 7f503eecd980 5 note: GC not initialized 2024-08-08T23:28:35.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.822+0000 7f4eee7e4640 20 reqs_thread_entry: start 2024-08-08T23:28:35.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.822+0000 7f503eecd980 20 init_complete bucket index max shards: 1 2024-08-08T23:28:35.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.822+0000 7f503eecd980 20 Filter name: none 2024-08-08T23:28:35.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.822+0000 7f4ee7fff640 20 reqs_thread_entry: start 2024-08-08T23:28:35.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.882+0000 7f4eef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:28:35.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.886+0000 7f503eecd980 20 remove_watcher() i=0 2024-08-08T23:28:35.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.886+0000 7f503eecd980 2 removed watcher, disabling cache 2024-08-08T23:28:35.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.890+0000 7f503eecd980 20 remove_watcher() i=1 2024-08-08T23:28:35.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.890+0000 7f503eecd980 20 remove_watcher() i=2 2024-08-08T23:28:35.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.894+0000 7f503eecd980 20 remove_watcher() i=3 2024-08-08T23:28:35.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.898+0000 7f503eecd980 20 remove_watcher() i=4 2024-08-08T23:28:35.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.898+0000 7f503eecd980 20 remove_watcher() i=5 2024-08-08T23:28:35.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.902+0000 7f503eecd980 20 remove_watcher() i=6 2024-08-08T23:28:35.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.902+0000 7f503eecd980 20 remove_watcher() i=7 2024-08-08T23:28:35.922 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-08-08T23:28:35.923 DEBUG:tasks.util.rgw: json result: [] 2024-08-08T23:28:35.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-08-08T23:28:35.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-08-08T23:28:35.923 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-08-08T23:28:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:35.965 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.994+0000 7f7df44ea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:35.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.994+0000 7f7df44ea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:35.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:35.998+0000 7f7c27fff640 20 reqs_thread_entry: start 2024-08-08T23:28:36.018 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"24080a39-07c5-4cbe-824a-f1c4e0c023f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-08-08T23:28:36.018 DEBUG:tasks.util.rgw: json result: {'id': '24080a39-07c5-4cbe-824a-f1c4e0c023f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-08-08T23:28:36.018 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-08-08T23:28:36.019 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p /tmp/rgw_datacache 2024-08-08T23:28:36.065 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a+rwx /tmp/rgw_datacache 2024-08-08T23:28:36.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-08-08T23:28:36.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-08-08T23:28:36.119 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-08-08T23:28:36.191 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:36.192 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:36.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.234+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 realm 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:28:36.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 rados_obj.operate() r=0 bl.length=1009 2024-08-08T23:28:36.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.238+0000 7f9d0fd3a980 20 searching for the correct realm 2024-08-08T23:28:36.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.242+0000 7f9d0e04f640 0 -- 172.21.15.83:0/1990251012 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f9d0403d050 msgr2=0x7f9d04004970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:28:36.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.458+0000 7f9d0d04d640 0 -- 172.21.15.83:0/1990251012 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f9d080df430 msgr2=0x7f9d080df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:28:36.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:28:36.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:28:36.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:28:36.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:28:36.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:28:36.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:28:36.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.673+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:28:36.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados_obj.operate() r=0 bl.length=436 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 zone default found 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 4 Realm: () 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 zonegroup default 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados->read ofs=0 len=0 2024-08-08T23:28:36.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:28:36.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 started sync module instance, tier type = 2024-08-08T23:28:36.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.677+0000 7f9d0fd3a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=0 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=1 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=2 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=3 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=4 2024-08-08T23:28:36.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=5 2024-08-08T23:28:36.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=6 2024-08-08T23:28:36.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 20 add_watcher() i=7 2024-08-08T23:28:36.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.705+0000 7f9d0fd3a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:28:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9bbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:28:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9d0fd3a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9d0fd3a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9d0fd3a980 5 note: GC not initialized 2024-08-08T23:28:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9bbe7fc640 20 reqs_thread_entry: start 2024-08-08T23:28:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9d0fd3a980 20 init_complete bucket index max shards: 1 2024-08-08T23:28:36.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9d0fd3a980 20 Filter name: none 2024-08-08T23:28:36.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.713+0000 7f9b2ffff640 20 reqs_thread_entry: start 2024-08-08T23:28:36.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.733+0000 7f9bbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:28:36.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.737+0000 7f9d0fd3a980 20 remove_watcher() i=0 2024-08-08T23:28:36.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.737+0000 7f9d0fd3a980 2 removed watcher, disabling cache 2024-08-08T23:28:36.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.741+0000 7f9d0fd3a980 20 remove_watcher() i=1 2024-08-08T23:28:36.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.741+0000 7f9d0fd3a980 20 remove_watcher() i=2 2024-08-08T23:28:36.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.745+0000 7f9d0fd3a980 20 remove_watcher() i=3 2024-08-08T23:28:36.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.745+0000 7f9d0fd3a980 20 remove_watcher() i=4 2024-08-08T23:28:36.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.749+0000 7f9d0fd3a980 20 remove_watcher() i=5 2024-08-08T23:28:36.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.749+0000 7f9d0fd3a980 20 remove_watcher() i=6 2024-08-08T23:28:36.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.753+0000 7f9d0fd3a980 20 remove_watcher() i=7 2024-08-08T23:28:36.768 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-08-08T23:28:36.768 DEBUG:tasks.util.rgw: json result: [] 2024-08-08T23:28:36.770 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-08-08T23:28:36.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-08-08T23:28:36.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-08-08T23:28:36.770 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-08-08T23:28:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:36.849 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:36.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.877+0000 7f37ac7fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:36.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.877+0000 7f37ac7fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:36.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:36.881+0000 7f366cfe1640 20 reqs_thread_entry: start 2024-08-08T23:28:36.902 INFO:teuthology.orchestra.run.smithi083.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-08-08T23:28:36.902 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-08-08T23:28:36.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-08-08T23:28:36.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-08-08T23:28:36.903 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-08-08T23:28:36.982 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:36.982 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:37.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.009+0000 7fc8cb99c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:37.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.009+0000 7fc8cb99c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:37.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.013+0000 7fc7077fe640 20 reqs_thread_entry: start 2024-08-08T23:28:37.035 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"24080a39-07c5-4cbe-824a-f1c4e0c023f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-08-08T23:28:37.035 DEBUG:tasks.util.rgw: json result: {'id': '24080a39-07c5-4cbe-824a-f1c4e0c023f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-08-08T23:28:37.035 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-08-08T23:28:37.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-08-08T23:28:37.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-08-08T23:28:37.036 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-08-08T23:28:37.117 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:37.117 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:37.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.145+0000 7f4bf932e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:37.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.145+0000 7f4bf932e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:37.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.149+0000 7f4ab4ff9640 20 reqs_thread_entry: start 2024-08-08T23:28:37.168 INFO:teuthology.orchestra.run.smithi083.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-08-08T23:28:37.169 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-08-08T23:28:37.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-08-08T23:28:37.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-08-08T23:28:37.169 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-08-08T23:28:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:28:37.254 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:28:37.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.281+0000 7fdad5dad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:28:37.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.281+0000 7fdad5dad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:28:37.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:28:37.285+0000 7fd919ffb640 20 reqs_thread_entry: start 2024-08-08T23:28:37.303 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"24080a39-07c5-4cbe-824a-f1c4e0c023f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-08-08T23:28:37.304 DEBUG:tasks.util.rgw: json result: {'id': '24080a39-07c5-4cbe-824a-f1c4e0c023f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-08-08T23:28:37.304 INFO:tasks.rgw:Starting rgw... 2024-08-08T23:28:37.304 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-08-08T23:28:37.304 INFO:tasks.rgw:Using beast as radosgw frontend 2024-08-08T23:28:37.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo echo -n http://smithi083.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-08-08T23:28:37.356 INFO:teuthology.orchestra.run.smithi083.stdout:http://smithi083.front.sepia.ceph.com:80 2024-08-08T23:28:37.356 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-08-08T23:28:37.407 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-08-08T23:28:37.407 INFO:tasks.rgw.client.0:Restarting daemon 2024-08-08T23:28:37.407 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-08-08T23:28:37.450 INFO:tasks.rgw.client.0:Started 2024-08-08T23:28:37.450 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:37.450 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:37.479 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-08T23:28:37.480 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:28:37.480 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:28:37.480 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-08T23:28:37.480 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-08T23:28:38.481 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:38.492 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:28:38.493 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:28:38.493 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-08T23:28:38.493 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-08T23:28:38.493 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-08T23:28:40.494 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:40.506 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:28:40.506 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:28:40.506 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-08T23:28:40.506 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-08T23:28:40.507 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-08T23:28:44.508 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:44.521 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:28:44.521 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:28:44.521 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-08T23:28:44.521 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-08T23:28:44.522 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-08T23:28:52.523 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:28:52.533 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:28:52.533 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:28:52.535 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-08T23:28:52.535 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-08T23:28:52.536 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-08T23:29:00.944 INFO:tasks.rgw.client.0.smithi083.stdout:2024-08-08T23:29:00.840+0000 8eb7e80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:29:08.537 DEBUG:teuthology.orchestra.run.smithi083:> curl http://smithi083.front.sepia.ceph.com:80/ 2024-08-08T23:29:08.549 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-08T23:29:08.549 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-08-08T23:29:09.020 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 396 0 --:--:-- --:--:-- --:--:-- 397 2024-08-08T23:29:09.022 INFO:teuthology.orchestra.run.smithi083.stdout:anonymous 2024-08-08T23:29:09.023 INFO:teuthology.run_tasks:Running task tox... 2024-08-08T23:29:09.034 INFO:tasks.tox:Deploying tox from pip... 2024-08-08T23:29:09.035 DEBUG:teuthology.orchestra.run.smithi083:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-08-08T23:29:11.933 DEBUG:teuthology.orchestra.run.smithi083:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-08-08T23:29:12.622 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting tox==3.15.0 2024-08-08T23:29:12.734 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-08-08T23:29:12.798 INFO:teuthology.orchestra.run.smithi083.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-08-08T23:29:12.904 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting toml>=0.9.4 2024-08-08T23:29:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-08-08T23:29:13.070 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting filelock<4,>=3.0.0 2024-08-08T23:29:13.085 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading filelock-3.15.4-py3-none-any.whl (16 kB) 2024-08-08T23:29:13.202 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting py<2,>=1.4.17 2024-08-08T23:29:13.217 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-08-08T23:29:13.275 INFO:teuthology.orchestra.run.smithi083.stdout: ---------------------------------------- 98.7/98.7 KB 1.7 MB/s eta 0:00:00 2024-08-08T23:29:13.369 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting pluggy<1,>=0.12.0 2024-08-08T23:29:13.386 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-08-08T23:29:13.666 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-08-08T23:29:13.681 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading virtualenv-20.26.3-py3-none-any.whl (5.7 MB) 2024-08-08T23:29:14.189 INFO:teuthology.orchestra.run.smithi083.stdout: ---------------------------------------- 5.7/5.7 MB 11.3 MB/s eta 0:00:00 2024-08-08T23:29:14.305 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting six<2,>=1.14.0 2024-08-08T23:29:14.321 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-08T23:29:14.446 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting packaging>=14 2024-08-08T23:29:14.462 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-08-08T23:29:14.495 INFO:teuthology.orchestra.run.smithi083.stdout: ---------------------------------------- 54.0/54.0 KB 1.5 MB/s eta 0:00:00 2024-08-08T23:29:14.633 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting distlib<1,>=0.3.7 2024-08-08T23:29:14.649 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-08-08T23:29:14.705 INFO:teuthology.orchestra.run.smithi083.stdout: --------------------------------------- 468.9/468.9 KB 8.8 MB/s eta 0:00:00 2024-08-08T23:29:14.815 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting platformdirs<5,>=3.9.1 2024-08-08T23:29:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading platformdirs-4.2.2-py3-none-any.whl (18 kB) 2024-08-08T23:29:15.011 INFO:teuthology.orchestra.run.smithi083.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-08-08T23:29:16.022 INFO:teuthology.orchestra.run.smithi083.stdout:Successfully installed distlib-0.3.8 filelock-3.15.4 packaging-24.1 platformdirs-4.2.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.3 2024-08-08T23:29:16.101 INFO:teuthology.run_tasks:Running task workunit... 2024-08-08T23:29:16.184 INFO:tasks.workunit:Pulling workunits from ref 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:29:16.185 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-08T23:29:16.185 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:29:16.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:29:16.198 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-08T23:29:16.198 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:29:16.248 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-08T23:29:16.248 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-08T23:29:16.297 INFO:tasks.workunit:timeout=3h 2024-08-08T23:29:16.297 INFO:tasks.workunit:cleanup=True 2024-08-08T23:29:16.298 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:29:16.349 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-08T23:30:01.556 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '0a88632b45f25ae38493667c7dbd155f6e59b499'. 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.557 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:30:01.558 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 0a88632b45f Merge branch 'wip-67364-squid' of https://github.com/yuvalif/ceph into wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:30:01.563 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-08T23:30:01.611 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-08T23:30:01.614 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:30:01.615 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-08T23:30:02.396 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-08T23:30:02.478 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-08T23:30:02.539 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:30:02.540 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:30:02.540 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-08T23:30:02.588 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:30:02.592 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:30:02.592 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-08T23:30:02.650 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-08-08T23:30:02.652 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-08-08T23:30:02.653 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-08-08T23:30:02.703 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-08-08T23:30:02.703 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:30:02.704 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:30:05.623 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-08T23:30:05.623 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-08-08T23:30:05.623 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-08-08T23:30:05.624 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:30:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-08-08T23:30:05.626 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-08T23:30:05.627 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-08T23:30:05.627 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:30:05.627 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:30:05.627 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-08-08T23:30:05.982 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-08T23:30:06.219 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-08-08T23:30:06.324 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-08T23:30:06.548 INFO:tasks.workunit.client.0.smithi083.stdout: ---------------------------------------- 1.8/1.8 MB 8.2 MB/s eta 0:00:00 2024-08-08T23:30:06.622 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-08-08T23:30:06.623 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-08-08T23:30:06.623 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 22.0.2 2024-08-08T23:30:06.900 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-22.0.2: 2024-08-08T23:30:06.906 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-22.0.2 2024-08-08T23:30:07.641 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-08-08T23:30:07.704 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install configobj 2024-08-08T23:30:08.362 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting configobj 2024-08-08T23:30:08.418 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-08-08T23:30:08.556 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six (from configobj) 2024-08-08T23:30:08.573 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-08T23:30:08.644 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-08-08T23:30:08.713 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-08T23:30:08.794 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: six, configobj 2024-08-08T23:30:08.951 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-08-08T23:30:09.361 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-08-08T23:30:09.399 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-08-08T23:30:09.399 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(pwd) 2024-08-08T23:30:09.400 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:09.400 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-08-08T23:30:09.400 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:30:09.400 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-08-08T23:30:09.475 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:09.475 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 37007/valgrind.bin \ntcp6 0 0 :::80 :::* LISTEN 37007/valgrind.bin \n' 2024-08-08T23:30:09.475 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:radosgw port: 80 2024-08-08T23:30:09.475 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-08-08T23:30:09.475 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-08-08T23:30:09.507 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:09.507 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'' 2024-08-08T23:30:09.507 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-08-08T23:30:10.194 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:10.194 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-08-08T23:30:10.066872Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-08-08T23:30:10.066846Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-08-08T23:30:10.194 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:Creating s3cmd config... 2024-08-08T23:30:10.195 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:proto for s3cmd config is http 2024-08-08T23:30:10.195 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:s3cmd config written 2024-08-08T23:30:10.195 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-08-08T23:30:11.223 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:11.223 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-08-08T23:30:11.223 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-08-08T23:30:13.560 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:13.560 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.1 seconds, 3.40 MB/s) [1 of 1]\n" 2024-08-08T23:30:13.560 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-08-08T23:30:14.309 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:14.309 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.6 seconds, 12.27 MB/s)\n" 2024-08-08T23:30:14.309 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-08-08T23:30:14.702 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:14.702 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "211f8652ca04b268d7aa2d9cbdd83bea",\n "tag": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10347466689926064389",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".pYDPHdpIoo3sqCAo-S0_wTO6Fv3gFZz_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "bucket_id": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "bucket_id": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340376,\n "stripe_size": 3146072,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "bucket_id": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".pYDPHdpIoo3sqCAo-S0_wTO6Fv3gFZz_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10347466689926064389",\n "user.rgw.x-amz-content-sha256": "8c57579cd85846d65740fb30daad713eb314c8db05c1b0cbf45c1556b66aac25",\n "user.rgw.x-amz-date": "20240808T233011Z",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1723159809/ctime:1723159809/gid:1271/gname:ubuntu/md5:211f8652ca04b268d7aa2d9cbdd83bea/mode:33204/mtime:1723159809/uid:1000/uname:ubuntu"\n }\n}\n' 2024-08-08T23:30:14.702 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Cached object name is: .pYDPHdpIoo3sqCAo-S0_wTO6Fv3gFZz_ 2024-08-08T23:30:14.702 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-08-08T23:30:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-08-08T23:30:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'0\n' 2024-08-08T23:30:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Check cache dir content: 0 2024-08-08T23:30:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-08-08T23:30:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:Completed Datacache tests 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:30:14.712 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-08-08T23:30:14.713 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-08-08T23:30:14.714 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-08-08T23:30:14.714 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:30:14.714 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:30:14.772 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-08-08T23:30:14.773 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-08T23:30:15.111 DEBUG:teuthology.parallel:result is None 2024-08-08T23:30:15.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:30:15.122 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:30:15.122 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:30:15.185 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:30:15.185 INFO:teuthology.run_tasks:Running task workunit... 2024-08-08T23:30:15.196 INFO:tasks.workunit:Pulling workunits from ref 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:30:15.196 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-08T23:30:15.196 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:30:15.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:30:15.235 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-08T23:30:15.235 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:30:15.287 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-08T23:30:15.287 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-08T23:30:15.335 INFO:tasks.workunit:timeout=3h 2024-08-08T23:30:15.335 INFO:tasks.workunit:cleanup=True 2024-08-08T23:30:15.336 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:30:15.385 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-08T23:31:00.685 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '0a88632b45f25ae38493667c7dbd155f6e59b499'. 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-08T23:31:00.686 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:00.687 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 0a88632b45f Merge branch 'wip-67364-squid' of https://github.com/yuvalif/ceph into wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:31:00.692 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-08T23:31:00.739 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-08T23:31:00.742 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:31:00.742 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-08T23:31:00.795 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-08T23:31:00.850 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-08T23:31:00.899 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:31:00.900 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:31:00.900 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-08T23:31:00.941 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:31:00.945 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:31:00.945 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-08T23:31:00.990 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-08-08T23:31:00.992 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-08-08T23:31:00.992 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-08-08T23:31:01.044 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-08-08T23:31:01.045 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:31:01.045 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:31:03.892 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:31:03.893 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-08-08T23:31:03.894 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:31:03.895 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-08-08T23:31:04.277 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-08T23:31:04.482 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-08-08T23:31:04.488 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-08T23:31:04.522 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-08-08T23:31:04.522 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-08-08T23:31:04.522 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 22.0.2 2024-08-08T23:31:04.781 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-22.0.2: 2024-08-08T23:31:04.787 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-22.0.2 2024-08-08T23:31:05.528 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-08-08T23:31:05.587 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install boto3 2024-08-08T23:31:06.677 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-08-08T23:31:06.724 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading boto3-1.34.157-py3-none-any.whl.metadata (6.6 kB) 2024-08-08T23:31:07.398 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.35.0,>=1.34.157 (from boto3) 2024-08-08T23:31:07.417 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading botocore-1.34.157-py3-none-any.whl.metadata (5.7 kB) 2024-08-08T23:31:07.568 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-08T23:31:07.585 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-08T23:31:07.694 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-08T23:31:07.712 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-08T23:31:07.850 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:31:07.866 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-08T23:31:08.079 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:31:08.091 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-08T23:31:08.330 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:31:08.331 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-08T23:31:08.349 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading boto3-1.34.157-py3-none-any.whl (139 kB) 2024-08-08T23:31:08.438 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading botocore-1.34.157-py3-none-any.whl (12.5 MB) 2024-08-08T23:31:08.682 INFO:tasks.workunit.client.0.smithi083.stdout: ---------------------------------------- 12.5/12.5 MB 53.8 MB/s eta 0:00:00 2024-08-08T23:31:08.700 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-08T23:31:08.765 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-08T23:31:08.834 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-08T23:31:08.899 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-08T23:31:08.953 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-08T23:31:09.077 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-08T23:31:10.162 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.34.157 botocore-1.34.157 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-08T23:31:10.367 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-08-08T23:31:10.511 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-08-08T23:31:10.551 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:10.551 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:10.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.593+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 realm 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:10.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:10.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:10.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.597+0000 7f71e4781980 20 searching for the correct realm 2024-08-08T23:31:10.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.601+0000 7f71e2a96640 0 -- 172.21.15.83:0/3622097863 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f71d8037950 msgr2=0x7f71d8014370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:10.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.609+0000 7f71e1a94640 0 -- 172.21.15.83:0/3622097863 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f71dc0f8c00 msgr2=0x7f71dc0b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:10.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:10.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:10.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:10.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.825+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:10.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 zone default found 2024-08-08T23:31:10.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 4 Realm: () 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 zonegroup default 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 started sync module instance, tier type = 2024-08-08T23:31:10.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.829+0000 7f71e4781980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=0 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=1 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=2 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=3 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=4 2024-08-08T23:31:10.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=5 2024-08-08T23:31:10.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.853+0000 7f71e4781980 20 add_watcher() i=6 2024-08-08T23:31:10.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.857+0000 7f71e4781980 20 add_watcher() i=7 2024-08-08T23:31:10.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.857+0000 7f71e4781980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:10.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f7098fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:10.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f71e4781980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:10.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f71e4781980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:10.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f71e4781980 5 note: GC not initialized 2024-08-08T23:31:10.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f70137fe640 20 reqs_thread_entry: start 2024-08-08T23:31:10.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f71e4781980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:10.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.861+0000 7f71e4781980 20 Filter name: none 2024-08-08T23:31:10.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f70117fa640 20 reqs_thread_entry: start 2024-08-08T23:31:10.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-08-08T23:31:10.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-08-08T23:31:10.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-08T23:31:10.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-08-08T23:31:10.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 20 rados->read ofs=0 len=0 2024-08-08T23:31:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-08-08T23:31:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-08T23:31:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-08-08T23:31:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.865+0000 7f71e4781980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-08-08T23:31:10.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f71e4781980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-08-08T23:31:10.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f71e4781980 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-08T23:31:10.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f71e4781980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-08-08T23:31:10.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f70c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659137 cookie 94465721015600 notifier 4526 bl.length()=593 2024-08-08T23:31:10.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f70c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-08-08T23:31:10.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.869+0000 7f70c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-08T23:31:10.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f71e4781980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-08-08T23:31:10.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f71e4781980 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-08T23:31:10.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f71e4781980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-08-08T23:31:10.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f70c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659137 cookie 94465721017536 notifier 4526 bl.length()=186 2024-08-08T23:31:10.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f70c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-08-08T23:31:10.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.877+0000 7f70c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-08T23:31:10.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.881+0000 7f7098fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:10.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.885+0000 7f71e4781980 20 remove_watcher() i=0 2024-08-08T23:31:10.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.885+0000 7f71e4781980 2 removed watcher, disabling cache 2024-08-08T23:31:10.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.889+0000 7f71e4781980 20 remove_watcher() i=1 2024-08-08T23:31:10.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.889+0000 7f71e4781980 20 remove_watcher() i=2 2024-08-08T23:31:10.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.893+0000 7f71e4781980 20 remove_watcher() i=3 2024-08-08T23:31:10.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.893+0000 7f71e4781980 20 remove_watcher() i=4 2024-08-08T23:31:10.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.897+0000 7f71e4781980 20 remove_watcher() i=5 2024-08-08T23:31:10.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.897+0000 7f71e4781980 20 remove_watcher() i=6 2024-08-08T23:31:10.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:10.897+0000 7f71e4781980 20 remove_watcher() i=7 2024-08-08T23:31:13.076 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: recalculated bucket check stats are correct 2024-08-08T23:31:13.076 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:13.077 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-08-08T23:31:13.110 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:13.110 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 realm 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:13.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.153+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.157+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:13.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.157+0000 7f0e53d9e980 20 searching for the correct realm 2024-08-08T23:31:13.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.161+0000 7f0e520b3640 0 -- 172.21.15.83:0/1473069733 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f0e480ec920 msgr2=0x7f0e480de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:13.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.377+0000 7f0e510b1640 0 -- 172.21.15.83:0/1473069733 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f0e4c061970 msgr2=0x7f0e4c085860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:13.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:13.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:13.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.593+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:13.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:13.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 zone default found 2024-08-08T23:31:13.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 4 Realm: () 2024-08-08T23:31:13.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:13.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:13.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:13.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 zonegroup default 2024-08-08T23:31:13.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 started sync module instance, tier type = 2024-08-08T23:31:13.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.597+0000 7f0e53d9e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=0 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=1 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=2 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=3 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=4 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=5 2024-08-08T23:31:13.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=6 2024-08-08T23:31:13.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 20 add_watcher() i=7 2024-08-08T23:31:13.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.625+0000 7f0e53d9e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:13.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.629+0000 7f0d07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:13.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:13.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:13.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 5 note: GC not initialized 2024-08-08T23:31:13.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0d06fe5640 20 reqs_thread_entry: start 2024-08-08T23:31:13.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:13.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 Filter name: none 2024-08-08T23:31:13.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0d04fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:13.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:13.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:13.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:13.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:13.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:13.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.633+0000 7f0e53d9e980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:31:13.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:31:13.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:31:13.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:31:13.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:31:13.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.637+0000 7f0e53d9e980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:31:13.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.641+0000 7f0d07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.649+0000 7f0e53d9e980 20 remove_watcher() i=0 2024-08-08T23:31:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.649+0000 7f0e53d9e980 2 removed watcher, disabling cache 2024-08-08T23:31:13.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.649+0000 7f0e53d9e980 20 remove_watcher() i=1 2024-08-08T23:31:13.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.653+0000 7f0e53d9e980 20 remove_watcher() i=2 2024-08-08T23:31:13.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.657+0000 7f0e53d9e980 20 remove_watcher() i=3 2024-08-08T23:31:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.657+0000 7f0e53d9e980 20 remove_watcher() i=4 2024-08-08T23:31:13.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.661+0000 7f0e53d9e980 20 remove_watcher() i=5 2024-08-08T23:31:13.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.661+0000 7f0e53d9e980 20 remove_watcher() i=6 2024-08-08T23:31:13.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.661+0000 7f0e53d9e980 20 remove_watcher() i=7 2024-08-08T23:31:13.682 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-08-08T23:31:13.709 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:13.709 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:13.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.749+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 realm 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:13.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.753+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.757+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:13.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.757+0000 7fb8cb50a980 20 searching for the correct realm 2024-08-08T23:31:13.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.761+0000 7fb8c981f640 0 -- 172.21.15.83:0/702279414 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x56121f47e660 msgr2=0x56121f480a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:13.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.765+0000 7fb8c881d640 0 -- 172.21.15.83:0/702279414 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fb8c4080050 msgr2=0x7fb8c40747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:13.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:13.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:13.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:13.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.773+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:13.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:13.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 zone default found 2024-08-08T23:31:13.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 4 Realm: () 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 zonegroup default 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 started sync module instance, tier type = 2024-08-08T23:31:13.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.777+0000 7fb8cb50a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:13.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=0 2024-08-08T23:31:13.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=1 2024-08-08T23:31:13.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=2 2024-08-08T23:31:13.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=3 2024-08-08T23:31:13.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=4 2024-08-08T23:31:13.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=5 2024-08-08T23:31:13.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=6 2024-08-08T23:31:13.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 20 add_watcher() i=7 2024-08-08T23:31:13.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.793+0000 7fb8cb50a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:13.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:13.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:13.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:13.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 5 note: GC not initialized 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb77efe5640 20 reqs_thread_entry: start 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 Filter name: none 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb77cfe1640 20 reqs_thread_entry: start 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:13.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.797+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:13.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:13.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:13.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:13.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb8cb50a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:13.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.801+0000 7fb77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:13.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.809+0000 7fb8cb50a980 20 remove_watcher() i=0 2024-08-08T23:31:13.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.809+0000 7fb8cb50a980 2 removed watcher, disabling cache 2024-08-08T23:31:13.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.809+0000 7fb8cb50a980 20 remove_watcher() i=1 2024-08-08T23:31:13.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.813+0000 7fb8cb50a980 20 remove_watcher() i=2 2024-08-08T23:31:13.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.813+0000 7fb8cb50a980 20 remove_watcher() i=3 2024-08-08T23:31:13.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.817+0000 7fb8cb50a980 20 remove_watcher() i=4 2024-08-08T23:31:13.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.817+0000 7fb8cb50a980 20 remove_watcher() i=5 2024-08-08T23:31:13.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.821+0000 7fb8cb50a980 20 remove_watcher() i=6 2024-08-08T23:31:13.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.821+0000 7fb8cb50a980 20 remove_watcher() i=7 2024-08-08T23:31:13.837 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 89, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-08-08T23:31:13.837 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not report normal entries 2024-08-08T23:31:13.838 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:13.838 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-08T23:31:13.869 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:13.869 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:13.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.909+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 realm 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:13.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:13.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:13.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.913+0000 7f9db6925980 20 searching for the correct realm 2024-08-08T23:31:13.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:13.917+0000 7f9db3c38640 0 -- 172.21.15.83:0/19527043 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f9da40d0040 msgr2=0x7f9da40b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:14.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.129+0000 7f9db4439640 0 -- 172.21.15.83:0/19527043 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x5578f3c83420 msgr2=0x7f9dac085050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:14.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:14.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:14.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.145+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:14.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 zone default found 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 4 Realm: () 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 zonegroup default 2024-08-08T23:31:14.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:14.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:14.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:14.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 started sync module instance, tier type = 2024-08-08T23:31:14.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.149+0000 7f9db6925980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:14.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=0 2024-08-08T23:31:14.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=1 2024-08-08T23:31:14.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=2 2024-08-08T23:31:14.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=3 2024-08-08T23:31:14.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=4 2024-08-08T23:31:14.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=5 2024-08-08T23:31:14.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=6 2024-08-08T23:31:14.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 20 add_watcher() i=7 2024-08-08T23:31:14.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.181+0000 7f9db6925980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:14.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9c6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:14.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:14.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:14.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 5 note: GC not initialized 2024-08-08T23:31:14.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9c69fdb640 20 reqs_thread_entry: start 2024-08-08T23:31:14.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:14.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 Filter name: none 2024-08-08T23:31:14.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9bdb7fe640 20 reqs_thread_entry: start 2024-08-08T23:31:14.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:14.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:14.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:14.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:14.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:14.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.189+0000 7f9db6925980 20 rados->read ofs=0 len=0 2024-08-08T23:31:14.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:14.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:14.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:14.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:14.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:14.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:14.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:14.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 1 NOTICE: finished shard 0 (0 entries found) 2024-08-08T23:31:14.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9db6925980 1 NOTICE: finished all shards (0 entries found) 2024-08-08T23:31:14.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.193+0000 7f9c6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:14.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.201+0000 7f9db6925980 20 remove_watcher() i=0 2024-08-08T23:31:14.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.201+0000 7f9db6925980 2 removed watcher, disabling cache 2024-08-08T23:31:14.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.201+0000 7f9db6925980 20 remove_watcher() i=1 2024-08-08T23:31:14.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.205+0000 7f9db6925980 20 remove_watcher() i=2 2024-08-08T23:31:14.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.205+0000 7f9db6925980 20 remove_watcher() i=3 2024-08-08T23:31:14.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.209+0000 7f9db6925980 20 remove_watcher() i=4 2024-08-08T23:31:14.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.209+0000 7f9db6925980 20 remove_watcher() i=5 2024-08-08T23:31:14.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.213+0000 7f9db6925980 20 remove_watcher() i=6 2024-08-08T23:31:14.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:14.213+0000 7f9db6925980 20 remove_watcher() i=7 2024-08-08T23:31:14.231 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-08T23:31:14.680 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-08T23:31:16.274 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:16.274 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-08T23:31:16.307 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:16.308 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:16.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.349+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 realm 2024-08-08T23:31:16.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:16.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:16.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:16.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.353+0000 7f946a91c980 20 searching for the correct realm 2024-08-08T23:31:16.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.361+0000 7f9468c31640 0 -- 172.21.15.83:0/2311145065 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f94500c0070 msgr2=0x7f94500f6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:16.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.365+0000 7f945ffff640 0 -- 172.21.15.83:0/2311145065 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f9460018410 msgr2=0x7f9460018850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:16.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:16.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:16.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:16.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:16.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.581+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:16.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 zone default found 2024-08-08T23:31:16.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 4 Realm: () 2024-08-08T23:31:16.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 zonegroup default 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 started sync module instance, tier type = 2024-08-08T23:31:16.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.585+0000 7f946a91c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=0 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=1 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=2 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=3 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=4 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=5 2024-08-08T23:31:16.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.617+0000 7f946a91c980 20 add_watcher() i=6 2024-08-08T23:31:16.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.621+0000 7f946a91c980 20 add_watcher() i=7 2024-08-08T23:31:16.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.621+0000 7f946a91c980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:16.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f931efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 5 note: GC not initialized 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f931dfdb640 20 reqs_thread_entry: start 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 20 Filter name: none 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f928f7fe640 20 reqs_thread_entry: start 2024-08-08T23:31:16.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.625+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:16.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:16.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:16.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:16.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 INFO: main: starting shard=0 2024-08-08T23:31:16.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:16.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-08T23:31:16.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.629+0000 7f946a91c980 20 INFO: main: done 2024-08-08T23:31:16.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.633+0000 7f931efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:16.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.637+0000 7f946a91c980 20 remove_watcher() i=0 2024-08-08T23:31:16.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.637+0000 7f946a91c980 2 removed watcher, disabling cache 2024-08-08T23:31:16.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.641+0000 7f946a91c980 20 remove_watcher() i=1 2024-08-08T23:31:16.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.645+0000 7f946a91c980 20 remove_watcher() i=2 2024-08-08T23:31:16.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.645+0000 7f946a91c980 20 remove_watcher() i=3 2024-08-08T23:31:16.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.649+0000 7f946a91c980 20 remove_watcher() i=4 2024-08-08T23:31:16.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.649+0000 7f946a91c980 20 remove_watcher() i=5 2024-08-08T23:31:16.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.653+0000 7f946a91c980 20 remove_watcher() i=6 2024-08-08T23:31:16.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.653+0000 7f946a91c980 20 remove_watcher() i=7 2024-08-08T23:31:16.887 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:16.887 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-08T23:31:16.923 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:16.923 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:16.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 realm 2024-08-08T23:31:16.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:16.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:16.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.965+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.969+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:16.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.969+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:16.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.969+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:16.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.969+0000 7f6a89a30980 20 searching for the correct realm 2024-08-08T23:31:16.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:16.973+0000 7f6a87d45640 0 -- 172.21.15.83:0/1684870454 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6a7c0b7030 msgr2=0x7f6a7c0d2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:17.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.189+0000 7f6a86d43640 0 -- 172.21.15.83:0/1684870454 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6a78040550 msgr2=0x7f6a7807cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.405+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:17.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 zone default found 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 4 Realm: () 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 zonegroup default 2024-08-08T23:31:17.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 started sync module instance, tier type = 2024-08-08T23:31:17.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.409+0000 7f6a89a30980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=0 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=1 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=2 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=3 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=4 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=5 2024-08-08T23:31:17.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=6 2024-08-08T23:31:17.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 20 add_watcher() i=7 2024-08-08T23:31:17.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.437+0000 7f6a89a30980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:17.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f693dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:17.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:17.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:17.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 5 note: GC not initialized 2024-08-08T23:31:17.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f693cfe1640 20 reqs_thread_entry: start 2024-08-08T23:31:17.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:17.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 Filter name: none 2024-08-08T23:31:17.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f68b67fc640 20 reqs_thread_entry: start 2024-08-08T23:31:17.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:17.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.445+0000 7f6a89a30980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:17.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:17.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:17.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 INFO: main: starting shard=0 2024-08-08T23:31:17.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:17.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-08T23:31:17.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f6a89a30980 20 INFO: main: done 2024-08-08T23:31:17.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.449+0000 7f693dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:17.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.457+0000 7f6a89a30980 20 remove_watcher() i=0 2024-08-08T23:31:17.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.457+0000 7f6a89a30980 2 removed watcher, disabling cache 2024-08-08T23:31:17.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.457+0000 7f6a89a30980 20 remove_watcher() i=1 2024-08-08T23:31:17.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.461+0000 7f6a89a30980 20 remove_watcher() i=2 2024-08-08T23:31:17.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.465+0000 7f6a89a30980 20 remove_watcher() i=3 2024-08-08T23:31:17.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.465+0000 7f6a89a30980 20 remove_watcher() i=4 2024-08-08T23:31:17.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.469+0000 7f6a89a30980 20 remove_watcher() i=5 2024-08-08T23:31:17.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.469+0000 7f6a89a30980 20 remove_watcher() i=6 2024-08-08T23:31:17.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.473+0000 7f6a89a30980 20 remove_watcher() i=7 2024-08-08T23:31:17.690 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:17.691 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-08-08T23:31:17.725 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:17.725 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:17.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 realm 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:17.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.769+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.773+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:17.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.773+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:17.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.773+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:17.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.773+0000 7f443987c980 20 searching for the correct realm 2024-08-08T23:31:17.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.777+0000 7f4436b8f640 0 -- 172.21.15.83:0/2556976003 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f4428043040 msgr2=0x7f4428044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:17.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:17.993+0000 7f4436b8f640 0 -- 172.21.15.83:0/2556976003 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f4428043040 msgr2=0x7f4428044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:18.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:18.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:18.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.009+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 zone default found 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 4 Realm: () 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 zonegroup default 2024-08-08T23:31:18.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 started sync module instance, tier type = 2024-08-08T23:31:18.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.013+0000 7f443987c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:18.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=0 2024-08-08T23:31:18.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=1 2024-08-08T23:31:18.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=2 2024-08-08T23:31:18.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=3 2024-08-08T23:31:18.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=4 2024-08-08T23:31:18.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=5 2024-08-08T23:31:18.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.037+0000 7f443987c980 20 add_watcher() i=6 2024-08-08T23:31:18.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.041+0000 7f443987c980 20 add_watcher() i=7 2024-08-08T23:31:18.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.041+0000 7f443987c980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:18.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f42e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:18.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f443987c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:18.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f443987c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:18.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f443987c980 5 note: GC not initialized 2024-08-08T23:31:18.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f42e8fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f443987c980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.045+0000 7f443987c980 20 Filter name: none 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f42627fc640 20 reqs_thread_entry: start 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:18.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:18.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:18.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:18.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 INFO: main: starting shard=0 2024-08-08T23:31:18.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:18.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:31:18.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.049+0000 7f443987c980 20 INFO: main: done 2024-08-08T23:31:18.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.053+0000 7f42e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:18.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.057+0000 7f443987c980 20 remove_watcher() i=0 2024-08-08T23:31:18.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.057+0000 7f443987c980 2 removed watcher, disabling cache 2024-08-08T23:31:18.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.061+0000 7f443987c980 20 remove_watcher() i=1 2024-08-08T23:31:18.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.061+0000 7f443987c980 20 remove_watcher() i=2 2024-08-08T23:31:18.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.065+0000 7f443987c980 20 remove_watcher() i=3 2024-08-08T23:31:18.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.065+0000 7f443987c980 20 remove_watcher() i=4 2024-08-08T23:31:18.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.069+0000 7f443987c980 20 remove_watcher() i=5 2024-08-08T23:31:18.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.069+0000 7f443987c980 20 remove_watcher() i=6 2024-08-08T23:31:18.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.073+0000 7f443987c980 20 remove_watcher() i=7 2024-08-08T23:31:18.262 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:18.263 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-08-08T23:31:18.298 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:18.299 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:18.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.525+0000 7fbf1d6ab640 0 --2- 172.21.15.83:0/2395832528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c9d382da30 0x55c9d39ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-08T23:31:18.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.549+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 realm 2024-08-08T23:31:18.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:18.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:18.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.553+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.557+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:18.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.557+0000 7fbf20398980 20 searching for the correct realm 2024-08-08T23:31:18.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.557+0000 7fbf1deac640 0 -- 172.21.15.83:0/1083984079 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fbf1802d030 msgr2=0x7fbf1807a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:18.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.565+0000 7fbf1deac640 0 -- 172.21.15.83:0/1083984079 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x7fbf18037040 msgr2=0x7fbf18083a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:18.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:18.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 zone default found 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 4 Realm: () 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 zonegroup default 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.789+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.793+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.793+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.793+0000 7fbf20398980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:18.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.793+0000 7fbf20398980 20 started sync module instance, tier type = 2024-08-08T23:31:18.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.793+0000 7fbf20398980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=0 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=1 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=2 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=3 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=4 2024-08-08T23:31:18.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=5 2024-08-08T23:31:18.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=6 2024-08-08T23:31:18.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 20 add_watcher() i=7 2024-08-08T23:31:18.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.821+0000 7fbf20398980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:18.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbdcffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:18.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:18.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:18.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 5 note: GC not initialized 2024-08-08T23:31:18.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbdceffd640 20 reqs_thread_entry: start 2024-08-08T23:31:18.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:18.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 Filter name: none 2024-08-08T23:31:18.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbdccff9640 20 reqs_thread_entry: start 2024-08-08T23:31:18.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.829+0000 7fbf20398980 20 rados->read ofs=0 len=0 2024-08-08T23:31:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:18.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 INFO: main: starting shard=0 2024-08-08T23:31:18.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:18.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:31:18.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbf20398980 20 INFO: main: done 2024-08-08T23:31:18.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.833+0000 7fbdcffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:18.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.841+0000 7fbf20398980 20 remove_watcher() i=0 2024-08-08T23:31:18.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.841+0000 7fbf20398980 2 removed watcher, disabling cache 2024-08-08T23:31:18.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.841+0000 7fbf20398980 20 remove_watcher() i=1 2024-08-08T23:31:18.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.845+0000 7fbf20398980 20 remove_watcher() i=2 2024-08-08T23:31:18.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.849+0000 7fbf20398980 20 remove_watcher() i=3 2024-08-08T23:31:18.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.849+0000 7fbf20398980 20 remove_watcher() i=4 2024-08-08T23:31:18.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.853+0000 7fbf20398980 20 remove_watcher() i=5 2024-08-08T23:31:18.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.853+0000 7fbf20398980 20 remove_watcher() i=6 2024-08-08T23:31:18.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:18.853+0000 7fbf20398980 20 remove_watcher() i=7 2024-08-08T23:31:18.906 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-08T23:31:19.326 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-08T23:31:19.734 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked finds unlistable entries 2024-08-08T23:31:19.734 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:19.734 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-08T23:31:19.767 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:19.767 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:19.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 realm 2024-08-08T23:31:19.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:19.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:19.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.805+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.809+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:19.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.809+0000 7f26d35be980 20 searching for the correct realm 2024-08-08T23:31:19.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.813+0000 7f26d10d2640 0 -- 172.21.15.83:0/4155662538 >> [v2:172.21.15.83:6816/3379310080,v1:172.21.15.83:6817/3379310080] conn(0x5610bed29ab0 msgr2=0x5610bed2bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:19.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.821+0000 7f26d18d3640 0 -- 172.21.15.83:0/4155662538 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f26c8043040 msgr2=0x7f26c8032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:19.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.825+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 zone default found 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 4 Realm: () 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 zonegroup default 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:19.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 started sync module instance, tier type = 2024-08-08T23:31:19.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.829+0000 7f26d35be980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=0 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=1 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=2 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=3 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=4 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=5 2024-08-08T23:31:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=6 2024-08-08T23:31:19.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 20 add_watcher() i=7 2024-08-08T23:31:19.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.853+0000 7f26d35be980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:19.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f25877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 5 note: GC not initialized 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f25867e4640 20 reqs_thread_entry: start 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 Filter name: none 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f24f7fff640 20 reqs_thread_entry: start 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:19.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:19.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rados->read ofs=0 len=0 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.857+0000 7f26d35be980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:19.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.861+0000 7f26d35be980 1 NOTICE: finished shard 0 (4 entries found) 2024-08-08T23:31:19.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.861+0000 7f26d35be980 1 NOTICE: finished all shards (4 entries found) 2024-08-08T23:31:19.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.865+0000 7f25877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:19.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.869+0000 7f26d35be980 20 remove_watcher() i=0 2024-08-08T23:31:19.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.869+0000 7f26d35be980 2 removed watcher, disabling cache 2024-08-08T23:31:19.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.873+0000 7f26d35be980 20 remove_watcher() i=1 2024-08-08T23:31:19.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.877+0000 7f26d35be980 20 remove_watcher() i=2 2024-08-08T23:31:19.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.877+0000 7f26d35be980 20 remove_watcher() i=3 2024-08-08T23:31:19.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.881+0000 7f26d35be980 20 remove_watcher() i=4 2024-08-08T23:31:19.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.881+0000 7f26d35be980 20 remove_watcher() i=5 2024-08-08T23:31:19.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.881+0000 7f26d35be980 20 remove_watcher() i=6 2024-08-08T23:31:19.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:19.885+0000 7f26d35be980 20 remove_watcher() i=7 2024-08-08T23:31:19.902 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: unlinked entries are not listable 2024-08-08T23:31:19.902 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:20.056 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-08-08T23:31:20.056 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:20.266 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-08-08T23:31:20.267 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:20.267 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-08T23:31:20.306 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:20.307 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:20.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 realm 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.349+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.353+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:20.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.353+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.353+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:20.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.353+0000 7fc37cbfa980 20 searching for the correct realm 2024-08-08T23:31:20.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.357+0000 7fc37af0f640 0 -- 172.21.15.83:0/1681097079 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc364048430 msgr2=0x7fc364048830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:20.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.361+0000 7fc379f0d640 0 -- 172.21.15.83:0/1681097079 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc36c060160 msgr2=0x7fc36c055fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:20.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:20.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.577+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 zone default found 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 4 Realm: () 2024-08-08T23:31:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 zonegroup default 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:20.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 started sync module instance, tier type = 2024-08-08T23:31:20.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.581+0000 7fc37cbfa980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:20.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=0 2024-08-08T23:31:20.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=1 2024-08-08T23:31:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=2 2024-08-08T23:31:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=3 2024-08-08T23:31:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=4 2024-08-08T23:31:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=5 2024-08-08T23:31:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=6 2024-08-08T23:31:20.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 20 add_watcher() i=7 2024-08-08T23:31:20.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.605+0000 7fc37cbfa980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.609+0000 7fc230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 5 note: GC not initialized 2024-08-08T23:31:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc1ab7fe640 20 reqs_thread_entry: start 2024-08-08T23:31:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 Filter name: none 2024-08-08T23:31:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc1a97fa640 20 reqs_thread_entry: start 2024-08-08T23:31:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rados->read ofs=0 len=0 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.613+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.617+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.617+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:c state=0x5594ea4cf468 s->prefetch_data=0 2024-08-08T23:31:20.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.617+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to g9tcttgjpoin6301m03trbw0kg5u9p5b 2024-08-08T23:31:20.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.617+0000 7fc37cbfa980 20 get_obj_state_impl: setting s->olh_tag to 7yyexej595yo1pxf2nc6guj5h2nx6z5n 2024-08-08T23:31:20.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.617+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7yyexej595yo1pxf2nc6guj5h2nx6z5n 2024-08-08T23:31:20.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.621+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.625+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.625+0000 7fc37cbfa980 20 olh_log_entry: epoch=3 op=3 key=c[UGmgJD79u9gF9ZvSLjMEwjJqWFz.2k1] 2024-08-08T23:31:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.625+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:UGmgJD79u9gF9ZvSLjMEwjJqWFz.2k1_c state=0x5594ea4fd688 s->prefetch_data=0 2024-08-08T23:31:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.629+0000 7fc37cbfa980 10 manifest: total_size = 9 2024-08-08T23:31:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.629+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5872756194003511102 2024-08-08T23:31:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.629+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:UGmgJD79u9gF9ZvSLjMEwjJqWFz.2k1_c state=0x5594ea4fd688 s->prefetch_data=0 2024-08-08T23:31:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.629+0000 7fc37cbfa980 20 prepare_atomic_modification: state is not atomic. state=0x5594ea4fd688 2024-08-08T23:31:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.629+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.637+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.637+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.637+0000 7fc25d7fa640 20 handle_completion(): completion ok for obj=c[UGmgJD79u9gF9ZvSLjMEwjJqWFz.2k1] 2024-08-08T23:31:20.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:d state=0x5594ea4d0498 s->prefetch_data=0 2024-08-08T23:31:20.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to 349rz6t3rrj82naorzgvnrdv4atzrd8t 2024-08-08T23:31:20.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 get_obj_state_impl: setting s->olh_tag to 0670trl4z9hbwzjnysd001c45li7aoee 2024-08-08T23:31:20.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.645+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0670trl4z9hbwzjnysd001c45li7aoee 2024-08-08T23:31:20.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.649+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 olh_log_entry: epoch=3 op=3 key=d[Po5ZUzxCPsuZI6uu1mx.utyOeJ69jjn] 2024-08-08T23:31:20.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:Po5ZUzxCPsuZI6uu1mx.utyOeJ69jjn_d state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 10 manifest: total_size = 9 2024-08-08T23:31:20.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4272361743883615379 2024-08-08T23:31:20.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:Po5ZUzxCPsuZI6uu1mx.utyOeJ69jjn_d state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 prepare_atomic_modification: state is not atomic. state=0x5594ea4ff6a8 2024-08-08T23:31:20.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.653+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.665+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.665+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.665+0000 7fc25dffb640 20 handle_completion(): completion ok for obj=d[Po5ZUzxCPsuZI6uu1mx.utyOeJ69jjn] 2024-08-08T23:31:20.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.669+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.669+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.669+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:e state=0x5594ea4d0498 s->prefetch_data=0 2024-08-08T23:31:20.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.673+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to rfen7mx2z78g0rwzdebonpd0bsh9rj9k 2024-08-08T23:31:20.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.673+0000 7fc37cbfa980 20 get_obj_state_impl: setting s->olh_tag to b45sljnq0qqmw16rta2w59u2fx01xkun 2024-08-08T23:31:20.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.673+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b45sljnq0qqmw16rta2w59u2fx01xkun 2024-08-08T23:31:20.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.677+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-08-08T23:31:20.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 olh_log_entry: epoch=2 op=3 key=e[4I7wukzgYsCcL6bPwNpGvdX6R7-gRek] 2024-08-08T23:31:20.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:4I7wukzgYsCcL6bPwNpGvdX6R7-gRek_e state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 10 manifest: total_size = 22 2024-08-08T23:31:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17044897033536761240 2024-08-08T23:31:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:4I7wukzgYsCcL6bPwNpGvdX6R7-gRek_e state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 prepare_atomic_modification: state is not atomic. state=0x5594ea4ff6a8 2024-08-08T23:31:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.681+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.693+0000 7fc25dffb640 20 handle_completion(): completion ok for obj=e[4I7wukzgYsCcL6bPwNpGvdX6R7-gRek] 2024-08-08T23:31:20.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.697+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:e state=0x5594ea4d0498 s->prefetch_data=0 2024-08-08T23:31:20.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.697+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b45sljnq0qqmw16rta2w59u2fx01xkun 2024-08-08T23:31:20.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.705+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.709+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.709+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.713+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:f state=0x5594ea4d0498 s->prefetch_data=0 2024-08-08T23:31:20.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.713+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to ci14tzlxpfm4szfjjj56uvzq6x083cgp 2024-08-08T23:31:20.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.713+0000 7fc37cbfa980 20 get_obj_state_impl: setting s->olh_tag to 2cyk7pykb9i2gs281cy4umbt3364q35f 2024-08-08T23:31:20.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.713+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2cyk7pykb9i2gs281cy4umbt3364q35f 2024-08-08T23:31:20.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.713+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-08-08T23:31:20.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 olh_log_entry: epoch=2 op=3 key=f[crE8qCy9TYaqT2trPVtWftlQwQ0ac3U] 2024-08-08T23:31:20.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:crE8qCy9TYaqT2trPVtWftlQwQ0ac3U_f state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 10 manifest: total_size = 22 2024-08-08T23:31:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4865530085414624274 2024-08-08T23:31:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:_:crE8qCy9TYaqT2trPVtWftlQwQ0ac3U_f state=0x5594ea4ff6a8 s->prefetch_data=0 2024-08-08T23:31:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 prepare_atomic_modification: state is not atomic. state=0x5594ea4ff6a8 2024-08-08T23:31:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.721+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.729+0000 7fc37cbfa980 20 get_obj_state: octx=0x5594ea21ec80 obj=check-bucket:f state=0x5594ea4d0498 s->prefetch_data=0 2024-08-08T23:31:20.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.733+0000 7fc37cbfa980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2cyk7pykb9i2gs281cy4umbt3364q35f 2024-08-08T23:31:20.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.733+0000 7fc25dffb640 20 handle_completion(): completion ok for obj=f[crE8qCy9TYaqT2trPVtWftlQwQ0ac3U] 2024-08-08T23:31:20.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.741+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.741+0000 7fc37cbfa980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:20.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.741+0000 7fc37cbfa980 1 NOTICE: finished shard 0 (4 entries removed) 2024-08-08T23:31:20.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.741+0000 7fc37cbfa980 1 NOTICE: finished all shards (4 entries removed) 2024-08-08T23:31:20.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.745+0000 7fc230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:20.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.749+0000 7fc37cbfa980 20 remove_watcher() i=0 2024-08-08T23:31:20.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.749+0000 7fc37cbfa980 2 removed watcher, disabling cache 2024-08-08T23:31:20.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.753+0000 7fc37cbfa980 20 remove_watcher() i=1 2024-08-08T23:31:20.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.757+0000 7fc37cbfa980 20 remove_watcher() i=2 2024-08-08T23:31:20.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.757+0000 7fc37cbfa980 20 remove_watcher() i=3 2024-08-08T23:31:20.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.761+0000 7fc37cbfa980 20 remove_watcher() i=4 2024-08-08T23:31:20.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.761+0000 7fc37cbfa980 20 remove_watcher() i=5 2024-08-08T23:31:20.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.765+0000 7fc37cbfa980 20 remove_watcher() i=6 2024-08-08T23:31:20.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:20.765+0000 7fc37cbfa980 20 remove_watcher() i=7 2024-08-08T23:31:20.962 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not affect normal entries 2024-08-08T23:31:20.963 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:21.328 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-08-08T23:31:21.328 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:21.328 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-08T23:31:21.365 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:21.365 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:21.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 realm 2024-08-08T23:31:21.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:21.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:21.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.409+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.413+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:21.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.413+0000 7fb901b97980 20 searching for the correct realm 2024-08-08T23:31:21.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.413+0000 7fb8ffeac640 0 -- 172.21.15.83:0/1522055162 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fb8f4027040 msgr2=0x7fb8f4008440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:21.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.629+0000 7fb8feeaa640 0 -- 172.21.15.83:0/1522055162 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fb8f81037b0 msgr2=0x7fb8f81070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:21.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:21.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:21.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:21.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:21.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.845+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:21.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 zone default found 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 4 Realm: () 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 zonegroup default 2024-08-08T23:31:21.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:21.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 started sync module instance, tier type = 2024-08-08T23:31:21.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.849+0000 7fb901b97980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=0 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=1 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=2 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=3 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=4 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=5 2024-08-08T23:31:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=6 2024-08-08T23:31:21.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 20 add_watcher() i=7 2024-08-08T23:31:21.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.877+0000 7fb901b97980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:21.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.881+0000 7fb7b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:21.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:21.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:21.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 5 note: GC not initialized 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb7b4fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 Filter name: none 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb72e7fc640 20 reqs_thread_entry: start 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:21.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rados->read ofs=0 len=0 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.885+0000 7fb901b97980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:21.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.889+0000 7fb901b97980 1 NOTICE: finished shard 0 (0 entries found) 2024-08-08T23:31:21.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.889+0000 7fb901b97980 1 NOTICE: finished all shards (0 entries found) 2024-08-08T23:31:21.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.889+0000 7fb7b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.893+0000 7fb901b97980 20 remove_watcher() i=0 2024-08-08T23:31:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.893+0000 7fb901b97980 2 removed watcher, disabling cache 2024-08-08T23:31:21.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.897+0000 7fb901b97980 20 remove_watcher() i=1 2024-08-08T23:31:21.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.901+0000 7fb901b97980 20 remove_watcher() i=2 2024-08-08T23:31:21.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.901+0000 7fb901b97980 20 remove_watcher() i=3 2024-08-08T23:31:21.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.905+0000 7fb901b97980 20 remove_watcher() i=4 2024-08-08T23:31:21.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.905+0000 7fb901b97980 20 remove_watcher() i=5 2024-08-08T23:31:21.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.905+0000 7fb901b97980 20 remove_watcher() i=6 2024-08-08T23:31:21.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:21.909+0000 7fb901b97980 20 remove_watcher() i=7 2024-08-08T23:31:22.359 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-08T23:31:22.392 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:22.392 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:22.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 realm 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.433+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.437+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.437+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.437+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.437+0000 7f6a98fba980 20 searching for the correct realm 2024-08-08T23:31:22.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.441+0000 7f6a96ace640 0 -- 172.21.15.83:0/2928482386 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f6a90017070 msgr2=0x7f6a9006a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:22.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.449+0000 7f6a962cd640 0 -- 172.21.15.83:0/2928482386 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6a9000f820 msgr2=0x7f6a90057880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:22.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.665+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:22.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:22.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 zone default found 2024-08-08T23:31:22.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 4 Realm: () 2024-08-08T23:31:22.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 zonegroup default 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 started sync module instance, tier type = 2024-08-08T23:31:22.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.669+0000 7f6a98fba980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=0 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=1 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=2 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=3 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=4 2024-08-08T23:31:22.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=5 2024-08-08T23:31:22.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.701+0000 7f6a98fba980 20 add_watcher() i=6 2024-08-08T23:31:22.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.705+0000 7f6a98fba980 20 add_watcher() i=7 2024-08-08T23:31:22.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.705+0000 7f6a98fba980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:22.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f694d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:22.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:22.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:22.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 5 note: GC not initialized 2024-08-08T23:31:22.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f68c7fff640 20 reqs_thread_entry: start 2024-08-08T23:31:22.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:22.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 Filter name: none 2024-08-08T23:31:22.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f68c5ffb640 20 reqs_thread_entry: start 2024-08-08T23:31:22.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:22.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.709+0000 7f6a98fba980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:22.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:22.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:22.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 INFO: main: starting shard=0 2024-08-08T23:31:22.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:22.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-08-08T23:31:22.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f6a98fba980 20 INFO: main: done 2024-08-08T23:31:22.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.713+0000 7f694d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:22.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.721+0000 7f6a98fba980 20 remove_watcher() i=0 2024-08-08T23:31:22.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.721+0000 7f6a98fba980 2 removed watcher, disabling cache 2024-08-08T23:31:22.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.721+0000 7f6a98fba980 20 remove_watcher() i=1 2024-08-08T23:31:22.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.725+0000 7f6a98fba980 20 remove_watcher() i=2 2024-08-08T23:31:22.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.729+0000 7f6a98fba980 20 remove_watcher() i=3 2024-08-08T23:31:22.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.729+0000 7f6a98fba980 20 remove_watcher() i=4 2024-08-08T23:31:22.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.733+0000 7f6a98fba980 20 remove_watcher() i=5 2024-08-08T23:31:22.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.737+0000 7f6a98fba980 20 remove_watcher() i=6 2024-08-08T23:31:22.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.737+0000 7f6a98fba980 20 remove_watcher() i=7 2024-08-08T23:31:22.764 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-08T23:31:22.795 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:22.795 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:22.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 realm 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.837+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.841+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:22.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.841+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:22.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.841+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:22.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.841+0000 7ffaf5228980 20 searching for the correct realm 2024-08-08T23:31:22.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.845+0000 7ffaf353d640 0 -- 172.21.15.83:0/3757391412 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ffae8008030 msgr2=0x7ffae803d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:22.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:22.853+0000 7ffaf253b640 0 -- 172.21.15.83:0/3757391412 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ffaec10d0c0 msgr2=0x7ffaec1097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:23.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:23.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:23.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.069+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 zone default found 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 4 Realm: () 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 zonegroup default 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 started sync module instance, tier type = 2024-08-08T23:31:23.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.073+0000 7ffaf5228980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=0 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=1 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=2 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=3 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=4 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=5 2024-08-08T23:31:23.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=6 2024-08-08T23:31:23.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 20 add_watcher() i=7 2024-08-08T23:31:23.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.105+0000 7ffaf5228980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:23.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ff9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:23.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:23.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 5 note: GC not initialized 2024-08-08T23:31:23.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ff923fff640 20 reqs_thread_entry: start 2024-08-08T23:31:23.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:23.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 Filter name: none 2024-08-08T23:31:23.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ff921ffb640 20 reqs_thread_entry: start 2024-08-08T23:31:23.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:23.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:23.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:23.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:23.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 INFO: main: starting shard=0 2024-08-08T23:31:23.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.113+0000 7ffaf5228980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.117+0000 7ffaf5228980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-08-08T23:31:23.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.117+0000 7ffaf5228980 20 INFO: main: done 2024-08-08T23:31:23.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.117+0000 7ff9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.121+0000 7ffaf5228980 20 remove_watcher() i=0 2024-08-08T23:31:23.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.121+0000 7ffaf5228980 2 removed watcher, disabling cache 2024-08-08T23:31:23.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.125+0000 7ffaf5228980 20 remove_watcher() i=1 2024-08-08T23:31:23.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.129+0000 7ffaf5228980 20 remove_watcher() i=2 2024-08-08T23:31:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.129+0000 7ffaf5228980 20 remove_watcher() i=3 2024-08-08T23:31:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.133+0000 7ffaf5228980 20 remove_watcher() i=4 2024-08-08T23:31:23.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.133+0000 7ffaf5228980 20 remove_watcher() i=5 2024-08-08T23:31:23.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.137+0000 7ffaf5228980 20 remove_watcher() i=6 2024-08-08T23:31:23.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.137+0000 7ffaf5228980 20 remove_watcher() i=7 2024-08-08T23:31:23.162 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh finds leftover OLH entries 2024-08-08T23:31:23.162 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:23.163 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-08-08T23:31:23.199 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:23.199 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:23.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 realm 2024-08-08T23:31:23.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:23.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.241+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.245+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:23.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.245+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.245+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:23.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.245+0000 7f583624c980 20 searching for the correct realm 2024-08-08T23:31:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.249+0000 7f5834561640 0 -- 172.21.15.83:0/4251677284 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f5828008050 msgr2=0x7f582807a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:23.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.257+0000 7f583355f640 0 -- 172.21.15.83:0/4251677284 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f582c0682a0 msgr2=0x7f582c052d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:23.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:23.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:23.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:23.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.473+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 zone default found 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 4 Realm: () 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 zonegroup default 2024-08-08T23:31:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 started sync module instance, tier type = 2024-08-08T23:31:23.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.477+0000 7f583624c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:23.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=0 2024-08-08T23:31:23.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=1 2024-08-08T23:31:23.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=2 2024-08-08T23:31:23.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=3 2024-08-08T23:31:23.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=4 2024-08-08T23:31:23.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=5 2024-08-08T23:31:23.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.501+0000 7f583624c980 20 add_watcher() i=6 2024-08-08T23:31:23.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.505+0000 7f583624c980 20 add_watcher() i=7 2024-08-08T23:31:23.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.505+0000 7f583624c980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:23.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.509+0000 7f56e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:23.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:23.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 5 note: GC not initialized 2024-08-08T23:31:23.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f56e8fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:23.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:23.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 Filter name: none 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f56627fc640 20 reqs_thread_entry: start 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:23.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:23.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:23.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.513+0000 7f583624c980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.517+0000 7f583624c980 1 NOTICE: finished shard 0 (2 entries found) 2024-08-08T23:31:23.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.517+0000 7f583624c980 1 NOTICE: finished all shards (2 entries found) 2024-08-08T23:31:23.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.517+0000 7f56e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.521+0000 7f583624c980 20 remove_watcher() i=0 2024-08-08T23:31:23.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.521+0000 7f583624c980 2 removed watcher, disabling cache 2024-08-08T23:31:23.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.525+0000 7f583624c980 20 remove_watcher() i=1 2024-08-08T23:31:23.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.529+0000 7f583624c980 20 remove_watcher() i=2 2024-08-08T23:31:23.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.529+0000 7f583624c980 20 remove_watcher() i=3 2024-08-08T23:31:23.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.533+0000 7f583624c980 20 remove_watcher() i=4 2024-08-08T23:31:23.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.533+0000 7f583624c980 20 remove_watcher() i=5 2024-08-08T23:31:23.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.537+0000 7f583624c980 20 remove_watcher() i=6 2024-08-08T23:31:23.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.537+0000 7f583624c980 20 remove_watcher() i=7 2024-08-08T23:31:23.557 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-08-08T23:31:23.557 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:23.558 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-08T23:31:23.593 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:23.594 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:23.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 realm 2024-08-08T23:31:23.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.637+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.641+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:23.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.641+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.641+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:23.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.641+0000 7fdba0173980 20 searching for the correct realm 2024-08-08T23:31:23.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.645+0000 7fdb9e488640 0 -- 172.21.15.83:0/3211982446 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fdb9402c030 msgr2=0x7fdb9405e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:23.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.649+0000 7fdb9d486640 0 -- 172.21.15.83:0/3211982446 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fdb980db430 msgr2=0x7fdb980db850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:23.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.865+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:23.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 zone default found 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 4 Realm: () 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 zonegroup default 2024-08-08T23:31:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.869+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.873+0000 7fdba0173980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.873+0000 7fdba0173980 20 started sync module instance, tier type = 2024-08-08T23:31:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.873+0000 7fdba0173980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=0 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=1 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=2 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=3 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=4 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=5 2024-08-08T23:31:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.897+0000 7fdba0173980 20 add_watcher() i=6 2024-08-08T23:31:23.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.901+0000 7fdba0173980 20 add_watcher() i=7 2024-08-08T23:31:23.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.901+0000 7fdba0173980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:23.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fda4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 5 note: GC not initialized 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fda4e7fc640 20 reqs_thread_entry: start 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 Filter name: none 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fd9bffff640 20 reqs_thread_entry: start 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rados->read ofs=0 len=0 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.905+0000 7fdba0173980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 get_obj_state: octx=0x561211d00c70 obj=check-bucket:c state=0x561211fb0048 s->prefetch_data=0 2024-08-08T23:31:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 get_obj_state: setting s->obj_tag to g9tcttgjpoin6301m03trbw0kg5u9p5b 2024-08-08T23:31:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 get_obj_state_impl: setting s->olh_tag to 7yyexej595yo1pxf2nc6guj5h2nx6z5n 2024-08-08T23:31:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-08-08T23:31:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 olh_log_entry: epoch=4 op=3 key=c[.SEdNyWT-VzdsLpwgudwl-5BXvpwpvZ] 2024-08-08T23:31:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.909+0000 7fdba0173980 20 get_obj_state: octx=0x561211fdbab0 obj=check-bucket:_:.SEdNyWT-VzdsLpwgudwl-5BXvpwpvZ_c state=0x561211fadbf8 s->prefetch_data=0 2024-08-08T23:31:23.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.913+0000 7fdba0173980 20 get_obj_state: octx=0x561211fdbab0 obj=check-bucket:c state=0x561211facbe8 s->prefetch_data=0 2024-08-08T23:31:23.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.913+0000 7fdba0173980 20 get_obj_state: setting s->obj_tag to g9tcttgjpoin6301m03trbw0kg5u9p5b 2024-08-08T23:31:23.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.913+0000 7fdba0173980 20 get_obj_state_impl: setting s->olh_tag to 7yyexej595yo1pxf2nc6guj5h2nx6z5n 2024-08-08T23:31:23.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.913+0000 7fdba0173980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7yyexej595yo1pxf2nc6guj5h2nx6z5n 2024-08-08T23:31:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.921+0000 7fdba0173980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 get_obj_state: octx=0x561211d00c70 obj=check-bucket:d state=0x561211fb0048 s->prefetch_data=0 2024-08-08T23:31:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 get_obj_state: setting s->obj_tag to 349rz6t3rrj82naorzgvnrdv4atzrd8t 2024-08-08T23:31:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 get_obj_state_impl: setting s->olh_tag to 0670trl4z9hbwzjnysd001c45li7aoee 2024-08-08T23:31:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-08-08T23:31:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 olh_log_entry: epoch=4 op=3 key=d[T7XwDwAqDEyR5yiJSbecBZSFeLwtokO] 2024-08-08T23:31:23.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.925+0000 7fdba0173980 20 get_obj_state: octx=0x561211fdbab0 obj=check-bucket:_:T7XwDwAqDEyR5yiJSbecBZSFeLwtokO_d state=0x561211fde2a8 s->prefetch_data=0 2024-08-08T23:31:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.929+0000 7fdba0173980 20 get_obj_state: octx=0x561211fdbab0 obj=check-bucket:d state=0x561211fabbd8 s->prefetch_data=0 2024-08-08T23:31:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.929+0000 7fdba0173980 20 get_obj_state: setting s->obj_tag to 349rz6t3rrj82naorzgvnrdv4atzrd8t 2024-08-08T23:31:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.929+0000 7fdba0173980 20 get_obj_state_impl: setting s->olh_tag to 0670trl4z9hbwzjnysd001c45li7aoee 2024-08-08T23:31:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.929+0000 7fdba0173980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0670trl4z9hbwzjnysd001c45li7aoee 2024-08-08T23:31:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.937+0000 7fdba0173980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.937+0000 7fdba0173980 1 NOTICE: finished shard 0 (2 entries removed) 2024-08-08T23:31:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.937+0000 7fdba0173980 1 NOTICE: finished all shards (2 entries removed) 2024-08-08T23:31:23.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.941+0000 7fda4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.945+0000 7fdba0173980 20 remove_watcher() i=0 2024-08-08T23:31:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.945+0000 7fdba0173980 2 removed watcher, disabling cache 2024-08-08T23:31:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.945+0000 7fdba0173980 20 remove_watcher() i=1 2024-08-08T23:31:23.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.949+0000 7fdba0173980 20 remove_watcher() i=2 2024-08-08T23:31:23.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.953+0000 7fdba0173980 20 remove_watcher() i=3 2024-08-08T23:31:23.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.953+0000 7fdba0173980 20 remove_watcher() i=4 2024-08-08T23:31:23.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.957+0000 7fdba0173980 20 remove_watcher() i=5 2024-08-08T23:31:23.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.957+0000 7fdba0173980 20 remove_watcher() i=6 2024-08-08T23:31:23.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:23.957+0000 7fdba0173980 20 remove_watcher() i=7 2024-08-08T23:31:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-08T23:31:24.010 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:24.010 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:24.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.049+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 realm 2024-08-08T23:31:24.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:24.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:24.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.053+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.057+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:24.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.057+0000 7fbe50ecc980 20 searching for the correct realm 2024-08-08T23:31:24.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.061+0000 7fbe4f1e1640 0 -- 172.21.15.83:0/46559936 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fbe440ed040 msgr2=0x7fbe440ed420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:24.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.277+0000 7fbe4e1df640 0 -- 172.21.15.83:0/46559936 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fbe4805a040 msgr2=0x7fbe4805a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:24.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:24.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 zone default found 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 4 Realm: () 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 zonegroup default 2024-08-08T23:31:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.493+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 started sync module instance, tier type = 2024-08-08T23:31:24.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.497+0000 7fbe50ecc980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:24.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=0 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=1 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=2 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=3 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=4 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=5 2024-08-08T23:31:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.521+0000 7fbe50ecc980 20 add_watcher() i=6 2024-08-08T23:31:24.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.525+0000 7fbe50ecc980 20 add_watcher() i=7 2024-08-08T23:31:24.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.525+0000 7fbe50ecc980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:24.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbd057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:24.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:24.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:24.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 5 note: GC not initialized 2024-08-08T23:31:24.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbc7ffff640 20 reqs_thread_entry: start 2024-08-08T23:31:24.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:24.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 Filter name: none 2024-08-08T23:31:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbc7dffb640 20 reqs_thread_entry: start 2024-08-08T23:31:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 INFO: main: starting shard=0 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.533+0000 7fbe50ecc980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.537+0000 7fbe50ecc980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:31:24.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.537+0000 7fbe50ecc980 20 INFO: main: done 2024-08-08T23:31:24.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.537+0000 7fbd057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:24.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.541+0000 7fbe50ecc980 20 remove_watcher() i=0 2024-08-08T23:31:24.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.541+0000 7fbe50ecc980 2 removed watcher, disabling cache 2024-08-08T23:31:24.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.545+0000 7fbe50ecc980 20 remove_watcher() i=1 2024-08-08T23:31:24.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.549+0000 7fbe50ecc980 20 remove_watcher() i=2 2024-08-08T23:31:24.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.549+0000 7fbe50ecc980 20 remove_watcher() i=3 2024-08-08T23:31:24.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.553+0000 7fbe50ecc980 20 remove_watcher() i=4 2024-08-08T23:31:24.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.553+0000 7fbe50ecc980 20 remove_watcher() i=5 2024-08-08T23:31:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.557+0000 7fbe50ecc980 20 remove_watcher() i=6 2024-08-08T23:31:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.557+0000 7fbe50ecc980 20 remove_watcher() i=7 2024-08-08T23:31:24.576 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-08T23:31:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.645+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 realm 2024-08-08T23:31:24.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:24.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:24.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:24.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:24.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:24.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.649+0000 7fdf25e45980 20 searching for the correct realm 2024-08-08T23:31:24.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.653+0000 7fdf2415a640 0 -- 172.21.15.83:0/1043036842 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fdf18064f30 msgr2=0x7fdf1805b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:24.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:24.869+0000 7fdf23158640 0 -- 172.21.15.83:0/1043036842 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fdf1c022070 msgr2=0x7fdf1c00f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:25.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 zone default found 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 4 Realm: () 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 zonegroup default 2024-08-08T23:31:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.085+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 started sync module instance, tier type = 2024-08-08T23:31:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.089+0000 7fdf25e45980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:25.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=0 2024-08-08T23:31:25.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=1 2024-08-08T23:31:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=2 2024-08-08T23:31:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=3 2024-08-08T23:31:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=4 2024-08-08T23:31:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=5 2024-08-08T23:31:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.113+0000 7fdf25e45980 20 add_watcher() i=6 2024-08-08T23:31:25.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.117+0000 7fdf25e45980 20 add_watcher() i=7 2024-08-08T23:31:25.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.117+0000 7fdf25e45980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:25.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.121+0000 7fddd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:25.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.121+0000 7fdf25e45980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:25.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.121+0000 7fdf25e45980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:25.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 5 note: GC not initialized 2024-08-08T23:31:25.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fddd8fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:25.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:25.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 Filter name: none 2024-08-08T23:31:25.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdd527fc640 20 reqs_thread_entry: start 2024-08-08T23:31:25.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 INFO: main: starting shard=0 2024-08-08T23:31:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:25.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:31:25.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.125+0000 7fdf25e45980 20 INFO: main: done 2024-08-08T23:31:25.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.129+0000 7fddd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:25.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.133+0000 7fdf25e45980 20 remove_watcher() i=0 2024-08-08T23:31:25.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.133+0000 7fdf25e45980 2 removed watcher, disabling cache 2024-08-08T23:31:25.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.137+0000 7fdf25e45980 20 remove_watcher() i=1 2024-08-08T23:31:25.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.141+0000 7fdf25e45980 20 remove_watcher() i=2 2024-08-08T23:31:25.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.141+0000 7fdf25e45980 20 remove_watcher() i=3 2024-08-08T23:31:25.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.145+0000 7fdf25e45980 20 remove_watcher() i=4 2024-08-08T23:31:25.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.145+0000 7fdf25e45980 20 remove_watcher() i=5 2024-08-08T23:31:25.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.149+0000 7fdf25e45980 20 remove_watcher() i=6 2024-08-08T23:31:25.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.153+0000 7fdf25e45980 20 remove_watcher() i=7 2024-08-08T23:31:25.172 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-08-08T23:31:25.172 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:25.173 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-08-08T23:31:25.205 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:25.205 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:25.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.245+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 realm 2024-08-08T23:31:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:25.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.249+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.253+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:25.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.253+0000 7f531e4f2980 20 searching for the correct realm 2024-08-08T23:31:25.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.257+0000 7f531c006640 0 -- 172.21.15.83:0/3828141916 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f531403e040 msgr2=0x7f5314003900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:25.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.261+0000 7f531b805640 0 -- 172.21.15.83:0/3828141916 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f531406a730 msgr2=0x7f53140022e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.477+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 zone default found 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 4 Realm: () 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 zonegroup default 2024-08-08T23:31:25.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:25.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 started sync module instance, tier type = 2024-08-08T23:31:25.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.481+0000 7f531e4f2980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:25.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=0 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=1 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=2 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=3 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=4 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=5 2024-08-08T23:31:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=6 2024-08-08T23:31:25.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 20 add_watcher() i=7 2024-08-08T23:31:25.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.513+0000 7f531e4f2980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:25.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f51d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 5 note: GC not initialized 2024-08-08T23:31:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f51d0fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:25.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 Filter name: none 2024-08-08T23:31:25.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f514a7fc640 20 reqs_thread_entry: start 2024-08-08T23:31:25.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:25.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:25.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:25.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:25.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:25.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.521+0000 7f531e4f2980 20 rados->read ofs=0 len=0 2024-08-08T23:31:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:25.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:25.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:25.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 1 NOTICE: finished shard 0 (0 entries found) 2024-08-08T23:31:25.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f531e4f2980 1 NOTICE: finished all shards (0 entries found) 2024-08-08T23:31:25.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.525+0000 7f51d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:25.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.533+0000 7f531e4f2980 20 remove_watcher() i=0 2024-08-08T23:31:25.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.533+0000 7f531e4f2980 2 removed watcher, disabling cache 2024-08-08T23:31:25.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.533+0000 7f531e4f2980 20 remove_watcher() i=1 2024-08-08T23:31:25.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.537+0000 7f531e4f2980 20 remove_watcher() i=2 2024-08-08T23:31:25.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.537+0000 7f531e4f2980 20 remove_watcher() i=3 2024-08-08T23:31:25.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.541+0000 7f531e4f2980 20 remove_watcher() i=4 2024-08-08T23:31:25.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.545+0000 7f531e4f2980 20 remove_watcher() i=5 2024-08-08T23:31:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.549+0000 7f531e4f2980 20 remove_watcher() i=6 2024-08-08T23:31:25.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:25.549+0000 7f531e4f2980 20 remove_watcher() i=7 2024-08-08T23:31:25.568 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-08-08T23:31:25.568 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:25.749 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-08-08T23:31:25.749 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:31:27.590 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-08T23:31:28.024 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-08T23:31:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-08T23:31:29.654 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:29.654 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:29.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 realm 2024-08-08T23:31:29.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:29.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.696+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.700+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:29.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.700+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.700+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:29.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.700+0000 7f7288004980 20 searching for the correct realm 2024-08-08T23:31:29.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.704+0000 7f7285b18640 0 -- 172.21.15.83:0/1234541885 >> [v2:172.21.15.83:6816/3379310080,v1:172.21.15.83:6817/3379310080] conn(0x55f9676dab00 msgr2=0x55f9676dcf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:29.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.712+0000 7f7286319640 0 -- 172.21.15.83:0/1234541885 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f727c0ed060 msgr2=0x7f727c1130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:29.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:29.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:29.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:29.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:29.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 zone default found 2024-08-08T23:31:29.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 4 Realm: () 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 zonegroup default 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 started sync module instance, tier type = 2024-08-08T23:31:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.720+0000 7f7288004980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=0 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=1 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=2 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=3 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=4 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=5 2024-08-08T23:31:29.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=6 2024-08-08T23:31:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 20 add_watcher() i=7 2024-08-08T23:31:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.748+0000 7f7288004980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:29.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f71377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:29.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:29.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:29.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 5 note: GC not initialized 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f71367fc640 20 reqs_thread_entry: start 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 Filter name: none 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f70a7fff640 20 reqs_thread_entry: start 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.752+0000 7f7288004980 20 rados->read ofs=0 len=0 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:29.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 INFO: main: starting shard=0 2024-08-08T23:31:29.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:29.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-08T23:31:29.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f7288004980 20 INFO: main: done 2024-08-08T23:31:29.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.756+0000 7f71377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:29.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.760+0000 7f7288004980 20 remove_watcher() i=0 2024-08-08T23:31:29.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.760+0000 7f7288004980 2 removed watcher, disabling cache 2024-08-08T23:31:29.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.764+0000 7f7288004980 20 remove_watcher() i=1 2024-08-08T23:31:29.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.768+0000 7f7288004980 20 remove_watcher() i=2 2024-08-08T23:31:29.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.768+0000 7f7288004980 20 remove_watcher() i=3 2024-08-08T23:31:29.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.772+0000 7f7288004980 20 remove_watcher() i=4 2024-08-08T23:31:29.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.772+0000 7f7288004980 20 remove_watcher() i=5 2024-08-08T23:31:29.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.772+0000 7f7288004980 20 remove_watcher() i=6 2024-08-08T23:31:29.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:29.776+0000 7f7288004980 20 remove_watcher() i=7 2024-08-08T23:31:29.930 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:29.931 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-08T23:31:29.967 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:29.967 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:30.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.008+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 realm 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.012+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.016+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:30.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.016+0000 7f3cf7fc4980 20 searching for the correct realm 2024-08-08T23:31:30.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.020+0000 7f3cf5ad8640 0 -- 172.21.15.83:0/281444115 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f3cf002c060 msgr2=0x7f3cf00554b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:30.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.028+0000 7f3cf52d7640 0 -- 172.21.15.83:0/281444115 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f3cf005ec90 msgr2=0x7f3cf006a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:30.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.244+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:30.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 zone default found 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 4 Realm: () 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 zonegroup default 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 started sync module instance, tier type = 2024-08-08T23:31:30.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.248+0000 7f3cf7fc4980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:30.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=0 2024-08-08T23:31:30.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=1 2024-08-08T23:31:30.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=2 2024-08-08T23:31:30.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=3 2024-08-08T23:31:30.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=4 2024-08-08T23:31:30.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=5 2024-08-08T23:31:30.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.272+0000 7f3cf7fc4980 20 add_watcher() i=6 2024-08-08T23:31:30.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.276+0000 7f3cf7fc4980 20 add_watcher() i=7 2024-08-08T23:31:30.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.276+0000 7f3cf7fc4980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:30.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:30.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:30.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:30.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 5 note: GC not initialized 2024-08-08T23:31:30.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3ba67fc640 20 reqs_thread_entry: start 2024-08-08T23:31:30.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:30.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 20 Filter name: none 2024-08-08T23:31:30.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3b17fff640 20 reqs_thread_entry: start 2024-08-08T23:31:30.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.280+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 INFO: main: starting shard=0 2024-08-08T23:31:30.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:30.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-08T23:31:30.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.284+0000 7f3cf7fc4980 20 INFO: main: done 2024-08-08T23:31:30.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.288+0000 7f3ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:30.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.292+0000 7f3cf7fc4980 20 remove_watcher() i=0 2024-08-08T23:31:30.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.292+0000 7f3cf7fc4980 2 removed watcher, disabling cache 2024-08-08T23:31:30.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.292+0000 7f3cf7fc4980 20 remove_watcher() i=1 2024-08-08T23:31:30.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.296+0000 7f3cf7fc4980 20 remove_watcher() i=2 2024-08-08T23:31:30.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.296+0000 7f3cf7fc4980 20 remove_watcher() i=3 2024-08-08T23:31:30.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.300+0000 7f3cf7fc4980 20 remove_watcher() i=4 2024-08-08T23:31:30.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.300+0000 7f3cf7fc4980 20 remove_watcher() i=5 2024-08-08T23:31:30.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.304+0000 7f3cf7fc4980 20 remove_watcher() i=6 2024-08-08T23:31:30.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.304+0000 7f3cf7fc4980 20 remove_watcher() i=7 2024-08-08T23:31:30.562 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:30.563 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-08-08T23:31:30.597 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:30.598 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:30.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 realm 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:30.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.640+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.644+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:30.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.644+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:30.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.644+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:30.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.644+0000 7faa45be9980 20 searching for the correct realm 2024-08-08T23:31:30.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.648+0000 7faa43efe640 0 -- 172.21.15.83:0/1247339649 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7faa2c0da070 msgr2=0x7faa2c0db400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:30.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:30.864+0000 7faa42efc640 0 -- 172.21.15.83:0/1247339649 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7faa3c05e3a0 msgr2=0x7faa3c07c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:31.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:31.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.080+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:31.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 zone default found 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 4 Realm: () 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 zonegroup default 2024-08-08T23:31:31.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 started sync module instance, tier type = 2024-08-08T23:31:31.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.084+0000 7faa45be9980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:31.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=0 2024-08-08T23:31:31.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=1 2024-08-08T23:31:31.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=2 2024-08-08T23:31:31.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=3 2024-08-08T23:31:31.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=4 2024-08-08T23:31:31.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=5 2024-08-08T23:31:31.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.112+0000 7faa45be9980 20 add_watcher() i=6 2024-08-08T23:31:31.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.116+0000 7faa45be9980 20 add_watcher() i=7 2024-08-08T23:31:31.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.116+0000 7faa45be9980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:31.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7fa8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:31.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:31.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:31.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 5 note: GC not initialized 2024-08-08T23:31:31.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7fa8f8fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:31.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:31.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 Filter name: none 2024-08-08T23:31:31.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7fa8727fc640 20 reqs_thread_entry: start 2024-08-08T23:31:31.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:31.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.120+0000 7faa45be9980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:31.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:31.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:31.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 INFO: main: starting shard=0 2024-08-08T23:31:31.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:31.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:31:31.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7faa45be9980 20 INFO: main: done 2024-08-08T23:31:31.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.124+0000 7fa8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:31.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.132+0000 7faa45be9980 20 remove_watcher() i=0 2024-08-08T23:31:31.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.132+0000 7faa45be9980 2 removed watcher, disabling cache 2024-08-08T23:31:31.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.132+0000 7faa45be9980 20 remove_watcher() i=1 2024-08-08T23:31:31.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.136+0000 7faa45be9980 20 remove_watcher() i=2 2024-08-08T23:31:31.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.136+0000 7faa45be9980 20 remove_watcher() i=3 2024-08-08T23:31:31.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.140+0000 7faa45be9980 20 remove_watcher() i=4 2024-08-08T23:31:31.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.140+0000 7faa45be9980 20 remove_watcher() i=5 2024-08-08T23:31:31.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.144+0000 7faa45be9980 20 remove_watcher() i=6 2024-08-08T23:31:31.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.144+0000 7faa45be9980 20 remove_watcher() i=7 2024-08-08T23:31:31.306 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:31:31.307 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-08-08T23:31:31.342 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:31.342 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:31.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 realm 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.384+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.388+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:31.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.388+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.388+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:31.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.388+0000 7f2080841980 20 searching for the correct realm 2024-08-08T23:31:31.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.392+0000 7f207eb56640 0 -- 172.21.15.83:0/1231678278 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f20680adc30 msgr2=0x7f2068123ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:31.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.400+0000 7f207db54640 0 -- 172.21.15.83:0/1231678278 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f207804f3d0 msgr2=0x7f207804f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:31.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:31.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:31.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.616+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:31.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 zone default found 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 4 Realm: () 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:31.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:31.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 zonegroup default 2024-08-08T23:31:31.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:31.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 started sync module instance, tier type = 2024-08-08T23:31:31.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.620+0000 7f2080841980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=0 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=1 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=2 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=3 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=4 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=5 2024-08-08T23:31:31.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.644+0000 7f2080841980 20 add_watcher() i=6 2024-08-08T23:31:31.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.648+0000 7f2080841980 20 add_watcher() i=7 2024-08-08T23:31:31.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.648+0000 7f2080841980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:31.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f1f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:31.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:31.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:31.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 5 note: GC not initialized 2024-08-08T23:31:31.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f1eaf7fe640 20 reqs_thread_entry: start 2024-08-08T23:31:31.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:31.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 Filter name: none 2024-08-08T23:31:31.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f1ead7fa640 20 reqs_thread_entry: start 2024-08-08T23:31:31.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:31.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.652+0000 7f2080841980 20 rados->read ofs=0 len=0 2024-08-08T23:31:31.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:31.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:31.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-08-08T23:31:31.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 INFO: main: starting shard=0 2024-08-08T23:31:31.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:31.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:31:31.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f2080841980 20 INFO: main: done 2024-08-08T23:31:31.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.656+0000 7f1f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:31.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.664+0000 7f2080841980 20 remove_watcher() i=0 2024-08-08T23:31:31.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.664+0000 7f2080841980 2 removed watcher, disabling cache 2024-08-08T23:31:31.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.664+0000 7f2080841980 20 remove_watcher() i=1 2024-08-08T23:31:31.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.668+0000 7f2080841980 20 remove_watcher() i=2 2024-08-08T23:31:31.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.668+0000 7f2080841980 20 remove_watcher() i=3 2024-08-08T23:31:31.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.672+0000 7f2080841980 20 remove_watcher() i=4 2024-08-08T23:31:31.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.672+0000 7f2080841980 20 remove_watcher() i=5 2024-08-08T23:31:31.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.676+0000 7f2080841980 20 remove_watcher() i=6 2024-08-08T23:31:31.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:31.676+0000 7f2080841980 20 remove_watcher() i=7 2024-08-08T23:31:31.738 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-08T23:31:32.162 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-08T23:31:32.576 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-08-08T23:31:32.606 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:32.606 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:32.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.640+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 realm 2024-08-08T23:31:32.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:32.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:32.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:32.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.644+0000 7f4b008a8980 20 searching for the correct realm 2024-08-08T23:31:32.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.652+0000 7f4afe3bc640 0 -- 172.21.15.83:0/4267574477 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f4af8039060 msgr2=0x7f4af805c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:32.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.656+0000 7f4af7fff640 0 -- 172.21.15.83:0/4267574477 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f4af808d0d0 msgr2=0x7f4af807b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:32.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.872+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:32.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 zone default found 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 4 Realm: () 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 zonegroup default 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:32.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 started sync module instance, tier type = 2024-08-08T23:31:32.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.876+0000 7f4b008a8980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:32.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=0 2024-08-08T23:31:32.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=1 2024-08-08T23:31:32.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=2 2024-08-08T23:31:32.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=3 2024-08-08T23:31:32.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=4 2024-08-08T23:31:32.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.896+0000 7f4b008a8980 20 add_watcher() i=5 2024-08-08T23:31:32.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.900+0000 7f4b008a8980 20 add_watcher() i=6 2024-08-08T23:31:32.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.900+0000 7f4b008a8980 20 add_watcher() i=7 2024-08-08T23:31:32.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.900+0000 7f4b008a8980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:32.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f49b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:32.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:32.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:32.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 5 note: GC not initialized 2024-08-08T23:31:32.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f49af7fe640 20 reqs_thread_entry: start 2024-08-08T23:31:32.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:32.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 Filter name: none 2024-08-08T23:31:32.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f49ad7fa640 20 reqs_thread_entry: start 2024-08-08T23:31:32.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:32.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.904+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:32.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:32.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 20 rados->read ofs=0 len=0 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:31:32.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:31:32.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:31:32.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:31:32.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:31:32.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.908+0000 7f4b008a8980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:31:32.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.916+0000 7f49b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:32.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.920+0000 7f4b008a8980 20 remove_watcher() i=0 2024-08-08T23:31:32.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.920+0000 7f4b008a8980 2 removed watcher, disabling cache 2024-08-08T23:31:32.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.924+0000 7f4b008a8980 20 remove_watcher() i=1 2024-08-08T23:31:32.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.924+0000 7f4b008a8980 20 remove_watcher() i=2 2024-08-08T23:31:32.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.928+0000 7f4b008a8980 20 remove_watcher() i=3 2024-08-08T23:31:32.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.932+0000 7f4b008a8980 20 remove_watcher() i=4 2024-08-08T23:31:32.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.932+0000 7f4b008a8980 20 remove_watcher() i=5 2024-08-08T23:31:32.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.936+0000 7f4b008a8980 20 remove_watcher() i=6 2024-08-08T23:31:32.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:32.936+0000 7f4b008a8980 20 remove_watcher() i=7 2024-08-08T23:31:32.952 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-08T23:31:32.988 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:32.988 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:33.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.024+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 realm 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:33.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:33.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.028+0000 7f027f921980 20 searching for the correct realm 2024-08-08T23:31:33.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.036+0000 7f027dc36640 0 -- 172.21.15.83:0/754946333 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x55a95d2ced40 msgr2=0x55a95d2d1150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:33.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.040+0000 7f027cc34640 0 -- 172.21.15.83:0/754946333 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f0270017900 msgr2=0x7f027001e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:33.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:33.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 zone default found 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 4 Realm: () 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 zonegroup default 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.048+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.052+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.052+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.052+0000 7f027f921980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.052+0000 7f027f921980 20 started sync module instance, tier type = 2024-08-08T23:31:33.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.052+0000 7f027f921980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=0 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=1 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=2 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=3 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=4 2024-08-08T23:31:33.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.068+0000 7f027f921980 20 add_watcher() i=5 2024-08-08T23:31:33.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.072+0000 7f027f921980 20 add_watcher() i=6 2024-08-08T23:31:33.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.072+0000 7f027f921980 20 add_watcher() i=7 2024-08-08T23:31:33.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.072+0000 7f027f921980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:33.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f01337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:33.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:33.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 5 note: GC not initialized 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f01327e4640 20 reqs_thread_entry: start 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 Filter name: none 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f00a3fff640 20 reqs_thread_entry: start 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-08T23:31:33.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 : miss 2024-08-08T23:31:33.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:33.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 info.flags=0x17 2024-08-08T23:31:33.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 to cache LRU end 2024-08-08T23:31:33.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:31:33.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-08T23:31:33.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2 2024-08-08T23:31:33.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.076+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.080+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.080+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:c state=0x55a95d301a38 s->prefetch_data=0 2024-08-08T23:31:33.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.080+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to l6hmtsrre5c4cbbz9c2knvfzilxbcny4 2024-08-08T23:31:33.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.080+0000 7f027f921980 20 get_obj_state_impl: setting s->olh_tag to qh6eaxvvfs5ijnsyao4xcf6dnp5nlxfw 2024-08-08T23:31:33.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.080+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qh6eaxvvfs5ijnsyao4xcf6dnp5nlxfw 2024-08-08T23:31:33.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.084+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 olh_log_entry: epoch=3 op=3 key=c[1INR1eqPfEY9BVV0cYhW4dnJLtB4u7y] 2024-08-08T23:31:33.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:1INR1eqPfEY9BVV0cYhW4dnJLtB4u7y_c state=0x55a95d32f9b8 s->prefetch_data=0 2024-08-08T23:31:33.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 10 manifest: total_size = 12 2024-08-08T23:31:33.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.764230092895743068 2024-08-08T23:31:33.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:1INR1eqPfEY9BVV0cYhW4dnJLtB4u7y_c state=0x55a95d32f9b8 s->prefetch_data=0 2024-08-08T23:31:33.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 prepare_atomic_modification: state is not atomic. state=0x55a95d32f9b8 2024-08-08T23:31:33.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.088+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.100+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.100+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.100+0000 7f014ffff640 20 handle_completion(): completion ok for obj=c[1INR1eqPfEY9BVV0cYhW4dnJLtB4u7y] 2024-08-08T23:31:33.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.104+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.104+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.108+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:d state=0x55a95d302a68 s->prefetch_data=0 2024-08-08T23:31:33.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.108+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to 0shois2znbk2g4d28ds98eoeuqutqdw9 2024-08-08T23:31:33.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.108+0000 7f027f921980 20 get_obj_state_impl: setting s->olh_tag to g8kvx4agxr3snsajdze9srczfm68xb32 2024-08-08T23:31:33.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.108+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g8kvx4agxr3snsajdze9srczfm68xb32 2024-08-08T23:31:33.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.108+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 olh_log_entry: epoch=3 op=3 key=d[rPWr0415w9ZTHdsaHtzzu4qJ3MBBWta] 2024-08-08T23:31:33.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:rPWr0415w9ZTHdsaHtzzu4qJ3MBBWta_d state=0x55a95d3319d8 s->prefetch_data=0 2024-08-08T23:31:33.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 10 manifest: total_size = 9 2024-08-08T23:31:33.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8829434386227421505 2024-08-08T23:31:33.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:rPWr0415w9ZTHdsaHtzzu4qJ3MBBWta_d state=0x55a95d3319d8 s->prefetch_data=0 2024-08-08T23:31:33.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 prepare_atomic_modification: state is not atomic. state=0x55a95d3319d8 2024-08-08T23:31:33.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.112+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.120+0000 7f014ffff640 20 handle_completion(): completion ok for obj=d[rPWr0415w9ZTHdsaHtzzu4qJ3MBBWta] 2024-08-08T23:31:33.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.120+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.120+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:e state=0x55a95d302a68 s->prefetch_data=0 2024-08-08T23:31:33.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to dj1gkoxtq4bbqlbp0jzs3rax6ilemy6y 2024-08-08T23:31:33.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 get_obj_state_impl: setting s->olh_tag to pe1u4fqvx08eldi8mrd8pxazftvwqfyl 2024-08-08T23:31:33.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.124+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe1u4fqvx08eldi8mrd8pxazftvwqfyl 2024-08-08T23:31:33.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.128+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-08-08T23:31:33.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 olh_log_entry: epoch=2 op=3 key=e[1fAfJ5dla4nWdnI-xRsuX1FAVmyavWu] 2024-08-08T23:31:33.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:1fAfJ5dla4nWdnI-xRsuX1FAVmyavWu_e state=0x55a95d3319d8 s->prefetch_data=0 2024-08-08T23:31:33.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 10 manifest: total_size = 11 2024-08-08T23:31:33.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11671915234620220315 2024-08-08T23:31:33.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:_:1fAfJ5dla4nWdnI-xRsuX1FAVmyavWu_e state=0x55a95d3319d8 s->prefetch_data=0 2024-08-08T23:31:33.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 prepare_atomic_modification: state is not atomic. state=0x55a95d3319d8 2024-08-08T23:31:33.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.132+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.140+0000 7f0160ff9640 20 handle_completion(): completion ok for obj=e[1fAfJ5dla4nWdnI-xRsuX1FAVmyavWu] 2024-08-08T23:31:33.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.140+0000 7f027f921980 20 get_obj_state: octx=0x55a95d055c80 obj=check-bucket:e state=0x55a95d302a68 s->prefetch_data=0 2024-08-08T23:31:33.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.140+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe1u4fqvx08eldi8mrd8pxazftvwqfyl 2024-08-08T23:31:33.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.148+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 get_obj_state: octx=0x55a95d300910 obj=check-bucket:f state=0x55a95d335b78 s->prefetch_data=0 2024-08-08T23:31:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to zdj2ou6z5ukke5bk6h7ao4t9fusproq3 2024-08-08T23:31:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 get_obj_state_impl: setting s->olh_tag to zpmi1q1zaf1srqpkcogyvwfrm66oboxw 2024-08-08T23:31:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.152+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zpmi1q1zaf1srqpkcogyvwfrm66oboxw 2024-08-08T23:31:33.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.156+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-08-08T23:31:33.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 olh_log_entry: epoch=2 op=3 key=f[Ch6jvgmgGc7Rw0jwm5d.Kc86VuzYrmO] 2024-08-08T23:31:33.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 get_obj_state: octx=0x55a95d300910 obj=check-bucket:_:Ch6jvgmgGc7Rw0jwm5d.Kc86VuzYrmO_f state=0x55a95d32e9a8 s->prefetch_data=0 2024-08-08T23:31:33.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 10 manifest: total_size = 12 2024-08-08T23:31:33.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8168698303776859086 2024-08-08T23:31:33.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 get_obj_state: octx=0x55a95d300910 obj=check-bucket:_:Ch6jvgmgGc7Rw0jwm5d.Kc86VuzYrmO_f state=0x55a95d32e9a8 s->prefetch_data=0 2024-08-08T23:31:33.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 prepare_atomic_modification: state is not atomic. state=0x55a95d32e9a8 2024-08-08T23:31:33.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.160+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.168+0000 7f027f921980 20 get_obj_state: octx=0x55a95d300910 obj=check-bucket:f state=0x55a95d335b78 s->prefetch_data=0 2024-08-08T23:31:33.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.168+0000 7f027f921980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zpmi1q1zaf1srqpkcogyvwfrm66oboxw 2024-08-08T23:31:33.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.168+0000 7f0160ff9640 20 handle_completion(): completion ok for obj=f[Ch6jvgmgGc7Rw0jwm5d.Kc86VuzYrmO] 2024-08-08T23:31:33.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.172+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.176+0000 7f027f921980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2.0 2024-08-08T23:31:33.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.176+0000 7f027f921980 1 NOTICE: finished shard 0 (4 entries removed) 2024-08-08T23:31:33.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.176+0000 7f027f921980 1 NOTICE: finished all shards (4 entries removed) 2024-08-08T23:31:33.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.176+0000 7f01337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:33.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.184+0000 7f027f921980 20 remove_watcher() i=0 2024-08-08T23:31:33.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.184+0000 7f027f921980 2 removed watcher, disabling cache 2024-08-08T23:31:33.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.184+0000 7f027f921980 20 remove_watcher() i=1 2024-08-08T23:31:33.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.188+0000 7f027f921980 20 remove_watcher() i=2 2024-08-08T23:31:33.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.188+0000 7f027f921980 20 remove_watcher() i=3 2024-08-08T23:31:33.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.192+0000 7f027f921980 20 remove_watcher() i=4 2024-08-08T23:31:33.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.192+0000 7f027f921980 20 remove_watcher() i=5 2024-08-08T23:31:33.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.196+0000 7f027f921980 20 remove_watcher() i=6 2024-08-08T23:31:33.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.196+0000 7f027f921980 20 remove_watcher() i=7 2024-08-08T23:31:33.716 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-08-08T23:31:33.747 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:31:33.747 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:31:33.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 realm 2024-08-08T23:31:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:31:33.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:33.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.788+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.792+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:33.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.792+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:33.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.792+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:31:33.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.792+0000 7f830169b980 20 searching for the correct realm 2024-08-08T23:31:33.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:33.796+0000 7f82ff9b0640 0 -- 172.21.15.83:0/927315227 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f82f40f0040 msgr2=0x7f82f40ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:31:34.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.012+0000 7f82fe9ae640 0 -- 172.21.15.83:0/927315227 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f82f8018040 msgr2=0x7f82f806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:31:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:34.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:31:34.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.228+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:31:34.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 zone default found 2024-08-08T23:31:34.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 4 Realm: () 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 zonegroup default 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:34.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:34.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:31:34.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 started sync module instance, tier type = 2024-08-08T23:31:34.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.232+0000 7f830169b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=0 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=1 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=2 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=3 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=4 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=5 2024-08-08T23:31:34.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.256+0000 7f830169b980 20 add_watcher() i=6 2024-08-08T23:31:34.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.260+0000 7f830169b980 20 add_watcher() i=7 2024-08-08T23:31:34.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.260+0000 7f830169b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:31:34.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f81b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:34.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:31:34.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:31:34.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 5 note: GC not initialized 2024-08-08T23:31:34.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f81b4fe1640 20 reqs_thread_entry: start 2024-08-08T23:31:34.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 init_complete bucket index max shards: 1 2024-08-08T23:31:34.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 Filter name: none 2024-08-08T23:31:34.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f812e7fc640 20 reqs_thread_entry: start 2024-08-08T23:31:34.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:34.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.264+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:34.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:34.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=190 2024-08-08T23:31:34.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 rados->read ofs=0 len=0 2024-08-08T23:31:34.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 rados_obj.operate() r=0 bl.length=404 2024-08-08T23:31:34.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f830169b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:31:34.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.268+0000 7f81b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:31:34.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.276+0000 7f830169b980 20 remove_watcher() i=0 2024-08-08T23:31:34.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.276+0000 7f830169b980 2 removed watcher, disabling cache 2024-08-08T23:31:34.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.276+0000 7f830169b980 20 remove_watcher() i=1 2024-08-08T23:31:34.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.280+0000 7f830169b980 20 remove_watcher() i=2 2024-08-08T23:31:34.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.284+0000 7f830169b980 20 remove_watcher() i=3 2024-08-08T23:31:34.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.284+0000 7f830169b980 20 remove_watcher() i=4 2024-08-08T23:31:34.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.288+0000 7f830169b980 20 remove_watcher() i=5 2024-08-08T23:31:34.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.288+0000 7f830169b980 20 remove_watcher() i=6 2024-08-08T23:31:34.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:31:34.288+0000 7f830169b980 20 remove_watcher() i=7 2024-08-08T23:31:34.309 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-08-08T23:31:34.309 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket check-bucket 2024-08-08T23:31:34.685 INFO:tasks.workunit.client.0.smithi083.stderr:Completed bucket check tests 2024-08-08T23:31:34.685 INFO:tasks.workunit.client.0.smithi083.stdout:connected to http://localhost:80 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:31:34.780 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-08-08T23:31:34.781 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:31:34.781 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-08T23:31:34.781 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-08-08T23:31:34.781 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-08-08T23:31:34.782 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-08-08T23:31:34.782 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:31:34.782 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:31:34.837 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-08-08T23:31:34.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-08T23:31:35.265 DEBUG:teuthology.parallel:result is None 2024-08-08T23:31:35.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:31:35.276 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:31:35.276 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:31:35.321 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:31:35.322 INFO:teuthology.run_tasks:Running task workunit... 2024-08-08T23:31:35.332 INFO:tasks.workunit:Pulling workunits from ref 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:31:35.332 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-08T23:31:35.333 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:31:35.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:31:35.370 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-08T23:31:35.371 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:31:35.418 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-08T23:31:35.418 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-08T23:31:35.467 INFO:tasks.workunit:timeout=3h 2024-08-08T23:31:35.467 INFO:tasks.workunit:cleanup=True 2024-08-08T23:31:35.468 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:31:35.516 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-08T23:32:21.844 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '0a88632b45f25ae38493667c7dbd155f6e59b499'. 2024-08-08T23:32:21.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.844 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-08-08T23:32:21.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.846 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-08T23:32:21.846 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:32:21.846 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 0a88632b45f Merge branch 'wip-67364-squid' of https://github.com/yuvalif/ceph into wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:32:21.855 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-08T23:32:21.903 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-08T23:32:21.906 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:32:21.906 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-08T23:32:21.956 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-08T23:32:22.003 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-08T23:32:22.043 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:32:22.044 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:32:22.044 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-08T23:32:22.085 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:32:22.088 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:32:22.088 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-08T23:32:22.134 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-08-08T23:32:22.135 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-08-08T23:32:22.135 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-08-08T23:32:22.198 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:32:22.198 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-08T23:32:22.198 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:32:22.199 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from ClsLock 2024-08-08T23:32:22.199 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-08-08T23:32:23.792 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:23.792 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-08-08T23:32:23.792 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:23.792 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:23.792 INFO:tasks.workunit.client.0.smithi083.stdout: client.5106 expiration=2024-08-08T23:34:23.786045+0000 addr=v1:172.21.15.83:0/3705530869 cookie= 2024-08-08T23:32:23.802 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:23.802 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-08-08T23:32:23.803 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:23.803 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:23.803 INFO:tasks.workunit.client.0.smithi083.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.83:0/3662477003 cookie= 2024-08-08T23:32:23.803 INFO:tasks.workunit.client.0.smithi083.stdout: client.5106 expiration=2024-08-08T23:34:23.800529+0000 addr=v1:172.21.15.83:0/3705530869 cookie= 2024-08-08T23:32:23.806 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:23.806 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-08-08T23:32:23.806 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:23.806 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:23.807 INFO:tasks.workunit.client.0.smithi083.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.83:0/3662477003 cookie= 2024-08-08T23:32:24.737 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMultiLocking (2539 ms) 2024-08-08T23:32:24.737 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMeta 2024-08-08T23:32:27.003 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:27.003 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-08-08T23:32:27.004 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:27.004 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:27.004 INFO:tasks.workunit.client.0.smithi083.stdout: client.5121 expiration=0.000000 addr=v1:172.21.15.83:0/1020967127 cookie= 2024-08-08T23:32:27.011 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:27.011 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-08-08T23:32:27.011 INFO:tasks.workunit.client.0.smithi083.stdout: tag: new_tag 2024-08-08T23:32:27.011 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:27.011 INFO:tasks.workunit.client.0.smithi083.stdout: client.5003 expiration=0.000000 addr=v1:172.21.15.83:0/531301639 cookie= 2024-08-08T23:32:27.736 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMeta (3000 ms) 2024-08-08T23:32:27.737 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestCookie 2024-08-08T23:32:29.820 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:29.820 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-08-08T23:32:29.820 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:29.820 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.83:0/1748199584 cookie= 2024-08-08T23:32:29.824 INFO:tasks.workunit.client.0.smithi083.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.83:0/1748199584 cookie=new cookie 2024-08-08T23:32:30.805 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestCookie (3069 ms) 2024-08-08T23:32:30.806 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-08-08T23:32:33.816 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMultipleLocks (3010 ms) 2024-08-08T23:32:33.816 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestLockDuration 2024-08-08T23:32:41.665 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestLockDuration (7849 ms) 2024-08-08T23:32:41.665 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-08-08T23:32:44.689 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestAssertLocked (3024 ms) 2024-08-08T23:32:44.689 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestSetCookie 2024-08-08T23:32:47.741 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestSetCookie (3052 ms) 2024-08-08T23:32:47.741 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestRenew 2024-08-08T23:33:08.802 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestRenew (21061 ms) 2024-08-08T23:33:08.802 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-08-08T23:33:15.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7087 ms) 2024-08-08T23:33:15.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-08-08T23:33:23.681 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7790 ms) 2024-08-08T23:33:23.681 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-08-08T23:33:31.713 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2024-08-08T23:33:31.714 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from ClsLock (69516 ms total) 2024-08-08T23:33:31.714 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:33:31.714 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:33:31.714 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (69516 ms total) 2024-08-08T23:33:31.714 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-08-08T23:33:31.722 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:33:31.722 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:33:31.778 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-08-08T23:33:31.780 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-08-08T23:33:31.780 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-08-08T23:33:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:33:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-08T23:33:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:33:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from cls_log 2024-08-08T23:33:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-08-08T23:33:34.752 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.test_log_add_same_time (2909 ms) 2024-08-08T23:33:34.752 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-08-08T23:33:37.784 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.test_log_add_different_time (3032 ms) 2024-08-08T23:33:37.784 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.trim_by_time 2024-08-08T23:33:40.806 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.trim_by_time (3021 ms) 2024-08-08T23:33:40.806 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.trim_by_marker 2024-08-08T23:33:43.857 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.trim_by_marker (3051 ms) 2024-08-08T23:33:43.858 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from cls_log (12013 ms total) 2024-08-08T23:33:43.858 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:33:43.858 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:33:43.858 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (12013 ms total) 2024-08-08T23:33:43.858 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-08-08T23:33:43.863 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:33:43.863 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:33:43.918 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-08-08T23:33:43.919 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-08-08T23:33:43.919 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-08-08T23:33:43.984 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:33:43.984 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 10 tests from 1 test suite. 2024-08-08T23:33:43.984 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:33:43.984 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from cls_refcount 2024-08-08T23:33:43.985 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit 2024-08-08T23:33:46.899 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit (2915 ms) 2024-08-08T23:33:46.899 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-08-08T23:33:49.932 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3032 ms) 2024-08-08T23:33:49.932 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_put_snap 2024-08-08T23:33:59.006 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_put_snap (9074 ms) 2024-08-08T23:33:59.006 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_explicit 2024-08-08T23:34:02.067 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_explicit (3062 ms) 2024-08-08T23:34:02.068 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.set 2024-08-08T23:34:05.096 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.set (3026 ms) 2024-08-08T23:34:05.096 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-08-08T23:34:12.151 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_ec (7058 ms) 2024-08-08T23:34:12.152 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-08-08T23:34:19.208 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7056 ms) 2024-08-08T23:34:19.208 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-08-08T23:34:31.396 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_put_snap_ec (12188 ms) 2024-08-08T23:34:31.396 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-08-08T23:34:38.451 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_explicit_ec (7055 ms) 2024-08-08T23:34:38.451 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.set_ec 2024-08-08T23:34:45.491 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.set_ec (7040 ms) 2024-08-08T23:34:45.491 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from cls_refcount (61507 ms total) 2024-08-08T23:34:45.491 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:34:45.491 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:34:45.491 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 10 tests from 1 test suite ran. (61507 ms total) 2024-08-08T23:34:45.492 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 10 tests. 2024-08-08T23:34:45.496 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:34:45.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:34:45.553 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-08-08T23:34:45.554 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-08-08T23:34:45.554 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-08-08T23:34:45.620 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:34:45.620 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 16 tests from 1 test suite. 2024-08-08T23:34:45.620 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:34:45.620 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 16 tests from cls_rgw 2024-08-08T23:34:47.559 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_basic 2024-08-08T23:34:47.614 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_basic (55 ms) 2024-08-08T23:34:47.614 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-08-08T23:34:47.689 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (75 ms) 2024-08-08T23:34:47.689 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_remove_object 2024-08-08T23:34:47.807 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_remove_object (119 ms) 2024-08-08T23:34:47.808 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_suggest 2024-08-08T23:34:50.308 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_suggest (2501 ms) 2024-08-08T23:34:50.308 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-08-08T23:34:50.322 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-08-08T23:34:50.322 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_list 2024-08-08T23:34:50.376 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_list (54 ms) 2024-08-08T23:34:50.377 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-08-08T23:35:32.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_list_delimited (42214 ms) 2024-08-08T23:35:32.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.bi_list 2024-08-08T23:35:32.732 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.bi_list (142 ms) 2024-08-08T23:35:32.732 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_set 2024-08-08T23:35:32.750 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_set (18 ms) 2024-08-08T23:35:32.750 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_list 2024-08-08T23:35:32.775 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_list (25 ms) 2024-08-08T23:35:32.775 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_defer 2024-08-08T23:35:40.752 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_defer (7977 ms) 2024-08-08T23:35:40.752 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_basic 2024-08-08T23:35:40.994 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_basic (240 ms) 2024-08-08T23:35:40.994 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-08-08T23:35:40.995 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-08-08T23:35:40.995 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_clear 2024-08-08T23:35:41.259 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_clear (264 ms) 2024-08-08T23:35:41.259 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-08-08T23:35:41.374 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.bi_log_trim (115 ms) 2024-08-08T23:35:41.375 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-08-08T23:35:41.409 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_racing_removes (35 ms) 2024-08-08T23:35:41.754 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 16 tests from cls_rgw (53851 ms total) 2024-08-08T23:35:41.755 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:35:41.755 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:35:41.755 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 16 tests from 1 test suite ran. (56136 ms total) 2024-08-08T23:35:41.755 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 16 tests. 2024-08-08T23:35:41.763 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:35:41.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:35:41.823 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-08-08T23:35:41.824 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-08-08T23:35:41.824 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-08-08T23:35:41.889 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:35:41.889 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-08T23:35:41.889 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:35:41.889 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from cls_rgw_gc 2024-08-08T23:35:41.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.init 2024-08-08T23:35:43.789 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.init (1901 ms) 2024-08-08T23:35:43.790 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-08-08T23:35:43.818 INFO:tasks.workunit.client.0.smithi083.stderr:[ ] list info tag = chain-0 2024-08-08T23:35:43.818 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (28 ms) 2024-08-08T23:35:43.818 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-08-08T23:35:43.832 INFO:tasks.workunit.client.0.smithi083.stderr:[ ] next_marker is: = 0/4263 2024-08-08T23:35:43.832 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-08-08T23:35:43.832 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-08-08T23:35:43.847 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-08-08T23:35:43.847 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-08-08T23:35:44.145 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (298 ms) 2024-08-08T23:35:44.145 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-08-08T23:35:44.167 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (22 ms) 2024-08-08T23:35:44.167 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-08-08T23:35:44.188 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (21 ms) 2024-08-08T23:35:44.188 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-08-08T23:35:44.206 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (19 ms) 2024-08-08T23:35:44.207 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.finalize 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.finalize (574 ms) 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from cls_rgw_gc (2892 ms total) 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (2892 ms total) 2024-08-08T23:35:44.781 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-08-08T23:35:44.786 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:35:44.786 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:35:44.840 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-08-08T23:35:44.841 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-08-08T23:35:44.841 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-08-08T23:35:44.915 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:35:44.915 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:35:44.915 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 1 test from 1 test suite. 2024-08-08T23:35:44.915 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:35:46.848 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 1 test from cls_rgw_stats 2024-08-08T23:35:46.848 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_stats.simulate 2024-08-08T23:35:46.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.861+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=3FS5OT6Q5906 type=write size=53370 2024-08-08T23:35:46.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.869+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.0 size=1048576 2024-08-08T23:35:46.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.869+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.1 size=1048576 2024-08-08T23:35:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.869+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.2 size=45956 2024-08-08T23:35:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.869+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=B72Q37WHZK2W tag=UK55E7IZ1LCD type=write size=3191684 2024-08-08T23:35:46.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.873+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=NYCA8D85H1QG type=del size=1897256 2024-08-08T23:35:46.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.877+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=X8HRSET0XRYZ type=del size=3347189 2024-08-08T23:35:46.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.881+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~7U9W5LPW6T0V.0 size=1048576 2024-08-08T23:35:46.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.881+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~7U9W5LPW6T0V.1 size=139682 2024-08-08T23:35:46.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.881+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=7U9W5LPW6T0V tag=BY1012BQWFNV type=write size=2236834 2024-08-08T23:35:46.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.885+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=2174Z6ITYTGB type=del size=1426237 2024-08-08T23:35:46.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.885+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=9SGH7GAWOJJQ type=del size=1852898 2024-08-08T23:35:46.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.889+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=CQ5D9GY9LK6L type=del size=2114428 2024-08-08T23:35:46.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.893+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=RMP2P9Q5M3ZJ type=del size=2435513 2024-08-08T23:35:46.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.897+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~P5SMGT40HEN0.0 size=1048576 2024-08-08T23:35:46.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.897+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~P5SMGT40HEN0.1 size=674621 2024-08-08T23:35:46.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.897+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=P5SMGT40HEN0 tag=NM8JCETXK11B type=write size=2771773 2024-08-08T23:35:46.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.901+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=BXNA7GNFX5WY type=del size=3617178 2024-08-08T23:35:46.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.901+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=6H0SWHF5NVAD type=write size=535100 2024-08-08T23:35:46.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.905+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=OPEB1FO7K7RL type=write size=578178 2024-08-08T23:35:46.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.909+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~BVXX28Z059V2.0 size=283754 2024-08-08T23:35:46.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.909+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=BVXX28Z059V2 tag=JCO8N3XY3B6H type=write size=1332330 2024-08-08T23:35:46.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.913+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=SX1B32K0TA55 type=del size=3323667 2024-08-08T23:35:46.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.913+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=RST5O2JK8T4D type=write size=739959 2024-08-08T23:35:46.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.921+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZQ8GOX9RSTBB tag=3FS5OT6Q5906 type=write 2024-08-08T23:35:46.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.925+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~1DI2GV8YKRBA.0 size=245207 2024-08-08T23:35:46.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.925+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=1DI2GV8YKRBA tag=CCSTUJKGEK6N type=write size=1293783 2024-08-08T23:35:46.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.0 size=1048576 2024-08-08T23:35:46.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.1 size=1048576 2024-08-08T23:35:46.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.929+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FBCEC998C8EJ.2~B72Q37WHZK2W.2 size=45956 2024-08-08T23:35:46.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.933+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FBCEC998C8EJ upload=B72Q37WHZK2W tag=UK55E7IZ1LCD type=write size=3191684 2024-08-08T23:35:46.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.937+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.0 size=1048576 2024-08-08T23:35:46.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.941+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.1 size=1048576 2024-08-08T23:35:46.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.941+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.2 size=292913 2024-08-08T23:35:46.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.941+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=4N6ABHBJ91YH tag=47M91QI8F13E type=write size=3438641 2024-08-08T23:35:46.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.945+0000 7fdbd6e2c8c0 1 < canceled operation key=QJB9DETMSY4X tag=NYCA8D85H1QG type=del size=1897256 2024-08-08T23:35:46.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.949+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.0 size=1048576 2024-08-08T23:35:46.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.953+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.1 size=1048576 2024-08-08T23:35:46.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.953+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.2 size=895653 2024-08-08T23:35:46.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.953+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=OE4Z3WWZWKUU tag=PIU8V5KXE8W4 type=write size=4041381 2024-08-08T23:35:46.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.957+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=X8HRSET0XRYZ type=del 2024-08-08T23:35:46.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.961+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=2Z0MW474RTO7 type=del size=1142327 2024-08-08T23:35:46.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.961+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~7U9W5LPW6T0V.0 size=1048576 2024-08-08T23:35:46.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.965+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~7U9W5LPW6T0V.1 size=139682 2024-08-08T23:35:46.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.969+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=7U9W5LPW6T0V tag=BY1012BQWFNV type=write size=2236834 2024-08-08T23:35:46.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.973+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.0 size=1048576 2024-08-08T23:35:46.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.977+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.1 size=1048576 2024-08-08T23:35:46.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.977+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.2 size=665903 2024-08-08T23:35:46.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.977+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=NA9LEOO18TST tag=QUQOAVPLFCLD type=write size=3811631 2024-08-08T23:35:46.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.981+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=2174Z6ITYTGB type=del 2024-08-08T23:35:46.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.981+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=OW7UIQ1M3UO4 type=del size=576881 2024-08-08T23:35:46.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.989+0000 7fdbd6e2c8c0 1 < suggested update operation key=63GVT7KRKCSS tag=9SGH7GAWOJJQ type=del size=1852898 2024-08-08T23:35:46.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.993+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~61JHCGEIWELK.0 size=781944 2024-08-08T23:35:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.993+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=61JHCGEIWELK tag=0F6T4BCTSNKK type=write size=1830520 2024-08-08T23:35:46.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:46.997+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=CQ5D9GY9LK6L type=del 2024-08-08T23:35:47.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.001+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.0 size=1048576 2024-08-08T23:35:47.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.005+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.1 size=1048576 2024-08-08T23:35:47.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.005+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.2 size=970223 2024-08-08T23:35:47.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.005+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=DKCSPXZPNM36 tag=TMG57IW65YBU type=write size=4115951 2024-08-08T23:35:47.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.009+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=RMP2P9Q5M3ZJ type=del 2024-08-08T23:35:47.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.013+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=Y7J8SPHXEZF4 type=del size=1738900 2024-08-08T23:35:47.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.013+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~P5SMGT40HEN0.0 size=1048576 2024-08-08T23:35:47.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.017+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~P5SMGT40HEN0.1 size=674621 2024-08-08T23:35:47.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.021+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=P5SMGT40HEN0 tag=NM8JCETXK11B type=write size=2771773 2024-08-08T23:35:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.025+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~B7M1QGWO6JVP.0 size=552722 2024-08-08T23:35:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.025+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=B7M1QGWO6JVP tag=CZ4GDI0FOG84 type=write size=1601298 2024-08-08T23:35:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.029+0000 7fdbd6e2c8c0 1 < canceled operation key=NMB4GI8R2BKU tag=BXNA7GNFX5WY type=del size=3617178 2024-08-08T23:35:47.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.029+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=GMMKDKV33ZCC type=del size=3141028 2024-08-08T23:35:47.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.033+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=6H0SWHF5NVAD type=write size=535100 2024-08-08T23:35:47.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.037+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=E18TPGVK13WJ type=del size=3491360 2024-08-08T23:35:47.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.037+0000 7fdbd6e2c8c0 1 < completed write operation key=ZBEB2Q3J9Z0D tag=OPEB1FO7K7RL type=write size=578178 2024-08-08T23:35:47.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.041+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.0 size=1048576 2024-08-08T23:35:47.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.045+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.1 size=1048576 2024-08-08T23:35:47.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.045+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.2 size=152045 2024-08-08T23:35:47.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.045+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=Y5IU1NIEJ8XS tag=HGLZ9SNJLRI5 type=write size=3297773 2024-08-08T23:35:47.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.049+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~BVXX28Z059V2.0 size=283754 2024-08-08T23:35:47.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.053+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=BVXX28Z059V2 tag=JCO8N3XY3B6H type=write size=1332330 2024-08-08T23:35:47.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.057+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=YLCJKPIOQPBD type=del size=1652825 2024-08-08T23:35:47.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.061+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=SX1B32K0TA55 type=del size=3323667 2024-08-08T23:35:47.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.061+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=M5SJDCS5YAL4 type=del size=1615569 2024-08-08T23:35:47.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.065+0000 7fdbd6e2c8c0 1 < suggested update operation key=41XLZV9ZY5OP tag=RST5O2JK8T4D type=write size=739959 2024-08-08T23:35:47.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.069+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=NDP0RW3VPJJ5 type=write size=504789 2024-08-08T23:35:47.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.073+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~1DI2GV8YKRBA.0 size=245207 2024-08-08T23:35:47.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.077+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=1DI2GV8YKRBA tag=CCSTUJKGEK6N type=write size=1293783 2024-08-08T23:35:47.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.077+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=KOA9WSF5665L type=del size=3698681 2024-08-08T23:35:47.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.077+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.0 size=1048576 2024-08-08T23:35:47.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.081+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.1 size=1048576 2024-08-08T23:35:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.081+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~4N6ABHBJ91YH.2 size=292913 2024-08-08T23:35:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.085+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=MNV404EWJHC1 upload=4N6ABHBJ91YH tag=47M91QI8F13E type=write size=3438641 2024-08-08T23:35:47.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.089+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=C9HUN0DQIQPZ type=del size=2249784 2024-08-08T23:35:47.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.089+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.0 size=1048576 2024-08-08T23:35:47.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.093+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.1 size=1048576 2024-08-08T23:35:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.093+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~OE4Z3WWZWKUU.2 size=895653 2024-08-08T23:35:47.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.097+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=OE4Z3WWZWKUU tag=PIU8V5KXE8W4 type=write size=4041381 2024-08-08T23:35:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.101+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=X534IXYPSYSW type=del size=552760 2024-08-08T23:35:47.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.101+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=2Z0MW474RTO7 type=del 2024-08-08T23:35:47.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.105+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=1EY733PVOD62 type=del size=2435882 2024-08-08T23:35:47.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.105+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.0 size=1048576 2024-08-08T23:35:47.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.109+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.1 size=1048576 2024-08-08T23:35:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.109+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~NA9LEOO18TST.2 size=665903 2024-08-08T23:35:47.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.117+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=NA9LEOO18TST tag=QUQOAVPLFCLD type=write size=3811631 2024-08-08T23:35:47.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.121+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~OW56F5Q5QCRC.0 size=1048576 2024-08-08T23:35:47.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.125+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~OW56F5Q5QCRC.1 size=730947 2024-08-08T23:35:47.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.125+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=OW56F5Q5QCRC tag=872VV35E26SK type=write size=2828099 2024-08-08T23:35:47.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.125+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=OW7UIQ1M3UO4 type=del 2024-08-08T23:35:47.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.129+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~02DGTEZUAEAH.0 size=1048576 2024-08-08T23:35:47.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.133+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~02DGTEZUAEAH.1 size=423221 2024-08-08T23:35:47.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.133+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=02DGTEZUAEAH tag=PHZ11F6WVHX2 type=write size=2520373 2024-08-08T23:35:47.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.133+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~61JHCGEIWELK.0 size=781944 2024-08-08T23:35:47.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.137+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=61JHCGEIWELK tag=0F6T4BCTSNKK type=write size=1830520 2024-08-08T23:35:47.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.141+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=QAUIUT3EWKFK type=del size=1234782 2024-08-08T23:35:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.141+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.0 size=1048576 2024-08-08T23:35:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.145+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.1 size=1048576 2024-08-08T23:35:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.145+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VSLBN9AVZK00.2~DKCSPXZPNM36.2 size=970223 2024-08-08T23:35:47.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.149+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VSLBN9AVZK00 upload=DKCSPXZPNM36 tag=TMG57IW65YBU type=write size=4115951 2024-08-08T23:35:47.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.153+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~MYIFHGE15411.0 size=1048576 2024-08-08T23:35:47.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.157+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~MYIFHGE15411.1 size=813023 2024-08-08T23:35:47.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.157+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=MYIFHGE15411 tag=Z60M7GMNQ9BW type=write size=2910175 2024-08-08T23:35:47.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.157+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=Y7J8SPHXEZF4 type=del 2024-08-08T23:35:47.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.161+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~7EK2WNP0QOCE.0 size=690914 2024-08-08T23:35:47.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.161+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=7EK2WNP0QOCE tag=8UB1JJ45I2XH type=write size=1739490 2024-08-08T23:35:47.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.165+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~B7M1QGWO6JVP.0 size=552722 2024-08-08T23:35:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.169+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=B7M1QGWO6JVP tag=CZ4GDI0FOG84 type=write size=1601298 2024-08-08T23:35:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.169+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=ZYWA8NCML5Z2 type=del size=1475694 2024-08-08T23:35:47.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.173+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=GMMKDKV33ZCC type=del 2024-08-08T23:35:47.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.177+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=Z2COTXT19MQP type=del size=1857022 2024-08-08T23:35:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.177+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=E18TPGVK13WJ type=del 2024-08-08T23:35:47.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.181+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~VAHAIHZ7S97W.0 size=1048576 2024-08-08T23:35:47.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.185+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~VAHAIHZ7S97W.1 size=652473 2024-08-08T23:35:47.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.185+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=VAHAIHZ7S97W tag=Z7P28XEN8BDV type=write size=2749625 2024-08-08T23:35:47.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.185+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.0 size=1048576 2024-08-08T23:35:47.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.189+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.1 size=1048576 2024-08-08T23:35:47.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.189+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y5IU1NIEJ8XS.2 size=152045 2024-08-08T23:35:47.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.193+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=Y5IU1NIEJ8XS tag=HGLZ9SNJLRI5 type=write size=3297773 2024-08-08T23:35:47.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.197+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.0 size=1048576 2024-08-08T23:35:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.201+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.1 size=1048576 2024-08-08T23:35:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.201+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.2 size=55382 2024-08-08T23:35:47.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.201+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=4SVWDTHHDQQ0 tag=ERUERQJ7X52C type=write size=3201110 2024-08-08T23:35:47.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.205+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=YLCJKPIOQPBD type=del size=1652825 2024-08-08T23:35:47.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.213+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~LLUGOYMJ3DCF.0 size=155874 2024-08-08T23:35:47.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.213+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=LLUGOYMJ3DCF tag=NZF2FRC8M0YL type=write size=1204450 2024-08-08T23:35:47.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.213+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=M5SJDCS5YAL4 type=del 2024-08-08T23:35:47.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.217+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.0 size=1048576 2024-08-08T23:35:47.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.221+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.1 size=1048576 2024-08-08T23:35:47.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.221+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.2 size=395040 2024-08-08T23:35:47.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.221+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=D9CG6GIK228I tag=EZHXXKFY68HV type=write size=3540768 2024-08-08T23:35:47.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.225+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=NDP0RW3VPJJ5 type=write size=504789 2024-08-08T23:35:47.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.225+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=XQB28XG42SQJ type=write size=872740 2024-08-08T23:35:47.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.229+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=KOA9WSF5665L type=del 2024-08-08T23:35:47.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.233+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.0 size=1048576 2024-08-08T23:35:47.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.237+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.1 size=1048576 2024-08-08T23:35:47.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.237+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.2 size=212999 2024-08-08T23:35:47.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.237+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=O5LAFI2SYPXO tag=2V35C5W4QFOE type=write size=3358727 2024-08-08T23:35:47.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.241+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=C9HUN0DQIQPZ type=del 2024-08-08T23:35:47.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.241+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=ZAVSZ7X4UOBA type=write size=736984 2024-08-08T23:35:47.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.245+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=X534IXYPSYSW type=del 2024-08-08T23:35:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.249+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~YN7XRLINCUSS.0 size=93667 2024-08-08T23:35:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.249+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=YN7XRLINCUSS tag=PV1N2W1VMPG5 type=write size=1142243 2024-08-08T23:35:47.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.253+0000 7fdbd6e2c8c0 1 < suggested update operation key=41XLZV9ZY5OP tag=1EY733PVOD62 type=del size=2435882 2024-08-08T23:35:47.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.261+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~5P4XUID0XJRK.0 size=1048576 2024-08-08T23:35:47.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.261+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~5P4XUID0XJRK.1 size=272796 2024-08-08T23:35:47.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.261+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=5P4XUID0XJRK tag=9RCGQDXLVT13 type=write size=2369948 2024-08-08T23:35:47.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.261+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~OW56F5Q5QCRC.0 size=1048576 2024-08-08T23:35:47.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.265+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~OW56F5Q5QCRC.1 size=730947 2024-08-08T23:35:47.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.265+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=OW56F5Q5QCRC tag=872VV35E26SK type=write size=2828099 2024-08-08T23:35:47.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.269+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=J0Q1N1B3B8SM type=del size=1743321 2024-08-08T23:35:47.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.269+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~02DGTEZUAEAH.0 size=1048576 2024-08-08T23:35:47.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.273+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~02DGTEZUAEAH.1 size=423221 2024-08-08T23:35:47.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.273+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=02DGTEZUAEAH tag=PHZ11F6WVHX2 type=write size=2520373 2024-08-08T23:35:47.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.277+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.0 size=1048576 2024-08-08T23:35:47.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.281+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.1 size=1048576 2024-08-08T23:35:47.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.281+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.2 size=847789 2024-08-08T23:35:47.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.281+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=9PQP91ZQJD0E tag=6IY37J5YI7JF type=write size=3993517 2024-08-08T23:35:47.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.285+0000 7fdbd6e2c8c0 1 < suggested update operation key=QHN8QYEEOHYO tag=QAUIUT3EWKFK type=del size=1234782 2024-08-08T23:35:47.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.289+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=HA6UM9NE01LZ type=del size=1754665 2024-08-08T23:35:47.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.289+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~MYIFHGE15411.0 size=1048576 2024-08-08T23:35:47.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.289+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~MYIFHGE15411.1 size=813023 2024-08-08T23:35:47.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.293+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=MYIFHGE15411 tag=Z60M7GMNQ9BW type=write size=2910175 2024-08-08T23:35:47.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.297+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=9PX7TGHO1QNQ type=del size=2827444 2024-08-08T23:35:47.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.297+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~7EK2WNP0QOCE.0 size=690914 2024-08-08T23:35:47.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.301+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=7EK2WNP0QOCE tag=8UB1JJ45I2XH type=write size=1739490 2024-08-08T23:35:47.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.305+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.0 size=1048576 2024-08-08T23:35:47.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.309+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.1 size=1048576 2024-08-08T23:35:47.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.309+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.2 size=1000509 2024-08-08T23:35:47.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.309+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=2HLGW95JVT2B tag=V5XUFRP2XOAF type=write size=4146237 2024-08-08T23:35:47.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.313+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=ZYWA8NCML5Z2 type=del 2024-08-08T23:35:47.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.317+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.0 size=1048576 2024-08-08T23:35:47.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.317+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.1 size=1048576 2024-08-08T23:35:47.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.321+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.2 size=101654 2024-08-08T23:35:47.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.321+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=ISQCOO8T8Y2S tag=HS3T6O9YI34C type=write size=3247382 2024-08-08T23:35:47.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.325+0000 7fdbd6e2c8c0 1 < suggested update operation key=JWTLJG79MYI5 tag=Z2COTXT19MQP type=del size=1857022 2024-08-08T23:35:47.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.329+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=Y0HHN4X7FOKQ type=del size=32235 2024-08-08T23:35:47.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.333+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~VAHAIHZ7S97W.0 size=1048576 2024-08-08T23:35:47.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.333+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~VAHAIHZ7S97W.1 size=652473 2024-08-08T23:35:47.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.337+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=VAHAIHZ7S97W tag=Z7P28XEN8BDV type=write size=2749625 2024-08-08T23:35:47.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.341+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=HL66HLEWTJTF type=write size=444552 2024-08-08T23:35:47.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.345+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.0 size=1048576 2024-08-08T23:35:47.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.345+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.1 size=1048576 2024-08-08T23:35:47.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.349+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~4SVWDTHHDQQ0.2 size=55382 2024-08-08T23:35:47.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.353+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=4SVWDTHHDQQ0 tag=ERUERQJ7X52C type=write size=3201110 2024-08-08T23:35:47.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.357+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.0 size=1048576 2024-08-08T23:35:47.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.357+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.1 size=1048576 2024-08-08T23:35:47.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.361+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.2 size=128109 2024-08-08T23:35:47.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.361+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=4A5QZD173KDR tag=4TUNM2HG2541 type=write size=3273837 2024-08-08T23:35:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.361+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~LLUGOYMJ3DCF.0 size=155874 2024-08-08T23:35:47.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.369+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=LLUGOYMJ3DCF tag=NZF2FRC8M0YL type=write size=1204450 2024-08-08T23:35:47.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.369+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=83HCYFP7ZFTU type=del size=3273744 2024-08-08T23:35:47.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.373+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.0 size=1048576 2024-08-08T23:35:47.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.373+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.1 size=1048576 2024-08-08T23:35:47.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.373+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~D9CG6GIK228I.2 size=395040 2024-08-08T23:35:47.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.377+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=D9CG6GIK228I tag=EZHXXKFY68HV type=write size=3540768 2024-08-08T23:35:47.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.381+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=1A7O6OBVLNR3 type=del size=1105487 2024-08-08T23:35:47.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.385+0000 7fdbd6e2c8c0 1 < suggested update operation key=D81PQ0FJVNEE tag=XQB28XG42SQJ type=write size=872740 2024-08-08T23:35:47.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.389+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=9W9PKUHE1G4O type=write size=735308 2024-08-08T23:35:47.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.389+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.0 size=1048576 2024-08-08T23:35:47.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.393+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.1 size=1048576 2024-08-08T23:35:47.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.393+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~O5LAFI2SYPXO.2 size=212999 2024-08-08T23:35:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.397+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=O5LAFI2SYPXO tag=2V35C5W4QFOE type=write size=3358727 2024-08-08T23:35:47.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.397+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=I4IH86FQPT6V type=write size=614357 2024-08-08T23:35:47.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.401+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=ZAVSZ7X4UOBA type=write size=736984 2024-08-08T23:35:47.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.401+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=8W2AYZRWFE7I type=del size=1441740 2024-08-08T23:35:47.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.405+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~YN7XRLINCUSS.0 size=93667 2024-08-08T23:35:47.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.409+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=YN7XRLINCUSS tag=PV1N2W1VMPG5 type=write size=1142243 2024-08-08T23:35:47.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.413+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~4TW1V8WVHO62.0 size=453501 2024-08-08T23:35:47.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.413+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=4TW1V8WVHO62 tag=1I0ECZWA1WH1 type=write size=1502077 2024-08-08T23:35:47.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.413+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~5P4XUID0XJRK.0 size=1048576 2024-08-08T23:35:47.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.417+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~5P4XUID0XJRK.1 size=272796 2024-08-08T23:35:47.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.421+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=5P4XUID0XJRK tag=9RCGQDXLVT13 type=write size=2369948 2024-08-08T23:35:47.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.421+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=ZA01QDE0D953 type=del size=3088858 2024-08-08T23:35:47.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.425+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=J0Q1N1B3B8SM type=del size=1743321 2024-08-08T23:35:47.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.429+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.0 size=1048576 2024-08-08T23:35:47.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.433+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.1 size=1048576 2024-08-08T23:35:47.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.433+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.2 size=812860 2024-08-08T23:35:47.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.433+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=YU1XHSEZJP31 tag=ZMKW7Q9E9G9F type=write size=3958588 2024-08-08T23:35:47.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.437+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.0 size=1048576 2024-08-08T23:35:47.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.437+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.1 size=1048576 2024-08-08T23:35:47.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.437+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~9PQP91ZQJD0E.2 size=847789 2024-08-08T23:35:47.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.441+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QANZ3YTL2NQV upload=9PQP91ZQJD0E tag=6IY37J5YI7JF type=write size=3993517 2024-08-08T23:35:47.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.445+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=HYNSDFB72CV0 type=del size=2074892 2024-08-08T23:35:47.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.445+0000 7fdbd6e2c8c0 1 < canceled operation key=ZBEB2Q3J9Z0D tag=HA6UM9NE01LZ type=del size=1754665 2024-08-08T23:35:47.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.449+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=97ONQFF7XL1M type=write size=557156 2024-08-08T23:35:47.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.453+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QANZ3YTL2NQV tag=9PX7TGHO1QNQ type=del 2024-08-08T23:35:47.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.453+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=PGQS2QZ9LXOJ type=del size=3584289 2024-08-08T23:35:47.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.457+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.0 size=1048576 2024-08-08T23:35:47.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.457+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.1 size=1048576 2024-08-08T23:35:47.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.461+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~2HLGW95JVT2B.2 size=1000509 2024-08-08T23:35:47.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.461+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=2HLGW95JVT2B tag=V5XUFRP2XOAF type=write size=4146237 2024-08-08T23:35:47.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.465+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=0TDLGJ06X1Y9 type=del size=3663930 2024-08-08T23:35:47.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.465+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.0 size=1048576 2024-08-08T23:35:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.465+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.1 size=1048576 2024-08-08T23:35:47.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.469+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~ISQCOO8T8Y2S.2 size=101654 2024-08-08T23:35:47.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.473+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=41XLZV9ZY5OP upload=ISQCOO8T8Y2S tag=HS3T6O9YI34C type=write size=3247382 2024-08-08T23:35:47.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.473+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=U3UJ0C58UQVD type=del size=2139160 2024-08-08T23:35:47.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.477+0000 7fdbd6e2c8c0 1 < canceled operation key=W5OVPO7BGE4S tag=Y0HHN4X7FOKQ type=del size=32235 2024-08-08T23:35:47.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.477+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=SW7R315DYAMX type=del size=3925153 2024-08-08T23:35:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.481+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=HL66HLEWTJTF type=write size=444552 2024-08-08T23:35:47.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.485+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=CBU5E88NM6P4 type=del size=3616302 2024-08-08T23:35:47.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.485+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.0 size=1048576 2024-08-08T23:35:47.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.489+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.1 size=1048576 2024-08-08T23:35:47.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.489+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_0MT9FJO58ELX.2~4A5QZD173KDR.2 size=128109 2024-08-08T23:35:47.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.493+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=0MT9FJO58ELX upload=4A5QZD173KDR tag=4TUNM2HG2541 type=write size=3273837 2024-08-08T23:35:47.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.497+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=H793S3GW1BUR type=del size=1825620 2024-08-08T23:35:47.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.501+0000 7fdbd6e2c8c0 1 < suggested update operation key=VGT9IXWM956F tag=83HCYFP7ZFTU type=del size=3273744 2024-08-08T23:35:47.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.505+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=RQSMF17TJ7B5 type=del size=3463895 2024-08-08T23:35:47.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.505+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=1A7O6OBVLNR3 type=del size=1105487 2024-08-08T23:35:47.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.513+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~RKZ9OA7JYTXT.0 size=645849 2024-08-08T23:35:47.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.513+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=RKZ9OA7JYTXT tag=3B6NR9AR3C2K type=write size=1694425 2024-08-08T23:35:47.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.513+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=9W9PKUHE1G4O type=write size=735308 2024-08-08T23:35:47.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.517+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=OI2RLKRU5V1G type=del size=1230846 2024-08-08T23:35:47.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.521+0000 7fdbd6e2c8c0 1 < completed write operation key=2SO6IPMXZUUI tag=I4IH86FQPT6V type=write size=614357 2024-08-08T23:35:47.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.521+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=9AFNGUDFUCCW type=del size=142352 2024-08-08T23:35:47.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.525+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=8W2AYZRWFE7I type=del 2024-08-08T23:35:47.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.525+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=CU6BMI1VLTJ8 type=write size=537358 2024-08-08T23:35:47.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.529+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_W5OVPO7BGE4S.2~4TW1V8WVHO62.0 size=453501 2024-08-08T23:35:47.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.533+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=W5OVPO7BGE4S upload=4TW1V8WVHO62 tag=1I0ECZWA1WH1 type=write size=1502077 2024-08-08T23:35:47.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.537+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~06NMEXIUK7SH.0 size=1048576 2024-08-08T23:35:47.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.541+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~06NMEXIUK7SH.1 size=881247 2024-08-08T23:35:47.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.541+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=06NMEXIUK7SH tag=YI03Z5SSNI19 type=write size=2978399 2024-08-08T23:35:47.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.541+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=ZA01QDE0D953 type=del 2024-08-08T23:35:47.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.549+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~CDRFKWOPEXGQ.0 size=806206 2024-08-08T23:35:47.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.549+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=CDRFKWOPEXGQ tag=1Y9UUT3M3NZJ type=write size=1854782 2024-08-08T23:35:47.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.553+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.0 size=1048576 2024-08-08T23:35:47.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.553+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.1 size=1048576 2024-08-08T23:35:47.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.553+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YNQU8Z202QCM.2~YU1XHSEZJP31.2 size=812860 2024-08-08T23:35:47.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.557+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YNQU8Z202QCM upload=YU1XHSEZJP31 tag=ZMKW7Q9E9G9F type=write size=3958588 2024-08-08T23:35:47.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.565+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.0 size=1048576 2024-08-08T23:35:47.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.565+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.1 size=1048576 2024-08-08T23:35:47.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.569+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.2 size=947910 2024-08-08T23:35:47.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.569+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=W1BS0QF2T4DK tag=IPR7TW0PTKW4 type=write size=4093638 2024-08-08T23:35:47.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.569+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=HYNSDFB72CV0 type=del 2024-08-08T23:35:47.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.573+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=QIJS4VTFZ95J type=del size=2246195 2024-08-08T23:35:47.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.577+0000 7fdbd6e2c8c0 1 < suggested update operation key=XIXN9HLLSJS3 tag=97ONQFF7XL1M type=write size=557156 2024-08-08T23:35:47.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.581+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=K5SMO3GC5XS2 type=del size=1850942 2024-08-08T23:35:47.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.585+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=PGQS2QZ9LXOJ type=del 2024-08-08T23:35:47.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.585+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=UQYAG4580VX4 type=del size=2444813 2024-08-08T23:35:47.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.589+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=0TDLGJ06X1Y9 type=del 2024-08-08T23:35:47.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.593+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=3H5OU6WWDPW8 type=del size=650119 2024-08-08T23:35:47.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.593+0000 7fdbd6e2c8c0 1 < canceled operation key=0MT9FJO58ELX tag=U3UJ0C58UQVD type=del size=2139160 2024-08-08T23:35:47.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.601+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.0 size=1048576 2024-08-08T23:35:47.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.601+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.1 size=1048576 2024-08-08T23:35:47.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.605+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.2 size=700109 2024-08-08T23:35:47.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.605+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=EYL1VBVA0MD0 tag=R0A2HZC5Y5OQ type=write size=3845837 2024-08-08T23:35:47.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.605+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=SW7R315DYAMX type=del 2024-08-08T23:35:47.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.609+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=T2I208CJVPK6 type=del size=3465006 2024-08-08T23:35:47.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.613+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=CBU5E88NM6P4 type=del 2024-08-08T23:35:47.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.617+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~EMXAM1QON30G.0 size=1048576 2024-08-08T23:35:47.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.617+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~EMXAM1QON30G.1 size=301417 2024-08-08T23:35:47.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.617+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=EMXAM1QON30G tag=7TXJ1EYIRQVK type=write size=2398569 2024-08-08T23:35:47.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.621+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=H793S3GW1BUR type=del 2024-08-08T23:35:47.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.625+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=YKNTC7ZTGYAE type=del size=3259069 2024-08-08T23:35:47.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.625+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=RQSMF17TJ7B5 type=del 2024-08-08T23:35:47.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.629+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.0 size=1048576 2024-08-08T23:35:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.633+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.1 size=1048576 2024-08-08T23:35:47.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.637+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.2 size=403510 2024-08-08T23:35:47.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.637+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=IB26XHYO30KM tag=5F1HDINJ3QCR type=write size=3549238 2024-08-08T23:35:47.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.637+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~RKZ9OA7JYTXT.0 size=645849 2024-08-08T23:35:47.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.641+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=RKZ9OA7JYTXT tag=3B6NR9AR3C2K type=write size=1694425 2024-08-08T23:35:47.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.649+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.0 size=1048576 2024-08-08T23:35:47.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.649+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.1 size=1048576 2024-08-08T23:35:47.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.653+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.2 size=880967 2024-08-08T23:35:47.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.653+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=ASGBSQ6TK23P tag=RSEN9KI9XG3M type=write size=4026695 2024-08-08T23:35:47.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.657+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=OI2RLKRU5V1G type=del 2024-08-08T23:35:47.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.0 size=1048576 2024-08-08T23:35:47.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.1 size=1048576 2024-08-08T23:35:47.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.665+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.2 size=470963 2024-08-08T23:35:47.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.665+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=T3AG6PXSVD29 tag=6KL4JBEIIJ83 type=write size=3616691 2024-08-08T23:35:47.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.669+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=9AFNGUDFUCCW type=del size=142352 2024-08-08T23:35:47.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.673+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=1RXC5LQ2W493 type=del size=1040484 2024-08-08T23:35:47.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.681+0000 7fdbd6e2c8c0 1 < suggested update operation key=464D0ROM6MHO tag=CU6BMI1VLTJ8 type=write size=537358 2024-08-08T23:35:47.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.685+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=K2AMJYVOQNR8 type=del size=3449293 2024-08-08T23:35:47.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.685+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~06NMEXIUK7SH.0 size=1048576 2024-08-08T23:35:47.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.689+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~06NMEXIUK7SH.1 size=881247 2024-08-08T23:35:47.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.693+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=06NMEXIUK7SH tag=YI03Z5SSNI19 type=write size=2978399 2024-08-08T23:35:47.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.701+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.0 size=1048576 2024-08-08T23:35:47.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.701+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.1 size=1048576 2024-08-08T23:35:47.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.705+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.2 size=790187 2024-08-08T23:35:47.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.705+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=CH0VAOSBCAHG tag=G2LJU8EE8M43 type=write size=3935915 2024-08-08T23:35:47.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.709+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~CDRFKWOPEXGQ.0 size=806206 2024-08-08T23:35:47.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.713+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=CDRFKWOPEXGQ tag=1Y9UUT3M3NZJ type=write size=1854782 2024-08-08T23:35:47.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.717+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~IFJHZN14S264.0 size=1027110 2024-08-08T23:35:47.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.717+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=IFJHZN14S264 tag=NZ1H30W064AN type=write size=2075686 2024-08-08T23:35:47.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.721+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.0 size=1048576 2024-08-08T23:35:47.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.721+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.1 size=1048576 2024-08-08T23:35:47.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.721+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~W1BS0QF2T4DK.2 size=947910 2024-08-08T23:35:47.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.729+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=W1BS0QF2T4DK tag=IPR7TW0PTKW4 type=write size=4093638 2024-08-08T23:35:47.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.733+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=CUZHLT07744V type=del size=2278694 2024-08-08T23:35:47.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.737+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=QIJS4VTFZ95J type=del size=2246195 2024-08-08T23:35:47.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.741+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=VWVHKSCSUN3L type=del size=1173324 2024-08-08T23:35:47.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.745+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=K5SMO3GC5XS2 type=del 2024-08-08T23:35:47.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.749+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=8X9CTI1C3B0L type=del size=683158 2024-08-08T23:35:47.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.753+0000 7fdbd6e2c8c0 1 < suggested update operation key=63GVT7KRKCSS tag=UQYAG4580VX4 type=del size=2444813 2024-08-08T23:35:47.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.757+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~CTV27RB03IOE.0 size=1048576 2024-08-08T23:35:47.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.761+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~CTV27RB03IOE.1 size=1007594 2024-08-08T23:35:47.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.761+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=CTV27RB03IOE tag=3Y07PYIU6IFP type=write size=3104746 2024-08-08T23:35:47.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.765+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=3H5OU6WWDPW8 type=del 2024-08-08T23:35:47.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.765+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=V658RMGD4R1T type=del size=1647612 2024-08-08T23:35:47.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.769+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.0 size=1048576 2024-08-08T23:35:47.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.773+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.1 size=1048576 2024-08-08T23:35:47.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.773+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_0XF26POOKR3V.2~EYL1VBVA0MD0.2 size=700109 2024-08-08T23:35:47.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.777+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=0XF26POOKR3V upload=EYL1VBVA0MD0 tag=R0A2HZC5Y5OQ type=write size=3845837 2024-08-08T23:35:47.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.781+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.0 size=1048576 2024-08-08T23:35:47.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.785+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.1 size=1048576 2024-08-08T23:35:47.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.785+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.2 size=653018 2024-08-08T23:35:47.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.785+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=B5PW25YPN053 tag=I824JHKAD7JG type=write size=3798746 2024-08-08T23:35:47.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.793+0000 7fdbd6e2c8c0 1 < suggested remove operation key=NMB4GI8R2BKU tag=T2I208CJVPK6 type=del 2024-08-08T23:35:47.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.797+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~SO4YVMVFEFXX.0 size=1048576 2024-08-08T23:35:47.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.801+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~SO4YVMVFEFXX.1 size=519332 2024-08-08T23:35:47.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.801+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=SO4YVMVFEFXX tag=P06VIV0QI66L type=write size=2616484 2024-08-08T23:35:47.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.801+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V6GSJH62C8TA.2~EMXAM1QON30G.0 size=1048576 2024-08-08T23:35:47.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.801+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V6GSJH62C8TA.2~EMXAM1QON30G.1 size=301417 2024-08-08T23:35:47.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.805+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V6GSJH62C8TA upload=EMXAM1QON30G tag=7TXJ1EYIRQVK type=write size=2398569 2024-08-08T23:35:47.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.813+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=B2U2RS20IDA8 type=write size=208226 2024-08-08T23:35:47.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.817+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=YKNTC7ZTGYAE type=del 2024-08-08T23:35:47.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.817+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=RVEJ5WN42O1S type=del size=3361073 2024-08-08T23:35:47.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.821+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.0 size=1048576 2024-08-08T23:35:47.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.825+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.1 size=1048576 2024-08-08T23:35:47.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.829+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IB26XHYO30KM.2 size=403510 2024-08-08T23:35:47.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.841+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=IB26XHYO30KM tag=5F1HDINJ3QCR type=write size=3549238 2024-08-08T23:35:47.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.845+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=LME88M5WM7IA type=del size=1159832 2024-08-08T23:35:47.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.845+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.0 size=1048576 2024-08-08T23:35:47.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.845+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.1 size=1048576 2024-08-08T23:35:47.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.849+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~ASGBSQ6TK23P.2 size=880967 2024-08-08T23:35:47.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.853+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=ASGBSQ6TK23P tag=RSEN9KI9XG3M type=write size=4026695 2024-08-08T23:35:47.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.857+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=UE41ENGXDEX4 type=del size=2320122 2024-08-08T23:35:47.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.857+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.0 size=1048576 2024-08-08T23:35:47.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.861+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.1 size=1048576 2024-08-08T23:35:47.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.861+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~T3AG6PXSVD29.2 size=470963 2024-08-08T23:35:47.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.865+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=T3AG6PXSVD29 tag=6KL4JBEIIJ83 type=write size=3616691 2024-08-08T23:35:47.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.869+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=9IMZ3G631TN2 type=del size=3758269 2024-08-08T23:35:47.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.873+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=1RXC5LQ2W493 type=del 2024-08-08T23:35:47.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.873+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=KFQ4O1MLFFL1 type=write size=224411 2024-08-08T23:35:47.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.877+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=K2AMJYVOQNR8 type=del 2024-08-08T23:35:47.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.881+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=7QWSXQANC76K type=del size=2758643 2024-08-08T23:35:47.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.881+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.0 size=1048576 2024-08-08T23:35:47.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.885+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.1 size=1048576 2024-08-08T23:35:47.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.885+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~CH0VAOSBCAHG.2 size=790187 2024-08-08T23:35:47.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.893+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=CH0VAOSBCAHG tag=G2LJU8EE8M43 type=write size=3935915 2024-08-08T23:35:47.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.893+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=INTRWQF8OXK8 type=del size=1484720 2024-08-08T23:35:47.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.897+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~IFJHZN14S264.0 size=1027110 2024-08-08T23:35:47.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.901+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=IFJHZN14S264 tag=NZ1H30W064AN type=write size=2075686 2024-08-08T23:35:47.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.0 size=1048576 2024-08-08T23:35:47.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.909+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.1 size=1048576 2024-08-08T23:35:47.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.909+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.2 size=713337 2024-08-08T23:35:47.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.909+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=HFIWEFI23BXC tag=K1AJOAZ5DFMA type=write size=3859065 2024-08-08T23:35:47.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.913+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=CUZHLT07744V type=del 2024-08-08T23:35:47.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.913+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=G9GBX4Q3ETRP type=del size=312035 2024-08-08T23:35:47.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.917+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=VWVHKSCSUN3L type=del 2024-08-08T23:35:47.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.921+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=QVCB1525QRCJ type=del size=3251988 2024-08-08T23:35:47.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.921+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=8X9CTI1C3B0L type=del 2024-08-08T23:35:47.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.925+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=JN7HBBGM9QG1 type=del size=2448731 2024-08-08T23:35:47.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~CTV27RB03IOE.0 size=1048576 2024-08-08T23:35:47.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~CTV27RB03IOE.1 size=1007594 2024-08-08T23:35:47.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.933+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=CTV27RB03IOE tag=3Y07PYIU6IFP type=write size=3104746 2024-08-08T23:35:47.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.937+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=6XI2BK2KY771 type=del size=1828481 2024-08-08T23:35:47.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.941+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=V658RMGD4R1T type=del 2024-08-08T23:35:47.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.941+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=CM21L965TYSU type=write size=441947 2024-08-08T23:35:47.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.945+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.0 size=1048576 2024-08-08T23:35:47.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.945+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.1 size=1048576 2024-08-08T23:35:47.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.949+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~B5PW25YPN053.2 size=653018 2024-08-08T23:35:47.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.953+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=Z5EXY8ZHZCHI upload=B5PW25YPN053 tag=I824JHKAD7JG type=write size=3798746 2024-08-08T23:35:47.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.957+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~YFD0PH47WHBN.0 size=1048576 2024-08-08T23:35:47.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.961+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~YFD0PH47WHBN.1 size=838926 2024-08-08T23:35:47.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.961+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=YFD0PH47WHBN tag=O350WVZYF68B type=write size=2936078 2024-08-08T23:35:47.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.961+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~SO4YVMVFEFXX.0 size=1048576 2024-08-08T23:35:47.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.965+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~SO4YVMVFEFXX.1 size=519332 2024-08-08T23:35:47.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.969+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=SO4YVMVFEFXX tag=P06VIV0QI66L type=write size=2616484 2024-08-08T23:35:47.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.973+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=0FSJFAMXBXQK type=write size=151693 2024-08-08T23:35:47.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.977+0000 7fdbd6e2c8c0 1 < completed write operation key=V3TA5KZ95NXT tag=B2U2RS20IDA8 type=write size=208226 2024-08-08T23:35:47.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.981+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=L3J233DUR64H type=del size=304891 2024-08-08T23:35:47.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.985+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=RVEJ5WN42O1S type=del 2024-08-08T23:35:47.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.985+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=JGV9BGV4OFGB type=del size=3735204 2024-08-08T23:35:47.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.993+0000 7fdbd6e2c8c0 1 < suggested update operation key=V6GSJH62C8TA tag=LME88M5WM7IA type=del size=1159832 2024-08-08T23:35:47.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:47.997+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~FSGICA3FXU1Q.0 size=1048576 2024-08-08T23:35:48.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.001+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~FSGICA3FXU1Q.1 size=957521 2024-08-08T23:35:48.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.001+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=FSGICA3FXU1Q tag=M5JZDHHVS7ST type=write size=3054673 2024-08-08T23:35:48.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.005+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=UE41ENGXDEX4 type=del 2024-08-08T23:35:48.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.009+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=LMS51I7Z847I type=del size=2110531 2024-08-08T23:35:48.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.013+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=9IMZ3G631TN2 type=del 2024-08-08T23:35:48.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.013+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=I0PN1JRNVFNA type=del size=1874075 2024-08-08T23:35:48.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.017+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=KFQ4O1MLFFL1 type=write size=224411 2024-08-08T23:35:48.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.021+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=02U1Y0HPDYJM type=del size=1869045 2024-08-08T23:35:48.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.025+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=7QWSXQANC76K type=del 2024-08-08T23:35:48.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.029+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~4YUESWPDXVD6.0 size=1048576 2024-08-08T23:35:48.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.033+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~4YUESWPDXVD6.1 size=126826 2024-08-08T23:35:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.033+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=4YUESWPDXVD6 tag=I272LVLB5SLE type=write size=2223978 2024-08-08T23:35:48.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.041+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=INTRWQF8OXK8 type=del 2024-08-08T23:35:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.041+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=FTHURVVYBGBX type=del size=4161795 2024-08-08T23:35:48.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.045+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.0 size=1048576 2024-08-08T23:35:48.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.045+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.1 size=1048576 2024-08-08T23:35:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.049+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~HFIWEFI23BXC.2 size=713337 2024-08-08T23:35:48.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.053+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VSLBN9AVZK00 upload=HFIWEFI23BXC tag=K1AJOAZ5DFMA type=write size=3859065 2024-08-08T23:35:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.061+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.0 size=1048576 2024-08-08T23:35:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.065+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.1 size=1048576 2024-08-08T23:35:48.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.065+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.2 size=239912 2024-08-08T23:35:48.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.065+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=IOC3LLM5BRMF tag=2WFYYNF38U2T type=write size=3385640 2024-08-08T23:35:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.073+0000 7fdbd6e2c8c0 1 < suggested update operation key=QWRYLH4P94BQ tag=G9GBX4Q3ETRP type=del size=312035 2024-08-08T23:35:48.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.081+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~6GB4ROPBVJZ4.0 size=1048576 2024-08-08T23:35:48.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.081+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~6GB4ROPBVJZ4.1 size=406019 2024-08-08T23:35:48.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.081+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=6GB4ROPBVJZ4 tag=VR28DHHZM2DD type=write size=2503171 2024-08-08T23:35:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.085+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=QVCB1525QRCJ type=del 2024-08-08T23:35:48.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.093+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~J7KZ2DT3LVZ1.0 size=1048576 2024-08-08T23:35:48.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.097+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~J7KZ2DT3LVZ1.1 size=250576 2024-08-08T23:35:48.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.097+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=J7KZ2DT3LVZ1 tag=RVRRN296C9IM type=write size=2347728 2024-08-08T23:35:48.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.105+0000 7fdbd6e2c8c0 1 < suggested remove operation key=464D0ROM6MHO tag=JN7HBBGM9QG1 type=del 2024-08-08T23:35:48.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.109+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=XJTZ1XSF3MKM type=del size=234577 2024-08-08T23:35:48.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.113+0000 7fdbd6e2c8c0 1 < suggested update operation key=903K2EO77YTJ tag=6XI2BK2KY771 type=del size=1828481 2024-08-08T23:35:48.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.121+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~QF2FZ5M84JH7.0 size=1048576 2024-08-08T23:35:48.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.121+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~QF2FZ5M84JH7.1 size=777382 2024-08-08T23:35:48.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.121+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=QF2FZ5M84JH7 tag=EJ5FMNXAB3YK type=write size=2874534 2024-08-08T23:35:48.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.125+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=CM21L965TYSU type=write size=441947 2024-08-08T23:35:48.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.129+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=6L8YPULI323C type=write size=754399 2024-08-08T23:35:48.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.129+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~YFD0PH47WHBN.0 size=1048576 2024-08-08T23:35:48.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.133+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~YFD0PH47WHBN.1 size=838926 2024-08-08T23:35:48.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.137+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=YFD0PH47WHBN tag=O350WVZYF68B type=write size=2936078 2024-08-08T23:35:48.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.145+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~PXK245AFQELF.0 size=257115 2024-08-08T23:35:48.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.145+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=PXK245AFQELF tag=DORC6R1VO4DS type=write size=1305691 2024-08-08T23:35:48.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.149+0000 7fdbd6e2c8c0 1 < completed write operation key=FBCEC998C8EJ tag=0FSJFAMXBXQK type=write size=151693 2024-08-08T23:35:48.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.153+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~XUMH1B931S4W.0 size=1048576 2024-08-08T23:35:48.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.157+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~XUMH1B931S4W.1 size=123331 2024-08-08T23:35:48.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.157+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=XUMH1B931S4W tag=PEB2MFWR23EQ type=write size=2220483 2024-08-08T23:35:48.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.161+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=464D0ROM6MHO tag=L3J233DUR64H type=del size=304891: (22) Invalid argument 2024-08-08T23:35:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.165+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=EBB3EOGTJMM1 type=del size=2954787 2024-08-08T23:35:48.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.165+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=0MT9FJO58ELX tag=JGV9BGV4OFGB type=del size=3735204: (22) Invalid argument 2024-08-08T23:35:48.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.169+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=7HUFV6E4X33Q type=write size=930462 2024-08-08T23:35:48.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.173+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~FSGICA3FXU1Q.0 size=1048576 2024-08-08T23:35:48.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.177+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~FSGICA3FXU1Q.1 size=957521 2024-08-08T23:35:48.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.181+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=FSGICA3FXU1Q tag=M5JZDHHVS7ST type=write size=3054673 2024-08-08T23:35:48.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.189+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~IGP1GGILWSFP.0 size=1048576 2024-08-08T23:35:48.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.189+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~IGP1GGILWSFP.1 size=253977 2024-08-08T23:35:48.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.189+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=IGP1GGILWSFP tag=5CDNERD52PU2 type=write size=2351129 2024-08-08T23:35:48.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.193+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=LMS51I7Z847I type=del 2024-08-08T23:35:48.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.201+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~JJA3466Z4KID.0 size=1048576 2024-08-08T23:35:48.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.201+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~JJA3466Z4KID.1 size=622573 2024-08-08T23:35:48.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.201+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=JJA3466Z4KID tag=ZS609AC6MMLK type=write size=2719725 2024-08-08T23:35:48.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.205+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=I0PN1JRNVFNA type=del 2024-08-08T23:35:48.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.213+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.0 size=1048576 2024-08-08T23:35:48.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.213+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.1 size=1048576 2024-08-08T23:35:48.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.217+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.2 size=1010947 2024-08-08T23:35:48.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.217+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=E1UNPPXP9KAH tag=2CDQDBHN4D4Q type=write size=4156675 2024-08-08T23:35:48.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.221+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=02U1Y0HPDYJM type=del 2024-08-08T23:35:48.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.225+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=D20X61DD9F87 type=del size=2546223 2024-08-08T23:35:48.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.225+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~4YUESWPDXVD6.0 size=1048576 2024-08-08T23:35:48.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.229+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~4YUESWPDXVD6.1 size=126826 2024-08-08T23:35:48.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.233+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=4YUESWPDXVD6 tag=I272LVLB5SLE type=write size=2223978 2024-08-08T23:35:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.241+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~GNFKLWT1VE0D.0 size=904320 2024-08-08T23:35:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.241+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=GNFKLWT1VE0D tag=E0V5OCZTW65V type=write size=1952896 2024-08-08T23:35:48.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.249+0000 7fdbd6e2c8c0 1 < suggested update operation key=QJB9DETMSY4X tag=FTHURVVYBGBX type=del size=4161795 2024-08-08T23:35:48.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.253+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=PWZAK2O9SAW5 type=del size=4193422 2024-08-08T23:35:48.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.257+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.0 size=1048576 2024-08-08T23:35:48.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.257+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.1 size=1048576 2024-08-08T23:35:48.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.257+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YO2FZOR7H0EX.2~IOC3LLM5BRMF.2 size=239912 2024-08-08T23:35:48.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.265+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YO2FZOR7H0EX upload=IOC3LLM5BRMF tag=2WFYYNF38U2T type=write size=3385640 2024-08-08T23:35:48.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.269+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=OGLRNQKELKQ9 type=del size=2855544 2024-08-08T23:35:48.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.273+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~6GB4ROPBVJZ4.0 size=1048576 2024-08-08T23:35:48.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.273+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~6GB4ROPBVJZ4.1 size=406019 2024-08-08T23:35:48.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.281+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=6GB4ROPBVJZ4 tag=VR28DHHZM2DD type=write size=2503171 2024-08-08T23:35:48.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.285+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ROS1V7LXQK3V.0 size=1048576 2024-08-08T23:35:48.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.289+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ROS1V7LXQK3V.1 size=794180 2024-08-08T23:35:48.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.289+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=ROS1V7LXQK3V tag=TQIEGCGT3ATX type=write size=2891332 2024-08-08T23:35:48.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.289+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~J7KZ2DT3LVZ1.0 size=1048576 2024-08-08T23:35:48.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.293+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~J7KZ2DT3LVZ1.1 size=250576 2024-08-08T23:35:48.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.301+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=J7KZ2DT3LVZ1 tag=RVRRN296C9IM type=write size=2347728 2024-08-08T23:35:48.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.301+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=NA7S3BD27XS7 type=write size=473229 2024-08-08T23:35:48.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.305+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=XJTZ1XSF3MKM type=del 2024-08-08T23:35:48.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.313+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.0 size=1048576 2024-08-08T23:35:48.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.313+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.1 size=1048576 2024-08-08T23:35:48.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.317+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.2 size=326238 2024-08-08T23:35:48.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.317+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=RBAJRHDO2YU5 tag=2JJ214UN2BJL type=write size=3471966 2024-08-08T23:35:48.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.321+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~QF2FZ5M84JH7.0 size=1048576 2024-08-08T23:35:48.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.321+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~QF2FZ5M84JH7.1 size=777382 2024-08-08T23:35:48.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.325+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=QF2FZ5M84JH7 tag=EJ5FMNXAB3YK type=write size=2874534 2024-08-08T23:35:48.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.329+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=A224AD5BI90L type=write size=734155 2024-08-08T23:35:48.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.333+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=6L8YPULI323C type=write size=754399 2024-08-08T23:35:48.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.337+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=6E8QZAJF7K2T type=del size=351331 2024-08-08T23:35:48.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.337+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_XIXN9HLLSJS3.2~PXK245AFQELF.0 size=257115 2024-08-08T23:35:48.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.345+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=XIXN9HLLSJS3 upload=PXK245AFQELF tag=DORC6R1VO4DS type=write size=1305691 2024-08-08T23:35:48.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.349+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=VW327272FWNJ type=write size=1027828 2024-08-08T23:35:48.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.353+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~XUMH1B931S4W.0 size=1048576 2024-08-08T23:35:48.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.353+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~XUMH1B931S4W.1 size=123331 2024-08-08T23:35:48.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.361+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=XUMH1B931S4W tag=PEB2MFWR23EQ type=write size=2220483 2024-08-08T23:35:48.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.365+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=0MGQLZ16HOUM type=del size=3439063 2024-08-08T23:35:48.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.369+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=EBB3EOGTJMM1 type=del 2024-08-08T23:35:48.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.369+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=HKWKCFO04WTM type=del size=2582479 2024-08-08T23:35:48.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.373+0000 7fdbd6e2c8c0 1 < canceled operation key=Z5EXY8ZHZCHI tag=7HUFV6E4X33Q type=write size=930462 2024-08-08T23:35:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.377+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=1F6CUTWYY2R9 type=del size=2190354 2024-08-08T23:35:48.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.381+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~IGP1GGILWSFP.0 size=1048576 2024-08-08T23:35:48.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.385+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~IGP1GGILWSFP.1 size=253977 2024-08-08T23:35:48.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.389+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=IGP1GGILWSFP tag=5CDNERD52PU2 type=write size=2351129 2024-08-08T23:35:48.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.393+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=7TIKV33NJG86 type=del size=2394045 2024-08-08T23:35:48.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.397+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~JJA3466Z4KID.0 size=1048576 2024-08-08T23:35:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.401+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~JJA3466Z4KID.1 size=622573 2024-08-08T23:35:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.405+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=JJA3466Z4KID tag=ZS609AC6MMLK type=write size=2719725 2024-08-08T23:35:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.409+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=MV7INEXIQ5Q0 type=del size=1107922 2024-08-08T23:35:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.417+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.0 size=1048576 2024-08-08T23:35:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.417+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.1 size=1048576 2024-08-08T23:35:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.417+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~E1UNPPXP9KAH.2 size=1010947 2024-08-08T23:35:48.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.425+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=D81PQ0FJVNEE upload=E1UNPPXP9KAH tag=2CDQDBHN4D4Q type=write size=4156675 2024-08-08T23:35:48.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.429+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~73RW6TQ7G754.0 size=788994 2024-08-08T23:35:48.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.429+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=73RW6TQ7G754 tag=O03XDJV5BPN5 type=write size=1837570 2024-08-08T23:35:48.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.433+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=D20X61DD9F87 type=del 2024-08-08T23:35:48.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.437+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=JM0XCGR0CUVP type=del size=1758862 2024-08-08T23:35:48.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.441+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~GNFKLWT1VE0D.0 size=904320 2024-08-08T23:35:48.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.445+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=GNFKLWT1VE0D tag=E0V5OCZTW65V type=write size=1952896 2024-08-08T23:35:48.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.453+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~MLYSRSGMV77W.0 size=1048576 2024-08-08T23:35:48.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.453+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~MLYSRSGMV77W.1 size=874601 2024-08-08T23:35:48.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.453+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=MLYSRSGMV77W tag=6ZNAZFXMPAWN type=write size=2971753 2024-08-08T23:35:48.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.457+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=PWZAK2O9SAW5 type=del 2024-08-08T23:35:48.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.461+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=KIZUAM5FMTJU type=del size=693840 2024-08-08T23:35:48.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.461+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=OGLRNQKELKQ9 type=del 2024-08-08T23:35:48.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.465+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=62TR3C4PSU3Q type=del size=1777924 2024-08-08T23:35:48.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.469+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ROS1V7LXQK3V.0 size=1048576 2024-08-08T23:35:48.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.469+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ROS1V7LXQK3V.1 size=794180 2024-08-08T23:35:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.473+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=ROS1V7LXQK3V tag=TQIEGCGT3ATX type=write size=2891332 2024-08-08T23:35:48.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.481+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~1ASDLJ9NYROK.0 size=40605 2024-08-08T23:35:48.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.481+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=1ASDLJ9NYROK tag=JCNCNDHF8IZM type=write size=1089181 2024-08-08T23:35:48.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.481+0000 7fdbd6e2c8c0 1 < completed write operation key=MNV404EWJHC1 tag=NA7S3BD27XS7 type=write size=473229 2024-08-08T23:35:48.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.485+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=8HQTUBFXYTIO type=write size=364099 2024-08-08T23:35:48.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.489+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.0 size=1048576 2024-08-08T23:35:48.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.489+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.1 size=1048576 2024-08-08T23:35:48.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.489+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~RBAJRHDO2YU5.2 size=326238 2024-08-08T23:35:48.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.493+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=RBAJRHDO2YU5 tag=2JJ214UN2BJL type=write size=3471966 2024-08-08T23:35:48.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.497+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=ZCMZAKCXDT0H type=del size=3150967 2024-08-08T23:35:48.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.497+0000 7fdbd6e2c8c0 1 < completed write operation key=0MT9FJO58ELX tag=A224AD5BI90L type=write size=734155 2024-08-08T23:35:48.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.501+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.0 size=1048576 2024-08-08T23:35:48.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.505+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.1 size=1048576 2024-08-08T23:35:48.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.505+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.2 size=935191 2024-08-08T23:35:48.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.505+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=FS26SQ6VO46M tag=FVA83ZS9WFHL type=write size=4080919 2024-08-08T23:35:48.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.509+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=6E8QZAJF7K2T type=del 2024-08-08T23:35:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.513+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~5JLIKATHFJII.0 size=1047293 2024-08-08T23:35:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.513+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=5JLIKATHFJII tag=O7CBQPO1VFYZ type=write size=2095869 2024-08-08T23:35:48.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.517+0000 7fdbd6e2c8c0 1 < completed write operation key=QHN8QYEEOHYO tag=VW327272FWNJ type=write size=1027828 2024-08-08T23:35:48.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.521+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=JLHJ4O56GWD9 type=del size=1495179 2024-08-08T23:35:48.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.525+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=0MGQLZ16HOUM type=del 2024-08-08T23:35:48.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.529+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~5LPXQ2SIZKVB.0 size=1048576 2024-08-08T23:35:48.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.529+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~5LPXQ2SIZKVB.1 size=932337 2024-08-08T23:35:48.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.529+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=5LPXQ2SIZKVB tag=32NGHD2XUT58 type=write size=3029489 2024-08-08T23:35:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.533+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=HKWKCFO04WTM type=del 2024-08-08T23:35:48.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.537+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.0 size=1048576 2024-08-08T23:35:48.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.541+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.1 size=1048576 2024-08-08T23:35:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.541+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.2 size=392112 2024-08-08T23:35:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.541+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=R72IQ3W2MVWE tag=3T7OJ51GEK41 type=write size=3537840 2024-08-08T23:35:48.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.545+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=1F6CUTWYY2R9 type=del 2024-08-08T23:35:48.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.549+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.0 size=1048576 2024-08-08T23:35:48.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.553+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.1 size=1048576 2024-08-08T23:35:48.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.553+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.2 size=553689 2024-08-08T23:35:48.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.553+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=CGIOYC4MPQT5 tag=6MXBHFEXNLA1 type=write size=3699417 2024-08-08T23:35:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.557+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=7TIKV33NJG86 type=del 2024-08-08T23:35:48.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.561+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~UMV9EOW4CSDL.0 size=673784 2024-08-08T23:35:48.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.561+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=UMV9EOW4CSDL tag=C04WSUNIM3R6 type=write size=1722360 2024-08-08T23:35:48.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.569+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=MV7INEXIQ5Q0 type=del size=1107922 2024-08-08T23:35:48.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.573+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~YJYTK147HX39.0 size=630241 2024-08-08T23:35:48.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.573+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=YJYTK147HX39 tag=CJMZ7WY63UI4 type=write size=1678817 2024-08-08T23:35:48.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.573+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QJB9DETMSY4X.2~73RW6TQ7G754.0 size=788994 2024-08-08T23:35:48.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.577+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QJB9DETMSY4X upload=73RW6TQ7G754 tag=O03XDJV5BPN5 type=write size=1837570 2024-08-08T23:35:48.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.581+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=AXESFU13EH4Q type=del size=3540751 2024-08-08T23:35:48.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.581+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=JM0XCGR0CUVP type=del 2024-08-08T23:35:48.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.585+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=4UMQR2A62H0T type=del size=874798 2024-08-08T23:35:48.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.589+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~MLYSRSGMV77W.0 size=1048576 2024-08-08T23:35:48.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.589+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~MLYSRSGMV77W.1 size=874601 2024-08-08T23:35:48.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.597+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=MLYSRSGMV77W tag=6ZNAZFXMPAWN type=write size=2971753 2024-08-08T23:35:48.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.601+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~95VLFX0ZSEI6.0 size=1048576 2024-08-08T23:35:48.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.601+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~95VLFX0ZSEI6.1 size=59785 2024-08-08T23:35:48.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.601+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=95VLFX0ZSEI6 tag=9080N7TT8SHW type=write size=2156937 2024-08-08T23:35:48.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.609+0000 7fdbd6e2c8c0 1 < suggested update operation key=0XF26POOKR3V tag=KIZUAM5FMTJU type=del size=693840 2024-08-08T23:35:48.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.613+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=GMF3INCA5FO6 type=del size=4186405 2024-08-08T23:35:48.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.613+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=62TR3C4PSU3Q type=del 2024-08-08T23:35:48.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.617+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.0 size=1048576 2024-08-08T23:35:48.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.621+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.1 size=1048576 2024-08-08T23:35:48.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.621+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.2 size=5597 2024-08-08T23:35:48.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.621+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=5DKEO57FB8EF tag=HWOZDNCFITUG type=write size=3151325 2024-08-08T23:35:48.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.625+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_Z5EXY8ZHZCHI.2~1ASDLJ9NYROK.0 size=40605 2024-08-08T23:35:48.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.629+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=Z5EXY8ZHZCHI upload=1ASDLJ9NYROK tag=JCNCNDHF8IZM type=write size=1089181 2024-08-08T23:35:48.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.633+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~B0WQVY9DXBFR.0 size=1048576 2024-08-08T23:35:48.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.637+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~B0WQVY9DXBFR.1 size=37578 2024-08-08T23:35:48.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.637+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=B0WQVY9DXBFR tag=V488BLWMGWAD type=write size=2134730 2024-08-08T23:35:48.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.637+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=8HQTUBFXYTIO type=write size=364099 2024-08-08T23:35:48.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.641+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=JZHRN18ITCJR type=write size=312154 2024-08-08T23:35:48.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.645+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=ZCMZAKCXDT0H type=del 2024-08-08T23:35:48.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.649+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=1YUXO54WCLKB type=del size=770323 2024-08-08T23:35:48.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.649+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.0 size=1048576 2024-08-08T23:35:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.653+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.1 size=1048576 2024-08-08T23:35:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.653+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~FS26SQ6VO46M.2 size=935191 2024-08-08T23:35:48.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.661+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=FS26SQ6VO46M tag=FVA83ZS9WFHL type=write size=4080919 2024-08-08T23:35:48.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.661+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=HCZWPM40HB88 type=del size=2189560 2024-08-08T23:35:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.665+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~5JLIKATHFJII.0 size=1047293 2024-08-08T23:35:48.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.669+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=5JLIKATHFJII tag=O7CBQPO1VFYZ type=write size=2095869 2024-08-08T23:35:48.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.673+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=MNTIPK37VB2X type=del size=429336 2024-08-08T23:35:48.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.677+0000 7fdbd6e2c8c0 1 < canceled operation key=41XLZV9ZY5OP tag=JLHJ4O56GWD9 type=del size=1495179 2024-08-08T23:35:48.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.677+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=T6K1WDACF7R1 type=del size=322232 2024-08-08T23:35:48.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.681+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~5LPXQ2SIZKVB.0 size=1048576 2024-08-08T23:35:48.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.681+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~5LPXQ2SIZKVB.1 size=932337 2024-08-08T23:35:48.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.685+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=5LPXQ2SIZKVB tag=32NGHD2XUT58 type=write size=3029489 2024-08-08T23:35:48.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.689+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=KZGAIQHC3ET9 type=del size=1991272 2024-08-08T23:35:48.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.689+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.0 size=1048576 2024-08-08T23:35:48.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.693+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.1 size=1048576 2024-08-08T23:35:48.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.697+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~R72IQ3W2MVWE.2 size=392112 2024-08-08T23:35:48.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.701+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=R72IQ3W2MVWE tag=3T7OJ51GEK41 type=write size=3537840 2024-08-08T23:35:48.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.705+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.0 size=1048576 2024-08-08T23:35:48.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.709+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.1 size=1048576 2024-08-08T23:35:48.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.709+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.2 size=162070 2024-08-08T23:35:48.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.709+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=O9RCB1UU1JME tag=TSIKV0WQKPVV type=write size=3307798 2024-08-08T23:35:48.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.713+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.0 size=1048576 2024-08-08T23:35:48.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.713+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.1 size=1048576 2024-08-08T23:35:48.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.717+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~CGIOYC4MPQT5.2 size=553689 2024-08-08T23:35:48.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.721+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=CGIOYC4MPQT5 tag=6MXBHFEXNLA1 type=write size=3699417 2024-08-08T23:35:48.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.725+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~LVPMJKT2FRDF.0 size=345300 2024-08-08T23:35:48.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.725+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=LVPMJKT2FRDF tag=7WAQU866Z0Z1 type=write size=1393876 2024-08-08T23:35:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.725+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~UMV9EOW4CSDL.0 size=673784 2024-08-08T23:35:48.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.729+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=UMV9EOW4CSDL tag=C04WSUNIM3R6 type=write size=1722360 2024-08-08T23:35:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.733+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=GJN0MHXQQTYB type=del size=2433939 2024-08-08T23:35:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.737+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~YJYTK147HX39.0 size=630241 2024-08-08T23:35:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.741+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=YJYTK147HX39 tag=CJMZ7WY63UI4 type=write size=1678817 2024-08-08T23:35:48.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.741+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=04U4Q1OIXLJ2 type=del size=1156093 2024-08-08T23:35:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.745+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=AXESFU13EH4Q type=del 2024-08-08T23:35:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.745+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=FH7OILR3Q303 type=del size=1356302 2024-08-08T23:35:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.753+0000 7fdbd6e2c8c0 1 < suggested remove operation key=W5OVPO7BGE4S tag=4UMQR2A62H0T type=del 2024-08-08T23:35:48.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.757+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~SRTR7BOEFTIJ.0 size=627831 2024-08-08T23:35:48.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.757+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=SRTR7BOEFTIJ tag=1QRMYI0R52LG type=write size=1676407 2024-08-08T23:35:48.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.757+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~95VLFX0ZSEI6.0 size=1048576 2024-08-08T23:35:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.761+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~95VLFX0ZSEI6.1 size=59785 2024-08-08T23:35:48.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.765+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=95VLFX0ZSEI6 tag=9080N7TT8SHW type=write size=2156937 2024-08-08T23:35:48.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.769+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=QGD171X1KI0Z type=del size=1353264 2024-08-08T23:35:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.769+0000 7fdbd6e2c8c0 1 < canceled operation key=2SO6IPMXZUUI tag=GMF3INCA5FO6 type=del size=4186405 2024-08-08T23:35:48.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.777+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~F1CEJOBT38Q7.0 size=1048576 2024-08-08T23:35:48.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.777+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~F1CEJOBT38Q7.1 size=939676 2024-08-08T23:35:48.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.777+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=F1CEJOBT38Q7 tag=MOBG6MLG4T0E type=write size=3036828 2024-08-08T23:35:48.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.781+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.0 size=1048576 2024-08-08T23:35:48.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.781+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.1 size=1048576 2024-08-08T23:35:48.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.785+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~5DKEO57FB8EF.2 size=5597 2024-08-08T23:35:48.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.789+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=5DKEO57FB8EF tag=HWOZDNCFITUG type=write size=3151325 2024-08-08T23:35:48.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.793+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ZNNG9JP1F1HE.0 size=1048576 2024-08-08T23:35:48.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.793+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ZNNG9JP1F1HE.1 size=627622 2024-08-08T23:35:48.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.793+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=ZNNG9JP1F1HE tag=U0UVGZD3JR52 type=write size=2724774 2024-08-08T23:35:48.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.797+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~B0WQVY9DXBFR.0 size=1048576 2024-08-08T23:35:48.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.797+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~B0WQVY9DXBFR.1 size=37578 2024-08-08T23:35:48.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.801+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=B0WQVY9DXBFR tag=V488BLWMGWAD type=write size=2134730 2024-08-08T23:35:48.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.805+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=OIRAFH4ALSSI type=del size=1722938 2024-08-08T23:35:48.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.809+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=JZHRN18ITCJR type=write size=312154 2024-08-08T23:35:48.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.813+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~59GVNMPO8OM7.0 size=1048576 2024-08-08T23:35:48.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.813+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~59GVNMPO8OM7.1 size=86740 2024-08-08T23:35:48.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.813+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=59GVNMPO8OM7 tag=9XRHITL6BLCD type=write size=2183892 2024-08-08T23:35:48.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.817+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=1YUXO54WCLKB type=del 2024-08-08T23:35:48.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.821+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=L1T4JQIDECT9 type=del size=3328801 2024-08-08T23:35:48.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.821+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=HCZWPM40HB88 type=del 2024-08-08T23:35:48.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.829+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.0 size=1048576 2024-08-08T23:35:48.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.833+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.1 size=1048576 2024-08-08T23:35:48.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.833+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.2 size=909559 2024-08-08T23:35:48.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.833+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=7V27E057GXF4 tag=F9O7K20OKMCN type=write size=4055287 2024-08-08T23:35:48.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.837+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=MNTIPK37VB2X type=del 2024-08-08T23:35:48.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.841+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=E1PK0FIEJOET type=write size=1022555 2024-08-08T23:35:48.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.841+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=T6K1WDACF7R1 type=del 2024-08-08T23:35:48.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.845+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ASZFYED4CMB1.0 size=1048576 2024-08-08T23:35:48.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.849+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ASZFYED4CMB1.1 size=350928 2024-08-08T23:35:48.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.849+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=ASZFYED4CMB1 tag=X3GJG5TLRYQT type=write size=2448080 2024-08-08T23:35:48.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.849+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=KZGAIQHC3ET9 type=del 2024-08-08T23:35:48.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.853+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=RZAF0YCADCLW type=del size=1619983 2024-08-08T23:35:48.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.857+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.0 size=1048576 2024-08-08T23:35:48.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.857+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.1 size=1048576 2024-08-08T23:35:48.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.861+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~O9RCB1UU1JME.2 size=162070 2024-08-08T23:35:48.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.861+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=O9RCB1UU1JME tag=TSIKV0WQKPVV type=write size=3307798 2024-08-08T23:35:48.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.865+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=I3GLLM9DUGHD type=write size=1026930 2024-08-08T23:35:48.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.869+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~LVPMJKT2FRDF.0 size=345300 2024-08-08T23:35:48.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.873+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=LVPMJKT2FRDF tag=7WAQU866Z0Z1 type=write size=1393876 2024-08-08T23:35:48.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.873+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=KETN6V8VT5EG type=del size=1475933 2024-08-08T23:35:48.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.877+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=GJN0MHXQQTYB type=del 2024-08-08T23:35:48.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.881+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=M6GZP1O763WY type=del size=1575490 2024-08-08T23:35:48.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.881+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=04U4Q1OIXLJ2 type=del 2024-08-08T23:35:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.885+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=728MG7WIJMOH type=write size=459752 2024-08-08T23:35:48.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.889+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=FH7OILR3Q303 type=del 2024-08-08T23:35:48.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.889+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=6M4WV7Q1YJNR type=write size=881735 2024-08-08T23:35:48.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.893+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~SRTR7BOEFTIJ.0 size=627831 2024-08-08T23:35:48.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.897+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=SRTR7BOEFTIJ tag=1QRMYI0R52LG type=write size=1676407 2024-08-08T23:35:48.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.901+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.0 size=1048576 2024-08-08T23:35:48.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.1 size=1048576 2024-08-08T23:35:48.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.2 size=626919 2024-08-08T23:35:48.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.905+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=822SVPUOIACA tag=B88M8AN8XUA6 type=write size=3772647 2024-08-08T23:35:48.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.909+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=QGD171X1KI0Z type=del 2024-08-08T23:35:48.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.913+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~V2CZ1PJYMYY1.0 size=1048576 2024-08-08T23:35:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.917+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~V2CZ1PJYMYY1.1 size=25736 2024-08-08T23:35:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.917+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=V2CZ1PJYMYY1 tag=YHG4EZ70YBEJ type=write size=2122888 2024-08-08T23:35:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.917+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FBCEC998C8EJ.2~F1CEJOBT38Q7.0 size=1048576 2024-08-08T23:35:48.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.917+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~F1CEJOBT38Q7.1 size=939676 2024-08-08T23:35:48.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.921+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FBCEC998C8EJ upload=F1CEJOBT38Q7 tag=MOBG6MLG4T0E type=write size=3036828 2024-08-08T23:35:48.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.925+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=2C9AGEATHIOY type=del size=960768 2024-08-08T23:35:48.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~ZNNG9JP1F1HE.0 size=1048576 2024-08-08T23:35:48.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.929+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~ZNNG9JP1F1HE.1 size=627622 2024-08-08T23:35:48.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.933+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=ZNNG9JP1F1HE tag=U0UVGZD3JR52 type=write size=2724774 2024-08-08T23:35:48.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.937+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~85TMPPIQIS3Y.0 size=539739 2024-08-08T23:35:48.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.937+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=85TMPPIQIS3Y tag=K24GJWQM9U2C type=write size=1588315 2024-08-08T23:35:48.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.941+0000 7fdbd6e2c8c0 1 < suggested update operation key=41XLZV9ZY5OP tag=OIRAFH4ALSSI type=del size=1722938 2024-08-08T23:35:48.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.945+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.0 size=1048576 2024-08-08T23:35:48.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.949+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.1 size=1048576 2024-08-08T23:35:48.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.949+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.2 size=541045 2024-08-08T23:35:48.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.949+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=ZJ76LHM1CA5E tag=6TYQGU9GMSTP type=write size=3686773 2024-08-08T23:35:48.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.953+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~59GVNMPO8OM7.0 size=1048576 2024-08-08T23:35:48.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.957+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~59GVNMPO8OM7.1 size=86740 2024-08-08T23:35:48.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.961+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=59GVNMPO8OM7 tag=9XRHITL6BLCD type=write size=2183892 2024-08-08T23:35:48.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.961+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=J4S07XDNHO5T type=del size=3169036 2024-08-08T23:35:48.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.965+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=L1T4JQIDECT9 type=del 2024-08-08T23:35:48.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.969+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=CWU7NYSOWDKD type=del size=1012063 2024-08-08T23:35:48.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.969+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.0 size=1048576 2024-08-08T23:35:48.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.973+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.1 size=1048576 2024-08-08T23:35:48.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.973+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7V27E057GXF4.2 size=909559 2024-08-08T23:35:48.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.977+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=7V27E057GXF4 tag=F9O7K20OKMCN type=write size=4055287 2024-08-08T23:35:48.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.981+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.0 size=1048576 2024-08-08T23:35:48.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.985+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.1 size=1048576 2024-08-08T23:35:48.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.985+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.2 size=1034473 2024-08-08T23:35:48.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.985+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=K67QM2AEYS1N tag=PS9UU56ZYMJ3 type=write size=4180201 2024-08-08T23:35:48.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.989+0000 7fdbd6e2c8c0 1 < completed write operation key=ZBEB2Q3J9Z0D tag=E1PK0FIEJOET type=write size=1022555 2024-08-08T23:35:48.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.993+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=73UFCLF3Y68B type=del size=3583099 2024-08-08T23:35:48.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.993+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ASZFYED4CMB1.0 size=1048576 2024-08-08T23:35:48.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:48.997+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ASZFYED4CMB1.1 size=350928 2024-08-08T23:35:49.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.001+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=ASZFYED4CMB1 tag=X3GJG5TLRYQT type=write size=2448080 2024-08-08T23:35:49.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.005+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~BL9MLFL1Z82H.0 size=158918 2024-08-08T23:35:49.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.005+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=BL9MLFL1Z82H tag=D9XZHOKX9LJE type=write size=1207494 2024-08-08T23:35:49.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.009+0000 7fdbd6e2c8c0 1 < canceled operation key=0XF26POOKR3V tag=RZAF0YCADCLW type=del size=1619983 2024-08-08T23:35:49.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.013+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.0 size=1048576 2024-08-08T23:35:49.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.1 size=1048576 2024-08-08T23:35:49.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.2 size=1037281 2024-08-08T23:35:49.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.017+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=66QBF0MB8CL9 tag=02Z1OO66YZ6C type=write size=4183009 2024-08-08T23:35:49.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.021+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=I3GLLM9DUGHD type=write size=1026930 2024-08-08T23:35:49.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.025+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=AC2MR9I83Z2B type=del size=1907875 2024-08-08T23:35:49.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.029+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=KETN6V8VT5EG type=del size=1475933 2024-08-08T23:35:49.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.037+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~VN7M9QD4BKNR.0 size=521486 2024-08-08T23:35:49.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.037+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=VN7M9QD4BKNR tag=D8ZTK5NK04TD type=write size=1570062 2024-08-08T23:35:49.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.041+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=M6GZP1O763WY type=del size=1575490 2024-08-08T23:35:49.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.049+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~B1WVK3XBJQ97.0 size=1048576 2024-08-08T23:35:49.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.053+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~B1WVK3XBJQ97.1 size=41609 2024-08-08T23:35:49.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.053+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=B1WVK3XBJQ97 tag=WK46UNA6XUNB type=write size=2138761 2024-08-08T23:35:49.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.053+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=728MG7WIJMOH type=write size=459752 2024-08-08T23:35:49.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.057+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=9LASTP11UTS0 type=del size=2776590 2024-08-08T23:35:49.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.061+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=6M4WV7Q1YJNR type=write size=881735 2024-08-08T23:35:49.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.061+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=KROD857JJL3U type=del size=3805839 2024-08-08T23:35:49.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.065+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.0 size=1048576 2024-08-08T23:35:49.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.069+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.1 size=1048576 2024-08-08T23:35:49.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.069+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~822SVPUOIACA.2 size=626919 2024-08-08T23:35:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.077+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=822SVPUOIACA tag=B88M8AN8XUA6 type=write size=3772647 2024-08-08T23:35:49.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.077+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=DOGCZUU01RGB type=del size=3935565 2024-08-08T23:35:49.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.081+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~V2CZ1PJYMYY1.0 size=1048576 2024-08-08T23:35:49.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.085+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~V2CZ1PJYMYY1.1 size=25736 2024-08-08T23:35:49.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.089+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=V2CZ1PJYMYY1 tag=YHG4EZ70YBEJ type=write size=2122888 2024-08-08T23:35:49.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.093+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=YTWQS0L1AL85 type=del size=3417636 2024-08-08T23:35:49.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.097+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=NMB4GI8R2BKU tag=2C9AGEATHIOY type=del size=960768: (22) Invalid argument 2024-08-08T23:35:49.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.097+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=50YJCH1EYFB0 type=del size=3899876 2024-08-08T23:35:49.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.101+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~85TMPPIQIS3Y.0 size=539739 2024-08-08T23:35:49.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.105+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=85TMPPIQIS3Y tag=K24GJWQM9U2C type=write size=1588315 2024-08-08T23:35:49.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.109+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=VX6HI527F8HB type=del size=2252944 2024-08-08T23:35:49.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.113+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.0 size=1048576 2024-08-08T23:35:49.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.113+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.1 size=1048576 2024-08-08T23:35:49.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.113+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~ZJ76LHM1CA5E.2 size=541045 2024-08-08T23:35:49.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.117+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=ZJ76LHM1CA5E tag=6TYQGU9GMSTP type=write size=3686773 2024-08-08T23:35:49.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.121+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=Y0APTB160ITH type=del size=1866690 2024-08-08T23:35:49.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.125+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=J4S07XDNHO5T type=del 2024-08-08T23:35:49.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.129+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ZS6B22DK9ULB.0 size=558811 2024-08-08T23:35:49.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.129+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=ZS6B22DK9ULB tag=T37U5S1Q93OO type=write size=1607387 2024-08-08T23:35:49.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.129+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=CWU7NYSOWDKD type=del 2024-08-08T23:35:49.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.133+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=9TFIOH4Q6C1T type=del size=1143724 2024-08-08T23:35:49.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.133+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.0 size=1048576 2024-08-08T23:35:49.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.137+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.1 size=1048576 2024-08-08T23:35:49.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.137+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~K67QM2AEYS1N.2 size=1034473 2024-08-08T23:35:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.145+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=D81PQ0FJVNEE upload=K67QM2AEYS1N tag=PS9UU56ZYMJ3 type=write size=4180201 2024-08-08T23:35:49.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.149+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~2E4KWZDQ8B3Q.0 size=666071 2024-08-08T23:35:49.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.149+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=2E4KWZDQ8B3Q tag=XBWU2WTTTNR1 type=write size=1714647 2024-08-08T23:35:49.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.149+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=73UFCLF3Y68B type=del 2024-08-08T23:35:49.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.157+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=ADJM2J089UNA type=del size=3168032 2024-08-08T23:35:49.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.157+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~BL9MLFL1Z82H.0 size=158918 2024-08-08T23:35:49.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.161+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=BL9MLFL1Z82H tag=D9XZHOKX9LJE type=write size=1207494 2024-08-08T23:35:49.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.165+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=DANPU1XQP1S8 type=del size=2407844 2024-08-08T23:35:49.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.169+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.0 size=1048576 2024-08-08T23:35:49.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.169+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.1 size=1048576 2024-08-08T23:35:49.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.169+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~66QBF0MB8CL9.2 size=1037281 2024-08-08T23:35:49.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.173+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=66QBF0MB8CL9 tag=02Z1OO66YZ6C type=write size=4183009 2024-08-08T23:35:49.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.177+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=CKW6O8LH9EY3 type=write size=601396 2024-08-08T23:35:49.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.185+0000 7fdbd6e2c8c0 1 < suggested update operation key=Z5EXY8ZHZCHI tag=AC2MR9I83Z2B type=del size=1907875 2024-08-08T23:35:49.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.185+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=2MBV0JWQ3GB9 type=del size=662560 2024-08-08T23:35:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.189+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~VN7M9QD4BKNR.0 size=521486 2024-08-08T23:35:49.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.197+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=VN7M9QD4BKNR tag=D8ZTK5NK04TD type=write size=1570062 2024-08-08T23:35:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.201+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~NTEACE1QJFP6.0 size=247909 2024-08-08T23:35:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.201+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=NTEACE1QJFP6 tag=EHUIBXRKY5BK type=write size=1296485 2024-08-08T23:35:49.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.205+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~B1WVK3XBJQ97.0 size=1048576 2024-08-08T23:35:49.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.205+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~B1WVK3XBJQ97.1 size=41609 2024-08-08T23:35:49.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.209+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=B1WVK3XBJQ97 tag=WK46UNA6XUNB type=write size=2138761 2024-08-08T23:35:49.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.213+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=TA5M1ROLGBG8 type=del size=2539827 2024-08-08T23:35:49.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.213+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=9LASTP11UTS0 type=del 2024-08-08T23:35:49.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.217+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=VPR9GXB0W257 type=del size=1038862 2024-08-08T23:35:49.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.221+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=KROD857JJL3U type=del 2024-08-08T23:35:49.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.225+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=JP1Q4JIOM9SR type=write size=522132 2024-08-08T23:35:49.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.229+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=DOGCZUU01RGB type=del size=3935565 2024-08-08T23:35:49.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.233+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=7NAD6KC6LZ1G type=del size=3271194 2024-08-08T23:35:49.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.237+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=YTWQS0L1AL85 type=del 2024-08-08T23:35:49.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.241+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=9WEQU218ZDNF type=write size=66664 2024-08-08T23:35:49.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.241+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=50YJCH1EYFB0 type=del 2024-08-08T23:35:49.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.249+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~31UO13M271QK.0 size=1048576 2024-08-08T23:35:49.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.253+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~31UO13M271QK.1 size=837687 2024-08-08T23:35:49.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.253+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=31UO13M271QK tag=F1F29PYJB75E type=write size=2934839 2024-08-08T23:35:49.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.257+0000 7fdbd6e2c8c0 1 < suggested remove operation key=Z5EXY8ZHZCHI tag=VX6HI527F8HB type=del 2024-08-08T23:35:49.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.261+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.0 size=1048576 2024-08-08T23:35:49.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.265+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.1 size=1048576 2024-08-08T23:35:49.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.269+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.2 size=315462 2024-08-08T23:35:49.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.269+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=D9FBM6DY3OOS tag=WGIC76V14JJY type=write size=3461190 2024-08-08T23:35:49.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.273+0000 7fdbd6e2c8c0 1 < suggested remove operation key=XIXN9HLLSJS3 tag=Y0APTB160ITH type=del 2024-08-08T23:35:49.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.281+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.0 size=1048576 2024-08-08T23:35:49.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.281+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.1 size=1048576 2024-08-08T23:35:49.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.285+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.2 size=714437 2024-08-08T23:35:49.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.285+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=TOU9OTRV6MG7 tag=ERP9PFLRNLG9 type=write size=3860165 2024-08-08T23:35:49.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.289+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ZS6B22DK9ULB.0 size=558811 2024-08-08T23:35:49.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.293+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=ZS6B22DK9ULB tag=T37U5S1Q93OO type=write size=1607387 2024-08-08T23:35:49.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.297+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=4E5QQGPLG3KG type=del size=3400398 2024-08-08T23:35:49.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.301+0000 7fdbd6e2c8c0 1 < suggested update operation key=MNV404EWJHC1 tag=9TFIOH4Q6C1T type=del size=1143724 2024-08-08T23:35:49.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.305+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=3A2UZAVP4GID type=del size=822800 2024-08-08T23:35:49.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.309+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~2E4KWZDQ8B3Q.0 size=666071 2024-08-08T23:35:49.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.313+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=2E4KWZDQ8B3Q tag=XBWU2WTTTNR1 type=write size=1714647 2024-08-08T23:35:49.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.317+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=E0PRIZVNRYH5 type=del size=882730 2024-08-08T23:35:49.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.321+0000 7fdbd6e2c8c0 1 < suggested remove operation key=464D0ROM6MHO tag=ADJM2J089UNA type=del 2024-08-08T23:35:49.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.325+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=MPMJ8QZGKVHP type=del size=1203516 2024-08-08T23:35:49.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.329+0000 7fdbd6e2c8c0 1 < suggested update operation key=0XF26POOKR3V tag=DANPU1XQP1S8 type=del size=2407844 2024-08-08T23:35:49.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.333+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~BYWPVFGS1446.0 size=907138 2024-08-08T23:35:49.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.333+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=BYWPVFGS1446 tag=P75M1UV9EHVC type=write size=1955714 2024-08-08T23:35:49.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.337+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=CKW6O8LH9EY3 type=write size=601396 2024-08-08T23:35:49.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.341+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~66W5E52G16EY.0 size=1048576 2024-08-08T23:35:49.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.345+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~66W5E52G16EY.1 size=623521 2024-08-08T23:35:49.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.345+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=66W5E52G16EY tag=XXGABBX0YQ44 type=write size=2720673 2024-08-08T23:35:49.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.349+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=2MBV0JWQ3GB9 type=del 2024-08-08T23:35:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.349+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=H27W03UHTDC8 type=del size=880426 2024-08-08T23:35:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.349+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~NTEACE1QJFP6.0 size=247909 2024-08-08T23:35:49.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.357+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=NTEACE1QJFP6 tag=EHUIBXRKY5BK type=write size=1296485 2024-08-08T23:35:49.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.357+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=H4R6UN3S1DH3 type=write size=149135 2024-08-08T23:35:49.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.361+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=TA5M1ROLGBG8 type=del 2024-08-08T23:35:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.365+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=YJKWTSI0SRMI type=del size=3938151 2024-08-08T23:35:49.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.369+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=VPR9GXB0W257 type=del 2024-08-08T23:35:49.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.373+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.0 size=1048576 2024-08-08T23:35:49.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.377+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.1 size=1048576 2024-08-08T23:35:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.377+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.2 size=138579 2024-08-08T23:35:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.377+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=JM1YSD2V91T8 tag=CXQOZFMIA092 type=write size=3284307 2024-08-08T23:35:49.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.381+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=JP1Q4JIOM9SR type=write size=522132 2024-08-08T23:35:49.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.385+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=MUJMCY0C82TW type=del size=3383512 2024-08-08T23:35:49.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.389+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=7NAD6KC6LZ1G type=del 2024-08-08T23:35:49.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.389+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=L0PH2Z7WUQJX type=write size=406154 2024-08-08T23:35:49.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.393+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=9WEQU218ZDNF type=write size=66664 2024-08-08T23:35:49.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.397+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=GNCSH5445M1X type=write size=840270 2024-08-08T23:35:49.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.401+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~31UO13M271QK.0 size=1048576 2024-08-08T23:35:49.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.401+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~31UO13M271QK.1 size=837687 2024-08-08T23:35:49.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.409+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=31UO13M271QK tag=F1F29PYJB75E type=write size=2934839 2024-08-08T23:35:49.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.409+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=ZVFKSBI3JLRE type=del size=2928438 2024-08-08T23:35:49.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.413+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.0 size=1048576 2024-08-08T23:35:49.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.413+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.1 size=1048576 2024-08-08T23:35:49.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.417+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~D9FBM6DY3OOS.2 size=315462 2024-08-08T23:35:49.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.421+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=D9FBM6DY3OOS tag=WGIC76V14JJY type=write size=3461190 2024-08-08T23:35:49.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.425+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=7DL4124ZLZ23 type=del size=2868557 2024-08-08T23:35:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.425+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.0 size=1048576 2024-08-08T23:35:49.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.429+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.1 size=1048576 2024-08-08T23:35:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.433+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~TOU9OTRV6MG7.2 size=714437 2024-08-08T23:35:49.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.437+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=TOU9OTRV6MG7 tag=ERP9PFLRNLG9 type=write size=3860165 2024-08-08T23:35:49.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.441+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=NBYJRZZUARRT type=del size=535714 2024-08-08T23:35:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.445+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=4E5QQGPLG3KG type=del 2024-08-08T23:35:49.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.445+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=BO3JIGX2WQ8A type=del size=2167113 2024-08-08T23:35:49.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.449+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=3A2UZAVP4GID type=del 2024-08-08T23:35:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.453+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~4DOU5T3LKR41.0 size=1048576 2024-08-08T23:35:49.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.453+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~4DOU5T3LKR41.1 size=953528 2024-08-08T23:35:49.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.453+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=4DOU5T3LKR41 tag=45WSTM3RJP2H type=write size=3050680 2024-08-08T23:35:49.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.457+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=E0PRIZVNRYH5 type=del 2024-08-08T23:35:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.461+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.0 size=1048576 2024-08-08T23:35:49.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.465+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.1 size=1048576 2024-08-08T23:35:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.465+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.2 size=544380 2024-08-08T23:35:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.465+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=L0BF1CBDOY6R tag=NWA0KROUH1JW type=write size=3690108 2024-08-08T23:35:49.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.469+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=MPMJ8QZGKVHP type=del 2024-08-08T23:35:49.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.473+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=P9RHRZEJ9SRJ type=write size=458773 2024-08-08T23:35:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.473+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~BYWPVFGS1446.0 size=907138 2024-08-08T23:35:49.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.477+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=BYWPVFGS1446 tag=P75M1UV9EHVC type=write size=1955714 2024-08-08T23:35:49.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.481+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=TZ7DN6P0BRS2 type=del size=2336369 2024-08-08T23:35:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.481+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~66W5E52G16EY.0 size=1048576 2024-08-08T23:35:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.485+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~66W5E52G16EY.1 size=623521 2024-08-08T23:35:49.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.485+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=66W5E52G16EY tag=XXGABBX0YQ44 type=write size=2720673 2024-08-08T23:35:49.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.489+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=LYN99BT6KZA1 type=del size=3416006 2024-08-08T23:35:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.493+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=H27W03UHTDC8 type=del 2024-08-08T23:35:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.493+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=DFGCK9JRXWR7 type=del size=1992291 2024-08-08T23:35:49.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.497+0000 7fdbd6e2c8c0 1 < completed write operation key=ZBEB2Q3J9Z0D tag=H4R6UN3S1DH3 type=write size=149135 2024-08-08T23:35:49.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.501+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=E4P31K0YN6WG type=del size=153311 2024-08-08T23:35:49.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.505+0000 7fdbd6e2c8c0 1 < suggested update operation key=9S8TBVP20KTG tag=YJKWTSI0SRMI type=del size=3938151 2024-08-08T23:35:49.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.509+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=BYZ6QU3ZFDNS type=del size=3012830 2024-08-08T23:35:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.509+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.0 size=1048576 2024-08-08T23:35:49.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.513+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.1 size=1048576 2024-08-08T23:35:49.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.513+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~JM1YSD2V91T8.2 size=138579 2024-08-08T23:35:49.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.521+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=JM1YSD2V91T8 tag=CXQOZFMIA092 type=write size=3284307 2024-08-08T23:35:49.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.521+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=3E28ZAXY4G1C type=del size=1496516 2024-08-08T23:35:49.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.525+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=MUJMCY0C82TW type=del 2024-08-08T23:35:49.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.529+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=2AFYNH82NLF3 type=write size=74035 2024-08-08T23:35:49.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.529+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=9S8TBVP20KTG tag=L0PH2Z7WUQJX type=write size=406154: (22) Invalid argument 2024-08-08T23:35:49.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.533+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=4BPC8XYXAAIJ type=write size=1012973 2024-08-08T23:35:49.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.541+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=GNCSH5445M1X type=write size=840270 2024-08-08T23:35:49.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.545+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.0 size=1048576 2024-08-08T23:35:49.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.549+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.1 size=1048576 2024-08-08T23:35:49.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.549+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.2 size=118192 2024-08-08T23:35:49.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.549+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=A9PLMXVHK3TI tag=YX9ZQ10ZZSX0 type=write size=3263920 2024-08-08T23:35:49.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.553+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=ZVFKSBI3JLRE type=del 2024-08-08T23:35:49.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.557+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=VRVJSZNCJELS type=del size=322515 2024-08-08T23:35:49.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.561+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=7DL4124ZLZ23 type=del 2024-08-08T23:35:49.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.565+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~M0C7KMDH7W3K.0 size=1048576 2024-08-08T23:35:49.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.569+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~M0C7KMDH7W3K.1 size=554213 2024-08-08T23:35:49.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.569+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=M0C7KMDH7W3K tag=FCU4FXGGE8MS type=write size=2651365 2024-08-08T23:35:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.569+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=NBYJRZZUARRT type=del 2024-08-08T23:35:49.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.573+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=C8LWRJ4339FB type=write size=892595 2024-08-08T23:35:49.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.577+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=BO3JIGX2WQ8A type=del 2024-08-08T23:35:49.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.581+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~833YW8EN78RW.0 size=1048576 2024-08-08T23:35:49.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.585+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~833YW8EN78RW.1 size=308350 2024-08-08T23:35:49.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.585+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=833YW8EN78RW tag=JANKYI955B5F type=write size=2405502 2024-08-08T23:35:49.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.589+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~4DOU5T3LKR41.0 size=1048576 2024-08-08T23:35:49.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.593+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~4DOU5T3LKR41.1 size=953528 2024-08-08T23:35:49.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.597+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=4DOU5T3LKR41 tag=45WSTM3RJP2H type=write size=3050680 2024-08-08T23:35:49.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.601+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~ZHVPP9WIOUK5.0 size=819745 2024-08-08T23:35:49.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.601+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=ZHVPP9WIOUK5 tag=0VK8GC1B7G40 type=write size=1868321 2024-08-08T23:35:49.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.605+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.0 size=1048576 2024-08-08T23:35:49.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.609+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.1 size=1048576 2024-08-08T23:35:49.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.613+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~L0BF1CBDOY6R.2 size=544380 2024-08-08T23:35:49.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.617+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=L0BF1CBDOY6R tag=NWA0KROUH1JW type=write size=3690108 2024-08-08T23:35:49.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.621+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=D5EZUUWI10MF type=del size=546195 2024-08-08T23:35:49.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.625+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=P9RHRZEJ9SRJ type=write size=458773 2024-08-08T23:35:49.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.629+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=SYJSYMDYHD0I type=del size=4033234 2024-08-08T23:35:49.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.629+0000 7fdbd6e2c8c0 1 < canceled operation key=XIXN9HLLSJS3 tag=TZ7DN6P0BRS2 type=del size=2336369 2024-08-08T23:35:49.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.637+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~SEPX7BIM4EQH.0 size=772312 2024-08-08T23:35:49.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.637+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=SEPX7BIM4EQH tag=Q3SMMPCG8WJ2 type=write size=1820888 2024-08-08T23:35:49.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.645+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=LYN99BT6KZA1 type=del 2024-08-08T23:35:49.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.645+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=GF2WWOLILVP1 type=write size=473938 2024-08-08T23:35:49.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.649+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=DFGCK9JRXWR7 type=del 2024-08-08T23:35:49.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.653+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.0 size=1048576 2024-08-08T23:35:49.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.657+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.1 size=1048576 2024-08-08T23:35:49.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.2 size=718991 2024-08-08T23:35:49.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.661+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=EGL85CBW1RCP tag=CPY0CGRGYUC9 type=write size=3864719 2024-08-08T23:35:49.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.661+0000 7fdbd6e2c8c0 1 < canceled operation key=0XF26POOKR3V tag=E4P31K0YN6WG type=del size=153311 2024-08-08T23:35:49.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.669+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.0 size=1048576 2024-08-08T23:35:49.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.669+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.1 size=1048576 2024-08-08T23:35:49.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.673+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.2 size=508506 2024-08-08T23:35:49.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.673+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=W3IIAXVGUO9O tag=NW1931NRLRSB type=write size=3654234 2024-08-08T23:35:49.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.677+0000 7fdbd6e2c8c0 1 < suggested remove operation key=9S8TBVP20KTG tag=BYZ6QU3ZFDNS type=del 2024-08-08T23:35:49.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.681+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=OMZLF7G99AFO type=write size=589392 2024-08-08T23:35:49.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.685+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=3E28ZAXY4G1C type=del size=1496516 2024-08-08T23:35:49.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.689+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~QX5LCR56XNT1.0 size=464956 2024-08-08T23:35:49.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.689+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=QX5LCR56XNT1 tag=IED84HFPJA7W type=write size=1513532 2024-08-08T23:35:49.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.693+0000 7fdbd6e2c8c0 1 < canceled operation key=464D0ROM6MHO tag=2AFYNH82NLF3 type=write size=74035 2024-08-08T23:35:49.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.693+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=WDCPVUCVVAD5 type=write size=342477 2024-08-08T23:35:49.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.697+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=4BPC8XYXAAIJ type=write size=1012973 2024-08-08T23:35:49.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.701+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=HFQNB0Y3DRDN type=del size=444513 2024-08-08T23:35:49.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.705+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.0 size=1048576 2024-08-08T23:35:49.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.709+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.1 size=1048576 2024-08-08T23:35:49.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.709+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~A9PLMXVHK3TI.2 size=118192 2024-08-08T23:35:49.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.713+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=A9PLMXVHK3TI tag=YX9ZQ10ZZSX0 type=write size=3263920 2024-08-08T23:35:49.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.721+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~KVTLX4XSVPHD.0 size=1048576 2024-08-08T23:35:49.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.721+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~KVTLX4XSVPHD.1 size=718558 2024-08-08T23:35:49.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.721+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=KVTLX4XSVPHD tag=Z9VTAJ67XYTR type=write size=2815710 2024-08-08T23:35:49.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.725+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=VRVJSZNCJELS type=del 2024-08-08T23:35:49.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.729+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=U0BYQF0YC13Y type=del size=3631074 2024-08-08T23:35:49.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.733+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~M0C7KMDH7W3K.0 size=1048576 2024-08-08T23:35:49.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.733+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~M0C7KMDH7W3K.1 size=554213 2024-08-08T23:35:49.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.737+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=M0C7KMDH7W3K tag=FCU4FXGGE8MS type=write size=2651365 2024-08-08T23:35:49.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.741+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=GU6CGTH23HPY type=del size=2721758 2024-08-08T23:35:49.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.745+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=VGT9IXWM956F tag=C8LWRJ4339FB type=write size=892595: (22) Invalid argument 2024-08-08T23:35:49.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.749+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=0A7C1ZC9BUFF type=del size=796707 2024-08-08T23:35:49.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.749+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~833YW8EN78RW.0 size=1048576 2024-08-08T23:35:49.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.753+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~833YW8EN78RW.1 size=308350 2024-08-08T23:35:49.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.757+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=833YW8EN78RW tag=JANKYI955B5F type=write size=2405502 2024-08-08T23:35:49.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.761+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=E7PAGB97B7OB type=write size=934643 2024-08-08T23:35:49.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.765+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~ZHVPP9WIOUK5.0 size=819745 2024-08-08T23:35:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.769+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=ZHVPP9WIOUK5 tag=0VK8GC1B7G40 type=write size=1868321 2024-08-08T23:35:49.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.769+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=1O8Y3V52CC5C type=write size=886173 2024-08-08T23:35:49.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.773+0000 7fdbd6e2c8c0 1 < canceled operation key=D81PQ0FJVNEE tag=D5EZUUWI10MF type=del size=546195 2024-08-08T23:35:49.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.777+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=CDQ555XNN1Q2 type=del size=1823871 2024-08-08T23:35:49.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.781+0000 7fdbd6e2c8c0 1 < suggested update operation key=FBCEC998C8EJ tag=SYJSYMDYHD0I type=del size=4033234 2024-08-08T23:35:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.785+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=22YADTD4Z5C1 type=del size=2390205 2024-08-08T23:35:49.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.785+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~SEPX7BIM4EQH.0 size=772312 2024-08-08T23:35:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.789+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=SEPX7BIM4EQH tag=Q3SMMPCG8WJ2 type=write size=1820888 2024-08-08T23:35:49.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.793+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=92UHX6QTQ3G3 type=del size=720959 2024-08-08T23:35:49.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.797+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=GF2WWOLILVP1 type=write size=473938 2024-08-08T23:35:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.801+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=27BDUTZE6C3K type=del size=3398435 2024-08-08T23:35:49.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.801+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.0 size=1048576 2024-08-08T23:35:49.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.805+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.1 size=1048576 2024-08-08T23:35:49.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.805+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~EGL85CBW1RCP.2 size=718991 2024-08-08T23:35:49.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.813+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=EGL85CBW1RCP tag=CPY0CGRGYUC9 type=write size=3864719 2024-08-08T23:35:49.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.813+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=XHVCV03EHBY7 type=write size=504705 2024-08-08T23:35:49.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.817+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.0 size=1048576 2024-08-08T23:35:49.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.817+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.1 size=1048576 2024-08-08T23:35:49.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.817+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~W3IIAXVGUO9O.2 size=508506 2024-08-08T23:35:49.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.821+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=W3IIAXVGUO9O tag=NW1931NRLRSB type=write size=3654234 2024-08-08T23:35:49.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.825+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=H2U9MB92HSX3 type=del size=2429499 2024-08-08T23:35:49.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.829+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=OMZLF7G99AFO type=write 2024-08-08T23:35:49.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.833+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=188QDO54L9LT type=del size=1638988 2024-08-08T23:35:49.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.837+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~QX5LCR56XNT1.0 size=464956 2024-08-08T23:35:49.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.841+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=QX5LCR56XNT1 tag=IED84HFPJA7W type=write size=1513532 2024-08-08T23:35:49.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.849+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~LEIQLD53DEI5.0 size=508432 2024-08-08T23:35:49.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.849+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=LEIQLD53DEI5 tag=W6PZVL2Q37O9 type=write size=1557008 2024-08-08T23:35:49.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.853+0000 7fdbd6e2c8c0 1 < completed write operation key=MNV404EWJHC1 tag=WDCPVUCVVAD5 type=write size=342477 2024-08-08T23:35:49.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.853+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=9BMHLY3LUHZN type=del size=2651476 2024-08-08T23:35:49.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.857+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=HFQNB0Y3DRDN type=del 2024-08-08T23:35:49.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.861+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=9MR6QG39KDZU type=del size=4158525 2024-08-08T23:35:49.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.861+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GZJ8GWYBB01F.2~KVTLX4XSVPHD.0 size=1048576 2024-08-08T23:35:49.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.865+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~KVTLX4XSVPHD.1 size=718558 2024-08-08T23:35:49.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.869+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GZJ8GWYBB01F upload=KVTLX4XSVPHD tag=Z9VTAJ67XYTR type=write size=2815710 2024-08-08T23:35:49.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.873+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=EU7IZHSV5OO8 type=del size=2657069 2024-08-08T23:35:49.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.877+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=U0BYQF0YC13Y type=del 2024-08-08T23:35:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.877+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=4NXJ6BIPK4QO type=del size=2558722 2024-08-08T23:35:49.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.881+0000 7fdbd6e2c8c0 1 < canceled operation key=ZQ8GOX9RSTBB tag=GU6CGTH23HPY type=del size=2721758 2024-08-08T23:35:49.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.885+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.0 size=1048576 2024-08-08T23:35:49.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.889+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.1 size=1048576 2024-08-08T23:35:49.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.893+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.2 size=499377 2024-08-08T23:35:49.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.893+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=2EUE0NUD5TK4 tag=V9XM7X8G57XQ type=write size=3645105 2024-08-08T23:35:49.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.893+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=0A7C1ZC9BUFF type=del 2024-08-08T23:35:49.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.897+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=4APF7ZASI8CX type=del size=2067819 2024-08-08T23:35:49.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.901+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=E7PAGB97B7OB type=write size=934643 2024-08-08T23:35:49.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.0 size=1048576 2024-08-08T23:35:49.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.1 size=1048576 2024-08-08T23:35:49.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.909+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.2 size=732141 2024-08-08T23:35:49.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.909+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=M5P42GLUQMB9 tag=Y34SY6RZCLPY type=write size=3877869 2024-08-08T23:35:49.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.909+0000 7fdbd6e2c8c0 1 < completed write operation key=2SO6IPMXZUUI tag=1O8Y3V52CC5C type=write size=886173 2024-08-08T23:35:49.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.913+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=UTXK65U7QWAR type=del size=2702001 2024-08-08T23:35:49.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.917+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=CDQ555XNN1Q2 type=del size=1823871 2024-08-08T23:35:49.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.917+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=HPRKMMN0V1YJ type=del size=942704 2024-08-08T23:35:49.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.925+0000 7fdbd6e2c8c0 1 < suggested update operation key=903K2EO77YTJ tag=22YADTD4Z5C1 type=del size=2390205 2024-08-08T23:35:49.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.929+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~VP9LNJX17V2E.0 size=1048576 2024-08-08T23:35:49.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.933+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~VP9LNJX17V2E.1 size=236533 2024-08-08T23:35:49.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.933+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=VP9LNJX17V2E tag=WG795EAJ7C2O type=write size=2333685 2024-08-08T23:35:49.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.933+0000 7fdbd6e2c8c0 1 < canceled operation key=63GVT7KRKCSS tag=92UHX6QTQ3G3 type=del size=720959 2024-08-08T23:35:49.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.937+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~6FBG2KSVRP9F.0 size=1048576 2024-08-08T23:35:49.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.941+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~6FBG2KSVRP9F.1 size=377655 2024-08-08T23:35:49.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.941+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=6FBG2KSVRP9F tag=6W7YN2SPLMTV type=write size=2474807 2024-08-08T23:35:49.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.941+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=27BDUTZE6C3K type=del 2024-08-08T23:35:49.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.945+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=YP18ZBYOQ0HA type=del size=2768310 2024-08-08T23:35:49.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.949+0000 7fdbd6e2c8c0 1 < suggested remove operation key=Z5EXY8ZHZCHI tag=XHVCV03EHBY7 type=write 2024-08-08T23:35:49.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.953+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=1ULGWU227IU1 type=write size=356362 2024-08-08T23:35:49.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.961+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=H2U9MB92HSX3 type=del size=2429499 2024-08-08T23:35:49.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.965+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~4R2Z1K9SQ5ET.0 size=832615 2024-08-08T23:35:49.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.965+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=4R2Z1K9SQ5ET tag=P69W10ZZP7A5 type=write size=1881191 2024-08-08T23:35:49.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.965+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=903K2EO77YTJ tag=188QDO54L9LT type=del size=1638988: (22) Invalid argument 2024-08-08T23:35:49.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.973+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~YE98HKZLSJYT.0 size=921891 2024-08-08T23:35:49.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.973+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=YE98HKZLSJYT tag=A17J017NLIOG type=write size=1970467 2024-08-08T23:35:49.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.977+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~LEIQLD53DEI5.0 size=508432 2024-08-08T23:35:49.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.981+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=LEIQLD53DEI5 tag=W6PZVL2Q37O9 type=write size=1557008 2024-08-08T23:35:49.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.985+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=H9T8NNJEQ0Y5 type=del size=849102 2024-08-08T23:35:49.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.989+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=9BMHLY3LUHZN type=del 2024-08-08T23:35:49.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.993+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.0 size=1048576 2024-08-08T23:35:49.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.997+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.1 size=1048576 2024-08-08T23:35:49.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.997+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.2 size=102881 2024-08-08T23:35:49.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:49.997+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=29QKQE7AGG9G tag=AG01FYKOM5YU type=write size=3248609 2024-08-08T23:35:50.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.001+0000 7fdbd6e2c8c0 1 < canceled operation key=0XF26POOKR3V tag=9MR6QG39KDZU type=del size=4158525 2024-08-08T23:35:50.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.005+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~DEZ3TP4PHVEU.0 size=1048576 2024-08-08T23:35:50.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.009+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~DEZ3TP4PHVEU.1 size=500188 2024-08-08T23:35:50.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.009+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=DEZ3TP4PHVEU tag=0OZ2KOL4G8SW type=write size=2597340 2024-08-08T23:35:50.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.009+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=EU7IZHSV5OO8 type=del 2024-08-08T23:35:50.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.0 size=1048576 2024-08-08T23:35:50.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.1 size=1048576 2024-08-08T23:35:50.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.021+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.2 size=856846 2024-08-08T23:35:50.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.021+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=1CDTJEJ8B2GW tag=L6RQ2UIH3OSH type=write size=4002574 2024-08-08T23:35:50.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.025+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=4NXJ6BIPK4QO type=del 2024-08-08T23:35:50.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.025+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=KWRUWYRU0UA3 type=del size=4152254 2024-08-08T23:35:50.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.029+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.0 size=1048576 2024-08-08T23:35:50.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.029+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.1 size=1048576 2024-08-08T23:35:50.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.033+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~2EUE0NUD5TK4.2 size=499377 2024-08-08T23:35:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.037+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QWRYLH4P94BQ upload=2EUE0NUD5TK4 tag=V9XM7X8G57XQ type=write size=3645105 2024-08-08T23:35:50.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.041+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.0 size=1048576 2024-08-08T23:35:50.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.045+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.1 size=1048576 2024-08-08T23:35:50.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.045+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.2 size=216827 2024-08-08T23:35:50.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.045+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=9YH8CIBXY5G3 tag=1DE0S09PPGP4 type=write size=3362555 2024-08-08T23:35:50.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.049+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=4APF7ZASI8CX type=del 2024-08-08T23:35:50.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.053+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~SHWHWSDHKZZV.0 size=210762 2024-08-08T23:35:50.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.053+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=SHWHWSDHKZZV tag=SS6ZIDUDD3C2 type=write size=1259338 2024-08-08T23:35:50.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.057+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.0 size=1048576 2024-08-08T23:35:50.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.057+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.1 size=1048576 2024-08-08T23:35:50.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.061+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~M5P42GLUQMB9.2 size=732141 2024-08-08T23:35:50.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.065+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=M5P42GLUQMB9 tag=Y34SY6RZCLPY type=write size=3877869 2024-08-08T23:35:50.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.069+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=TK1ZS40VW64Y type=del size=1982897 2024-08-08T23:35:50.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.073+0000 7fdbd6e2c8c0 1 < suggested update operation key=MNV404EWJHC1 tag=UTXK65U7QWAR type=del size=2702001 2024-08-08T23:35:50.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.077+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=ISI34M5LCTHN type=write size=680038 2024-08-08T23:35:50.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.077+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=HPRKMMN0V1YJ type=del 2024-08-08T23:35:50.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.081+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.0 size=1048576 2024-08-08T23:35:50.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.085+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.1 size=1048576 2024-08-08T23:35:50.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.089+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.2 size=484698 2024-08-08T23:35:50.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.089+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=KC2VOEWH3L9H tag=0HQXSH8C8ECS type=write size=3630426 2024-08-08T23:35:50.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.089+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~VP9LNJX17V2E.0 size=1048576 2024-08-08T23:35:50.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.089+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~VP9LNJX17V2E.1 size=236533 2024-08-08T23:35:50.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.093+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=VP9LNJX17V2E tag=WG795EAJ7C2O type=write size=2333685 2024-08-08T23:35:50.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.097+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=UYKWGJ11RDH0 type=del size=863424 2024-08-08T23:35:50.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.097+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YNQU8Z202QCM.2~6FBG2KSVRP9F.0 size=1048576 2024-08-08T23:35:50.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.101+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~6FBG2KSVRP9F.1 size=377655 2024-08-08T23:35:50.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.105+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YNQU8Z202QCM upload=6FBG2KSVRP9F tag=6W7YN2SPLMTV type=write size=2474807 2024-08-08T23:35:50.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.109+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.0 size=1048576 2024-08-08T23:35:50.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.113+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.1 size=1048576 2024-08-08T23:35:50.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.117+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.2 size=666082 2024-08-08T23:35:50.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.117+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=3RBFGWL6TU5H tag=LNPI142BJDCX type=write size=3811810 2024-08-08T23:35:50.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.117+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=YP18ZBYOQ0HA type=del 2024-08-08T23:35:50.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.121+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=OV1I94TMALHX type=del size=602428 2024-08-08T23:35:50.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.125+0000 7fdbd6e2c8c0 1 < suggested remove operation key=GMVEOO97I8YH tag=1ULGWU227IU1 type=write 2024-08-08T23:35:50.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.129+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=5WBIIGN9JU30 type=del size=1214753 2024-08-08T23:35:50.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.129+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~4R2Z1K9SQ5ET.0 size=832615 2024-08-08T23:35:50.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.133+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=4R2Z1K9SQ5ET tag=P69W10ZZP7A5 type=write size=1881191 2024-08-08T23:35:50.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.137+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=ZONCMDYJDCWD type=del size=3120067 2024-08-08T23:35:50.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.137+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~YE98HKZLSJYT.0 size=921891 2024-08-08T23:35:50.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.141+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=YE98HKZLSJYT tag=A17J017NLIOG type=write size=1970467 2024-08-08T23:35:50.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.145+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=K6ZIH6HL4B36 type=del size=3208526 2024-08-08T23:35:50.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.149+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=H9T8NNJEQ0Y5 type=del 2024-08-08T23:35:50.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.149+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=XE8GOM03F479 type=del size=1542129 2024-08-08T23:35:50.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.153+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.0 size=1048576 2024-08-08T23:35:50.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.157+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.1 size=1048576 2024-08-08T23:35:50.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.157+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~29QKQE7AGG9G.2 size=102881 2024-08-08T23:35:50.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.165+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=29QKQE7AGG9G tag=AG01FYKOM5YU type=write size=3248609 2024-08-08T23:35:50.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.165+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=AEUZUZBK15YQ type=del size=1812642 2024-08-08T23:35:50.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.169+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~DEZ3TP4PHVEU.0 size=1048576 2024-08-08T23:35:50.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.173+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~DEZ3TP4PHVEU.1 size=500188 2024-08-08T23:35:50.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.177+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=DEZ3TP4PHVEU tag=0OZ2KOL4G8SW type=write size=2597340 2024-08-08T23:35:50.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.181+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=7DRHC0MNUJ9A type=del size=1581593 2024-08-08T23:35:50.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.181+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.0 size=1048576 2024-08-08T23:35:50.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.185+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.1 size=1048576 2024-08-08T23:35:50.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.185+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~1CDTJEJ8B2GW.2 size=856846 2024-08-08T23:35:50.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.193+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=1CDTJEJ8B2GW tag=L6RQ2UIH3OSH type=write size=4002574 2024-08-08T23:35:50.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.193+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=PWNXCW6VTP5J type=del size=3280356 2024-08-08T23:35:50.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.197+0000 7fdbd6e2c8c0 1 < canceled operation key=V3TA5KZ95NXT tag=KWRUWYRU0UA3 type=del size=4152254 2024-08-08T23:35:50.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.201+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=7BPK2IOCJVD4 type=del size=1112804 2024-08-08T23:35:50.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.205+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.0 size=1048576 2024-08-08T23:35:50.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.205+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.1 size=1048576 2024-08-08T23:35:50.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.205+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~9YH8CIBXY5G3.2 size=216827 2024-08-08T23:35:50.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.209+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GZJ8GWYBB01F upload=9YH8CIBXY5G3 tag=1DE0S09PPGP4 type=write size=3362555 2024-08-08T23:35:50.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.213+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=CAQFEYOC67TF type=del size=536033 2024-08-08T23:35:50.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.217+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~SHWHWSDHKZZV.0 size=210762 2024-08-08T23:35:50.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.221+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=SHWHWSDHKZZV tag=SS6ZIDUDD3C2 type=write size=1259338 2024-08-08T23:35:50.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.225+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=ZJD8LRAFRTFV type=del size=3561422 2024-08-08T23:35:50.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.233+0000 7fdbd6e2c8c0 1 < suggested update operation key=QWRYLH4P94BQ tag=TK1ZS40VW64Y type=del size=1982897 2024-08-08T23:35:50.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.241+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.0 size=1048576 2024-08-08T23:35:50.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.241+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.1 size=1048576 2024-08-08T23:35:50.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.245+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.2 size=371136 2024-08-08T23:35:50.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.245+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=LI7AZS0TUD6K tag=I9AVNVFYL2R7 type=write size=3516864 2024-08-08T23:35:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.249+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=ISI34M5LCTHN type=write size=680038 2024-08-08T23:35:50.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.253+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=JZ3FS6M67G0M type=del size=1221271 2024-08-08T23:35:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.253+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.0 size=1048576 2024-08-08T23:35:50.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.257+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.1 size=1048576 2024-08-08T23:35:50.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.261+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~KC2VOEWH3L9H.2 size=484698 2024-08-08T23:35:50.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.265+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=KC2VOEWH3L9H tag=0HQXSH8C8ECS type=write size=3630426 2024-08-08T23:35:50.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.269+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=D64VV8L9ZKMB type=del size=2233222 2024-08-08T23:35:50.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.277+0000 7fdbd6e2c8c0 1 < suggested remove operation key=MNV404EWJHC1 tag=UYKWGJ11RDH0 type=del 2024-08-08T23:35:50.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.277+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=K430YDB7EZY5 type=del size=3290325 2024-08-08T23:35:50.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.281+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.0 size=1048576 2024-08-08T23:35:50.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.285+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.1 size=1048576 2024-08-08T23:35:50.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.285+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~3RBFGWL6TU5H.2 size=666082 2024-08-08T23:35:50.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.293+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=3RBFGWL6TU5H tag=LNPI142BJDCX type=write size=3811810 2024-08-08T23:35:50.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.297+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~9SYW8Q7UMNTU.0 size=90711 2024-08-08T23:35:50.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.297+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=9SYW8Q7UMNTU tag=726N6BMY76QT type=write size=1139287 2024-08-08T23:35:50.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.301+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=OV1I94TMALHX type=del 2024-08-08T23:35:50.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.305+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=K76UIBS6J23A type=del size=2267951 2024-08-08T23:35:50.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.313+0000 7fdbd6e2c8c0 1 < suggested update operation key=V6GSJH62C8TA tag=5WBIIGN9JU30 type=del size=1214753 2024-08-08T23:35:50.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.317+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~W822VYMDRANZ.0 size=642280 2024-08-08T23:35:50.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.317+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=W822VYMDRANZ tag=BHQ4VB9YHLW2 type=write size=1690856 2024-08-08T23:35:50.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.325+0000 7fdbd6e2c8c0 1 < suggested update operation key=YO2FZOR7H0EX tag=ZONCMDYJDCWD type=del size=3120067 2024-08-08T23:35:50.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.325+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=SXXKZY44X6HX type=del size=3734197 2024-08-08T23:35:50.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.329+0000 7fdbd6e2c8c0 1 < canceled operation key=2SO6IPMXZUUI tag=K6ZIH6HL4B36 type=del size=3208526 2024-08-08T23:35:50.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.337+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.0 size=1048576 2024-08-08T23:35:50.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.341+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.1 size=1048576 2024-08-08T23:35:50.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.341+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.2 size=552137 2024-08-08T23:35:50.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.341+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=MVVQ4DQ15TW5 tag=N41F5XUFDJL1 type=write size=3697865 2024-08-08T23:35:50.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.345+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=XE8GOM03F479 type=del 2024-08-08T23:35:50.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.349+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.0 size=1048576 2024-08-08T23:35:50.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.353+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.1 size=1048576 2024-08-08T23:35:50.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.353+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.2 size=506377 2024-08-08T23:35:50.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.353+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=D3A7PJESPO7J tag=96O82LSPEIDV type=write size=3652105 2024-08-08T23:35:50.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.357+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=AEUZUZBK15YQ type=del 2024-08-08T23:35:50.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.361+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~JXS7B00KC5BD.0 size=621869 2024-08-08T23:35:50.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.361+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=JXS7B00KC5BD tag=DQXRZZN462UO type=write size=1670445 2024-08-08T23:35:50.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.365+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=7DRHC0MNUJ9A type=del 2024-08-08T23:35:50.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.369+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~295B7GZN8N76.0 size=398498 2024-08-08T23:35:50.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.369+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=295B7GZN8N76 tag=KOYC12ERF1IS type=write size=1447074 2024-08-08T23:35:50.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.373+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=PWNXCW6VTP5J type=del 2024-08-08T23:35:50.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.377+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=5AETA6F210RM type=write size=126403 2024-08-08T23:35:50.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.381+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=7BPK2IOCJVD4 type=del 2024-08-08T23:35:50.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.381+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=QXKOHLIVGJXQ type=write size=494990 2024-08-08T23:35:50.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.385+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=YO2FZOR7H0EX tag=CAQFEYOC67TF type=del size=536033: (22) Invalid argument 2024-08-08T23:35:50.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.389+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=FB4QHJX2WFQ5 type=write size=183446 2024-08-08T23:35:50.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.389+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=ZJD8LRAFRTFV type=del 2024-08-08T23:35:50.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.393+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=XQGXBRSKVLQW type=del size=219851 2024-08-08T23:35:50.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.397+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.0 size=1048576 2024-08-08T23:35:50.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.397+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.1 size=1048576 2024-08-08T23:35:50.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.401+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~LI7AZS0TUD6K.2 size=371136 2024-08-08T23:35:50.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.405+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=LI7AZS0TUD6K tag=I9AVNVFYL2R7 type=write size=3516864 2024-08-08T23:35:50.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.413+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~W55L6EJ9DTL9.0 size=425501 2024-08-08T23:35:50.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.413+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=W55L6EJ9DTL9 tag=O7SXR80AOK1O type=write size=1474077 2024-08-08T23:35:50.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.417+0000 7fdbd6e2c8c0 1 < suggested remove operation key=JWTLJG79MYI5 tag=JZ3FS6M67G0M type=del 2024-08-08T23:35:50.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.421+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=I6W5K65SJBEO type=del size=1559782 2024-08-08T23:35:50.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.425+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=D64VV8L9ZKMB type=del 2024-08-08T23:35:50.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.425+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=O1O9127F7RV4 type=del size=2009254 2024-08-08T23:35:50.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.429+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=K430YDB7EZY5 type=del 2024-08-08T23:35:50.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.433+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~GSXO4Z8LAJHS.0 size=1048576 2024-08-08T23:35:50.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.437+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~GSXO4Z8LAJHS.1 size=164880 2024-08-08T23:35:50.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.437+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=GSXO4Z8LAJHS tag=99HL5FZZTR2P type=write size=2262032 2024-08-08T23:35:50.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.437+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~9SYW8Q7UMNTU.0 size=90711 2024-08-08T23:35:50.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.445+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=9SYW8Q7UMNTU tag=726N6BMY76QT type=write size=1139287 2024-08-08T23:35:50.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.449+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~GHCO6V690THM.0 size=479127 2024-08-08T23:35:50.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.449+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=GHCO6V690THM tag=OOPI0RKRSYG1 type=write size=1527703 2024-08-08T23:35:50.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.449+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=K76UIBS6J23A type=del 2024-08-08T23:35:50.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.453+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=Y3Y4C7EDPC43 type=del size=1533740 2024-08-08T23:35:50.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.457+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~W822VYMDRANZ.0 size=642280 2024-08-08T23:35:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.461+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=W822VYMDRANZ tag=BHQ4VB9YHLW2 type=write size=1690856 2024-08-08T23:35:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.465+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=HRWT8DL6JEAP type=write size=467780 2024-08-08T23:35:50.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.465+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=SXXKZY44X6HX type=del 2024-08-08T23:35:50.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.469+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=73PKPOYPMBYX type=write size=503702 2024-08-08T23:35:50.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.473+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.0 size=1048576 2024-08-08T23:35:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.473+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.1 size=1048576 2024-08-08T23:35:50.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.477+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~MVVQ4DQ15TW5.2 size=552137 2024-08-08T23:35:50.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.481+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=MVVQ4DQ15TW5 tag=N41F5XUFDJL1 type=write size=3697865 2024-08-08T23:35:50.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.485+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=JQWJS9QCNJ37 type=del size=3144730 2024-08-08T23:35:50.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.489+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.0 size=1048576 2024-08-08T23:35:50.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.489+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.1 size=1048576 2024-08-08T23:35:50.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.493+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~D3A7PJESPO7J.2 size=506377 2024-08-08T23:35:50.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.497+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=D3A7PJESPO7J tag=96O82LSPEIDV type=write size=3652105 2024-08-08T23:35:50.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.501+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~ZS8TU2TNRWCF.0 size=1048576 2024-08-08T23:35:50.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.505+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~ZS8TU2TNRWCF.1 size=982965 2024-08-08T23:35:50.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.505+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=ZS8TU2TNRWCF tag=4J0UFAP7IDS8 type=write size=3080117 2024-08-08T23:35:50.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.509+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~JXS7B00KC5BD.0 size=621869 2024-08-08T23:35:50.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.513+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=JXS7B00KC5BD tag=DQXRZZN462UO type=write size=1670445 2024-08-08T23:35:50.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.517+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=GWUKI14TTZNH type=del size=1229880 2024-08-08T23:35:50.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.521+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~295B7GZN8N76.0 size=398498 2024-08-08T23:35:50.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.525+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=295B7GZN8N76 tag=KOYC12ERF1IS type=write size=1447074 2024-08-08T23:35:50.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.529+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=N6DBCMA4GKN1 type=del size=3089345 2024-08-08T23:35:50.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.533+0000 7fdbd6e2c8c0 1 < suggested update operation key=Z5EXY8ZHZCHI tag=5AETA6F210RM type=write size=126403 2024-08-08T23:35:50.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.537+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~ILV7SWS3E2MC.0 size=1048576 2024-08-08T23:35:50.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.541+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~ILV7SWS3E2MC.1 size=891787 2024-08-08T23:35:50.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.541+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=ILV7SWS3E2MC tag=O3HT06AYMBIM type=write size=2988939 2024-08-08T23:35:50.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.545+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=QXKOHLIVGJXQ type=write size=494990 2024-08-08T23:35:50.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.549+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=HD22II54SR7B type=del size=881211 2024-08-08T23:35:50.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.553+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V3TA5KZ95NXT tag=FB4QHJX2WFQ5 type=write 2024-08-08T23:35:50.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.561+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.0 size=1048576 2024-08-08T23:35:50.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.561+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.1 size=1048576 2024-08-08T23:35:50.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.565+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.2 size=494654 2024-08-08T23:35:50.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.565+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=3HKBN51P5PSV tag=PV7Q4WQLOEQ5 type=write size=3640382 2024-08-08T23:35:50.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.569+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=XQGXBRSKVLQW type=del 2024-08-08T23:35:50.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.573+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.0 size=1048576 2024-08-08T23:35:50.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.577+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.1 size=1048576 2024-08-08T23:35:50.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.577+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.2 size=209311 2024-08-08T23:35:50.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.577+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=1GEMR7PVX2J1 tag=EOZBRH6ID4BE type=write size=3355039 2024-08-08T23:35:50.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.581+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~W55L6EJ9DTL9.0 size=425501 2024-08-08T23:35:50.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.589+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=W55L6EJ9DTL9 tag=O7SXR80AOK1O type=write size=1474077 2024-08-08T23:35:50.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.593+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~KZ7URZ0QNJL9.0 size=722602 2024-08-08T23:35:50.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.593+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=KZ7URZ0QNJL9 tag=I0BE7MVHYFG7 type=write size=1771178 2024-08-08T23:35:50.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.597+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=I6W5K65SJBEO type=del 2024-08-08T23:35:50.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.605+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~87KXG5RONHUK.0 size=422075 2024-08-08T23:35:50.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.605+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=87KXG5RONHUK tag=M231H3H7B3DD type=write size=1470651 2024-08-08T23:35:50.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.609+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=O1O9127F7RV4 type=del 2024-08-08T23:35:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.613+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~LUI068UR7FYH.0 size=781495 2024-08-08T23:35:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.613+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=LUI068UR7FYH tag=J0IMF0VJJLO5 type=write size=1830071 2024-08-08T23:35:50.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.617+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~GSXO4Z8LAJHS.0 size=1048576 2024-08-08T23:35:50.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.621+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~GSXO4Z8LAJHS.1 size=164880 2024-08-08T23:35:50.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.625+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=GSXO4Z8LAJHS tag=99HL5FZZTR2P type=write size=2262032 2024-08-08T23:35:50.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.629+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=WIEZJR5ED870 type=del size=33712 2024-08-08T23:35:50.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.629+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~GHCO6V690THM.0 size=479127 2024-08-08T23:35:50.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.637+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=GHCO6V690THM tag=OOPI0RKRSYG1 type=write size=1527703 2024-08-08T23:35:50.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.637+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=URU746PTEW4X type=write size=768731 2024-08-08T23:35:50.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.641+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=Y3Y4C7EDPC43 type=del 2024-08-08T23:35:50.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.649+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~CZ019LD0OHFE.0 size=1048576 2024-08-08T23:35:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.649+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~CZ019LD0OHFE.1 size=590653 2024-08-08T23:35:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.649+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=CZ019LD0OHFE tag=R63XSXC5ZZKF type=write size=2687805 2024-08-08T23:35:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.657+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=HRWT8DL6JEAP type=write 2024-08-08T23:35:50.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~OZ0HU9Y1NSEN.0 size=571495 2024-08-08T23:35:50.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.661+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=OZ0HU9Y1NSEN tag=BRJSC2D0GCJ4 type=write size=1620071 2024-08-08T23:35:50.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.665+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=73PKPOYPMBYX type=write size=503702 2024-08-08T23:35:50.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.669+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.0 size=1048576 2024-08-08T23:35:50.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.673+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.1 size=1048576 2024-08-08T23:35:50.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.673+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.2 size=821236 2024-08-08T23:35:50.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.673+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=CDI4E3BJ4I99 tag=CYHNGNP9MXD5 type=write size=3966964 2024-08-08T23:35:50.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.677+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=JQWJS9QCNJ37 type=del 2024-08-08T23:35:50.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.681+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~OPDGB9XU9ZS7.0 size=329067 2024-08-08T23:35:50.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.681+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=OPDGB9XU9ZS7 tag=T29EO7A20M0T type=write size=1377643 2024-08-08T23:35:50.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.685+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~ZS8TU2TNRWCF.0 size=1048576 2024-08-08T23:35:50.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.689+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~ZS8TU2TNRWCF.1 size=982965 2024-08-08T23:35:50.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.693+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=ZS8TU2TNRWCF tag=4J0UFAP7IDS8 type=write size=3080117 2024-08-08T23:35:50.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.697+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=CYN0P2ZTHW84 type=del size=1702374 2024-08-08T23:35:50.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.701+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=GWUKI14TTZNH type=del 2024-08-08T23:35:50.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.705+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=QGQMD3NN9XBT type=del size=3667055 2024-08-08T23:35:50.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.709+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=N6DBCMA4GKN1 type=del 2024-08-08T23:35:50.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.713+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=TJPACSOY62AR type=del size=21937 2024-08-08T23:35:50.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.713+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~ILV7SWS3E2MC.0 size=1048576 2024-08-08T23:35:50.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.717+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~ILV7SWS3E2MC.1 size=891787 2024-08-08T23:35:50.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.721+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=ILV7SWS3E2MC tag=O3HT06AYMBIM type=write size=2988939 2024-08-08T23:35:50.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.725+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=81HP3YX7OCI3 type=del size=3363769 2024-08-08T23:35:50.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.729+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=HD22II54SR7B type=del 2024-08-08T23:35:50.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.733+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=7DOQGH0BC18S type=del size=3726199 2024-08-08T23:35:50.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.733+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.0 size=1048576 2024-08-08T23:35:50.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.733+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.1 size=1048576 2024-08-08T23:35:50.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.737+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~3HKBN51P5PSV.2 size=494654 2024-08-08T23:35:50.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.741+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=3HKBN51P5PSV tag=PV7Q4WQLOEQ5 type=write size=3640382 2024-08-08T23:35:50.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.745+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=2R9K9WJ7099U type=del size=950187 2024-08-08T23:35:50.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.745+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.0 size=1048576 2024-08-08T23:35:50.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.749+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.1 size=1048576 2024-08-08T23:35:50.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.753+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~1GEMR7PVX2J1.2 size=209311 2024-08-08T23:35:50.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.757+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=1GEMR7PVX2J1 tag=EOZBRH6ID4BE type=write size=3355039 2024-08-08T23:35:50.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.761+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=3OOOUIKVEVXZ type=del size=859369 2024-08-08T23:35:50.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.765+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~KZ7URZ0QNJL9.0 size=722602 2024-08-08T23:35:50.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.769+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=KZ7URZ0QNJL9 tag=I0BE7MVHYFG7 type=write size=1771178 2024-08-08T23:35:50.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.773+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=POUIG4NZL13V type=write size=275833 2024-08-08T23:35:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.777+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~87KXG5RONHUK.0 size=422075 2024-08-08T23:35:50.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.781+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=87KXG5RONHUK tag=M231H3H7B3DD type=write size=1470651 2024-08-08T23:35:50.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.785+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=S002DE5ZNCTV type=del size=431518 2024-08-08T23:35:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.785+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~LUI068UR7FYH.0 size=781495 2024-08-08T23:35:50.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.793+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=LUI068UR7FYH tag=J0IMF0VJJLO5 type=write size=1830071 2024-08-08T23:35:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.801+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~JOU0SF5I1L3G.0 size=734761 2024-08-08T23:35:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.801+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=JOU0SF5I1L3G tag=H1C1CEWEIK1K type=write size=1783337 2024-08-08T23:35:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.805+0000 7fdbd6e2c8c0 1 < canceled operation key=QANZ3YTL2NQV tag=WIEZJR5ED870 type=del size=33712 2024-08-08T23:35:50.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.805+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=ZINF1DQGN32K type=write size=804145 2024-08-08T23:35:50.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.809+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=URU746PTEW4X type=write size=768731 2024-08-08T23:35:50.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.813+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=QN0V0Y03AWYZ type=del size=1737830 2024-08-08T23:35:50.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.813+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~CZ019LD0OHFE.0 size=1048576 2024-08-08T23:35:50.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.817+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~CZ019LD0OHFE.1 size=590653 2024-08-08T23:35:50.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.821+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=CZ019LD0OHFE tag=R63XSXC5ZZKF type=write size=2687805 2024-08-08T23:35:50.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.825+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=6R8EMRJO9BW8 type=del size=2711150 2024-08-08T23:35:50.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.829+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~OZ0HU9Y1NSEN.0 size=571495 2024-08-08T23:35:50.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.833+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=OZ0HU9Y1NSEN tag=BRJSC2D0GCJ4 type=write size=1620071 2024-08-08T23:35:50.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.833+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=09WLT5S16M37 type=write size=274782 2024-08-08T23:35:50.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.837+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.0 size=1048576 2024-08-08T23:35:50.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.841+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.1 size=1048576 2024-08-08T23:35:50.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.841+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~CDI4E3BJ4I99.2 size=821236 2024-08-08T23:35:50.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.849+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=CDI4E3BJ4I99 tag=CYHNGNP9MXD5 type=write size=3966964 2024-08-08T23:35:50.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.853+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.0 size=1048576 2024-08-08T23:35:50.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.857+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.1 size=1048576 2024-08-08T23:35:50.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.857+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.2 size=963857 2024-08-08T23:35:50.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.857+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=TOTX6H0E24YE tag=33X1UNFH067M type=write size=4109585 2024-08-08T23:35:50.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.861+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~OPDGB9XU9ZS7.0 size=329067 2024-08-08T23:35:50.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.865+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=OPDGB9XU9ZS7 tag=T29EO7A20M0T type=write size=1377643 2024-08-08T23:35:50.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.869+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=EXAHETESAYWP type=del size=828577 2024-08-08T23:35:50.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.873+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=CYN0P2ZTHW84 type=del 2024-08-08T23:35:50.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.873+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=35TZN7ZKU65P type=del size=352564 2024-08-08T23:35:50.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.877+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=QGQMD3NN9XBT type=del 2024-08-08T23:35:50.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.881+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.0 size=1048576 2024-08-08T23:35:50.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.885+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.1 size=1048576 2024-08-08T23:35:50.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.889+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.2 size=834049 2024-08-08T23:35:50.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.889+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=PPNIHLP4CDFB tag=08K9J566LEVF type=write size=3979777 2024-08-08T23:35:50.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.893+0000 7fdbd6e2c8c0 1 < suggested remove operation key=63GVT7KRKCSS tag=TJPACSOY62AR type=del 2024-08-08T23:35:50.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.897+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=0MBO5Y1ER2VO type=del size=2870439 2024-08-08T23:35:50.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.897+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=81HP3YX7OCI3 type=del 2024-08-08T23:35:50.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.905+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~J0Q2AQ4NIQ2B.0 size=133709 2024-08-08T23:35:50.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.905+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=J0Q2AQ4NIQ2B tag=T0KTTM8UETPH type=write size=1182285 2024-08-08T23:35:50.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.909+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=7DOQGH0BC18S type=del 2024-08-08T23:35:50.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.913+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=IL0S7BCQ9DO0 type=write size=999442 2024-08-08T23:35:50.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.913+0000 7fdbd6e2c8c0 1 < canceled operation key=W5OVPO7BGE4S tag=2R9K9WJ7099U type=del size=950187 2024-08-08T23:35:50.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.917+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=VUIKLNAJR22N type=del size=2825632 2024-08-08T23:35:50.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.921+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=3OOOUIKVEVXZ type=del 2024-08-08T23:35:50.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.925+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~HWS3SPVYQPSI.0 size=351965 2024-08-08T23:35:50.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.925+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=HWS3SPVYQPSI tag=YK5DMX54JFM3 type=write size=1400541 2024-08-08T23:35:50.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.929+0000 7fdbd6e2c8c0 1 < suggested update operation key=V6GSJH62C8TA tag=POUIG4NZL13V type=write size=275833 2024-08-08T23:35:50.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.933+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=O5IWOPXFPDFQ type=write size=326754 2024-08-08T23:35:50.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.937+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=V6GSJH62C8TA tag=S002DE5ZNCTV type=del size=431518: (22) Invalid argument 2024-08-08T23:35:50.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.941+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=BYC09FO84VFS type=del size=2612993 2024-08-08T23:35:50.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.941+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VSLBN9AVZK00.2~JOU0SF5I1L3G.0 size=734761 2024-08-08T23:35:50.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.945+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VSLBN9AVZK00 upload=JOU0SF5I1L3G tag=H1C1CEWEIK1K type=write size=1783337 2024-08-08T23:35:50.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.949+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=FI6KRYJV1U7F type=del size=1309474 2024-08-08T23:35:50.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.953+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=ZINF1DQGN32K type=write size=804145 2024-08-08T23:35:50.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.957+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.0 size=1048576 2024-08-08T23:35:50.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.961+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.1 size=1048576 2024-08-08T23:35:50.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.965+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.2 size=269839 2024-08-08T23:35:50.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.965+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=8J1735VO1N62 tag=NXH7NK62XLXM type=write size=3415567 2024-08-08T23:35:50.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.965+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=QN0V0Y03AWYZ type=del 2024-08-08T23:35:50.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.973+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.0 size=1048576 2024-08-08T23:35:50.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.973+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.1 size=1048576 2024-08-08T23:35:50.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.977+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.2 size=996721 2024-08-08T23:35:50.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.977+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=XZ5H0NI6C8JQ tag=V7YBIXA0MXBC type=write size=4142449 2024-08-08T23:35:50.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.981+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=6R8EMRJO9BW8 type=del 2024-08-08T23:35:50.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.981+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=KXN35H3SWBWG type=del size=3694688 2024-08-08T23:35:50.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.985+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=41XLZV9ZY5OP tag=09WLT5S16M37 type=write size=274782: (22) Invalid argument 2024-08-08T23:35:50.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.989+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~7B08XDQQP1VR.0 size=1048576 2024-08-08T23:35:50.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.993+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~7B08XDQQP1VR.1 size=957199 2024-08-08T23:35:50.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.993+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=7B08XDQQP1VR tag=TLXHINCGZ6OZ type=write size=3054351 2024-08-08T23:35:50.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.993+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.0 size=1048576 2024-08-08T23:35:50.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:50.997+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.1 size=1048576 2024-08-08T23:35:51.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.001+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~TOTX6H0E24YE.2 size=963857 2024-08-08T23:35:51.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.005+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=TOTX6H0E24YE tag=33X1UNFH067M type=write size=4109585 2024-08-08T23:35:51.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.009+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=2QFEQVYHVJYG type=del size=1284920 2024-08-08T23:35:51.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.013+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=EXAHETESAYWP type=del 2024-08-08T23:35:51.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~UQJ0PXKN0TOS.0 size=1048576 2024-08-08T23:35:51.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.017+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~UQJ0PXKN0TOS.1 size=899280 2024-08-08T23:35:51.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.017+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=UQJ0PXKN0TOS tag=710EBRJP6PDZ type=write size=2996432 2024-08-08T23:35:51.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.021+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=35TZN7ZKU65P type=del 2024-08-08T23:35:51.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.025+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=V46FZKILK1FK type=del size=3797773 2024-08-08T23:35:51.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.029+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.0 size=1048576 2024-08-08T23:35:51.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.029+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.1 size=1048576 2024-08-08T23:35:51.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.033+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~PPNIHLP4CDFB.2 size=834049 2024-08-08T23:35:51.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.037+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=PPNIHLP4CDFB tag=08K9J566LEVF type=write size=3979777 2024-08-08T23:35:51.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.037+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=X80QSTBB0S74 type=write size=453990 2024-08-08T23:35:51.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.041+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=0MBO5Y1ER2VO type=del 2024-08-08T23:35:51.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.045+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=1B3CMGIGWPGW type=del size=3009942 2024-08-08T23:35:51.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.049+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~J0Q2AQ4NIQ2B.0 size=133709 2024-08-08T23:35:51.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.053+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=J0Q2AQ4NIQ2B tag=T0KTTM8UETPH type=write size=1182285 2024-08-08T23:35:51.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.053+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=4XA9E28M8LLD type=write size=663380 2024-08-08T23:35:51.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.057+0000 7fdbd6e2c8c0 1 < canceled operation key=W5OVPO7BGE4S tag=IL0S7BCQ9DO0 type=write size=999442 2024-08-08T23:35:51.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.061+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=GNIMWEGOK1T6 type=del size=948299 2024-08-08T23:35:51.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.065+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=VUIKLNAJR22N type=del 2024-08-08T23:35:51.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.069+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~J0GJCEHP3L90.0 size=1048576 2024-08-08T23:35:51.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.073+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~J0GJCEHP3L90.1 size=418204 2024-08-08T23:35:51.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.073+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=J0GJCEHP3L90 tag=PPKB5I9J001D type=write size=2515356 2024-08-08T23:35:51.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.073+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~HWS3SPVYQPSI.0 size=351965 2024-08-08T23:35:51.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.081+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=HWS3SPVYQPSI tag=YK5DMX54JFM3 type=write size=1400541 2024-08-08T23:35:51.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.081+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=XLK4WU37RF5E type=del size=365607 2024-08-08T23:35:51.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.089+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=O5IWOPXFPDFQ type=write size=326754 2024-08-08T23:35:51.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.089+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=RS4KDUN0VN2S type=del size=258582 2024-08-08T23:35:51.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.093+0000 7fdbd6e2c8c0 1 < suggested update operation key=P3H05VKM0ZGJ tag=BYC09FO84VFS type=del size=2612993 2024-08-08T23:35:51.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.097+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=MZTOE90LM554 type=del size=3044542 2024-08-08T23:35:51.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.101+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=FI6KRYJV1U7F type=del 2024-08-08T23:35:51.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.105+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~4Q00P5WS8NNA.0 size=1048576 2024-08-08T23:35:51.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.109+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~4Q00P5WS8NNA.1 size=220755 2024-08-08T23:35:51.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.109+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=4Q00P5WS8NNA tag=T3XGRJ0A3UYV type=write size=2317907 2024-08-08T23:35:51.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.109+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.0 size=1048576 2024-08-08T23:35:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.113+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.1 size=1048576 2024-08-08T23:35:51.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.117+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~8J1735VO1N62.2 size=269839 2024-08-08T23:35:51.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.121+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=8J1735VO1N62 tag=NXH7NK62XLXM type=write size=3415567 2024-08-08T23:35:51.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.121+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=OLO8YEUAS0Z5 type=del size=2455302 2024-08-08T23:35:51.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.125+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.0 size=1048576 2024-08-08T23:35:51.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.129+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.1 size=1048576 2024-08-08T23:35:51.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.129+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~XZ5H0NI6C8JQ.2 size=996721 2024-08-08T23:35:51.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.133+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=XZ5H0NI6C8JQ tag=V7YBIXA0MXBC type=write size=4142449 2024-08-08T23:35:51.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.137+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=157SDV43HFHU type=del size=2764100 2024-08-08T23:35:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.141+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=KXN35H3SWBWG type=del 2024-08-08T23:35:51.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.145+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~PXAR494BBY2B.0 size=1048576 2024-08-08T23:35:51.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.149+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~PXAR494BBY2B.1 size=191476 2024-08-08T23:35:51.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.149+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=PXAR494BBY2B tag=MMZWGUVE5PXY type=write size=2288628 2024-08-08T23:35:51.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.149+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~7B08XDQQP1VR.0 size=1048576 2024-08-08T23:35:51.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.153+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~7B08XDQQP1VR.1 size=957199 2024-08-08T23:35:51.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.157+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=7B08XDQQP1VR tag=TLXHINCGZ6OZ type=write size=3054351 2024-08-08T23:35:51.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.161+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~27D73PL1GXOI.0 size=1048576 2024-08-08T23:35:51.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.165+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~27D73PL1GXOI.1 size=362362 2024-08-08T23:35:51.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.165+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=27D73PL1GXOI tag=3H04VDHIOR3S type=write size=2459514 2024-08-08T23:35:51.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.169+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=2QFEQVYHVJYG type=del 2024-08-08T23:35:51.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.177+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.0 size=1048576 2024-08-08T23:35:51.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.177+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.1 size=1048576 2024-08-08T23:35:51.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.181+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.2 size=107465 2024-08-08T23:35:51.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.181+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=OZ54VR491GAG tag=SWO827TXW5LQ type=write size=3253193 2024-08-08T23:35:51.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.181+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~UQJ0PXKN0TOS.0 size=1048576 2024-08-08T23:35:51.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.185+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~UQJ0PXKN0TOS.1 size=899280 2024-08-08T23:35:51.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.189+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=UQJ0PXKN0TOS tag=710EBRJP6PDZ type=write size=2996432 2024-08-08T23:35:51.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.193+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=1690NMDQHVAT type=del size=2574310 2024-08-08T23:35:51.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.193+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=V46FZKILK1FK type=del 2024-08-08T23:35:51.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.197+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=2PPJT05XB3DV type=write size=520764 2024-08-08T23:35:51.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.201+0000 7fdbd6e2c8c0 1 < completed write operation key=ZBEB2Q3J9Z0D tag=X80QSTBB0S74 type=write size=453990 2024-08-08T23:35:51.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.205+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=B4M2DB4M352O type=write size=304272 2024-08-08T23:35:51.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.209+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=1B3CMGIGWPGW type=del 2024-08-08T23:35:51.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.209+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=L68KSR9K1D26 type=del size=3267228 2024-08-08T23:35:51.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.213+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=4XA9E28M8LLD type=write size=663380 2024-08-08T23:35:51.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.217+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.0 size=1048576 2024-08-08T23:35:51.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.221+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.1 size=1048576 2024-08-08T23:35:51.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.225+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.2 size=33106 2024-08-08T23:35:51.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.225+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=5W8F6O7HNO7I tag=KF76KM7TB5J5 type=write size=3178834 2024-08-08T23:35:51.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.225+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=GNIMWEGOK1T6 type=del size=948299 2024-08-08T23:35:51.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.233+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~84L6IEHLM1AD.0 size=1048576 2024-08-08T23:35:51.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.233+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~84L6IEHLM1AD.1 size=806469 2024-08-08T23:35:51.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.233+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=84L6IEHLM1AD tag=XWQ9NKIAJ1H8 type=write size=2903621 2024-08-08T23:35:51.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.237+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~J0GJCEHP3L90.0 size=1048576 2024-08-08T23:35:51.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.241+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~J0GJCEHP3L90.1 size=418204 2024-08-08T23:35:51.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.245+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=J0GJCEHP3L90 tag=PPKB5I9J001D type=write size=2515356 2024-08-08T23:35:51.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.249+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=VEUL4H2EK16V type=write size=420741 2024-08-08T23:35:51.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.249+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=XLK4WU37RF5E type=del 2024-08-08T23:35:51.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.253+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=MNXR926Q05JC type=del size=1628090 2024-08-08T23:35:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.261+0000 7fdbd6e2c8c0 1 < suggested update operation key=MNV404EWJHC1 tag=RS4KDUN0VN2S type=del size=258582 2024-08-08T23:35:51.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.269+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~49A9VBX25I7X.0 size=8771 2024-08-08T23:35:51.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.269+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=49A9VBX25I7X tag=DIBIJX2BXOI7 type=write size=1057347 2024-08-08T23:35:51.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.269+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=MZTOE90LM554 type=del 2024-08-08T23:35:51.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.277+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~36OL4AK0CFVH.0 size=1048576 2024-08-08T23:35:51.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.277+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~36OL4AK0CFVH.1 size=866868 2024-08-08T23:35:51.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.277+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=36OL4AK0CFVH tag=4XEUP8GM3HNN type=write size=2964020 2024-08-08T23:35:51.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.281+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~4Q00P5WS8NNA.0 size=1048576 2024-08-08T23:35:51.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.281+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~4Q00P5WS8NNA.1 size=220755 2024-08-08T23:35:51.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.289+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=4Q00P5WS8NNA tag=T3XGRJ0A3UYV type=write size=2317907 2024-08-08T23:35:51.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.293+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~E5B3394Z6KIF.0 size=324784 2024-08-08T23:35:51.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.293+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=E5B3394Z6KIF tag=9QDAPH47RUW0 type=write size=1373360 2024-08-08T23:35:51.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.297+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=OLO8YEUAS0Z5 type=del 2024-08-08T23:35:51.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.301+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=C8O8Z565XQRL type=write size=959004 2024-08-08T23:35:51.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.305+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=157SDV43HFHU type=del 2024-08-08T23:35:51.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.305+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=BYQ4FAHXC20F type=write size=540505 2024-08-08T23:35:51.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.309+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~PXAR494BBY2B.0 size=1048576 2024-08-08T23:35:51.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.313+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~PXAR494BBY2B.1 size=191476 2024-08-08T23:35:51.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.317+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=PXAR494BBY2B tag=MMZWGUVE5PXY type=write size=2288628 2024-08-08T23:35:51.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.321+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~FIVCEF1YQQGF.0 size=1048576 2024-08-08T23:35:51.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.325+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~FIVCEF1YQQGF.1 size=16714 2024-08-08T23:35:51.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.325+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=FIVCEF1YQQGF tag=OCL7W81EW6HA type=write size=2113866 2024-08-08T23:35:51.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.325+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~27D73PL1GXOI.0 size=1048576 2024-08-08T23:35:51.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.333+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~27D73PL1GXOI.1 size=362362 2024-08-08T23:35:51.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.337+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=27D73PL1GXOI tag=3H04VDHIOR3S type=write size=2459514 2024-08-08T23:35:51.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.337+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=BDFGVFA5O1LU type=del size=1114692 2024-08-08T23:35:51.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.341+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.0 size=1048576 2024-08-08T23:35:51.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.345+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.1 size=1048576 2024-08-08T23:35:51.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.345+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~OZ54VR491GAG.2 size=107465 2024-08-08T23:35:51.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.349+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=OZ54VR491GAG tag=SWO827TXW5LQ type=write size=3253193 2024-08-08T23:35:51.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.353+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=XXJTQW4JRXM2 type=write size=560690 2024-08-08T23:35:51.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.357+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=1690NMDQHVAT type=del 2024-08-08T23:35:51.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.361+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.0 size=1048576 2024-08-08T23:35:51.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.365+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.1 size=1048576 2024-08-08T23:35:51.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.369+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.2 size=1015645 2024-08-08T23:35:51.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.369+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=WFU2FDXM5V0P tag=641LKCCOUWWW type=write size=4161373 2024-08-08T23:35:51.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.373+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=2PPJT05XB3DV type=write size=520764 2024-08-08T23:35:51.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.377+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=M03221778APC type=write size=1044318 2024-08-08T23:35:51.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.381+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=B4M2DB4M352O type=write size=304272 2024-08-08T23:35:51.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.381+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=UIWHD5N74VVL type=del size=1392298 2024-08-08T23:35:51.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.389+0000 7fdbd6e2c8c0 1 < suggested update operation key=VGT9IXWM956F tag=L68KSR9K1D26 type=del size=3267228 2024-08-08T23:35:51.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.393+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=I7PJH2JLKCSG type=write size=663708 2024-08-08T23:35:51.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.397+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.0 size=1048576 2024-08-08T23:35:51.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.397+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.1 size=1048576 2024-08-08T23:35:51.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.401+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~5W8F6O7HNO7I.2 size=33106 2024-08-08T23:35:51.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.405+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=5W8F6O7HNO7I tag=KF76KM7TB5J5 type=write size=3178834 2024-08-08T23:35:51.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.413+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~YZS9T4A8RMLQ.0 size=680973 2024-08-08T23:35:51.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.413+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=YZS9T4A8RMLQ tag=CO33KYHLGH6Y type=write size=1729549 2024-08-08T23:35:51.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.417+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~84L6IEHLM1AD.0 size=1048576 2024-08-08T23:35:51.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.421+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~84L6IEHLM1AD.1 size=806469 2024-08-08T23:35:51.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.425+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=84L6IEHLM1AD tag=XWQ9NKIAJ1H8 type=write size=2903621 2024-08-08T23:35:51.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.429+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=YGW69LXGVOF8 type=write size=693124 2024-08-08T23:35:51.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.433+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=VEUL4H2EK16V type=write size=420741 2024-08-08T23:35:51.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.437+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~YRAHFL9FXXV8.0 size=756936 2024-08-08T23:35:51.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.437+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=YRAHFL9FXXV8 tag=31FNYHYYX2QS type=write size=1805512 2024-08-08T23:35:51.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.441+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=MNXR926Q05JC type=del 2024-08-08T23:35:51.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.445+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=T99PT03TZZMD type=write size=643693 2024-08-08T23:35:51.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.449+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~49A9VBX25I7X.0 size=8771 2024-08-08T23:35:51.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.453+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=49A9VBX25I7X tag=DIBIJX2BXOI7 type=write size=1057347 2024-08-08T23:35:51.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.457+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=KSOM68UFY91O type=del size=1558941 2024-08-08T23:35:51.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.461+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~36OL4AK0CFVH.0 size=1048576 2024-08-08T23:35:51.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.461+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~36OL4AK0CFVH.1 size=866868 2024-08-08T23:35:51.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.469+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=36OL4AK0CFVH tag=4XEUP8GM3HNN type=write size=2964020 2024-08-08T23:35:51.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.473+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=EXMQ22K0JZIP type=del size=12771 2024-08-08T23:35:51.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.473+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_XIXN9HLLSJS3.2~E5B3394Z6KIF.0 size=324784 2024-08-08T23:35:51.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.477+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=XIXN9HLLSJS3 upload=E5B3394Z6KIF tag=9QDAPH47RUW0 type=write size=1373360 2024-08-08T23:35:51.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.481+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=3AH4SXHYI095 type=del size=3952897 2024-08-08T23:35:51.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.485+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=C8O8Z565XQRL type=write size=959004 2024-08-08T23:35:51.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.489+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=XPIHFERC5PPQ type=del size=1825217 2024-08-08T23:35:51.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.493+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=BYQ4FAHXC20F type=write size=540505 2024-08-08T23:35:51.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.497+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.0 size=1048576 2024-08-08T23:35:51.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.501+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.1 size=1048576 2024-08-08T23:35:51.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.505+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.2 size=778078 2024-08-08T23:35:51.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.505+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=Z2CPSBENJ22W tag=B76DHT5GVIRJ type=write size=3923806 2024-08-08T23:35:51.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.509+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~FIVCEF1YQQGF.0 size=1048576 2024-08-08T23:35:51.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.509+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~FIVCEF1YQQGF.1 size=16714 2024-08-08T23:35:51.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.517+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=FIVCEF1YQQGF tag=OCL7W81EW6HA type=write size=2113866 2024-08-08T23:35:51.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.517+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=V8A8KCVFN0NB type=del size=3720589 2024-08-08T23:35:51.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.521+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=BDFGVFA5O1LU type=del 2024-08-08T23:35:51.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.525+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=QY0E6V3MLYS5 type=del size=3309165 2024-08-08T23:35:51.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.533+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=XXJTQW4JRXM2 type=write 2024-08-08T23:35:51.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.537+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~ETA0NJXQ9KUD.0 size=121443 2024-08-08T23:35:51.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.537+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=ETA0NJXQ9KUD tag=J82FWAP9RN2A type=write size=1170019 2024-08-08T23:35:51.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.541+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.0 size=1048576 2024-08-08T23:35:51.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.545+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.1 size=1048576 2024-08-08T23:35:51.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.549+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~WFU2FDXM5V0P.2 size=1015645 2024-08-08T23:35:51.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.553+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=WFU2FDXM5V0P tag=641LKCCOUWWW type=write size=4161373 2024-08-08T23:35:51.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.561+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~JRHWW5EYIAP4.0 size=1048576 2024-08-08T23:35:51.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.561+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~JRHWW5EYIAP4.1 size=628392 2024-08-08T23:35:51.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.561+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=JRHWW5EYIAP4 tag=0XYTAM48AYAZ type=write size=2725544 2024-08-08T23:35:51.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.569+0000 7fdbd6e2c8c0 1 < suggested update operation key=63GVT7KRKCSS tag=M03221778APC type=write size=1044318 2024-08-08T23:35:51.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.573+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=G0SQ45PX25EW type=del size=4070662 2024-08-08T23:35:51.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.577+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=UIWHD5N74VVL type=del 2024-08-08T23:35:51.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.577+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=KCJO4GZEX037 type=del size=4066753 2024-08-08T23:35:51.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.581+0000 7fdbd6e2c8c0 1 < canceled operation key=NMB4GI8R2BKU tag=I7PJH2JLKCSG type=write size=663708 2024-08-08T23:35:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.589+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~9WMJAV4TW2LE.0 size=400671 2024-08-08T23:35:51.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.589+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=9WMJAV4TW2LE tag=1VA1WVH0CVKJ type=write size=1449247 2024-08-08T23:35:51.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.593+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~YZS9T4A8RMLQ.0 size=680973 2024-08-08T23:35:51.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.597+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=YZS9T4A8RMLQ tag=CO33KYHLGH6Y type=write size=1729549 2024-08-08T23:35:51.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.601+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=Q8J9KROIQCAU type=del size=3981551 2024-08-08T23:35:51.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.605+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=63GVT7KRKCSS tag=YGW69LXGVOF8 type=write size=693124: (22) Invalid argument 2024-08-08T23:35:51.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.609+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=4YRPWC640BZJ type=del size=3187939 2024-08-08T23:35:51.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.613+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~YRAHFL9FXXV8.0 size=756936 2024-08-08T23:35:51.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.617+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=YRAHFL9FXXV8 tag=31FNYHYYX2QS type=write size=1805512 2024-08-08T23:35:51.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.625+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~IPI0L7EK23N0.0 size=1044810 2024-08-08T23:35:51.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.625+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=IPI0L7EK23N0 tag=SD2ZFGT6XPPI type=write size=2093386 2024-08-08T23:35:51.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.629+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=T99PT03TZZMD type=write size=643693 2024-08-08T23:35:51.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.633+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=24OORZW2EDYW type=del size=954513 2024-08-08T23:35:51.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.637+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=KSOM68UFY91O type=del 2024-08-08T23:35:51.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.645+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~KH5BB13F6T0A.0 size=1048576 2024-08-08T23:35:51.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.649+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~KH5BB13F6T0A.1 size=1003948 2024-08-08T23:35:51.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.649+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=KH5BB13F6T0A tag=EIX2YMTR6GTV type=write size=3101100 2024-08-08T23:35:51.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.653+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=EXMQ22K0JZIP type=del size=12771 2024-08-08T23:35:51.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.0 size=1048576 2024-08-08T23:35:51.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.661+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.1 size=1048576 2024-08-08T23:35:51.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.665+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.2 size=930944 2024-08-08T23:35:51.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.665+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=CJ6GNO5EV7JI tag=T617C69OAYC8 type=write size=4076672 2024-08-08T23:35:51.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.669+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=3AH4SXHYI095 type=del 2024-08-08T23:35:51.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.677+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~UR7FO5EGE70F.0 size=395531 2024-08-08T23:35:51.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.677+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=UR7FO5EGE70F tag=DGJO10UVHR8K type=write size=1444107 2024-08-08T23:35:51.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.677+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=XPIHFERC5PPQ type=del 2024-08-08T23:35:51.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.681+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=X94BSDZKXLVL type=del size=3729013 2024-08-08T23:35:51.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.685+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.0 size=1048576 2024-08-08T23:35:51.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.689+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.1 size=1048576 2024-08-08T23:35:51.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.689+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~Z2CPSBENJ22W.2 size=778078 2024-08-08T23:35:51.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.697+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=Z2CPSBENJ22W tag=B76DHT5GVIRJ type=write size=3923806 2024-08-08T23:35:51.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.697+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=AAJ4YSAQ6VWS type=del size=3891609 2024-08-08T23:35:51.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.701+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=W5OVPO7BGE4S tag=V8A8KCVFN0NB type=del size=3720589: (22) Invalid argument 2024-08-08T23:35:51.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.705+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=7LVYK9N4X68P type=write size=130171 2024-08-08T23:35:51.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.709+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=QY0E6V3MLYS5 type=del 2024-08-08T23:35:51.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.713+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=EW3ZUZKTP3DQ type=del size=1002933 2024-08-08T23:35:51.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.713+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~ETA0NJXQ9KUD.0 size=121443 2024-08-08T23:35:51.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.717+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=ETA0NJXQ9KUD tag=J82FWAP9RN2A type=write size=1170019 2024-08-08T23:35:51.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.721+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~WKVZS12DK60W.0 size=1048576 2024-08-08T23:35:51.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.725+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~WKVZS12DK60W.1 size=354101 2024-08-08T23:35:51.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.725+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=WKVZS12DK60W tag=GCY0513F3OXF type=write size=2451253 2024-08-08T23:35:51.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.725+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~JRHWW5EYIAP4.0 size=1048576 2024-08-08T23:35:51.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.725+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FBCEC998C8EJ.2~JRHWW5EYIAP4.1 size=628392 2024-08-08T23:35:51.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.729+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FBCEC998C8EJ upload=JRHWW5EYIAP4 tag=0XYTAM48AYAZ type=write size=2725544 2024-08-08T23:35:51.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.733+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=UTDMALOJL6AI type=del size=2595904 2024-08-08T23:35:51.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.737+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=G0SQ45PX25EW type=del 2024-08-08T23:35:51.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.741+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.0 size=1048576 2024-08-08T23:35:51.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.741+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.1 size=1048576 2024-08-08T23:35:51.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.745+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.2 size=506979 2024-08-08T23:35:51.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.745+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=IBBPXKWUK57Q tag=X5S26826BFPS type=write size=3652707 2024-08-08T23:35:51.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.748+0000 7fdbd6e2c8c0 1 < suggested update operation key=QHN8QYEEOHYO tag=KCJO4GZEX037 type=del size=4066753 2024-08-08T23:35:51.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.756+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~B0S5GWR6HEKC.0 size=582630 2024-08-08T23:35:51.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.756+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=B0S5GWR6HEKC tag=CKXKZHGS8KJL type=write size=1631206 2024-08-08T23:35:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~9WMJAV4TW2LE.0 size=400671 2024-08-08T23:35:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.764+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=9WMJAV4TW2LE tag=1VA1WVH0CVKJ type=write size=1449247 2024-08-08T23:35:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.768+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~9TQ0FSY92EMR.0 size=1048576 2024-08-08T23:35:51.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~9TQ0FSY92EMR.1 size=400359 2024-08-08T23:35:51.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.772+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=9TQ0FSY92EMR tag=FQIH8C6LFUR0 type=write size=2497511 2024-08-08T23:35:51.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.776+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YNQU8Z202QCM tag=Q8J9KROIQCAU type=del 2024-08-08T23:35:51.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.780+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=898YS6Y5NR80 type=write size=250736 2024-08-08T23:35:51.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.784+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=4YRPWC640BZJ type=del 2024-08-08T23:35:51.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.784+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=XIX8PGNM5YC5 type=write size=651515 2024-08-08T23:35:51.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.788+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~IPI0L7EK23N0.0 size=1044810 2024-08-08T23:35:51.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.792+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=IPI0L7EK23N0 tag=SD2ZFGT6XPPI type=write size=2093386 2024-08-08T23:35:51.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.796+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=31AV3NR2KUT8 type=del size=1234657 2024-08-08T23:35:51.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.800+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=24OORZW2EDYW type=del 2024-08-08T23:35:51.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.804+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=181WL6O2JIBH type=del size=349204 2024-08-08T23:35:51.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.804+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~KH5BB13F6T0A.0 size=1048576 2024-08-08T23:35:51.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.808+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~KH5BB13F6T0A.1 size=1003948 2024-08-08T23:35:51.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.812+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=KH5BB13F6T0A tag=EIX2YMTR6GTV type=write size=3101100 2024-08-08T23:35:51.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.816+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=TBS6OND30U6L type=del size=627171 2024-08-08T23:35:51.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.816+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.0 size=1048576 2024-08-08T23:35:51.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.820+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.1 size=1048576 2024-08-08T23:35:51.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.824+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~CJ6GNO5EV7JI.2 size=930944 2024-08-08T23:35:51.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.828+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=CJ6GNO5EV7JI tag=T617C69OAYC8 type=write size=4076672 2024-08-08T23:35:51.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.832+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=RZYS47BVNADH type=write size=149184 2024-08-08T23:35:51.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.836+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~UR7FO5EGE70F.0 size=395531 2024-08-08T23:35:51.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.840+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=UR7FO5EGE70F tag=DGJO10UVHR8K type=write size=1444107 2024-08-08T23:35:51.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.0 size=1048576 2024-08-08T23:35:51.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.1 size=1048576 2024-08-08T23:35:51.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.2 size=153096 2024-08-08T23:35:51.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.848+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=FHEGYB96BJ51 tag=GOQNTK9B9CHF type=write size=3298824 2024-08-08T23:35:51.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.852+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=X94BSDZKXLVL type=del 2024-08-08T23:35:51.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.0 size=1048576 2024-08-08T23:35:51.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.1 size=1048576 2024-08-08T23:35:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.2 size=89533 2024-08-08T23:35:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.860+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=V95KOG48FXWD tag=67KJT71CN1GW type=write size=3235261 2024-08-08T23:35:51.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.864+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=AAJ4YSAQ6VWS type=del 2024-08-08T23:35:51.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.868+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.0 size=1048576 2024-08-08T23:35:51.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.872+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.1 size=1048576 2024-08-08T23:35:51.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.2 size=875876 2024-08-08T23:35:51.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.876+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=B4MG0VOQJM60 tag=7CIXCV70ST9O type=write size=4021604 2024-08-08T23:35:51.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.876+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=7LVYK9N4X68P type=write size=130171 2024-08-08T23:35:51.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.880+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=XS3WD6D9POUE type=del size=258082 2024-08-08T23:35:51.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.884+0000 7fdbd6e2c8c0 1 < suggested update operation key=903K2EO77YTJ tag=EW3ZUZKTP3DQ type=del size=1002933 2024-08-08T23:35:51.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.888+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=EHQH1HR619OP type=del size=1758904 2024-08-08T23:35:51.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~WKVZS12DK60W.0 size=1048576 2024-08-08T23:35:51.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~WKVZS12DK60W.1 size=354101 2024-08-08T23:35:51.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.900+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=WKVZS12DK60W tag=GCY0513F3OXF type=write size=2451253 2024-08-08T23:35:51.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.900+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=0WMTINF1IJFS type=write size=752098 2024-08-08T23:35:51.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.904+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QHN8QYEEOHYO tag=UTDMALOJL6AI type=del size=2595904: (22) Invalid argument 2024-08-08T23:35:51.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.908+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=LY0MCEVBY3XJ type=write size=348172 2024-08-08T23:35:51.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.0 size=1048576 2024-08-08T23:35:51.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.912+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.1 size=1048576 2024-08-08T23:35:51.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~IBBPXKWUK57Q.2 size=506979 2024-08-08T23:35:51.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.920+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=IBBPXKWUK57Q tag=X5S26826BFPS type=write size=3652707 2024-08-08T23:35:51.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.924+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~5QECINSUOUDS.0 size=1048576 2024-08-08T23:35:51.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.928+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~5QECINSUOUDS.1 size=660010 2024-08-08T23:35:51.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.928+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=5QECINSUOUDS tag=1MTOHLQBY3Z4 type=write size=2757162 2024-08-08T23:35:51.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~B0S5GWR6HEKC.0 size=582630 2024-08-08T23:35:51.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.936+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=B0S5GWR6HEKC tag=CKXKZHGS8KJL type=write size=1631206 2024-08-08T23:35:51.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.940+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~GDKL5G3IE93Z.0 size=619021 2024-08-08T23:35:51.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.940+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=GDKL5G3IE93Z tag=7FMO3MRQNPKE type=write size=1667597 2024-08-08T23:35:51.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.944+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~9TQ0FSY92EMR.0 size=1048576 2024-08-08T23:35:51.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~9TQ0FSY92EMR.1 size=400359 2024-08-08T23:35:51.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.952+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=9TQ0FSY92EMR tag=FQIH8C6LFUR0 type=write size=2497511 2024-08-08T23:35:51.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.0 size=1048576 2024-08-08T23:35:51.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.1 size=1048576 2024-08-08T23:35:51.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.2 size=947638 2024-08-08T23:35:51.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.960+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=9HXZU4ANPL8N tag=XIDYI9EQG2HD type=write size=4093366 2024-08-08T23:35:51.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.964+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=903K2EO77YTJ tag=898YS6Y5NR80 type=write size=250736: (22) Invalid argument 2024-08-08T23:35:51.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.972+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~U9DQQP0EOGBN.0 size=1011841 2024-08-08T23:35:51.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.972+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=U9DQQP0EOGBN tag=E8L5Z0SC14AP type=write size=2060417 2024-08-08T23:35:51.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.976+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=XIX8PGNM5YC5 type=write size=651515 2024-08-08T23:35:51.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.980+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=222JTQJQCR7X type=write size=416621 2024-08-08T23:35:51.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.984+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=31AV3NR2KUT8 type=del size=1234657 2024-08-08T23:35:51.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.988+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=COUF8YLD1RWV type=del size=1048375 2024-08-08T23:35:51.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.992+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=181WL6O2JIBH type=del 2024-08-08T23:35:51.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.996+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.0 size=1048576 2024-08-08T23:35:51.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:51.996+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.1 size=1048576 2024-08-08T23:35:52.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.000+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.2 size=122437 2024-08-08T23:35:52.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.000+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=1PREIT1X3F9J tag=OKVBRAQJ23CU type=write size=3268165 2024-08-08T23:35:52.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.008+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=TBS6OND30U6L type=del 2024-08-08T23:35:52.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~1L36D99T5K5N.0 size=990469 2024-08-08T23:35:52.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.012+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=1L36D99T5K5N tag=ZE1B0FN0E5JX type=write size=2039045 2024-08-08T23:35:52.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.016+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=RZYS47BVNADH type=write size=149184 2024-08-08T23:35:52.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.016+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=5G5EPPMT7SPG type=del size=3672495 2024-08-08T23:35:52.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.020+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.0 size=1048576 2024-08-08T23:35:52.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.020+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.1 size=1048576 2024-08-08T23:35:52.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.024+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~FHEGYB96BJ51.2 size=153096 2024-08-08T23:35:52.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.028+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=FHEGYB96BJ51 tag=GOQNTK9B9CHF type=write size=3298824 2024-08-08T23:35:52.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.032+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=1PUPFZ2RXU14 type=del size=3195901 2024-08-08T23:35:52.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.036+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.0 size=1048576 2024-08-08T23:35:52.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.036+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.1 size=1048576 2024-08-08T23:35:52.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.040+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~V95KOG48FXWD.2 size=89533 2024-08-08T23:35:52.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.044+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=V95KOG48FXWD tag=67KJT71CN1GW type=write size=3235261 2024-08-08T23:35:52.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.048+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=U5BJNAXW1IO4 type=write size=394736 2024-08-08T23:35:52.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.048+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.0 size=1048576 2024-08-08T23:35:52.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.1 size=1048576 2024-08-08T23:35:52.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~B4MG0VOQJM60.2 size=875876 2024-08-08T23:35:52.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=B4MG0VOQJM60 tag=7CIXCV70ST9O type=write size=4021604 2024-08-08T23:35:52.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.064+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~B44FPTVFZHQ5.0 size=236593 2024-08-08T23:35:52.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.064+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=B44FPTVFZHQ5 tag=OVHY0AZ4GCKO type=write size=1285169 2024-08-08T23:35:52.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.068+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=XS3WD6D9POUE type=del 2024-08-08T23:35:52.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.072+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=FKAMYK3S9V8E type=del size=1491306 2024-08-08T23:35:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.076+0000 7fdbd6e2c8c0 1 < suggested update operation key=FWZ5TEP1P2LK tag=EHQH1HR619OP type=del size=1758904 2024-08-08T23:35:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.080+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=M554H93SV5KQ type=write size=303635 2024-08-08T23:35:52.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.084+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=0WMTINF1IJFS type=write size=752098 2024-08-08T23:35:52.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.084+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=SRM1A91ZFQ7F type=del size=1649058 2024-08-08T23:35:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.088+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=YNQU8Z202QCM tag=LY0MCEVBY3XJ type=write size=348172: (22) Invalid argument 2024-08-08T23:35:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.092+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=P2N1C4JR6DLM type=del size=2657574 2024-08-08T23:35:52.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~5QECINSUOUDS.0 size=1048576 2024-08-08T23:35:52.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~5QECINSUOUDS.1 size=660010 2024-08-08T23:35:52.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.100+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=5QECINSUOUDS tag=1MTOHLQBY3Z4 type=write size=2757162 2024-08-08T23:35:52.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.104+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=H23L368WTL5E type=del size=1190325 2024-08-08T23:35:52.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.108+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~GDKL5G3IE93Z.0 size=619021 2024-08-08T23:35:52.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.112+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=GDKL5G3IE93Z tag=7FMO3MRQNPKE type=write size=1667597 2024-08-08T23:35:52.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.120+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~C6VIFS21UM0D.0 size=1048576 2024-08-08T23:35:52.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.124+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~C6VIFS21UM0D.1 size=985528 2024-08-08T23:35:52.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.124+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=C6VIFS21UM0D tag=ZSHG1B6WAS4P type=write size=3082680 2024-08-08T23:35:52.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.124+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.0 size=1048576 2024-08-08T23:35:52.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.1 size=1048576 2024-08-08T23:35:52.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.132+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~9HXZU4ANPL8N.2 size=947638 2024-08-08T23:35:52.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.136+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=9HXZU4ANPL8N tag=XIDYI9EQG2HD type=write size=4093366 2024-08-08T23:35:52.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.140+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=AEWTXLMK46O1 type=del size=2843537 2024-08-08T23:35:52.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.140+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_D81PQ0FJVNEE.2~U9DQQP0EOGBN.0 size=1011841 2024-08-08T23:35:52.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.144+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=D81PQ0FJVNEE upload=U9DQQP0EOGBN tag=E8L5Z0SC14AP type=write size=2060417 2024-08-08T23:35:52.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.144+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=4XJZ2ODRKN1F type=del size=1771687 2024-08-08T23:35:52.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.148+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=222JTQJQCR7X type=write size=416621 2024-08-08T23:35:52.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.152+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=VI9FZ5XV6C5L type=del size=510218 2024-08-08T23:35:52.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.152+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=COUF8YLD1RWV type=del 2024-08-08T23:35:52.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.156+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=HUU20OIVMBBJ type=write size=161989 2024-08-08T23:35:52.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.0 size=1048576 2024-08-08T23:35:52.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.160+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.1 size=1048576 2024-08-08T23:35:52.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~1PREIT1X3F9J.2 size=122437 2024-08-08T23:35:52.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.164+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=1PREIT1X3F9J tag=OKVBRAQJ23CU type=write size=3268165 2024-08-08T23:35:52.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.168+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=VC946Y78MKP9 type=del size=3018536 2024-08-08T23:35:52.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~1L36D99T5K5N.0 size=990469 2024-08-08T23:35:52.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.176+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=1L36D99T5K5N tag=ZE1B0FN0E5JX type=write size=2039045 2024-08-08T23:35:52.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~JKP493109NT6.0 size=1048576 2024-08-08T23:35:52.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~JKP493109NT6.1 size=404524 2024-08-08T23:35:52.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.184+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=JKP493109NT6 tag=8SCLRI0Y9MBV type=write size=2501676 2024-08-08T23:35:52.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.188+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=5G5EPPMT7SPG type=del 2024-08-08T23:35:52.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.192+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=PCNPJ86P0QE8 type=del size=2816178 2024-08-08T23:35:52.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.196+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=1PUPFZ2RXU14 type=del 2024-08-08T23:35:52.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.196+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=TN86IUMO4M74 type=del size=2262369 2024-08-08T23:35:52.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.200+0000 7fdbd6e2c8c0 1 < completed write operation key=YO2FZOR7H0EX tag=U5BJNAXW1IO4 type=write size=394736 2024-08-08T23:35:52.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.204+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=GZOZE2K6N9XX type=del size=1419643 2024-08-08T23:35:52.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~B44FPTVFZHQ5.0 size=236593 2024-08-08T23:35:52.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.212+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=B44FPTVFZHQ5 tag=OVHY0AZ4GCKO type=write size=1285169 2024-08-08T23:35:52.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.216+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=7ISOUHCPUZKQ type=del size=2783391 2024-08-08T23:35:52.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.220+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=FKAMYK3S9V8E type=del 2024-08-08T23:35:52.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.0 size=1048576 2024-08-08T23:35:52.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.1 size=1048576 2024-08-08T23:35:52.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.2 size=908798 2024-08-08T23:35:52.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.228+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=MX43Q5U30KZW tag=XEPJCA4NSZXI type=write size=4054526 2024-08-08T23:35:52.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.236+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZQ8GOX9RSTBB tag=M554H93SV5KQ type=write size=303635 2024-08-08T23:35:52.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~8BQEPV8D6GHT.0 size=460454 2024-08-08T23:35:52.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.244+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=8BQEPV8D6GHT tag=E99G8AWYVKGO type=write size=1509030 2024-08-08T23:35:52.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.248+0000 7fdbd6e2c8c0 1 < canceled operation key=V6GSJH62C8TA tag=SRM1A91ZFQ7F type=del size=1649058 2024-08-08T23:35:52.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.252+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.0 size=1048576 2024-08-08T23:35:52.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.256+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.1 size=1048576 2024-08-08T23:35:52.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.256+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.2 size=843304 2024-08-08T23:35:52.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.256+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=N6ZR2Y0AFDAH tag=YMVZZ34SGPRS type=write size=3989032 2024-08-08T23:35:52.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.264+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QHN8QYEEOHYO tag=P2N1C4JR6DLM type=del 2024-08-08T23:35:52.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.268+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=TNM441VZY6WQ type=del size=2850316 2024-08-08T23:35:52.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.272+0000 7fdbd6e2c8c0 1 < suggested update operation key=0XF26POOKR3V tag=H23L368WTL5E type=del size=1190325 2024-08-08T23:35:52.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.280+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~OPTK29U6XN43.0 size=1048576 2024-08-08T23:35:52.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.280+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~OPTK29U6XN43.1 size=862754 2024-08-08T23:35:52.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.280+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=OPTK29U6XN43 tag=7T6LOZ4XA13G type=write size=2959906 2024-08-08T23:35:52.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~C6VIFS21UM0D.0 size=1048576 2024-08-08T23:35:52.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.288+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~C6VIFS21UM0D.1 size=985528 2024-08-08T23:35:52.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.292+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=C6VIFS21UM0D tag=ZSHG1B6WAS4P type=write size=3082680 2024-08-08T23:35:52.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.296+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=P3RW0XR985RD type=del size=2571240 2024-08-08T23:35:52.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.300+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=AEWTXLMK46O1 type=del size=2843537 2024-08-08T23:35:52.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.304+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=0U1OZCY26QF7 type=del size=2088804 2024-08-08T23:35:52.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.308+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=4XJZ2ODRKN1F type=del 2024-08-08T23:35:52.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.312+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=J5JYN0J2BYOE type=del size=4183674 2024-08-08T23:35:52.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.312+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=VI9FZ5XV6C5L type=del 2024-08-08T23:35:52.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.316+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=ZOE7SDBVR6LI type=del size=1994623 2024-08-08T23:35:52.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.320+0000 7fdbd6e2c8c0 1 < canceled operation key=FWZ5TEP1P2LK tag=HUU20OIVMBBJ type=write size=161989 2024-08-08T23:35:52.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.324+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~9O5MWWZDSZAW.0 size=1048576 2024-08-08T23:35:52.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.328+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~9O5MWWZDSZAW.1 size=559064 2024-08-08T23:35:52.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.328+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=9O5MWWZDSZAW tag=S24E1NRD3630 type=write size=2656216 2024-08-08T23:35:52.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.332+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=VC946Y78MKP9 type=del 2024-08-08T23:35:52.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~JVV6OWZGZ2AO.0 size=759833 2024-08-08T23:35:52.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.336+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=JVV6OWZGZ2AO tag=VFRTZVD107ED type=write size=1808409 2024-08-08T23:35:52.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~JKP493109NT6.0 size=1048576 2024-08-08T23:35:52.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~JKP493109NT6.1 size=404524 2024-08-08T23:35:52.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.344+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=JKP493109NT6 tag=8SCLRI0Y9MBV type=write size=2501676 2024-08-08T23:35:52.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.348+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=TEM5VBWQXWQ9 type=write size=100187 2024-08-08T23:35:52.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.352+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=PCNPJ86P0QE8 type=del 2024-08-08T23:35:52.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.356+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=0NB34BFR9AVM type=del size=791033 2024-08-08T23:35:52.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.360+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=TN86IUMO4M74 type=del 2024-08-08T23:35:52.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.360+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=AMG0IFRJFHT5 type=del size=825785 2024-08-08T23:35:52.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.364+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=GZOZE2K6N9XX type=del 2024-08-08T23:35:52.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~V1NAD6E15SEG.0 size=24476 2024-08-08T23:35:52.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.368+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=V1NAD6E15SEG tag=0011Q373Y1UQ type=write size=1073052 2024-08-08T23:35:52.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.372+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=7ISOUHCPUZKQ type=del 2024-08-08T23:35:52.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.376+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=18TRE9NDI8V0 type=write size=256373 2024-08-08T23:35:52.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.380+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.0 size=1048576 2024-08-08T23:35:52.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.380+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.1 size=1048576 2024-08-08T23:35:52.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.384+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~MX43Q5U30KZW.2 size=908798 2024-08-08T23:35:52.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.388+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=MX43Q5U30KZW tag=XEPJCA4NSZXI type=write size=4054526 2024-08-08T23:35:52.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.392+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=HNQD2Y7O774B type=del size=1969161 2024-08-08T23:35:52.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.396+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~8BQEPV8D6GHT.0 size=460454 2024-08-08T23:35:52.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.400+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=8BQEPV8D6GHT tag=E99G8AWYVKGO type=write size=1509030 2024-08-08T23:35:52.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.408+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~3YTLO8IYFS4F.0 size=113568 2024-08-08T23:35:52.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.408+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=3YTLO8IYFS4F tag=EW1UQFT1GK05 type=write size=1162144 2024-08-08T23:35:52.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.0 size=1048576 2024-08-08T23:35:52.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.1 size=1048576 2024-08-08T23:35:52.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.416+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~N6ZR2Y0AFDAH.2 size=843304 2024-08-08T23:35:52.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.420+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=N6ZR2Y0AFDAH tag=YMVZZ34SGPRS type=write size=3989032 2024-08-08T23:35:52.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.424+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=JDC6ZCALND5C type=del size=1364925 2024-08-08T23:35:52.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.428+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=TNM441VZY6WQ type=del 2024-08-08T23:35:52.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~1ROIPOVYY3SL.0 size=1048576 2024-08-08T23:35:52.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~1ROIPOVYY3SL.1 size=373274 2024-08-08T23:35:52.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.436+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=1ROIPOVYY3SL tag=BXVH3935HYLA type=write size=2470426 2024-08-08T23:35:52.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~OPTK29U6XN43.0 size=1048576 2024-08-08T23:35:52.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~OPTK29U6XN43.1 size=862754 2024-08-08T23:35:52.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.452+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=OPTK29U6XN43 tag=7T6LOZ4XA13G type=write size=2959906 2024-08-08T23:35:52.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.452+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=JHNC3U0GB17U type=del size=2447926 2024-08-08T23:35:52.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.456+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=P3RW0XR985RD type=del 2024-08-08T23:35:52.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.0 size=1048576 2024-08-08T23:35:52.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.1 size=1048576 2024-08-08T23:35:52.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.2 size=718685 2024-08-08T23:35:52.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.468+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=0AMQPBK2AUUM tag=7MZKX2GIO7ZU type=write size=3864413 2024-08-08T23:35:52.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.472+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=0U1OZCY26QF7 type=del 2024-08-08T23:35:52.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.476+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=LWYBRZ74XSIN type=del size=85104 2024-08-08T23:35:52.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.476+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=J5JYN0J2BYOE type=del 2024-08-08T23:35:52.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.484+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~30D3JNNCRP86.0 size=832287 2024-08-08T23:35:52.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.484+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=30D3JNNCRP86 tag=TAU843G3YMPN type=write size=1880863 2024-08-08T23:35:52.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.488+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=ZOE7SDBVR6LI type=del size=1994623 2024-08-08T23:35:52.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.496+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~2NEVPUKNWOZQ.0 size=1048576 2024-08-08T23:35:52.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.496+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~2NEVPUKNWOZQ.1 size=711322 2024-08-08T23:35:52.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.496+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=2NEVPUKNWOZQ tag=32KLTXG2X64J type=write size=2808474 2024-08-08T23:35:52.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.500+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~9O5MWWZDSZAW.0 size=1048576 2024-08-08T23:35:52.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.504+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~9O5MWWZDSZAW.1 size=559064 2024-08-08T23:35:52.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.508+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=9O5MWWZDSZAW tag=S24E1NRD3630 type=write size=2656216 2024-08-08T23:35:52.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.512+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=FEG6BKKHJLZC type=del size=3570896 2024-08-08T23:35:52.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~JVV6OWZGZ2AO.0 size=759833 2024-08-08T23:35:52.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.520+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=JVV6OWZGZ2AO tag=VFRTZVD107ED type=write size=1808409 2024-08-08T23:35:52.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.520+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=Y5NSADJ380AX type=write size=211777 2024-08-08T23:35:52.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.524+0000 7fdbd6e2c8c0 1 < completed write operation key=FBCEC998C8EJ tag=TEM5VBWQXWQ9 type=write size=100187 2024-08-08T23:35:52.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.528+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=NBY0YD6ZCRF7 type=del size=148967 2024-08-08T23:35:52.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.532+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=0NB34BFR9AVM type=del 2024-08-08T23:35:52.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.536+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=FECI1G3C8554 type=write size=487710 2024-08-08T23:35:52.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.540+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=AMG0IFRJFHT5 type=del 2024-08-08T23:35:52.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.544+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~FNME30BYR2GX.0 size=426016 2024-08-08T23:35:52.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.544+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=FNME30BYR2GX tag=DRC3GWPKTS76 type=write size=1474592 2024-08-08T23:35:52.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.548+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~V1NAD6E15SEG.0 size=24476 2024-08-08T23:35:52.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.552+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=V1NAD6E15SEG tag=0011Q373Y1UQ type=write size=1073052 2024-08-08T23:35:52.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~421VYLCU7OXA.0 size=734462 2024-08-08T23:35:52.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=421VYLCU7OXA tag=FS9XNNUQAAFA type=write size=1783038 2024-08-08T23:35:52.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.560+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=18TRE9NDI8V0 type=write size=256373 2024-08-08T23:35:52.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.560+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=70QWNOOGFO62 type=del size=2241717 2024-08-08T23:35:52.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.568+0000 7fdbd6e2c8c0 1 < suggested remove operation key=NMB4GI8R2BKU tag=HNQD2Y7O774B type=del 2024-08-08T23:35:52.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.568+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=8I2WVSJ6A18O type=write size=1000397 2024-08-08T23:35:52.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.572+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~3YTLO8IYFS4F.0 size=113568 2024-08-08T23:35:52.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.576+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=3YTLO8IYFS4F tag=EW1UQFT1GK05 type=write size=1162144 2024-08-08T23:35:52.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.580+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.0 size=1048576 2024-08-08T23:35:52.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.584+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.1 size=1048576 2024-08-08T23:35:52.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.588+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.2 size=760971 2024-08-08T23:35:52.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.588+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=F6AEHP31JZTW tag=ZLS541TI8JCW type=write size=3906699 2024-08-08T23:35:52.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.588+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=JDC6ZCALND5C type=del 2024-08-08T23:35:52.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.596+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~T59JZ1VORXL7.0 size=259870 2024-08-08T23:35:52.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.596+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=T59JZ1VORXL7 tag=1YAF6PBJXIUR type=write size=1308446 2024-08-08T23:35:52.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.596+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~1ROIPOVYY3SL.0 size=1048576 2024-08-08T23:35:52.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.600+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~1ROIPOVYY3SL.1 size=373274 2024-08-08T23:35:52.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.604+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=1ROIPOVYY3SL tag=BXVH3935HYLA type=write size=2470426 2024-08-08T23:35:52.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.608+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=IXYEDDU1FXAN type=del size=1859785 2024-08-08T23:35:52.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.612+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=JHNC3U0GB17U type=del 2024-08-08T23:35:52.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.616+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=5NIYLYTX3XUO type=write size=540800 2024-08-08T23:35:52.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.0 size=1048576 2024-08-08T23:35:52.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.620+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.1 size=1048576 2024-08-08T23:35:52.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.624+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~0AMQPBK2AUUM.2 size=718685 2024-08-08T23:35:52.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.628+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=0AMQPBK2AUUM tag=7MZKX2GIO7ZU type=write size=3864413 2024-08-08T23:35:52.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.632+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=CMIREWNS4DDV type=write size=704688 2024-08-08T23:35:52.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.636+0000 7fdbd6e2c8c0 1 < suggested remove operation key=W5OVPO7BGE4S tag=LWYBRZ74XSIN type=del 2024-08-08T23:35:52.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~PUF5ZVSZHIT2.0 size=60805 2024-08-08T23:35:52.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.644+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=PUF5ZVSZHIT2 tag=ATKDUBDM5052 type=write size=1109381 2024-08-08T23:35:52.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.644+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~30D3JNNCRP86.0 size=832287 2024-08-08T23:35:52.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.652+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=30D3JNNCRP86 tag=TAU843G3YMPN type=write size=1880863 2024-08-08T23:35:52.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.652+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=9KB3MBNGUOO8 type=del size=1598941 2024-08-08T23:35:52.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.656+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~2NEVPUKNWOZQ.0 size=1048576 2024-08-08T23:35:52.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.660+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~2NEVPUKNWOZQ.1 size=711322 2024-08-08T23:35:52.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.664+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=2NEVPUKNWOZQ tag=32KLTXG2X64J type=write size=2808474 2024-08-08T23:35:52.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.672+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.0 size=1048576 2024-08-08T23:35:52.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.672+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.1 size=1048576 2024-08-08T23:35:52.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.2 size=244328 2024-08-08T23:35:52.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.676+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=XDBP0VGJXYYC tag=ZLYNGOZ6J46I type=write size=3390056 2024-08-08T23:35:52.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.680+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=FEG6BKKHJLZC type=del 2024-08-08T23:35:52.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.684+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~XFK6S0YG3GLS.0 size=445350 2024-08-08T23:35:52.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.684+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=XFK6S0YG3GLS tag=PF065WOWJMBK type=write size=1493926 2024-08-08T23:35:52.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.688+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=Y5NSADJ380AX type=write size=211777 2024-08-08T23:35:52.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.692+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=2OS00WACWXS6 type=del size=2391025 2024-08-08T23:35:52.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.692+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=NBY0YD6ZCRF7 type=del 2024-08-08T23:35:52.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~GDWM2R7L3F84.0 size=490718 2024-08-08T23:35:52.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.700+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=GDWM2R7L3F84 tag=ANY7BQK0R89S type=write size=1539294 2024-08-08T23:35:52.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.700+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=W5OVPO7BGE4S tag=FECI1G3C8554 type=write size=487710: (22) Invalid argument 2024-08-08T23:35:52.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.708+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~V9GFSH9YQX21.0 size=518886 2024-08-08T23:35:52.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.708+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=V9GFSH9YQX21 tag=3I6A48I56JMB type=write size=1567462 2024-08-08T23:35:52.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.708+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~FNME30BYR2GX.0 size=426016 2024-08-08T23:35:52.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.712+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=FNME30BYR2GX tag=DRC3GWPKTS76 type=write size=1474592 2024-08-08T23:35:52.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.716+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=5JODDE712TWF type=del size=3240623 2024-08-08T23:35:52.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.720+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~421VYLCU7OXA.0 size=734462 2024-08-08T23:35:52.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.724+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=421VYLCU7OXA tag=FS9XNNUQAAFA type=write size=1783038 2024-08-08T23:35:52.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.728+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=ZEZ4L47BF0S7 type=del size=2982016 2024-08-08T23:35:52.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.732+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=70QWNOOGFO62 type=del 2024-08-08T23:35:52.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.736+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=MUFP5OS59LAG type=write size=32490 2024-08-08T23:35:52.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.736+0000 7fdbd6e2c8c0 1 < completed write operation key=V6GSJH62C8TA tag=8I2WVSJ6A18O type=write size=1000397 2024-08-08T23:35:52.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.744+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.0 size=1048576 2024-08-08T23:35:52.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.744+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.1 size=1048576 2024-08-08T23:35:52.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.748+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.2 size=82800 2024-08-08T23:35:52.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.748+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=MAZCDANIU0DO tag=PU3CQIO9F2NQ type=write size=3228528 2024-08-08T23:35:52.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.0 size=1048576 2024-08-08T23:35:52.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.1 size=1048576 2024-08-08T23:35:52.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~F6AEHP31JZTW.2 size=760971 2024-08-08T23:35:52.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.760+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=F6AEHP31JZTW tag=ZLS541TI8JCW type=write size=3906699 2024-08-08T23:35:52.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.764+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=LXPBIN9Z2K8Z type=del size=1120454 2024-08-08T23:35:52.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.768+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~T59JZ1VORXL7.0 size=259870 2024-08-08T23:35:52.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.772+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=T59JZ1VORXL7 tag=1YAF6PBJXIUR type=write size=1308446 2024-08-08T23:35:52.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.776+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=7UGKCUEWFQCA type=del size=2909720 2024-08-08T23:35:52.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.780+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=IXYEDDU1FXAN type=del 2024-08-08T23:35:52.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.784+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.0 size=1048576 2024-08-08T23:35:52.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.784+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.1 size=1048576 2024-08-08T23:35:52.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.2 size=873788 2024-08-08T23:35:52.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.788+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=27VR4RS0YC5F tag=KQX6HVEP203Y type=write size=4019516 2024-08-08T23:35:52.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.792+0000 7fdbd6e2c8c0 1 < suggested update operation key=P3H05VKM0ZGJ tag=5NIYLYTX3XUO type=write size=540800 2024-08-08T23:35:52.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.796+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=U3891L9TXKYK type=write size=165505 2024-08-08T23:35:52.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.800+0000 7fdbd6e2c8c0 1 < completed write operation key=2SO6IPMXZUUI tag=CMIREWNS4DDV type=write size=704688 2024-08-08T23:35:52.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.0 size=1048576 2024-08-08T23:35:52.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.1 size=1048576 2024-08-08T23:35:52.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.2 size=668255 2024-08-08T23:35:52.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.808+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=CG982IRR5NEK tag=89NCON2C62R7 type=write size=3813983 2024-08-08T23:35:52.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.808+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~PUF5ZVSZHIT2.0 size=60805 2024-08-08T23:35:52.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.812+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=PUF5ZVSZHIT2 tag=ATKDUBDM5052 type=write size=1109381 2024-08-08T23:35:52.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.816+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=5WJ49DMNDSHL type=write size=410896 2024-08-08T23:35:52.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.820+0000 7fdbd6e2c8c0 1 < suggested remove operation key=P3H05VKM0ZGJ tag=9KB3MBNGUOO8 type=del 2024-08-08T23:35:52.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.0 size=1048576 2024-08-08T23:35:52.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.1 size=1048576 2024-08-08T23:35:52.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.2 size=281843 2024-08-08T23:35:52.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.828+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=K3ZS9J6SXOS7 tag=RDNH7MUO76QD type=write size=3427571 2024-08-08T23:35:52.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.832+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.0 size=1048576 2024-08-08T23:35:52.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.832+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.1 size=1048576 2024-08-08T23:35:52.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.836+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~XDBP0VGJXYYC.2 size=244328 2024-08-08T23:35:52.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.840+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=XDBP0VGJXYYC tag=ZLYNGOZ6J46I type=write size=3390056 2024-08-08T23:35:52.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.0 size=1048576 2024-08-08T23:35:52.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.1 size=1048576 2024-08-08T23:35:52.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.2 size=644199 2024-08-08T23:35:52.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.848+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=VJHQ4XDQD9QT tag=T8UJ6G3A07GX type=write size=3789927 2024-08-08T23:35:52.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.848+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~XFK6S0YG3GLS.0 size=445350 2024-08-08T23:35:52.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.852+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=XFK6S0YG3GLS tag=PF065WOWJMBK type=write size=1493926 2024-08-08T23:35:52.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.852+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=7S5H0R8MCODS type=del size=748477 2024-08-08T23:35:52.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.856+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=2OS00WACWXS6 type=del 2024-08-08T23:35:52.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~JE31HTAGTW4U.0 size=1048576 2024-08-08T23:35:52.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~JE31HTAGTW4U.1 size=870672 2024-08-08T23:35:52.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.860+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=JE31HTAGTW4U tag=KWSMKLJU3GMG type=write size=2967824 2024-08-08T23:35:52.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.864+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~GDWM2R7L3F84.0 size=490718 2024-08-08T23:35:52.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.868+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=GDWM2R7L3F84 tag=ANY7BQK0R89S type=write size=1539294 2024-08-08T23:35:52.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.868+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=SZRIO2B0ENL0 type=write size=925149 2024-08-08T23:35:52.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.872+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~V9GFSH9YQX21.0 size=518886 2024-08-08T23:35:52.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.876+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=V9GFSH9YQX21 tag=3I6A48I56JMB type=write size=1567462 2024-08-08T23:35:52.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.876+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=IRAZH8KSNV20 type=del size=1603209 2024-08-08T23:35:52.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.880+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=5JODDE712TWF type=del 2024-08-08T23:35:52.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.880+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=TE171OKR2B3N type=del size=1519961 2024-08-08T23:35:52.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.884+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=ZEZ4L47BF0S7 type=del 2024-08-08T23:35:52.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.888+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=VMESTXOASER7 type=del size=717610 2024-08-08T23:35:52.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.888+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=MUFP5OS59LAG type=write size=32490 2024-08-08T23:35:52.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.892+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=HB1TNTYGKR29 type=del size=2602553 2024-08-08T23:35:52.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.0 size=1048576 2024-08-08T23:35:52.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.1 size=1048576 2024-08-08T23:35:52.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~MAZCDANIU0DO.2 size=82800 2024-08-08T23:35:52.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.900+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=MAZCDANIU0DO tag=PU3CQIO9F2NQ type=write size=3228528 2024-08-08T23:35:52.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.0 size=1048576 2024-08-08T23:35:52.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.1 size=1048576 2024-08-08T23:35:52.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.2 size=542554 2024-08-08T23:35:52.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.908+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=184LCGJG3JNS tag=1RTNBXB5P3KJ type=write size=3688282 2024-08-08T23:35:52.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.912+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=P3H05VKM0ZGJ tag=LXPBIN9Z2K8Z type=del size=1120454: (22) Invalid argument 2024-08-08T23:35:52.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.912+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=AWD1OGIW7PZX type=del size=605119 2024-08-08T23:35:52.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.916+0000 7fdbd6e2c8c0 1 < canceled operation key=41XLZV9ZY5OP tag=7UGKCUEWFQCA type=del size=2909720 2024-08-08T23:35:52.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.920+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~RD3LIARM058Z.0 size=1048576 2024-08-08T23:35:52.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.924+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~RD3LIARM058Z.1 size=319260 2024-08-08T23:35:52.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.924+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=RD3LIARM058Z tag=IX9W0UX8THV7 type=write size=2416412 2024-08-08T23:35:52.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.0 size=1048576 2024-08-08T23:35:52.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.1 size=1048576 2024-08-08T23:35:52.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~27VR4RS0YC5F.2 size=873788 2024-08-08T23:35:52.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.932+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=27VR4RS0YC5F tag=KQX6HVEP203Y type=write size=4019516 2024-08-08T23:35:52.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.936+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=179Z7QP3TPWI type=del size=3385047 2024-08-08T23:35:52.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.936+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=U3891L9TXKYK type=write size=165505 2024-08-08T23:35:52.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.940+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.0 size=1048576 2024-08-08T23:35:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.940+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.1 size=1048576 2024-08-08T23:35:52.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.944+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.2 size=502198 2024-08-08T23:35:52.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.944+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=ZSRHE22B6CGA tag=VI5HG0Z6SNSR type=write size=3647926 2024-08-08T23:35:52.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.944+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.0 size=1048576 2024-08-08T23:35:52.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.944+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.1 size=1048576 2024-08-08T23:35:52.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~CG982IRR5NEK.2 size=668255 2024-08-08T23:35:52.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.952+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=CG982IRR5NEK tag=89NCON2C62R7 type=write size=3813983 2024-08-08T23:35:52.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~8JRNT43NGZ3F.0 size=847712 2024-08-08T23:35:52.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=8JRNT43NGZ3F tag=FVC5OZTWA6PJ type=write size=1896288 2024-08-08T23:35:52.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.956+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=5WJ49DMNDSHL type=write size=410896 2024-08-08T23:35:52.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.960+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=F814UU22G4AJ type=write size=131885 2024-08-08T23:35:52.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.0 size=1048576 2024-08-08T23:35:52.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.1 size=1048576 2024-08-08T23:35:52.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~K3ZS9J6SXOS7.2 size=281843 2024-08-08T23:35:52.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.968+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=K3ZS9J6SXOS7 tag=RDNH7MUO76QD type=write size=3427571 2024-08-08T23:35:52.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.972+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=0K34GUHT0ZMO type=write size=37328 2024-08-08T23:35:52.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.0 size=1048576 2024-08-08T23:35:52.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.976+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.1 size=1048576 2024-08-08T23:35:52.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~VJHQ4XDQD9QT.2 size=644199 2024-08-08T23:35:52.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.984+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=VJHQ4XDQD9QT tag=T8UJ6G3A07GX type=write size=3789927 2024-08-08T23:35:52.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.984+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~0MOXJ8KXH4KU.0 size=480718 2024-08-08T23:35:52.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.984+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=0MOXJ8KXH4KU tag=RKENA0USSLN0 type=write size=1529294 2024-08-08T23:35:52.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.988+0000 7fdbd6e2c8c0 1 < canceled operation key=2SO6IPMXZUUI tag=7S5H0R8MCODS type=del size=748477 2024-08-08T23:35:52.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.988+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=X1R1JOW8EMR1 type=del size=2105920 2024-08-08T23:35:52.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~JE31HTAGTW4U.0 size=1048576 2024-08-08T23:35:52.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~JE31HTAGTW4U.1 size=870672 2024-08-08T23:35:52.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:52.996+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=JE31HTAGTW4U tag=KWSMKLJU3GMG type=write size=2967824 2024-08-08T23:35:53.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.000+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=NN1NKLJ54F78 type=del size=1034174 2024-08-08T23:35:53.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.000+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=SZRIO2B0ENL0 type=write size=925149 2024-08-08T23:35:53.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~X8H74N7ZE2HG.0 size=1048576 2024-08-08T23:35:53.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~X8H74N7ZE2HG.1 size=570798 2024-08-08T23:35:53.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.004+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=X8H74N7ZE2HG tag=0THN0D1ZC7PZ type=write size=2667950 2024-08-08T23:35:53.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.008+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=IRAZH8KSNV20 type=del 2024-08-08T23:35:53.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.008+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=USZED47R975H type=del size=3497951 2024-08-08T23:35:53.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.012+0000 7fdbd6e2c8c0 1 < suggested remove operation key=NMB4GI8R2BKU tag=TE171OKR2B3N type=del 2024-08-08T23:35:53.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.016+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=PE451RESZMIF type=del size=508686 2024-08-08T23:35:53.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.016+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=VMESTXOASER7 type=del 2024-08-08T23:35:53.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.020+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=25CQWIMVHIBX type=del size=289488 2024-08-08T23:35:53.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.020+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=HB1TNTYGKR29 type=del 2024-08-08T23:35:53.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~A8BHLZZOJ0NF.0 size=123353 2024-08-08T23:35:53.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.024+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=A8BHLZZOJ0NF tag=IP0PARFQ1OIZ type=write size=1171929 2024-08-08T23:35:53.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.024+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.0 size=1048576 2024-08-08T23:35:53.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.1 size=1048576 2024-08-08T23:35:53.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.028+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QJB9DETMSY4X.2~184LCGJG3JNS.2 size=542554 2024-08-08T23:35:53.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.032+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QJB9DETMSY4X upload=184LCGJG3JNS tag=1RTNBXB5P3KJ type=write size=3688282 2024-08-08T23:35:53.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.032+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=BNNAOKD1O1OQ type=del size=3192965 2024-08-08T23:35:53.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=AWD1OGIW7PZX type=del 2024-08-08T23:35:53.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.040+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=3ZPJKVORXWDW type=write size=95126 2024-08-08T23:35:53.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.040+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~RD3LIARM058Z.0 size=1048576 2024-08-08T23:35:53.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.044+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~RD3LIARM058Z.1 size=319260 2024-08-08T23:35:53.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.048+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=RD3LIARM058Z tag=IX9W0UX8THV7 type=write size=2416412 2024-08-08T23:35:53.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.048+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=BQ5250SH7IAI type=del size=2576560 2024-08-08T23:35:53.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.052+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=179Z7QP3TPWI type=del 2024-08-08T23:35:53.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5TTWYSAS834S.0 size=245685 2024-08-08T23:35:53.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.056+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=5TTWYSAS834S tag=JLP7NMOM47IB type=write size=1294261 2024-08-08T23:35:53.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.0 size=1048576 2024-08-08T23:35:53.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.060+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.1 size=1048576 2024-08-08T23:35:53.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.060+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~ZSRHE22B6CGA.2 size=502198 2024-08-08T23:35:53.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.064+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=ZSRHE22B6CGA tag=VI5HG0Z6SNSR type=write size=3647926 2024-08-08T23:35:53.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.064+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=3XA1B00P3UOY type=del size=286998 2024-08-08T23:35:53.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.068+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~8JRNT43NGZ3F.0 size=847712 2024-08-08T23:35:53.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.068+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=8JRNT43NGZ3F tag=FVC5OZTWA6PJ type=write size=1896288 2024-08-08T23:35:53.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.072+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=GEWXZ9NKC6X8 type=write size=734044 2024-08-08T23:35:53.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.072+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=F814UU22G4AJ type=write size=131885 2024-08-08T23:35:53.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.0 size=1048576 2024-08-08T23:35:53.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.080+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.1 size=1048576 2024-08-08T23:35:53.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.080+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.2 size=413285 2024-08-08T23:35:53.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.080+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=M1BREEYIEAEY tag=N8IMCIW5DNKN type=write size=3559013 2024-08-08T23:35:53.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.080+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=0K34GUHT0ZMO type=write size=37328 2024-08-08T23:35:53.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.084+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.0 size=1048576 2024-08-08T23:35:53.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.1 size=1048576 2024-08-08T23:35:53.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.2 size=857954 2024-08-08T23:35:53.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.088+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=PNCKMB20TLB1 tag=Y33BW9LZEOIV type=write size=4003682 2024-08-08T23:35:53.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.092+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~0MOXJ8KXH4KU.0 size=480718 2024-08-08T23:35:53.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.096+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=0MOXJ8KXH4KU tag=RKENA0USSLN0 type=write size=1529294 2024-08-08T23:35:53.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.100+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~5D420TJF5GVS.0 size=346624 2024-08-08T23:35:53.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.100+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=5D420TJF5GVS tag=Y19R6JBMZ7IC type=write size=1395200 2024-08-08T23:35:53.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.100+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=X1R1JOW8EMR1 type=del 2024-08-08T23:35:53.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.104+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=IT21QNXKYZ1N type=write size=233132 2024-08-08T23:35:53.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.108+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=NN1NKLJ54F78 type=del 2024-08-08T23:35:53.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.108+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=M9YPVMN5NLHX type=del size=2871278 2024-08-08T23:35:53.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.108+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~X8H74N7ZE2HG.0 size=1048576 2024-08-08T23:35:53.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.112+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~X8H74N7ZE2HG.1 size=570798 2024-08-08T23:35:53.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.116+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=X8H74N7ZE2HG tag=0THN0D1ZC7PZ type=write size=2667950 2024-08-08T23:35:53.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.120+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~TJ4EC6XVWXSB.0 size=1048576 2024-08-08T23:35:53.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.124+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~TJ4EC6XVWXSB.1 size=14904 2024-08-08T23:35:53.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.124+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=TJ4EC6XVWXSB tag=EL3PKYYNDK9B type=write size=2112056 2024-08-08T23:35:53.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.124+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=USZED47R975H type=del 2024-08-08T23:35:53.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.128+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=GAVUX46KUAM6 type=del size=2073023 2024-08-08T23:35:53.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.128+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=PE451RESZMIF type=del 2024-08-08T23:35:53.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.132+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~PG9S1B6RHC50.0 size=756793 2024-08-08T23:35:53.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.132+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=PG9S1B6RHC50 tag=NI4FK74WNC0G type=write size=1805369 2024-08-08T23:35:53.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.136+0000 7fdbd6e2c8c0 1 < suggested update operation key=9S8TBVP20KTG tag=25CQWIMVHIBX type=del size=289488 2024-08-08T23:35:53.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.140+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~B4BRDBOC2LIY.0 size=1048576 2024-08-08T23:35:53.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~B4BRDBOC2LIY.1 size=531844 2024-08-08T23:35:53.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.144+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=B4BRDBOC2LIY tag=BSC252L5XYZ1 type=write size=2628996 2024-08-08T23:35:53.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.144+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_W5OVPO7BGE4S.2~A8BHLZZOJ0NF.0 size=123353 2024-08-08T23:35:53.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.148+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=W5OVPO7BGE4S upload=A8BHLZZOJ0NF tag=IP0PARFQ1OIZ type=write size=1171929 2024-08-08T23:35:53.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.0 size=1048576 2024-08-08T23:35:53.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.156+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.1 size=1048576 2024-08-08T23:35:53.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.156+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.2 size=640112 2024-08-08T23:35:53.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.156+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=Y21FWQUU4US2 tag=070SEUAY9GOS type=write size=3785840 2024-08-08T23:35:53.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.160+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=BNNAOKD1O1OQ type=del 2024-08-08T23:35:53.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~BC06XH5431NC.0 size=789899 2024-08-08T23:35:53.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.164+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=BC06XH5431NC tag=UMN8YZN41U3K type=write size=1838475 2024-08-08T23:35:53.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.164+0000 7fdbd6e2c8c0 1 < completed write operation key=V6GSJH62C8TA tag=3ZPJKVORXWDW type=write size=95126 2024-08-08T23:35:53.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ARVE0E2GYLPC.0 size=1048576 2024-08-08T23:35:53.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ARVE0E2GYLPC.1 size=42069 2024-08-08T23:35:53.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=ARVE0E2GYLPC tag=OQA2AJGPTT5K type=write size=2139221 2024-08-08T23:35:53.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.172+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=BQ5250SH7IAI type=del 2024-08-08T23:35:53.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.176+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=U4WJSUTF4Z0G type=del size=2900853 2024-08-08T23:35:53.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.176+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~5TTWYSAS834S.0 size=245685 2024-08-08T23:35:53.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.180+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=5TTWYSAS834S tag=JLP7NMOM47IB type=write size=1294261 2024-08-08T23:35:53.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~4LDPU5VMIID8.0 size=337806 2024-08-08T23:35:53.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.184+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=4LDPU5VMIID8 tag=B1CNDPKFE5O4 type=write size=1386382 2024-08-08T23:35:53.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.188+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=3XA1B00P3UOY type=del 2024-08-08T23:35:53.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.188+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=8LXSPG5UUALJ type=del size=1690654 2024-08-08T23:35:53.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.192+0000 7fdbd6e2c8c0 1 < completed write operation key=V3TA5KZ95NXT tag=GEWXZ9NKC6X8 type=write size=734044 2024-08-08T23:35:53.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.192+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=ZXV1ZTPRIZ49 type=del size=2938471 2024-08-08T23:35:53.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.0 size=1048576 2024-08-08T23:35:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.1 size=1048576 2024-08-08T23:35:53.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~M1BREEYIEAEY.2 size=413285 2024-08-08T23:35:53.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=M1BREEYIEAEY tag=N8IMCIW5DNKN type=write size=3559013 2024-08-08T23:35:53.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.204+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=9VBBI0XGAMHF type=del size=2230965 2024-08-08T23:35:53.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.204+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.0 size=1048576 2024-08-08T23:35:53.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.1 size=1048576 2024-08-08T23:35:53.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~PNCKMB20TLB1.2 size=857954 2024-08-08T23:35:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.212+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=PNCKMB20TLB1 tag=Y33BW9LZEOIV type=write size=4003682 2024-08-08T23:35:53.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.216+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=PH99XLXI5E49 type=del size=605427 2024-08-08T23:35:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.220+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~5D420TJF5GVS.0 size=346624 2024-08-08T23:35:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.224+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=5D420TJF5GVS tag=Y19R6JBMZ7IC type=write size=1395200 2024-08-08T23:35:53.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.0 size=1048576 2024-08-08T23:35:53.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.1 size=1048576 2024-08-08T23:35:53.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.2 size=710279 2024-08-08T23:35:53.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.232+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=6WCDQ2IWE928 tag=C0CNC7J936YU type=write size=3856007 2024-08-08T23:35:53.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.236+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QJB9DETMSY4X tag=IT21QNXKYZ1N type=write 2024-08-08T23:35:53.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.240+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.0 size=1048576 2024-08-08T23:35:53.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.240+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.1 size=1048576 2024-08-08T23:35:53.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.2 size=624404 2024-08-08T23:35:53.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.244+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=2E90BO9HYFA2 tag=53SDMG1F79A2 type=write size=3770132 2024-08-08T23:35:53.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.244+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=M9YPVMN5NLHX type=del 2024-08-08T23:35:53.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.248+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=KHVJSHFS2U6L type=del size=2097577 2024-08-08T23:35:53.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~TJ4EC6XVWXSB.0 size=1048576 2024-08-08T23:35:53.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~TJ4EC6XVWXSB.1 size=14904 2024-08-08T23:35:53.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.256+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=TJ4EC6XVWXSB tag=EL3PKYYNDK9B type=write size=2112056 2024-08-08T23:35:53.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.256+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=CKVB6P2UVIV8 type=del size=2328836 2024-08-08T23:35:53.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.260+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=GAVUX46KUAM6 type=del 2024-08-08T23:35:53.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.264+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=67QZ7PSQCMKK type=del size=2842984 2024-08-08T23:35:53.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.264+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~PG9S1B6RHC50.0 size=756793 2024-08-08T23:35:53.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.268+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=PG9S1B6RHC50 tag=NI4FK74WNC0G type=write size=1805369 2024-08-08T23:35:53.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~84WV9YQ6Q8WG.0 size=1048576 2024-08-08T23:35:53.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~84WV9YQ6Q8WG.1 size=300941 2024-08-08T23:35:53.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.272+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=84WV9YQ6Q8WG tag=ZA2YQQFT8K1G type=write size=2398093 2024-08-08T23:35:53.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.276+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~B4BRDBOC2LIY.0 size=1048576 2024-08-08T23:35:53.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.276+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~B4BRDBOC2LIY.1 size=531844 2024-08-08T23:35:53.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.280+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=B4BRDBOC2LIY tag=BSC252L5XYZ1 type=write size=2628996 2024-08-08T23:35:53.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.284+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~M3XJ1ZXI6PUA.0 size=1048576 2024-08-08T23:35:53.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~M3XJ1ZXI6PUA.1 size=960122 2024-08-08T23:35:53.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.288+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=M3XJ1ZXI6PUA tag=QUVUW07ZC5SN type=write size=3057274 2024-08-08T23:35:53.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.288+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.0 size=1048576 2024-08-08T23:35:53.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.292+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.1 size=1048576 2024-08-08T23:35:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.292+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~Y21FWQUU4US2.2 size=640112 2024-08-08T23:35:53.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.296+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=Y21FWQUU4US2 tag=070SEUAY9GOS type=write size=3785840 2024-08-08T23:35:53.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.296+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=1IO91ZOHP30U type=write size=467175 2024-08-08T23:35:53.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.300+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~BC06XH5431NC.0 size=789899 2024-08-08T23:35:53.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.304+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=BC06XH5431NC tag=UMN8YZN41U3K type=write size=1838475 2024-08-08T23:35:53.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.0 size=1048576 2024-08-08T23:35:53.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.1 size=1048576 2024-08-08T23:35:53.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.312+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.2 size=909076 2024-08-08T23:35:53.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.312+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=7Q8J5BZ15RTC tag=Q36CC17BTU31 type=write size=4054804 2024-08-08T23:35:53.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.312+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ARVE0E2GYLPC.0 size=1048576 2024-08-08T23:35:53.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.312+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ARVE0E2GYLPC.1 size=42069 2024-08-08T23:35:53.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.316+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=ARVE0E2GYLPC tag=OQA2AJGPTT5K type=write size=2139221 2024-08-08T23:35:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.320+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=4NLGI1XJRHQW type=del size=4061677 2024-08-08T23:35:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.320+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=U4WJSUTF4Z0G type=del 2024-08-08T23:35:53.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.324+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~7TXBOD0574E1.0 size=1048576 2024-08-08T23:35:53.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.328+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~7TXBOD0574E1.1 size=589672 2024-08-08T23:35:53.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.328+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=7TXBOD0574E1 tag=FW8TXMIOGAT4 type=write size=2686824 2024-08-08T23:35:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.328+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~4LDPU5VMIID8.0 size=337806 2024-08-08T23:35:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.332+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=4LDPU5VMIID8 tag=B1CNDPKFE5O4 type=write size=1386382 2024-08-08T23:35:53.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~LPD4DI2DVW5V.0 size=462426 2024-08-08T23:35:53.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.336+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=LPD4DI2DVW5V tag=CZ9Z3U0BS3TQ type=write size=1511002 2024-08-08T23:35:53.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.340+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=8LXSPG5UUALJ type=del 2024-08-08T23:35:53.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.0 size=1048576 2024-08-08T23:35:53.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.1 size=1048576 2024-08-08T23:35:53.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.2 size=527047 2024-08-08T23:35:53.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.348+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=VZLOQ49NB5CX tag=JZ80K0J65NZE type=write size=3672775 2024-08-08T23:35:53.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.348+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=ZXV1ZTPRIZ49 type=del 2024-08-08T23:35:53.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.352+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.0 size=1048576 2024-08-08T23:35:53.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.356+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.1 size=1048576 2024-08-08T23:35:53.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.356+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.2 size=843330 2024-08-08T23:35:53.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.356+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=H254Z7L28BTB tag=D10V2A4INCQQ type=write size=3989058 2024-08-08T23:35:53.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.360+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=9VBBI0XGAMHF type=del 2024-08-08T23:35:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~OC5HA7C1K5Z0.0 size=1048576 2024-08-08T23:35:53.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~OC5HA7C1K5Z0.1 size=658149 2024-08-08T23:35:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.364+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=OC5HA7C1K5Z0 tag=YUJLUBIB96H0 type=write size=2755301 2024-08-08T23:35:53.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.368+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=PH99XLXI5E49 type=del 2024-08-08T23:35:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.376+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~VF54IIJT5T2R.0 size=599897 2024-08-08T23:35:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.376+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=VF54IIJT5T2R tag=8JOJLT8UHAEV type=write size=1648473 2024-08-08T23:35:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.376+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.0 size=1048576 2024-08-08T23:35:53.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.376+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.1 size=1048576 2024-08-08T23:35:53.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.380+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~6WCDQ2IWE928.2 size=710279 2024-08-08T23:35:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.384+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=6WCDQ2IWE928 tag=C0CNC7J936YU type=write size=3856007 2024-08-08T23:35:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.384+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=BJCRSNDGDZ3C type=del size=1006839 2024-08-08T23:35:53.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.388+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.0 size=1048576 2024-08-08T23:35:53.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.388+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.1 size=1048576 2024-08-08T23:35:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.392+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~2E90BO9HYFA2.2 size=624404 2024-08-08T23:35:53.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.396+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=2E90BO9HYFA2 tag=53SDMG1F79A2 type=write size=3770132 2024-08-08T23:35:53.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.400+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~RIDUA5LN2R84.0 size=1048576 2024-08-08T23:35:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.400+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~RIDUA5LN2R84.1 size=83577 2024-08-08T23:35:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.400+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=RIDUA5LN2R84 tag=BLHC87F20Y0F type=write size=2180729 2024-08-08T23:35:53.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.404+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=KHVJSHFS2U6L type=del 2024-08-08T23:35:53.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.404+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=ZZBNIZZBCPJ0 type=write size=684035 2024-08-08T23:35:53.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.408+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=CKVB6P2UVIV8 type=del 2024-08-08T23:35:53.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.412+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~ILWKPH2L4XQ4.0 size=712222 2024-08-08T23:35:53.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.412+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=ILWKPH2L4XQ4 tag=JLEX7DVL6APN type=write size=1760798 2024-08-08T23:35:53.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.416+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=67QZ7PSQCMKK type=del 2024-08-08T23:35:53.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.416+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=N6W13CX09HSE type=del size=1215859 2024-08-08T23:35:53.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~84WV9YQ6Q8WG.0 size=1048576 2024-08-08T23:35:53.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~84WV9YQ6Q8WG.1 size=300941 2024-08-08T23:35:53.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.424+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=84WV9YQ6Q8WG tag=ZA2YQQFT8K1G type=write size=2398093 2024-08-08T23:35:53.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.424+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=4GXYYHI6CS13 type=del size=1675978 2024-08-08T23:35:53.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.428+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~M3XJ1ZXI6PUA.0 size=1048576 2024-08-08T23:35:53.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.428+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~M3XJ1ZXI6PUA.1 size=960122 2024-08-08T23:35:53.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.432+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=M3XJ1ZXI6PUA tag=QUVUW07ZC5SN type=write size=3057274 2024-08-08T23:35:53.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~BQNIXKHA3T80.0 size=1048576 2024-08-08T23:35:53.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.440+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~BQNIXKHA3T80.1 size=78897 2024-08-08T23:35:53.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.440+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=BQNIXKHA3T80 tag=B804FHT4FOOQ type=write size=2176049 2024-08-08T23:35:53.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.440+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=1IO91ZOHP30U type=write size=467175 2024-08-08T23:35:53.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.444+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=AFXLRD87LM52 type=del size=3715632 2024-08-08T23:35:53.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.0 size=1048576 2024-08-08T23:35:53.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.448+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.1 size=1048576 2024-08-08T23:35:53.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.448+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~7Q8J5BZ15RTC.2 size=909076 2024-08-08T23:35:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.452+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=7Q8J5BZ15RTC tag=Q36CC17BTU31 type=write size=4054804 2024-08-08T23:35:53.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.456+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~CF9LDKFZQ9Y2.0 size=1048576 2024-08-08T23:35:53.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.456+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~CF9LDKFZQ9Y2.1 size=845680 2024-08-08T23:35:53.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.456+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=CF9LDKFZQ9Y2 tag=AZLUOIMQZSOS type=write size=2942832 2024-08-08T23:35:53.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.460+0000 7fdbd6e2c8c0 1 < suggested update operation key=41XLZV9ZY5OP tag=4NLGI1XJRHQW type=del size=4061677 2024-08-08T23:35:53.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~H3LUZ30C63ST.0 size=478924 2024-08-08T23:35:53.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.464+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=H3LUZ30C63ST tag=A5CBRHXAZNKA type=write size=1527500 2024-08-08T23:35:53.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.468+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~7TXBOD0574E1.0 size=1048576 2024-08-08T23:35:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.468+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~7TXBOD0574E1.1 size=589672 2024-08-08T23:35:53.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.472+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=7TXBOD0574E1 tag=FW8TXMIOGAT4 type=write size=2686824 2024-08-08T23:35:53.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.476+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=ZWX5DFBHJN2I type=del size=239901 2024-08-08T23:35:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~LPD4DI2DVW5V.0 size=462426 2024-08-08T23:35:53.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.480+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=LPD4DI2DVW5V tag=CZ9Z3U0BS3TQ type=write size=1511002 2024-08-08T23:35:53.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.484+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=TZ8UNBRYHZ99 type=del size=2147312 2024-08-08T23:35:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.484+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.0 size=1048576 2024-08-08T23:35:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.1 size=1048576 2024-08-08T23:35:53.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZLOQ49NB5CX.2 size=527047 2024-08-08T23:35:53.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.492+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=VZLOQ49NB5CX tag=JZ80K0J65NZE type=write size=3672775 2024-08-08T23:35:53.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.496+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=TU9A88128WGQ type=del size=3242431 2024-08-08T23:35:53.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.496+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.0 size=1048576 2024-08-08T23:35:53.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.500+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.1 size=1048576 2024-08-08T23:35:53.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.500+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~H254Z7L28BTB.2 size=843330 2024-08-08T23:35:53.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.504+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=H254Z7L28BTB tag=D10V2A4INCQQ type=write size=3989058 2024-08-08T23:35:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.0 size=1048576 2024-08-08T23:35:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.1 size=1048576 2024-08-08T23:35:53.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.2 size=769153 2024-08-08T23:35:53.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.512+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=F4J3SVPUXJH3 tag=WZ75KLP2VY9X type=write size=3914881 2024-08-08T23:35:53.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.516+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~OC5HA7C1K5Z0.0 size=1048576 2024-08-08T23:35:53.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.516+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~OC5HA7C1K5Z0.1 size=658149 2024-08-08T23:35:53.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.520+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=OC5HA7C1K5Z0 tag=YUJLUBIB96H0 type=write size=2755301 2024-08-08T23:35:53.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.524+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=RS13K8QAEO4M type=del size=392150 2024-08-08T23:35:53.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.528+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~VF54IIJT5T2R.0 size=599897 2024-08-08T23:35:53.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.532+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=VF54IIJT5T2R tag=8JOJLT8UHAEV type=write size=1648473 2024-08-08T23:35:53.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.532+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=GH0C6D02CCDM type=del size=2011102 2024-08-08T23:35:53.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.536+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=BJCRSNDGDZ3C type=del 2024-08-08T23:35:53.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.540+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=3J352OULKZYT type=write size=760773 2024-08-08T23:35:53.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.544+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~RIDUA5LN2R84.0 size=1048576 2024-08-08T23:35:53.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.544+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~RIDUA5LN2R84.1 size=83577 2024-08-08T23:35:53.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.548+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=RIDUA5LN2R84 tag=BLHC87F20Y0F type=write size=2180729 2024-08-08T23:35:53.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.552+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=BM6TP7558PI7 type=del size=2362592 2024-08-08T23:35:53.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.552+0000 7fdbd6e2c8c0 1 < completed write operation key=VSLBN9AVZK00 tag=ZZBNIZZBCPJ0 type=write size=684035 2024-08-08T23:35:53.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.556+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=Z80AXUESZ254 type=del size=3494479 2024-08-08T23:35:53.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.560+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~ILWKPH2L4XQ4.0 size=712222 2024-08-08T23:35:53.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.564+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=ILWKPH2L4XQ4 tag=JLEX7DVL6APN type=write size=1760798 2024-08-08T23:35:53.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~TUIHDDDKIR73.0 size=1048576 2024-08-08T23:35:53.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~TUIHDDDKIR73.1 size=697069 2024-08-08T23:35:53.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=TUIHDDDKIR73 tag=M1616EFGD21E type=write size=2794221 2024-08-08T23:35:53.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.572+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=N6W13CX09HSE type=del 2024-08-08T23:35:53.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.576+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=TJY1WXK8X8SI type=write size=370247 2024-08-08T23:35:53.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.576+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=4GXYYHI6CS13 type=del 2024-08-08T23:35:53.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.580+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=V44Z1PBBAWDG type=write size=405757 2024-08-08T23:35:53.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~BQNIXKHA3T80.0 size=1048576 2024-08-08T23:35:53.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~BQNIXKHA3T80.1 size=78897 2024-08-08T23:35:53.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.588+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=BQNIXKHA3T80 tag=B804FHT4FOOQ type=write size=2176049 2024-08-08T23:35:53.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.592+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=IAC053UHGZC0 type=del size=2583018 2024-08-08T23:35:53.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.596+0000 7fdbd6e2c8c0 1 < suggested update operation key=QANZ3YTL2NQV tag=AFXLRD87LM52 type=del size=3715632 2024-08-08T23:35:53.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.596+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=JQJP9Q31R69L type=write size=1012476 2024-08-08T23:35:53.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.600+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~CF9LDKFZQ9Y2.0 size=1048576 2024-08-08T23:35:53.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.604+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~CF9LDKFZQ9Y2.1 size=845680 2024-08-08T23:35:53.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.608+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=CF9LDKFZQ9Y2 tag=AZLUOIMQZSOS type=write size=2942832 2024-08-08T23:35:53.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.608+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=931HLIZY4ULN type=del size=3105401 2024-08-08T23:35:53.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.612+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~H3LUZ30C63ST.0 size=478924 2024-08-08T23:35:53.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.616+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=H3LUZ30C63ST tag=A5CBRHXAZNKA type=write size=1527500 2024-08-08T23:35:53.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.620+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~WLPZJKCTOSKO.0 size=1048576 2024-08-08T23:35:53.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.620+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~WLPZJKCTOSKO.1 size=357423 2024-08-08T23:35:53.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.620+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=WLPZJKCTOSKO tag=0QEMMO9EQJ2L type=write size=2454575 2024-08-08T23:35:53.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.624+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=ZWX5DFBHJN2I type=del 2024-08-08T23:35:53.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.628+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.0 size=1048576 2024-08-08T23:35:53.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.632+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.1 size=1048576 2024-08-08T23:35:53.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.632+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.2 size=866460 2024-08-08T23:35:53.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.632+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=7UXYGZD6Q46E tag=FAH2DTFJFRKN type=write size=4012188 2024-08-08T23:35:53.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.636+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=TZ8UNBRYHZ99 type=del 2024-08-08T23:35:53.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.640+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~VLC1M2D1D43R.0 size=1048576 2024-08-08T23:35:53.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~VLC1M2D1D43R.1 size=66662 2024-08-08T23:35:53.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.644+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=VLC1M2D1D43R tag=PMCGL4HTUZR3 type=write size=2163814 2024-08-08T23:35:53.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.644+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QANZ3YTL2NQV tag=TU9A88128WGQ type=del size=3242431: (22) Invalid argument 2024-08-08T23:35:53.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.648+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~ANL5PZ6F4TL9.0 size=862326 2024-08-08T23:35:53.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.648+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=ANL5PZ6F4TL9 tag=XP0QU6NX8S8W type=write size=1910902 2024-08-08T23:35:53.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.652+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.0 size=1048576 2024-08-08T23:35:53.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.656+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.1 size=1048576 2024-08-08T23:35:53.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.656+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~F4J3SVPUXJH3.2 size=769153 2024-08-08T23:35:53.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.660+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=F4J3SVPUXJH3 tag=WZ75KLP2VY9X type=write size=3914881 2024-08-08T23:35:53.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~X45FLB9TEG3Y.0 size=600594 2024-08-08T23:35:53.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.664+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=X45FLB9TEG3Y tag=MX72ITRUG8YE type=write size=1649170 2024-08-08T23:35:53.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.668+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=RS13K8QAEO4M type=del 2024-08-08T23:35:53.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.668+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=VYFN2S0SUMKK type=del size=466474 2024-08-08T23:35:53.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.672+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=GH0C6D02CCDM type=del 2024-08-08T23:35:53.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.672+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=2TCEG4S9NLUK type=del size=1707482 2024-08-08T23:35:53.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.676+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=3J352OULKZYT type=write size=760773 2024-08-08T23:35:53.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.676+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=R8BD207L6GO6 type=del size=2039968 2024-08-08T23:35:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.680+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=BM6TP7558PI7 type=del 2024-08-08T23:35:53.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.684+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=R7XBMWKZ0CXL type=del size=1857355 2024-08-08T23:35:53.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.684+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=Z80AXUESZ254 type=del size=3494479 2024-08-08T23:35:53.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.688+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=DTSICGCVTU80 type=del size=109466 2024-08-08T23:35:53.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.688+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~TUIHDDDKIR73.0 size=1048576 2024-08-08T23:35:53.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~TUIHDDDKIR73.1 size=697069 2024-08-08T23:35:53.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.696+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=TUIHDDDKIR73 tag=M1616EFGD21E type=write size=2794221 2024-08-08T23:35:53.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.0 size=1048576 2024-08-08T23:35:53.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.1 size=1048576 2024-08-08T23:35:53.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.2 size=257351 2024-08-08T23:35:53.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.704+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=T7W6XIAXBX80 tag=YUX7PW23AY59 type=write size=3403079 2024-08-08T23:35:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.704+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QANZ3YTL2NQV tag=TJY1WXK8X8SI type=write size=370247: (22) Invalid argument 2024-08-08T23:35:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.708+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~5R6ZNN4CN20I.0 size=136326 2024-08-08T23:35:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.708+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=5R6ZNN4CN20I tag=0RHOXQCZTBVK type=write size=1184902 2024-08-08T23:35:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.712+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QANZ3YTL2NQV tag=V44Z1PBBAWDG type=write size=405757: (22) Invalid argument 2024-08-08T23:35:53.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.716+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=R09UPBN81M9N type=del size=2108611 2024-08-08T23:35:53.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.716+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=IAC053UHGZC0 type=del 2024-08-08T23:35:53.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.720+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=IYMBBWZ4FIB4 type=del size=4091477 2024-08-08T23:35:53.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.720+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=JQJP9Q31R69L type=write size=1012476 2024-08-08T23:35:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.724+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=M7HY6FGAB0XU type=del size=1135959 2024-08-08T23:35:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.728+0000 7fdbd6e2c8c0 1 < canceled operation key=ZQ8GOX9RSTBB tag=931HLIZY4ULN type=del size=3105401 2024-08-08T23:35:53.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.728+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=809BSX6GQOVL type=del size=1471462 2024-08-08T23:35:53.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~WLPZJKCTOSKO.0 size=1048576 2024-08-08T23:35:53.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~WLPZJKCTOSKO.1 size=357423 2024-08-08T23:35:53.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.736+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=WLPZJKCTOSKO tag=0QEMMO9EQJ2L type=write size=2454575 2024-08-08T23:35:53.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.740+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=A9XTE0B21MYK type=del size=1657911 2024-08-08T23:35:53.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.740+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.0 size=1048576 2024-08-08T23:35:53.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.740+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.1 size=1048576 2024-08-08T23:35:53.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.744+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~7UXYGZD6Q46E.2 size=866460 2024-08-08T23:35:53.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.748+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=7UXYGZD6Q46E tag=FAH2DTFJFRKN type=write size=4012188 2024-08-08T23:35:53.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.748+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=IPXPSBVYDWS7 type=write size=970418 2024-08-08T23:35:53.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~VLC1M2D1D43R.0 size=1048576 2024-08-08T23:35:53.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~VLC1M2D1D43R.1 size=66662 2024-08-08T23:35:53.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.760+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=VLC1M2D1D43R tag=PMCGL4HTUZR3 type=write size=2163814 2024-08-08T23:35:53.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.0 size=1048576 2024-08-08T23:35:53.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.1 size=1048576 2024-08-08T23:35:53.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.768+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.2 size=452433 2024-08-08T23:35:53.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.768+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=NDREOLQHFIP3 tag=U0VSLQI5MP8Q type=write size=3598161 2024-08-08T23:35:53.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.768+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~ANL5PZ6F4TL9.0 size=862326 2024-08-08T23:35:53.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.772+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=ANL5PZ6F4TL9 tag=XP0QU6NX8S8W type=write size=1910902 2024-08-08T23:35:53.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.776+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=LHJGEZ0KDSE9 type=del size=3246242 2024-08-08T23:35:53.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.776+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~X45FLB9TEG3Y.0 size=600594 2024-08-08T23:35:53.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.780+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=X45FLB9TEG3Y tag=MX72ITRUG8YE type=write size=1649170 2024-08-08T23:35:53.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.0 size=1048576 2024-08-08T23:35:53.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.1 size=1048576 2024-08-08T23:35:53.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.2 size=132858 2024-08-08T23:35:53.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=NVTZCJ156HPQ tag=CRBM7RG1Q79B type=write size=3278586 2024-08-08T23:35:53.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.792+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=VYFN2S0SUMKK type=del 2024-08-08T23:35:53.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.796+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=C1P9VDX789HI type=write size=924563 2024-08-08T23:35:53.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.800+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=2TCEG4S9NLUK type=del 2024-08-08T23:35:53.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~0RTKW1KR50TI.0 size=1048576 2024-08-08T23:35:53.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~0RTKW1KR50TI.1 size=993400 2024-08-08T23:35:53.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.808+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=0RTKW1KR50TI tag=Z11DLS21KYS7 type=write size=3090552 2024-08-08T23:35:53.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.812+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=R8BD207L6GO6 type=del 2024-08-08T23:35:53.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.812+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=82U1KQD79JB7 type=write size=57809 2024-08-08T23:35:53.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.816+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=R7XBMWKZ0CXL type=del size=1857355 2024-08-08T23:35:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.820+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=WBK2WISC45O7 type=del size=677695 2024-08-08T23:35:53.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.824+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FWZ5TEP1P2LK tag=DTSICGCVTU80 type=del 2024-08-08T23:35:53.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.0 size=1048576 2024-08-08T23:35:53.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.1 size=1048576 2024-08-08T23:35:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.2 size=328165 2024-08-08T23:35:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.832+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=US1GCGC6Z8AM tag=KJCLLU0SK09L type=write size=3473893 2024-08-08T23:35:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.832+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.0 size=1048576 2024-08-08T23:35:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.832+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.1 size=1048576 2024-08-08T23:35:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.836+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~T7W6XIAXBX80.2 size=257351 2024-08-08T23:35:53.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.840+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QANZ3YTL2NQV upload=T7W6XIAXBX80 tag=YUX7PW23AY59 type=write size=3403079 2024-08-08T23:35:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.0 size=1048576 2024-08-08T23:35:53.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.1 size=1048576 2024-08-08T23:35:53.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.2 size=187668 2024-08-08T23:35:53.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.848+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=9JX5O6E6M1UE tag=78EUFH16WCB5 type=write size=3333396 2024-08-08T23:35:53.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.852+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~5R6ZNN4CN20I.0 size=136326 2024-08-08T23:35:53.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.856+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=5R6ZNN4CN20I tag=0RHOXQCZTBVK type=write size=1184902 2024-08-08T23:35:53.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.860+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=OQDRHZMXBH1M type=del size=3327208 2024-08-08T23:35:53.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.860+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=R09UPBN81M9N type=del 2024-08-08T23:35:53.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~ZGAOUP8C39H2.0 size=838875 2024-08-08T23:35:53.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.864+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=ZGAOUP8C39H2 tag=R7M6YU821MIQ type=write size=1887451 2024-08-08T23:35:53.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.868+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=IYMBBWZ4FIB4 type=del 2024-08-08T23:35:53.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.872+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=GRXS3R3OXLUQ type=del size=1613593 2024-08-08T23:35:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.876+0000 7fdbd6e2c8c0 1 < suggested update operation key=QWRYLH4P94BQ tag=M7HY6FGAB0XU type=del size=1135959 2024-08-08T23:35:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.876+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=QRGN2Y51HGFW type=write size=532025 2024-08-08T23:35:53.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.880+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=809BSX6GQOVL type=del 2024-08-08T23:35:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~WAWTGX8RZ3MH.0 size=439090 2024-08-08T23:35:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.884+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=WAWTGX8RZ3MH tag=Z1FPKQJAQKRM type=write size=1487666 2024-08-08T23:35:53.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.888+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=FWZ5TEP1P2LK tag=A9XTE0B21MYK type=del size=1657911: (22) Invalid argument 2024-08-08T23:35:53.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~YR10NR3MHEY2.0 size=1048576 2024-08-08T23:35:53.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~YR10NR3MHEY2.1 size=968306 2024-08-08T23:35:53.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.892+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=YR10NR3MHEY2 tag=0IPB9Z5C4CJ5 type=write size=3065458 2024-08-08T23:35:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.896+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=IPXPSBVYDWS7 type=write size=970418 2024-08-08T23:35:53.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.896+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=YF0PLGKUA47S type=del size=337266 2024-08-08T23:35:53.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.900+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.0 size=1048576 2024-08-08T23:35:53.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.900+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.1 size=1048576 2024-08-08T23:35:53.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~NDREOLQHFIP3.2 size=452433 2024-08-08T23:35:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.908+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=NDREOLQHFIP3 tag=U0VSLQI5MP8Q type=write size=3598161 2024-08-08T23:35:53.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.912+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=KGJQ6TIULB0R type=write size=285405 2024-08-08T23:35:53.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.912+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=LHJGEZ0KDSE9 type=del 2024-08-08T23:35:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.916+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=BFAEIWHKGV1P type=del size=2015617 2024-08-08T23:35:53.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.916+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.0 size=1048576 2024-08-08T23:35:53.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.1 size=1048576 2024-08-08T23:35:53.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~NVTZCJ156HPQ.2 size=132858 2024-08-08T23:35:53.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.928+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=Z5EXY8ZHZCHI upload=NVTZCJ156HPQ tag=CRBM7RG1Q79B type=write size=3278586 2024-08-08T23:35:53.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.932+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=84T49CXQUP5D type=write size=768730 2024-08-08T23:35:53.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.932+0000 7fdbd6e2c8c0 1 < completed write operation key=41XLZV9ZY5OP tag=C1P9VDX789HI type=write size=924563 2024-08-08T23:35:53.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.936+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=RA3CA6D7I2BV type=del size=2957693 2024-08-08T23:35:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~0RTKW1KR50TI.0 size=1048576 2024-08-08T23:35:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~0RTKW1KR50TI.1 size=993400 2024-08-08T23:35:53.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.948+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=0RTKW1KR50TI tag=Z11DLS21KYS7 type=write size=3090552 2024-08-08T23:35:53.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~5M5ZWUEBZRIG.0 size=1048576 2024-08-08T23:35:53.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~5M5ZWUEBZRIG.1 size=911309 2024-08-08T23:35:53.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=5M5ZWUEBZRIG tag=PUZMLEY20TBD type=write size=3008461 2024-08-08T23:35:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.956+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=82U1KQD79JB7 type=write size=57809 2024-08-08T23:35:53.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.0 size=1048576 2024-08-08T23:35:53.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.1 size=1048576 2024-08-08T23:35:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.2 size=207473 2024-08-08T23:35:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.968+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=TCTF05AIY3FE tag=DOVJ18FOCDKX type=write size=3353201 2024-08-08T23:35:53.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.972+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=WBK2WISC45O7 type=del 2024-08-08T23:35:53.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.972+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=9AXK0DM1W9QH type=del size=722561 2024-08-08T23:35:53.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.976+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.0 size=1048576 2024-08-08T23:35:53.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.1 size=1048576 2024-08-08T23:35:53.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~US1GCGC6Z8AM.2 size=328165 2024-08-08T23:35:53.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.984+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=US1GCGC6Z8AM tag=KJCLLU0SK09L type=write size=3473893 2024-08-08T23:35:53.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.988+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=EAZRPH7VG8L6 type=del size=72466 2024-08-08T23:35:53.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.988+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.0 size=1048576 2024-08-08T23:35:53.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.1 size=1048576 2024-08-08T23:35:53.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:53.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~9JX5O6E6M1UE.2 size=187668 2024-08-08T23:35:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.000+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=9JX5O6E6M1UE tag=78EUFH16WCB5 type=write size=3333396 2024-08-08T23:35:54.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.0 size=1048576 2024-08-08T23:35:54.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.1 size=1048576 2024-08-08T23:35:54.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.2 size=677931 2024-08-08T23:35:54.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.008+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=ML7J72ILOFJN tag=EXVF2QQC0HAH type=write size=3823659 2024-08-08T23:35:54.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.012+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=OQDRHZMXBH1M type=del 2024-08-08T23:35:54.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.016+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=3TMXUK9SBEZ8 type=del size=2239716 2024-08-08T23:35:54.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.016+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~ZGAOUP8C39H2.0 size=838875 2024-08-08T23:35:54.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.024+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=ZGAOUP8C39H2 tag=R7M6YU821MIQ type=write size=1887451 2024-08-08T23:35:54.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.028+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~PW63890WIJ89.0 size=173858 2024-08-08T23:35:54.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.028+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=PW63890WIJ89 tag=NV095G4C27Z8 type=write size=1222434 2024-08-08T23:35:54.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.032+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QWRYLH4P94BQ tag=GRXS3R3OXLUQ type=del size=1613593: (22) Invalid argument 2024-08-08T23:35:54.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.036+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=QH9IQ081Q1F4 type=write size=722103 2024-08-08T23:35:54.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.036+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=QRGN2Y51HGFW type=write size=532025 2024-08-08T23:35:54.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.0 size=1048576 2024-08-08T23:35:54.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.1 size=1048576 2024-08-08T23:35:54.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.048+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.2 size=701045 2024-08-08T23:35:54.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.048+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=RQEZZON14LBS tag=ICFXVM5M0U0B type=write size=3846773 2024-08-08T23:35:54.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~WAWTGX8RZ3MH.0 size=439090 2024-08-08T23:35:54.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.056+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=WAWTGX8RZ3MH tag=Z1FPKQJAQKRM type=write size=1487666 2024-08-08T23:35:54.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.060+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~KKFBFQGVFKCQ.0 size=282187 2024-08-08T23:35:54.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.060+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=KKFBFQGVFKCQ tag=DGOJ2M4A6S8O type=write size=1330763 2024-08-08T23:35:54.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.064+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~YR10NR3MHEY2.0 size=1048576 2024-08-08T23:35:54.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.064+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~YR10NR3MHEY2.1 size=968306 2024-08-08T23:35:54.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.068+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=YR10NR3MHEY2 tag=0IPB9Z5C4CJ5 type=write size=3065458 2024-08-08T23:35:54.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~P5AOQBXDHAC9.0 size=556888 2024-08-08T23:35:54.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=P5AOQBXDHAC9 tag=GM3NUTX36PCX type=write size=1605464 2024-08-08T23:35:54.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.076+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=YF0PLGKUA47S type=del 2024-08-08T23:35:54.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.080+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=87H64219VZ0C type=del size=2109089 2024-08-08T23:35:54.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.084+0000 7fdbd6e2c8c0 1 < completed write operation key=V3TA5KZ95NXT tag=KGJQ6TIULB0R type=write size=285405 2024-08-08T23:35:54.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.088+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=O4UBFF0GWYO5 type=del size=2048264 2024-08-08T23:35:54.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.088+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=BFAEIWHKGV1P type=del 2024-08-08T23:35:54.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.096+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~CG0GOLQUY13K.0 size=1048576 2024-08-08T23:35:54.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.096+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~CG0GOLQUY13K.1 size=425283 2024-08-08T23:35:54.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.096+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=CG0GOLQUY13K tag=148FX66P8IO7 type=write size=2522435 2024-08-08T23:35:54.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.100+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=84T49CXQUP5D type=write size=768730 2024-08-08T23:35:54.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.104+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=N0NUKLH7AX2U type=write size=276016 2024-08-08T23:35:54.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.104+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=RA3CA6D7I2BV type=del 2024-08-08T23:35:54.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.112+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~KHYA05OVH2MF.0 size=706233 2024-08-08T23:35:54.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.112+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=KHYA05OVH2MF tag=B7IIFZT614KK type=write size=1754809 2024-08-08T23:35:54.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~5M5ZWUEBZRIG.0 size=1048576 2024-08-08T23:35:54.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.116+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~5M5ZWUEBZRIG.1 size=911309 2024-08-08T23:35:54.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.120+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=5M5ZWUEBZRIG tag=PUZMLEY20TBD type=write size=3008461 2024-08-08T23:35:54.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.124+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=3MZXHKNVOGSS type=del size=83605 2024-08-08T23:35:54.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.0 size=1048576 2024-08-08T23:35:54.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.132+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.1 size=1048576 2024-08-08T23:35:54.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.136+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~TCTF05AIY3FE.2 size=207473 2024-08-08T23:35:54.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.140+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=TCTF05AIY3FE tag=DOVJ18FOCDKX type=write size=3353201 2024-08-08T23:35:54.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.144+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=MLKSX3D4SZN6 type=del size=955868 2024-08-08T23:35:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.148+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=9AXK0DM1W9QH type=del 2024-08-08T23:35:54.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~O84DGBJ8039S.0 size=1048576 2024-08-08T23:35:54.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.156+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~O84DGBJ8039S.1 size=966408 2024-08-08T23:35:54.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.156+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=O84DGBJ8039S tag=F8LI03S5C5J8 type=write size=3063560 2024-08-08T23:35:54.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.160+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=EAZRPH7VG8L6 type=del size=72466 2024-08-08T23:35:54.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~509LWWTCSS89.0 size=1048576 2024-08-08T23:35:54.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~509LWWTCSS89.1 size=1004030 2024-08-08T23:35:54.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=509LWWTCSS89 tag=T5BBLDL1JC15 type=write size=3101182 2024-08-08T23:35:54.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.0 size=1048576 2024-08-08T23:35:54.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.1 size=1048576 2024-08-08T23:35:54.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.176+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~ML7J72ILOFJN.2 size=677931 2024-08-08T23:35:54.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.180+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=ML7J72ILOFJN tag=EXVF2QQC0HAH type=write size=3823659 2024-08-08T23:35:54.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.184+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=1WSRKAOWWV7W type=del size=839180 2024-08-08T23:35:54.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.192+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=3TMXUK9SBEZ8 type=del size=2239716 2024-08-08T23:35:54.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.196+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=68SM64ACU16T type=del size=3679469 2024-08-08T23:35:54.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.200+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~PW63890WIJ89.0 size=173858 2024-08-08T23:35:54.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.204+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=PW63890WIJ89 tag=NV095G4C27Z8 type=write size=1222434 2024-08-08T23:35:54.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~273S1GQVKMOL.0 size=1048576 2024-08-08T23:35:54.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.212+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~273S1GQVKMOL.1 size=414273 2024-08-08T23:35:54.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.212+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=273S1GQVKMOL tag=GQE31R1XKVR6 type=write size=2511425 2024-08-08T23:35:54.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.216+0000 7fdbd6e2c8c0 1 < completed write operation key=V6GSJH62C8TA tag=QH9IQ081Q1F4 type=write size=722103 2024-08-08T23:35:54.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.220+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~2NXZ6L3GYT63.0 size=253772 2024-08-08T23:35:54.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.220+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=2NXZ6L3GYT63 tag=B9ELASJTONMF type=write size=1302348 2024-08-08T23:35:54.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.224+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.0 size=1048576 2024-08-08T23:35:54.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.228+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.1 size=1048576 2024-08-08T23:35:54.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.232+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~RQEZZON14LBS.2 size=701045 2024-08-08T23:35:54.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.240+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=RQEZZON14LBS tag=ICFXVM5M0U0B type=write size=3846773 2024-08-08T23:35:54.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~RTK314XZ54CS.0 size=1048576 2024-08-08T23:35:54.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.248+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~RTK314XZ54CS.1 size=429916 2024-08-08T23:35:54.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.248+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=RTK314XZ54CS tag=ANHXRF4BLDBY type=write size=2527068 2024-08-08T23:35:54.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~KKFBFQGVFKCQ.0 size=282187 2024-08-08T23:35:54.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.256+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=KKFBFQGVFKCQ tag=DGOJ2M4A6S8O type=write size=1330763 2024-08-08T23:35:54.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.0 size=1048576 2024-08-08T23:35:54.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.1 size=1048576 2024-08-08T23:35:54.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.268+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.2 size=284496 2024-08-08T23:35:54.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.268+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=MEBNN244OV5G tag=13QR27ZGUNE6 type=write size=3430224 2024-08-08T23:35:54.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.272+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~P5AOQBXDHAC9.0 size=556888 2024-08-08T23:35:54.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.276+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=P5AOQBXDHAC9 tag=GM3NUTX36PCX type=write size=1605464 2024-08-08T23:35:54.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.284+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~AZ4TT06XCLCO.0 size=27805 2024-08-08T23:35:54.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.284+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=AZ4TT06XCLCO tag=RESZDP1OULHF type=write size=1076381 2024-08-08T23:35:54.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.288+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=87H64219VZ0C type=del 2024-08-08T23:35:54.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.288+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=XGEBK0RK2NY4 type=del size=3583510 2024-08-08T23:35:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.292+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=O4UBFF0GWYO5 type=del 2024-08-08T23:35:54.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.296+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=ZNBCI8SPCGXY type=del size=1403852 2024-08-08T23:35:54.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.300+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~CG0GOLQUY13K.0 size=1048576 2024-08-08T23:35:54.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.304+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~CG0GOLQUY13K.1 size=425283 2024-08-08T23:35:54.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.308+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=CG0GOLQUY13K tag=148FX66P8IO7 type=write size=2522435 2024-08-08T23:35:54.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.312+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=OHT6JCJHDJPD type=del size=254673 2024-08-08T23:35:54.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.316+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=N0NUKLH7AX2U type=write size=276016 2024-08-08T23:35:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.320+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=RGAF8HACSIVG type=del size=3423216 2024-08-08T23:35:54.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~KHYA05OVH2MF.0 size=706233 2024-08-08T23:35:54.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.328+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=KHYA05OVH2MF tag=B7IIFZT614KK type=write size=1754809 2024-08-08T23:35:54.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.328+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=2X2AABDQVHFK type=write size=779691 2024-08-08T23:35:54.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.336+0000 7fdbd6e2c8c0 1 < suggested update operation key=YO2FZOR7H0EX tag=3MZXHKNVOGSS type=del size=83605 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.340+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=FB5Q7WRQJOBA type=del size=2033392 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.344+0000 7fdbd6e2c8c0 1 < canceled operation key=XIXN9HLLSJS3 tag=MLKSX3D4SZN6 type=del size=955868 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~RNJU0IT798K9.0 size=298301 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.348+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=RNJU0IT798K9 tag=LAISJNQFR966 type=write size=1346877 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~O84DGBJ8039S.0 size=1048576 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~O84DGBJ8039S.1 size=966408 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.360+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=O84DGBJ8039S tag=F8LI03S5C5J8 type=write size=3063560 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.360+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=OREJCU2H1ZMK type=del size=339193 2024-08-08T23:35:54.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.364+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~509LWWTCSS89.0 size=1048576 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.364+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VSLBN9AVZK00.2~509LWWTCSS89.1 size=1004030 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.368+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VSLBN9AVZK00 upload=509LWWTCSS89 tag=T5BBLDL1JC15 type=write size=3101182 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.376+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~1G301HCPJ3EL.0 size=1048576 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.376+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~1G301HCPJ3EL.1 size=642663 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.376+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=1G301HCPJ3EL tag=OIR2US0L1I3J type=write size=2739815 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.384+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=1WSRKAOWWV7W type=del 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~UQCZKQ45W7O6.0 size=1048576 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~UQCZKQ45W7O6.1 size=94304 2024-08-08T23:35:54.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.392+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=UQCZKQ45W7O6 tag=87F7RA5DSS5I type=write size=2191456 2024-08-08T23:35:54.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.396+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YNQU8Z202QCM tag=68SM64ACU16T type=del 2024-08-08T23:35:54.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.400+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=Y61SYG6MO1J8 type=del size=2513390 2024-08-08T23:35:54.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.404+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~273S1GQVKMOL.0 size=1048576 2024-08-08T23:35:54.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.404+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~273S1GQVKMOL.1 size=414273 2024-08-08T23:35:54.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.412+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=273S1GQVKMOL tag=GQE31R1XKVR6 type=write size=2511425 2024-08-08T23:35:54.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.416+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.0 size=1048576 2024-08-08T23:35:54.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.1 size=1048576 2024-08-08T23:35:54.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.2 size=957508 2024-08-08T23:35:54.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.420+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=FYS4RZ1OMH7A tag=7CCNI61Q09MC type=write size=4103236 2024-08-08T23:35:54.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~2NXZ6L3GYT63.0 size=253772 2024-08-08T23:35:54.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.428+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=2NXZ6L3GYT63 tag=B9ELASJTONMF type=write size=1302348 2024-08-08T23:35:54.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~CLRDI3H6PYYX.0 size=1048576 2024-08-08T23:35:54.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~CLRDI3H6PYYX.1 size=909117 2024-08-08T23:35:54.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.436+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=CLRDI3H6PYYX tag=FJE42M9T0BFT type=write size=3006269 2024-08-08T23:35:54.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~RTK314XZ54CS.0 size=1048576 2024-08-08T23:35:54.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~RTK314XZ54CS.1 size=429916 2024-08-08T23:35:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.448+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=RTK314XZ54CS tag=ANHXRF4BLDBY type=write size=2527068 2024-08-08T23:35:54.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.452+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=XOH4EJWPNV3C type=del size=7144 2024-08-08T23:35:54.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.0 size=1048576 2024-08-08T23:35:54.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.1 size=1048576 2024-08-08T23:35:54.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.460+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~MEBNN244OV5G.2 size=284496 2024-08-08T23:35:54.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.464+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=MEBNN244OV5G tag=13QR27ZGUNE6 type=write size=3430224 2024-08-08T23:35:54.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.468+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=XZR7L01DOD2O type=del size=2674670 2024-08-08T23:35:54.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.468+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~AZ4TT06XCLCO.0 size=27805 2024-08-08T23:35:54.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.472+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=AZ4TT06XCLCO tag=RESZDP1OULHF type=write size=1076381 2024-08-08T23:35:54.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.476+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=8U59I09L7XI2 type=del size=2626292 2024-08-08T23:35:54.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.484+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YO2FZOR7H0EX tag=XGEBK0RK2NY4 type=del 2024-08-08T23:35:54.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.484+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=90NVJ8QTNVAS type=del size=2583759 2024-08-08T23:35:54.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.492+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=ZNBCI8SPCGXY type=del size=1403852 2024-08-08T23:35:54.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.496+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=1IFNLGKV06JL type=write size=602303 2024-08-08T23:35:54.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.496+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=OHT6JCJHDJPD type=del 2024-08-08T23:35:54.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.500+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=8SATSSEKN6ZC type=del size=3998773 2024-08-08T23:35:54.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.508+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=RGAF8HACSIVG type=del size=3423216 2024-08-08T23:35:54.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.508+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=08IINT5W5Y53 type=del size=864124 2024-08-08T23:35:54.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.512+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=2X2AABDQVHFK type=write size=779691 2024-08-08T23:35:54.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.516+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=1U82NI1RBPFI type=del size=1669012 2024-08-08T23:35:54.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.520+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=FB5Q7WRQJOBA type=del 2024-08-08T23:35:54.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.524+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=SLTEWFJVYZ4G type=del size=2163426 2024-08-08T23:35:54.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~RNJU0IT798K9.0 size=298301 2024-08-08T23:35:54.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.532+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=RNJU0IT798K9 tag=LAISJNQFR966 type=write size=1346877 2024-08-08T23:35:54.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.532+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=4NLBW5WCJ6L5 type=del size=3467439 2024-08-08T23:35:54.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.540+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=OREJCU2H1ZMK type=del 2024-08-08T23:35:54.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.544+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=SZYJ7J84RER9 type=del size=1177689 2024-08-08T23:35:54.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.548+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~1G301HCPJ3EL.0 size=1048576 2024-08-08T23:35:54.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.552+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~1G301HCPJ3EL.1 size=642663 2024-08-08T23:35:54.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.556+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=1G301HCPJ3EL tag=OIR2US0L1I3J type=write size=2739815 2024-08-08T23:35:54.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.560+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=V8VN99U92PVT type=del size=2008522 2024-08-08T23:35:54.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~UQCZKQ45W7O6.0 size=1048576 2024-08-08T23:35:54.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.568+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~UQCZKQ45W7O6.1 size=94304 2024-08-08T23:35:54.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.572+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=UQCZKQ45W7O6 tag=87F7RA5DSS5I type=write size=2191456 2024-08-08T23:35:54.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.580+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~2EQKBMVSOZC0.0 size=834027 2024-08-08T23:35:54.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.580+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=2EQKBMVSOZC0 tag=N6NOFX80HFXE type=write size=1882603 2024-08-08T23:35:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.580+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=NMB4GI8R2BKU tag=Y61SYG6MO1J8 type=del size=2513390: (22) Invalid argument 2024-08-08T23:35:54.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.584+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=M3ZTUQHUN5DG type=write size=242071 2024-08-08T23:35:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.588+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.0 size=1048576 2024-08-08T23:35:54.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.592+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.1 size=1048576 2024-08-08T23:35:54.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.596+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~FYS4RZ1OMH7A.2 size=957508 2024-08-08T23:35:54.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.600+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=FYS4RZ1OMH7A tag=7CCNI61Q09MC type=write size=4103236 2024-08-08T23:35:54.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.604+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=19UL8A094GUK type=del size=2897780 2024-08-08T23:35:54.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.604+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~CLRDI3H6PYYX.0 size=1048576 2024-08-08T23:35:54.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.608+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~CLRDI3H6PYYX.1 size=909117 2024-08-08T23:35:54.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.616+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=CLRDI3H6PYYX tag=FJE42M9T0BFT type=write size=3006269 2024-08-08T23:35:54.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.620+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.0 size=1048576 2024-08-08T23:35:54.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.624+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.1 size=1048576 2024-08-08T23:35:54.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.624+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.2 size=1045192 2024-08-08T23:35:54.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.624+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=8SXYMCXX09LQ tag=198TEQVHT5OF type=write size=4190920 2024-08-08T23:35:54.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.628+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=VGT9IXWM956F tag=XOH4EJWPNV3C type=del size=7144: (22) Invalid argument 2024-08-08T23:35:54.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.632+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=3S140E5XSY4M type=del size=2730933 2024-08-08T23:35:54.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.636+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=XZR7L01DOD2O type=del 2024-08-08T23:35:54.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.640+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=X0VGPZZ5DL1Q type=del size=698877 2024-08-08T23:35:54.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.640+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=8U59I09L7XI2 type=del 2024-08-08T23:35:54.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.644+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=7KOCVEVG4SOM type=del size=1851611 2024-08-08T23:35:54.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.652+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=90NVJ8QTNVAS type=del size=2583759 2024-08-08T23:35:54.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.656+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=VWQXZSATXWI3 type=del size=3387866 2024-08-08T23:35:54.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.656+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=1IFNLGKV06JL type=write size=602303 2024-08-08T23:35:54.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.0 size=1048576 2024-08-08T23:35:54.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.1 size=1048576 2024-08-08T23:35:54.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.668+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.2 size=139923 2024-08-08T23:35:54.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.668+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=D1NZVGXMQZNA tag=ERO1RODOFO11 type=write size=3285651 2024-08-08T23:35:54.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.672+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YO2FZOR7H0EX tag=8SATSSEKN6ZC type=del 2024-08-08T23:35:54.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.676+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=QGKWH9W6LY5D type=del size=97681 2024-08-08T23:35:54.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.680+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=08IINT5W5Y53 type=del 2024-08-08T23:35:54.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.684+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.0 size=1048576 2024-08-08T23:35:54.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.688+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.1 size=1048576 2024-08-08T23:35:54.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.692+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.2 size=157472 2024-08-08T23:35:54.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.692+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=P6Q67WRE6LEL tag=V6WYCTFOLRW9 type=write size=3303200 2024-08-08T23:35:54.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.692+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=1U82NI1RBPFI type=del 2024-08-08T23:35:54.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.696+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=HWOPFQ0FRH8K type=del size=3061924 2024-08-08T23:35:54.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.700+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=SLTEWFJVYZ4G type=del 2024-08-08T23:35:54.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~SFOIVQKJYTER.0 size=65911 2024-08-08T23:35:54.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.704+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=SFOIVQKJYTER tag=KD9H076E8X6W type=write size=1114487 2024-08-08T23:35:54.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.712+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=4NLBW5WCJ6L5 type=del size=3467439 2024-08-08T23:35:54.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.0 size=1048576 2024-08-08T23:35:54.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.1 size=1048576 2024-08-08T23:35:54.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.2 size=919027 2024-08-08T23:35:54.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.724+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=LXN0M0MJZKUO tag=GSADRBTXTN7Q type=write size=4064755 2024-08-08T23:35:54.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.728+0000 7fdbd6e2c8c0 1 < canceled operation key=GZJ8GWYBB01F tag=SZYJ7J84RER9 type=del size=1177689 2024-08-08T23:35:54.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.732+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~1OQ59TU5RE7B.0 size=1048576 2024-08-08T23:35:54.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.736+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~1OQ59TU5RE7B.1 size=1047872 2024-08-08T23:35:54.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.736+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=1OQ59TU5RE7B tag=RQO97F5EX816 type=write size=3145024 2024-08-08T23:35:54.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.736+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=V8VN99U92PVT type=del 2024-08-08T23:35:54.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.740+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=H4785O23FCH5 type=del size=984649 2024-08-08T23:35:54.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.744+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~2EQKBMVSOZC0.0 size=834027 2024-08-08T23:35:54.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.748+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=2EQKBMVSOZC0 tag=N6NOFX80HFXE type=write size=1882603 2024-08-08T23:35:54.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.756+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.0 size=1048576 2024-08-08T23:35:54.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.1 size=1048576 2024-08-08T23:35:54.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.2 size=901339 2024-08-08T23:35:54.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.760+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=CKGHZJZRI39J tag=5HZHV9UPCK6U type=write size=4047067 2024-08-08T23:35:54.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.764+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=M3ZTUQHUN5DG type=write size=242071 2024-08-08T23:35:54.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~LNY258U3MERO.0 size=1048576 2024-08-08T23:35:54.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~LNY258U3MERO.1 size=509857 2024-08-08T23:35:54.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.772+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=LNY258U3MERO tag=8EVC8B8M3DRE type=write size=2607009 2024-08-08T23:35:54.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.780+0000 7fdbd6e2c8c0 1 < suggested update operation key=VGT9IXWM956F tag=19UL8A094GUK type=del size=2897780 2024-08-08T23:35:54.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.784+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.0 size=1048576 2024-08-08T23:35:54.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.1 size=1048576 2024-08-08T23:35:54.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.2 size=417560 2024-08-08T23:35:54.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.788+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=X004X23PC07U tag=DLGZQSP0B33W type=write size=3563288 2024-08-08T23:35:54.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.792+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.0 size=1048576 2024-08-08T23:35:54.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.792+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.1 size=1048576 2024-08-08T23:35:54.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~8SXYMCXX09LQ.2 size=1045192 2024-08-08T23:35:54.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.800+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=8SXYMCXX09LQ tag=198TEQVHT5OF type=write size=4190920 2024-08-08T23:35:54.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.0 size=1048576 2024-08-08T23:35:54.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.1 size=1048576 2024-08-08T23:35:54.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.2 size=795058 2024-08-08T23:35:54.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.808+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=UA2L6VNLNOUK tag=Q12T7DLZAC2F type=write size=3940786 2024-08-08T23:35:54.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.812+0000 7fdbd6e2c8c0 1 < suggested remove operation key=W5OVPO7BGE4S tag=3S140E5XSY4M type=del 2024-08-08T23:35:54.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.812+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=QHCHG1S7MVW9 type=del size=737991 2024-08-08T23:35:54.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.816+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=X0VGPZZ5DL1Q type=del 2024-08-08T23:35:54.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.820+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=KFWWMWXS97OR type=del size=1158263 2024-08-08T23:35:54.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.824+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QWRYLH4P94BQ tag=7KOCVEVG4SOM type=del 2024-08-08T23:35:54.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~XX5DGTOH9TJE.0 size=1048576 2024-08-08T23:35:54.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~XX5DGTOH9TJE.1 size=470109 2024-08-08T23:35:54.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.832+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=XX5DGTOH9TJE tag=YDQ5QBOYTHWL type=write size=2567261 2024-08-08T23:35:54.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.836+0000 7fdbd6e2c8c0 1 < suggested update operation key=QANZ3YTL2NQV tag=VWQXZSATXWI3 type=del size=3387866 2024-08-08T23:35:54.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.840+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=3OVL0CBKQT7L type=del size=3770555 2024-08-08T23:35:54.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.844+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.0 size=1048576 2024-08-08T23:35:54.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.844+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.1 size=1048576 2024-08-08T23:35:54.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.844+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~D1NZVGXMQZNA.2 size=139923 2024-08-08T23:35:54.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.848+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=D1NZVGXMQZNA tag=ERO1RODOFO11 type=write size=3285651 2024-08-08T23:35:54.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.0 size=1048576 2024-08-08T23:35:54.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.1 size=1048576 2024-08-08T23:35:54.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.2 size=722056 2024-08-08T23:35:54.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.856+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=5F408MYWP8YR tag=15SO1YQ9VRGF type=write size=3867784 2024-08-08T23:35:54.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.860+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=QGKWH9W6LY5D type=del 2024-08-08T23:35:54.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.864+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=ACVXOS0R2FJJ type=del size=1517460 2024-08-08T23:35:54.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.864+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.0 size=1048576 2024-08-08T23:35:54.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.1 size=1048576 2024-08-08T23:35:54.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~P6Q67WRE6LEL.2 size=157472 2024-08-08T23:35:54.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.872+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=P6Q67WRE6LEL tag=V6WYCTFOLRW9 type=write size=3303200 2024-08-08T23:35:54.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.876+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=SRD3PGXSYGOC type=del size=2516200 2024-08-08T23:35:54.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.876+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=HWOPFQ0FRH8K type=del 2024-08-08T23:35:54.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.880+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=UZR2AUJQRFLD type=del size=3761653 2024-08-08T23:35:54.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~SFOIVQKJYTER.0 size=65911 2024-08-08T23:35:54.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.888+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=SFOIVQKJYTER tag=KD9H076E8X6W type=write size=1114487 2024-08-08T23:35:54.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.888+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=NY4LO24130G2 type=del size=3528626 2024-08-08T23:35:54.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.0 size=1048576 2024-08-08T23:35:54.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.1 size=1048576 2024-08-08T23:35:54.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~LXN0M0MJZKUO.2 size=919027 2024-08-08T23:35:54.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.900+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=LXN0M0MJZKUO tag=GSADRBTXTN7Q type=write size=4064755 2024-08-08T23:35:54.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.900+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=K6QU3ZORKNLR type=del size=915927 2024-08-08T23:35:54.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.904+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_D81PQ0FJVNEE.2~1OQ59TU5RE7B.0 size=1048576 2024-08-08T23:35:54.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~1OQ59TU5RE7B.1 size=1047872 2024-08-08T23:35:54.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.912+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=D81PQ0FJVNEE upload=1OQ59TU5RE7B tag=RQO97F5EX816 type=write size=3145024 2024-08-08T23:35:54.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.912+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=4Y8VXU6UG88V type=write size=135536 2024-08-08T23:35:54.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.916+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=H4785O23FCH5 type=del size=984649 2024-08-08T23:35:54.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.916+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=OAIXW4QDAFFF type=write size=773944 2024-08-08T23:35:54.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.0 size=1048576 2024-08-08T23:35:54.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.1 size=1048576 2024-08-08T23:35:54.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~CKGHZJZRI39J.2 size=901339 2024-08-08T23:35:54.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.928+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=CKGHZJZRI39J tag=5HZHV9UPCK6U type=write size=4047067 2024-08-08T23:35:54.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.928+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=SJKBTW9MRPG5 type=del size=3854760 2024-08-08T23:35:54.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.932+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~LNY258U3MERO.0 size=1048576 2024-08-08T23:35:54.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.932+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~LNY258U3MERO.1 size=509857 2024-08-08T23:35:54.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.940+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=LNY258U3MERO tag=8EVC8B8M3DRE type=write size=2607009 2024-08-08T23:35:54.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.944+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~8HMAA1FFR30I.0 size=588603 2024-08-08T23:35:54.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.944+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=8HMAA1FFR30I tag=5PIQ23J7LI5U type=write size=1637179 2024-08-08T23:35:54.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.0 size=1048576 2024-08-08T23:35:54.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.1 size=1048576 2024-08-08T23:35:54.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.952+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~X004X23PC07U.2 size=417560 2024-08-08T23:35:54.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.956+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=X004X23PC07U tag=DLGZQSP0B33W type=write size=3563288 2024-08-08T23:35:54.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.0 size=1048576 2024-08-08T23:35:54.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.1 size=1048576 2024-08-08T23:35:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.2 size=616956 2024-08-08T23:35:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.964+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=6F3A35W5LKG0 tag=K90FW0CGQRBR type=write size=3762684 2024-08-08T23:35:54.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.964+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.0 size=1048576 2024-08-08T23:35:54.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.1 size=1048576 2024-08-08T23:35:54.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~UA2L6VNLNOUK.2 size=795058 2024-08-08T23:35:54.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.976+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=UA2L6VNLNOUK tag=Q12T7DLZAC2F type=write size=3940786 2024-08-08T23:35:54.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.976+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=TF5Y2DPE3TIS type=del size=3263983 2024-08-08T23:35:54.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.980+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=QHCHG1S7MVW9 type=del 2024-08-08T23:35:54.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.984+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~J5B0P5N4YZD1.0 size=1048576 2024-08-08T23:35:54.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~J5B0P5N4YZD1.1 size=881998 2024-08-08T23:35:54.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.988+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=J5B0P5N4YZD1 tag=NHOINW3R5XZN type=write size=2979150 2024-08-08T23:35:54.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.988+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=KFWWMWXS97OR type=del 2024-08-08T23:35:54.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.992+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~XNIK57DA6QLC.0 size=222937 2024-08-08T23:35:54.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.992+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=XNIK57DA6QLC tag=VFC8PX3DHNDX type=write size=1271513 2024-08-08T23:35:54.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~XX5DGTOH9TJE.0 size=1048576 2024-08-08T23:35:54.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:54.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~XX5DGTOH9TJE.1 size=470109 2024-08-08T23:35:55.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.000+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=XX5DGTOH9TJE tag=YDQ5QBOYTHWL type=write size=2567261 2024-08-08T23:35:55.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.004+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=XA7KDHMNQ4O4 type=write size=171429 2024-08-08T23:35:55.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.008+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=3OVL0CBKQT7L type=del 2024-08-08T23:35:55.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.008+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=BCNAGB8NWUD5 type=write size=598976 2024-08-08T23:35:55.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.012+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.0 size=1048576 2024-08-08T23:35:55.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.012+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.1 size=1048576 2024-08-08T23:35:55.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.016+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~5F408MYWP8YR.2 size=722056 2024-08-08T23:35:55.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.020+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=5F408MYWP8YR tag=15SO1YQ9VRGF type=write size=3867784 2024-08-08T23:35:55.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.024+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=JXRQ3OJE339G type=del size=3014001 2024-08-08T23:35:55.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.024+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=ACVXOS0R2FJJ type=del 2024-08-08T23:35:55.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.028+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~HOOVCSE7RCAN.0 size=1048576 2024-08-08T23:35:55.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.032+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~HOOVCSE7RCAN.1 size=549742 2024-08-08T23:35:55.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.032+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=HOOVCSE7RCAN tag=VDYHISD04U20 type=write size=2646894 2024-08-08T23:35:55.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=SRD3PGXSYGOC type=del 2024-08-08T23:35:55.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.036+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=QJ9IG37K5KPK type=write size=694338 2024-08-08T23:35:55.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.040+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=UZR2AUJQRFLD type=del 2024-08-08T23:35:55.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.040+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=6F1SDJZMFOZX type=write size=545217 2024-08-08T23:35:55.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.044+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=NY4LO24130G2 type=del 2024-08-08T23:35:55.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.044+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=ZCKAC6AVHK6G type=del size=438360 2024-08-08T23:35:55.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.048+0000 7fdbd6e2c8c0 1 < suggested update operation key=MNV404EWJHC1 tag=K6QU3ZORKNLR type=del size=915927 2024-08-08T23:35:55.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.0 size=1048576 2024-08-08T23:35:55.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.1 size=1048576 2024-08-08T23:35:55.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.060+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.2 size=329348 2024-08-08T23:35:55.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.060+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=HVV8Q2MMVB3L tag=5DGLJQ3XT66B type=write size=3475076 2024-08-08T23:35:55.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.060+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=4Y8VXU6UG88V type=write size=135536 2024-08-08T23:35:55.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.064+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=R23H1VBJ180M type=del size=2364567 2024-08-08T23:35:55.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.064+0000 7fdbd6e2c8c0 1 < completed write operation key=V6GSJH62C8TA tag=OAIXW4QDAFFF type=write size=773944 2024-08-08T23:35:55.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.068+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=UQ9TY78NRCGN type=del size=2230924 2024-08-08T23:35:55.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.072+0000 7fdbd6e2c8c0 1 < canceled operation key=YNQU8Z202QCM tag=SJKBTW9MRPG5 type=del size=3854760 2024-08-08T23:35:55.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.072+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=XY0MJAKB6MVY type=del size=918972 2024-08-08T23:35:55.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.076+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~8HMAA1FFR30I.0 size=588603 2024-08-08T23:35:55.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.080+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=8HMAA1FFR30I tag=5PIQ23J7LI5U type=write size=1637179 2024-08-08T23:35:55.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.084+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~QWJVYXXADYP6.0 size=657387 2024-08-08T23:35:55.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.084+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=QWJVYXXADYP6 tag=N3WAI2YJ1T7C type=write size=1705963 2024-08-08T23:35:55.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.0 size=1048576 2024-08-08T23:35:55.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.088+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.1 size=1048576 2024-08-08T23:35:55.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.088+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~6F3A35W5LKG0.2 size=616956 2024-08-08T23:35:55.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.092+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=6F3A35W5LKG0 tag=K90FW0CGQRBR type=write size=3762684 2024-08-08T23:35:55.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.096+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.0 size=1048576 2024-08-08T23:35:55.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.100+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.1 size=1048576 2024-08-08T23:35:55.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.2 size=440709 2024-08-08T23:35:55.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.104+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=LDUS3WN0GANK tag=PTBHKI5QIKPM type=write size=3586437 2024-08-08T23:35:55.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.108+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZQ8GOX9RSTBB tag=TF5Y2DPE3TIS type=del size=3263983 2024-08-08T23:35:55.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.112+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=302O9LAV51WN type=del size=1159938 2024-08-08T23:35:55.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.112+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~J5B0P5N4YZD1.0 size=1048576 2024-08-08T23:35:55.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~J5B0P5N4YZD1.1 size=881998 2024-08-08T23:35:55.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.120+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=J5B0P5N4YZD1 tag=NHOINW3R5XZN type=write size=2979150 2024-08-08T23:35:55.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.124+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=BKGP14JVVN93 type=del size=2590101 2024-08-08T23:35:55.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.124+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~XNIK57DA6QLC.0 size=222937 2024-08-08T23:35:55.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.132+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=XNIK57DA6QLC tag=VFC8PX3DHNDX type=write size=1271513 2024-08-08T23:35:55.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.136+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~58P9H4OY5SQH.0 size=1048576 2024-08-08T23:35:55.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.136+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~58P9H4OY5SQH.1 size=658810 2024-08-08T23:35:55.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.136+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=58P9H4OY5SQH tag=MDA51CQYX6UD type=write size=2755962 2024-08-08T23:35:55.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.144+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=XA7KDHMNQ4O4 type=write size=171429 2024-08-08T23:35:55.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.148+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~E10C30BU9D5Y.0 size=1048576 2024-08-08T23:35:55.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~E10C30BU9D5Y.1 size=934878 2024-08-08T23:35:55.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.152+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=E10C30BU9D5Y tag=KDA5JJ05CNP2 type=write size=3032030 2024-08-08T23:35:55.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.152+0000 7fdbd6e2c8c0 1 < completed write operation key=0MT9FJO58ELX tag=BCNAGB8NWUD5 type=write size=598976 2024-08-08T23:35:55.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.156+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=MFSAGZV3A6OC type=del size=2623106 2024-08-08T23:35:55.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.160+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=JXRQ3OJE339G type=del 2024-08-08T23:35:55.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.160+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=6UIAALD5MXXE type=write size=902617 2024-08-08T23:35:55.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.164+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~HOOVCSE7RCAN.0 size=1048576 2024-08-08T23:35:55.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~HOOVCSE7RCAN.1 size=549742 2024-08-08T23:35:55.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.172+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=HOOVCSE7RCAN tag=VDYHISD04U20 type=write size=2646894 2024-08-08T23:35:55.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.172+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=M01SCO07Y3XS type=del size=2028038 2024-08-08T23:35:55.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.176+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=QJ9IG37K5KPK type=write size=694338 2024-08-08T23:35:55.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.180+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=2I9U6NOYULJK type=del size=4091217 2024-08-08T23:35:55.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.180+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=6F1SDJZMFOZX type=write size=545217 2024-08-08T23:35:55.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~P631FS25X1B6.0 size=1048576 2024-08-08T23:35:55.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.188+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~P631FS25X1B6.1 size=515489 2024-08-08T23:35:55.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.188+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=P631FS25X1B6 tag=B9TLLB33OVBZ type=write size=2612641 2024-08-08T23:35:55.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.188+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=ZCKAC6AVHK6G type=del 2024-08-08T23:35:55.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.192+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=G6PT2WMK8BL8 type=del size=772171 2024-08-08T23:35:55.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.0 size=1048576 2024-08-08T23:35:55.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.1 size=1048576 2024-08-08T23:35:55.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~HVV8Q2MMVB3L.2 size=329348 2024-08-08T23:35:55.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=HVV8Q2MMVB3L tag=5DGLJQ3XT66B type=write size=3475076 2024-08-08T23:35:55.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.204+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=5ZMZ2W9PY2Y8 type=del size=970219 2024-08-08T23:35:55.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.208+0000 7fdbd6e2c8c0 1 < suggested update operation key=JWTLJG79MYI5 tag=R23H1VBJ180M type=del size=2364567 2024-08-08T23:35:55.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.212+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.0 size=1048576 2024-08-08T23:35:55.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.1 size=1048576 2024-08-08T23:35:55.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.2 size=763002 2024-08-08T23:35:55.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.216+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=5BDPKCE2WU03 tag=0XXNHVEOSCDL type=write size=3908730 2024-08-08T23:35:55.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.220+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=UQ9TY78NRCGN type=del size=2230924 2024-08-08T23:35:55.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.220+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=AZPX4LNGMUEE type=del size=3437461 2024-08-08T23:35:55.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.224+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=XY0MJAKB6MVY type=del 2024-08-08T23:35:55.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.228+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=SVBHLW2DD31J type=write size=755361 2024-08-08T23:35:55.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.232+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~QWJVYXXADYP6.0 size=657387 2024-08-08T23:35:55.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.236+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=QWJVYXXADYP6 tag=N3WAI2YJ1T7C type=write size=1705963 2024-08-08T23:35:55.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.240+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~AWYWIXS3ROSV.0 size=991125 2024-08-08T23:35:55.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.240+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=AWYWIXS3ROSV tag=WPZ4Y1K1JTEH type=write size=2039701 2024-08-08T23:35:55.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.244+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.0 size=1048576 2024-08-08T23:35:55.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.244+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.1 size=1048576 2024-08-08T23:35:55.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.248+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LDUS3WN0GANK.2 size=440709 2024-08-08T23:35:55.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.252+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=LDUS3WN0GANK tag=PTBHKI5QIKPM type=write size=3586437 2024-08-08T23:35:55.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.0 size=1048576 2024-08-08T23:35:55.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.1 size=1048576 2024-08-08T23:35:55.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.2 size=932681 2024-08-08T23:35:55.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=ZBM5534JGRY1 tag=26UAJGL3NR6D type=write size=4078409 2024-08-08T23:35:55.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.264+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=302O9LAV51WN type=del 2024-08-08T23:35:55.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.268+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=ZQ43DI14WWP2 type=del size=114538 2024-08-08T23:35:55.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.272+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=BKGP14JVVN93 type=del size=2590101 2024-08-08T23:35:55.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~C65E9GDPAC6H.0 size=395912 2024-08-08T23:35:55.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.276+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=C65E9GDPAC6H tag=32T60KB9AFAV type=write size=1444488 2024-08-08T23:35:55.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~58P9H4OY5SQH.0 size=1048576 2024-08-08T23:35:55.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~58P9H4OY5SQH.1 size=658810 2024-08-08T23:35:55.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.288+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=58P9H4OY5SQH tag=MDA51CQYX6UD type=write size=2755962 2024-08-08T23:35:55.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.292+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=GW35Q60AUE4W type=del size=2480411 2024-08-08T23:35:55.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.292+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~E10C30BU9D5Y.0 size=1048576 2024-08-08T23:35:55.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.296+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~E10C30BU9D5Y.1 size=934878 2024-08-08T23:35:55.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.300+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=E10C30BU9D5Y tag=KDA5JJ05CNP2 type=write size=3032030 2024-08-08T23:35:55.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.304+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=583NGT8NKSZM type=del size=3207496 2024-08-08T23:35:55.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.308+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=MFSAGZV3A6OC type=del 2024-08-08T23:35:55.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.312+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~RJ7MJQUK4PX9.0 size=1048576 2024-08-08T23:35:55.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.312+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~RJ7MJQUK4PX9.1 size=516462 2024-08-08T23:35:55.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.312+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=RJ7MJQUK4PX9 tag=W1JQ2VY2PZKX type=write size=2613614 2024-08-08T23:35:55.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.316+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=JWTLJG79MYI5 tag=6UIAALD5MXXE type=write size=902617: (22) Invalid argument 2024-08-08T23:35:55.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.320+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=WMN9K83RNQOV type=del size=3976272 2024-08-08T23:35:55.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.328+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=M01SCO07Y3XS type=del 2024-08-08T23:35:55.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.328+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=S40IIXTVKVBO type=write size=488116 2024-08-08T23:35:55.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.336+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=2I9U6NOYULJK type=del size=4091217 2024-08-08T23:35:55.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.340+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~QW1U5Z1WKPLB.0 size=1048576 2024-08-08T23:35:55.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~QW1U5Z1WKPLB.1 size=858767 2024-08-08T23:35:55.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.344+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=QW1U5Z1WKPLB tag=D4AMZ6PT4MNL type=write size=2955919 2024-08-08T23:35:55.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.344+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~P631FS25X1B6.0 size=1048576 2024-08-08T23:35:55.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.348+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~P631FS25X1B6.1 size=515489 2024-08-08T23:35:55.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.352+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=P631FS25X1B6 tag=B9TLLB33OVBZ type=write size=2612641 2024-08-08T23:35:55.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.356+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=XRIH34FWRIQY type=del size=2281251 2024-08-08T23:35:55.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.360+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=G6PT2WMK8BL8 type=del 2024-08-08T23:35:55.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~S72VPP4IHYEX.0 size=628130 2024-08-08T23:35:55.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.364+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=S72VPP4IHYEX tag=ZOQFFKIX82NL type=write size=1676706 2024-08-08T23:35:55.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.364+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=JWTLJG79MYI5 tag=5ZMZ2W9PY2Y8 type=del size=970219: (22) Invalid argument 2024-08-08T23:35:55.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.368+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=5BHR4029JY7K type=del size=1661413 2024-08-08T23:35:55.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.0 size=1048576 2024-08-08T23:35:55.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.1 size=1048576 2024-08-08T23:35:55.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.376+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5BDPKCE2WU03.2 size=763002 2024-08-08T23:35:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.380+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=5BDPKCE2WU03 tag=0XXNHVEOSCDL type=write size=3908730 2024-08-08T23:35:55.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.384+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~YFUB96B0VVSG.0 size=1048576 2024-08-08T23:35:55.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~YFUB96B0VVSG.1 size=273025 2024-08-08T23:35:55.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.388+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=YFUB96B0VVSG tag=NM8SSH0TYKKA type=write size=2370177 2024-08-08T23:35:55.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.392+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=AZPX4LNGMUEE type=del 2024-08-08T23:35:55.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.400+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~FIY94ZXALBMJ.0 size=23890 2024-08-08T23:35:55.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.400+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=FIY94ZXALBMJ tag=889BJ1G30UJW type=write size=1072466 2024-08-08T23:35:55.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.400+0000 7fdbd6e2c8c0 1 < canceled operation key=XIXN9HLLSJS3 tag=SVBHLW2DD31J type=write size=755361 2024-08-08T23:35:55.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.408+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~C84PU050RZ19.0 size=315640 2024-08-08T23:35:55.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.408+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=C84PU050RZ19 tag=2XTESWU0BX40 type=write size=1364216 2024-08-08T23:35:55.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.408+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~AWYWIXS3ROSV.0 size=991125 2024-08-08T23:35:55.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.416+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=AWYWIXS3ROSV tag=WPZ4Y1K1JTEH type=write size=2039701 2024-08-08T23:35:55.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.416+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=0LKW6W4PI300 type=del size=3403956 2024-08-08T23:35:55.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.0 size=1048576 2024-08-08T23:35:55.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.1 size=1048576 2024-08-08T23:35:55.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZBM5534JGRY1.2 size=932681 2024-08-08T23:35:55.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.432+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=ZBM5534JGRY1 tag=26UAJGL3NR6D type=write size=4078409 2024-08-08T23:35:55.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~GF53RA462GR4.0 size=1048576 2024-08-08T23:35:55.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.440+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~GF53RA462GR4.1 size=577420 2024-08-08T23:35:55.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.440+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=GF53RA462GR4 tag=F2CKB27LWFHO type=write size=2674572 2024-08-08T23:35:55.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.444+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=ZQ43DI14WWP2 type=del 2024-08-08T23:35:55.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.448+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~5O245VNB2GYL.0 size=1048576 2024-08-08T23:35:55.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.452+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~5O245VNB2GYL.1 size=575406 2024-08-08T23:35:55.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.452+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=5O245VNB2GYL tag=I74YG37J3PR9 type=write size=2672558 2024-08-08T23:35:55.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~C65E9GDPAC6H.0 size=395912 2024-08-08T23:35:55.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.464+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=C65E9GDPAC6H tag=32T60KB9AFAV type=write size=1444488 2024-08-08T23:35:55.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.468+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=05A3F20U28YA type=del size=1024701 2024-08-08T23:35:55.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.472+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=GW35Q60AUE4W type=del size=2480411 2024-08-08T23:35:55.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.472+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=4WL3H9QA101E type=write size=1019387 2024-08-08T23:35:55.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.476+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=583NGT8NKSZM type=del 2024-08-08T23:35:55.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.484+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~D29MIMNIGTUT.0 size=521009 2024-08-08T23:35:55.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.484+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=D29MIMNIGTUT tag=57GAQX6VN7W3 type=write size=1569585 2024-08-08T23:35:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~RJ7MJQUK4PX9.0 size=1048576 2024-08-08T23:35:55.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.492+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~RJ7MJQUK4PX9.1 size=516462 2024-08-08T23:35:55.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.496+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=RJ7MJQUK4PX9 tag=W1JQ2VY2PZKX type=write size=2613614 2024-08-08T23:35:55.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.500+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=J687O35J4LLU type=write size=168911 2024-08-08T23:35:55.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.500+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=WMN9K83RNQOV type=del 2024-08-08T23:35:55.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~6TGKG56JQIBW.0 size=1048576 2024-08-08T23:35:55.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~6TGKG56JQIBW.1 size=598189 2024-08-08T23:35:55.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.508+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=6TGKG56JQIBW tag=R3JDI91FCZQ9 type=write size=2695341 2024-08-08T23:35:55.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.512+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=S40IIXTVKVBO type=write size=488116 2024-08-08T23:35:55.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.516+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=7AQF120JJJI2 type=del size=590490 2024-08-08T23:35:55.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.520+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~QW1U5Z1WKPLB.0 size=1048576 2024-08-08T23:35:55.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.520+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~QW1U5Z1WKPLB.1 size=858767 2024-08-08T23:35:55.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.528+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=QW1U5Z1WKPLB tag=D4AMZ6PT4MNL type=write size=2955919 2024-08-08T23:35:55.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.528+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=1SA792SM37TK type=del size=4154502 2024-08-08T23:35:55.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.532+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=XRIH34FWRIQY type=del 2024-08-08T23:35:55.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.536+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=XUTRPH4IKZU2 type=del size=1281698 2024-08-08T23:35:55.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.540+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~S72VPP4IHYEX.0 size=628130 2024-08-08T23:35:55.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.544+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=S72VPP4IHYEX tag=ZOQFFKIX82NL type=write size=1676706 2024-08-08T23:35:55.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.548+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=41KRYR6518OA type=del size=127344 2024-08-08T23:35:55.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.552+0000 7fdbd6e2c8c0 1 < suggested remove operation key=63GVT7KRKCSS tag=5BHR4029JY7K type=del 2024-08-08T23:35:55.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.560+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~I722P1NWZ8UJ.0 size=1048576 2024-08-08T23:35:55.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.560+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~I722P1NWZ8UJ.1 size=60036 2024-08-08T23:35:55.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.560+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=I722P1NWZ8UJ tag=08ATQIZ5HC5R type=write size=2157188 2024-08-08T23:35:55.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~YFUB96B0VVSG.0 size=1048576 2024-08-08T23:35:55.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.568+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~YFUB96B0VVSG.1 size=273025 2024-08-08T23:35:55.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.572+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=YFUB96B0VVSG tag=NM8SSH0TYKKA type=write size=2370177 2024-08-08T23:35:55.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.576+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=IQQSLNWLQ8JA type=del size=2215193 2024-08-08T23:35:55.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~FIY94ZXALBMJ.0 size=23890 2024-08-08T23:35:55.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.584+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=FIY94ZXALBMJ tag=889BJ1G30UJW type=write size=1072466 2024-08-08T23:35:55.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~RX87V1S2VN1D.0 size=1048576 2024-08-08T23:35:55.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~RX87V1S2VN1D.1 size=78464 2024-08-08T23:35:55.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.592+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=RX87V1S2VN1D tag=YSPZ3AK29IQV type=write size=2175616 2024-08-08T23:35:55.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.596+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~C84PU050RZ19.0 size=315640 2024-08-08T23:35:55.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.604+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=C84PU050RZ19 tag=2XTESWU0BX40 type=write size=1364216 2024-08-08T23:35:55.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.608+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=BEY18OK0M7Y7 type=del size=1205092 2024-08-08T23:35:55.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.608+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=0LKW6W4PI300 type=del 2024-08-08T23:35:55.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.612+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=XHERMAE3FR2D type=write size=582306 2024-08-08T23:35:55.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~GF53RA462GR4.0 size=1048576 2024-08-08T23:35:55.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.616+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~GF53RA462GR4.1 size=577420 2024-08-08T23:35:55.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.624+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=GF53RA462GR4 tag=F2CKB27LWFHO type=write size=2674572 2024-08-08T23:35:55.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.628+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=U0G2SCIYPBVY type=del size=1346910 2024-08-08T23:35:55.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~5O245VNB2GYL.0 size=1048576 2024-08-08T23:35:55.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~5O245VNB2GYL.1 size=575406 2024-08-08T23:35:55.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.640+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=5O245VNB2GYL tag=I74YG37J3PR9 type=write size=2672558 2024-08-08T23:35:55.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~4NCVYM4IIGIZ.0 size=715855 2024-08-08T23:35:55.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.644+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=4NCVYM4IIGIZ tag=5O318XYF126C type=write size=1764431 2024-08-08T23:35:55.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.648+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=05A3F20U28YA type=del 2024-08-08T23:35:55.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.652+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=GL1F2A4M2BND type=del size=3430329 2024-08-08T23:35:55.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.656+0000 7fdbd6e2c8c0 1 < completed write operation key=V3TA5KZ95NXT tag=4WL3H9QA101E type=write size=1019387 2024-08-08T23:35:55.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~9J3I1K77LNBM.0 size=156505 2024-08-08T23:35:55.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.664+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=9J3I1K77LNBM tag=N27FY45ZNI9J type=write size=1205081 2024-08-08T23:35:55.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.668+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~D29MIMNIGTUT.0 size=521009 2024-08-08T23:35:55.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.672+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=D29MIMNIGTUT tag=57GAQX6VN7W3 type=write size=1569585 2024-08-08T23:35:55.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~VZDUIE4LINK3.0 size=341943 2024-08-08T23:35:55.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.680+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=VZDUIE4LINK3 tag=AQYVHQT7XQF4 type=write size=1390519 2024-08-08T23:35:55.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.680+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=J687O35J4LLU type=write size=168911 2024-08-08T23:35:55.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.684+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=OG14UO4SW77J type=del size=318700 2024-08-08T23:35:55.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.688+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~6TGKG56JQIBW.0 size=1048576 2024-08-08T23:35:55.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~6TGKG56JQIBW.1 size=598189 2024-08-08T23:35:55.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.696+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=6TGKG56JQIBW tag=R3JDI91FCZQ9 type=write size=2695341 2024-08-08T23:35:55.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.700+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=C24Q8SR2IUYP type=del size=3314186 2024-08-08T23:35:55.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.708+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=7AQF120JJJI2 type=del 2024-08-08T23:35:55.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.712+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=R5RHUXGRCAZG type=del size=1407491 2024-08-08T23:35:55.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.716+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=1SA792SM37TK type=del 2024-08-08T23:35:55.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.716+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=1ANVBY76ZYLM type=del size=2426391 2024-08-08T23:35:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.720+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=XUTRPH4IKZU2 type=del 2024-08-08T23:35:55.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.724+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=LN6BVMRSYMD4 type=del size=1182425 2024-08-08T23:35:55.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.728+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=41KRYR6518OA type=del 2024-08-08T23:35:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.728+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=NHJYNCSZ21NQ type=del size=3728404 2024-08-08T23:35:55.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~I722P1NWZ8UJ.0 size=1048576 2024-08-08T23:35:55.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.736+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~I722P1NWZ8UJ.1 size=60036 2024-08-08T23:35:55.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.740+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=I722P1NWZ8UJ tag=08ATQIZ5HC5R type=write size=2157188 2024-08-08T23:35:55.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.744+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=DPZAFXDZC3UK type=write size=444802 2024-08-08T23:35:55.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.748+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=IQQSLNWLQ8JA type=del 2024-08-08T23:35:55.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.752+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~98SQ5AM3UH01.0 size=317112 2024-08-08T23:35:55.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.752+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=98SQ5AM3UH01 tag=LS40K21VZOZX type=write size=1365688 2024-08-08T23:35:55.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~RX87V1S2VN1D.0 size=1048576 2024-08-08T23:35:55.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~RX87V1S2VN1D.1 size=78464 2024-08-08T23:35:55.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.764+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=RX87V1S2VN1D tag=YSPZ3AK29IQV type=write size=2175616 2024-08-08T23:35:55.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.764+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=ZNH1XQYD24PT type=write size=825755 2024-08-08T23:35:55.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.768+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=BEY18OK0M7Y7 type=del 2024-08-08T23:35:55.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~SJBT8EG4LKG1.0 size=689254 2024-08-08T23:35:55.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.776+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=SJBT8EG4LKG1 tag=HPD5YH4ROZEH type=write size=1737830 2024-08-08T23:35:55.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.780+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=XHERMAE3FR2D type=write size=582306 2024-08-08T23:35:55.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.784+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=RXH99E428WF5 type=del size=1866904 2024-08-08T23:35:55.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.788+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FBCEC998C8EJ tag=U0G2SCIYPBVY type=del 2024-08-08T23:35:55.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.792+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=UL41TW215EB1 type=del size=2112033 2024-08-08T23:35:55.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~4NCVYM4IIGIZ.0 size=715855 2024-08-08T23:35:55.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.800+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=4NCVYM4IIGIZ tag=5O318XYF126C type=write size=1764431 2024-08-08T23:35:55.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~BLJATBLNH0VO.0 size=1048576 2024-08-08T23:35:55.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.812+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~BLJATBLNH0VO.1 size=1037317 2024-08-08T23:35:55.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.812+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=BLJATBLNH0VO tag=0S5RVT37GMXU type=write size=3134469 2024-08-08T23:35:55.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.812+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=GL1F2A4M2BND type=del 2024-08-08T23:35:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~WHJK22A18AGE.0 size=1048576 2024-08-08T23:35:55.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~WHJK22A18AGE.1 size=761722 2024-08-08T23:35:55.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=WHJK22A18AGE tag=9V1513GTNL0M type=write size=2858874 2024-08-08T23:35:55.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.824+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~9J3I1K77LNBM.0 size=156505 2024-08-08T23:35:55.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.832+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=9J3I1K77LNBM tag=N27FY45ZNI9J type=write size=1205081 2024-08-08T23:35:55.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.836+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=M9XOUT2Z4AUF type=del size=234575 2024-08-08T23:35:55.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.840+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~VZDUIE4LINK3.0 size=341943 2024-08-08T23:35:55.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.844+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=VZDUIE4LINK3 tag=AQYVHQT7XQF4 type=write size=1390519 2024-08-08T23:35:55.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.852+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~IVUHYZX0XL8H.0 size=583745 2024-08-08T23:35:55.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.852+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=IVUHYZX0XL8H tag=9ZVY9R0JCAYF type=write size=1632321 2024-08-08T23:35:55.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.856+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=OG14UO4SW77J type=del size=318700 2024-08-08T23:35:55.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.860+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=Y3TCOIAX53S3 type=del size=1429490 2024-08-08T23:35:55.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.860+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=C24Q8SR2IUYP type=del 2024-08-08T23:35:55.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.864+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=UVEN9SK1ZB1X type=write size=338453 2024-08-08T23:35:55.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.868+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=R5RHUXGRCAZG type=del 2024-08-08T23:35:55.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.872+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~EHZV7X3WSB9R.0 size=899492 2024-08-08T23:35:55.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.872+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=EHZV7X3WSB9R tag=338YKFCHNQ6X type=write size=1948068 2024-08-08T23:35:55.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.876+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=1ANVBY76ZYLM type=del 2024-08-08T23:35:55.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~TDK0CJDYPGNE.0 size=1048576 2024-08-08T23:35:55.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~TDK0CJDYPGNE.1 size=1043665 2024-08-08T23:35:55.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.884+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=TDK0CJDYPGNE tag=UATN1ODVA5KM type=write size=3140817 2024-08-08T23:35:55.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.888+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=LN6BVMRSYMD4 type=del 2024-08-08T23:35:55.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.892+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=FJI0YU9TXFM3 type=write size=190107 2024-08-08T23:35:55.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.896+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=NHJYNCSZ21NQ type=del 2024-08-08T23:35:55.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.900+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=JG4XVO47I2DM type=write size=807522 2024-08-08T23:35:55.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.904+0000 7fdbd6e2c8c0 1 < completed write operation key=W5OVPO7BGE4S tag=DPZAFXDZC3UK type=write size=444802 2024-08-08T23:35:55.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.904+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=F09TU92FHA3K type=del size=684730 2024-08-08T23:35:55.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~98SQ5AM3UH01.0 size=317112 2024-08-08T23:35:55.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.912+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=98SQ5AM3UH01 tag=LS40K21VZOZX type=write size=1365688 2024-08-08T23:35:55.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.916+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=KGTU518OCERG type=del size=3749298 2024-08-08T23:35:55.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.920+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=ZNH1XQYD24PT type=write size=825755 2024-08-08T23:35:55.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.924+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=1K33OJ0IIP7N type=del size=2935325 2024-08-08T23:35:55.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~SJBT8EG4LKG1.0 size=689254 2024-08-08T23:35:55.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.932+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=SJBT8EG4LKG1 tag=HPD5YH4ROZEH type=write size=1737830 2024-08-08T23:35:55.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.932+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=HLWNQ00FNLZF type=del size=400365 2024-08-08T23:35:55.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.940+0000 7fdbd6e2c8c0 1 < suggested update operation key=0MT9FJO58ELX tag=RXH99E428WF5 type=del size=1866904 2024-08-08T23:35:55.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.944+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~JUO3M112SEHA.0 size=674880 2024-08-08T23:35:55.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.944+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=JUO3M112SEHA tag=TT02ZNZLH1W5 type=write size=1723456 2024-08-08T23:35:55.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.948+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=UL41TW215EB1 type=del 2024-08-08T23:35:55.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~KMPLP4JC9LD3.0 size=1048576 2024-08-08T23:35:55.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~KMPLP4JC9LD3.1 size=273599 2024-08-08T23:35:55.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=KMPLP4JC9LD3 tag=PGS9RCFYMMG5 type=write size=2370751 2024-08-08T23:35:55.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~BLJATBLNH0VO.0 size=1048576 2024-08-08T23:35:55.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~BLJATBLNH0VO.1 size=1037317 2024-08-08T23:35:55.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.964+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=BLJATBLNH0VO tag=0S5RVT37GMXU type=write size=3134469 2024-08-08T23:35:55.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.972+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~3MDN9L3I6W7F.0 size=1048576 2024-08-08T23:35:55.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.972+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~3MDN9L3I6W7F.1 size=898560 2024-08-08T23:35:55.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.972+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=3MDN9L3I6W7F tag=JHDP5C667ZRY type=write size=2995712 2024-08-08T23:35:55.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.976+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~WHJK22A18AGE.0 size=1048576 2024-08-08T23:35:55.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~WHJK22A18AGE.1 size=761722 2024-08-08T23:35:55.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.984+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=WHJK22A18AGE tag=9V1513GTNL0M type=write size=2858874 2024-08-08T23:35:55.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.988+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=1E5Y8JNSH7A2 type=del size=2763830 2024-08-08T23:35:55.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.988+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=M9XOUT2Z4AUF type=del 2024-08-08T23:35:55.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.996+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~DQ4TAVYH881G.0 size=462898 2024-08-08T23:35:55.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.996+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=DQ4TAVYH881G tag=BYPOV4CCW2QR type=write size=1511474 2024-08-08T23:35:55.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:55.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~IVUHYZX0XL8H.0 size=583745 2024-08-08T23:35:56.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.008+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=IVUHYZX0XL8H tag=9ZVY9R0JCAYF type=write size=1632321 2024-08-08T23:35:56.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.012+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=KHSP6WKSWO7N type=del size=3158411 2024-08-08T23:35:56.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.012+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=Y3TCOIAX53S3 type=del 2024-08-08T23:35:56.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.020+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.0 size=1048576 2024-08-08T23:35:56.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.1 size=1048576 2024-08-08T23:35:56.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.2 size=222699 2024-08-08T23:35:56.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.024+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=ATSFO2JX08BW tag=MW04T4ZOSG9S type=write size=3368427 2024-08-08T23:35:56.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.032+0000 7fdbd6e2c8c0 1 < suggested remove operation key=MNV404EWJHC1 tag=UVEN9SK1ZB1X type=write 2024-08-08T23:35:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.036+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=JNYS0MJ4MT23 type=del size=3309926 2024-08-08T23:35:56.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.040+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~EHZV7X3WSB9R.0 size=899492 2024-08-08T23:35:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.044+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=EHZV7X3WSB9R tag=338YKFCHNQ6X type=write size=1948068 2024-08-08T23:35:56.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.048+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.0 size=1048576 2024-08-08T23:35:56.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.1 size=1048576 2024-08-08T23:35:56.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.2 size=515797 2024-08-08T23:35:56.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.052+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=QZO78U6XXNHW tag=THDFQY1N0PM1 type=write size=3661525 2024-08-08T23:35:56.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~TDK0CJDYPGNE.0 size=1048576 2024-08-08T23:35:56.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.060+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~TDK0CJDYPGNE.1 size=1043665 2024-08-08T23:35:56.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.064+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=TDK0CJDYPGNE tag=UATN1ODVA5KM type=write size=3140817 2024-08-08T23:35:56.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.068+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=45KLM9MQR3Z6 type=del size=1908758 2024-08-08T23:35:56.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.072+0000 7fdbd6e2c8c0 1 < completed write operation key=QHN8QYEEOHYO tag=FJI0YU9TXFM3 type=write size=190107 2024-08-08T23:35:56.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~FQOR2W8KDS80.0 size=455119 2024-08-08T23:35:56.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=FQOR2W8KDS80 tag=C12RDSM2CVRP type=write size=1503695 2024-08-08T23:35:56.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.080+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=JG4XVO47I2DM type=write size=807522 2024-08-08T23:35:56.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.084+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~T8X4LT6LCHTV.0 size=832804 2024-08-08T23:35:56.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.084+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=T8X4LT6LCHTV tag=EZGYTG459DN7 type=write size=1881380 2024-08-08T23:35:56.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.088+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=F09TU92FHA3K type=del size=684730 2024-08-08T23:35:56.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.096+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.0 size=1048576 2024-08-08T23:35:56.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.096+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.1 size=1048576 2024-08-08T23:35:56.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.100+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.2 size=884386 2024-08-08T23:35:56.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.100+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=TS4GR2K61GV7 tag=IDZQKJX5RWHO type=write size=4030114 2024-08-08T23:35:56.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.100+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=KGTU518OCERG type=del 2024-08-08T23:35:56.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.104+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=V1OV6PTB4MUB type=write size=39586 2024-08-08T23:35:56.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.108+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=1K33OJ0IIP7N type=del 2024-08-08T23:35:56.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.112+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=BYENYCGD0WL1 type=del size=2739181 2024-08-08T23:35:56.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.112+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=HLWNQ00FNLZF type=del 2024-08-08T23:35:56.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.116+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=Y0CJM7CLENTA type=del size=1323910 2024-08-08T23:35:56.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~JUO3M112SEHA.0 size=674880 2024-08-08T23:35:56.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.124+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=JUO3M112SEHA tag=TT02ZNZLH1W5 type=write size=1723456 2024-08-08T23:35:56.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.128+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~G9YV7LZ458AO.0 size=1048576 2024-08-08T23:35:56.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.128+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~G9YV7LZ458AO.1 size=85698 2024-08-08T23:35:56.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.128+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=G9YV7LZ458AO tag=EJVIYLAIRKDH type=write size=2182850 2024-08-08T23:35:56.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.132+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~KMPLP4JC9LD3.0 size=1048576 2024-08-08T23:35:56.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.136+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~KMPLP4JC9LD3.1 size=273599 2024-08-08T23:35:56.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.140+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=KMPLP4JC9LD3 tag=PGS9RCFYMMG5 type=write size=2370751 2024-08-08T23:35:56.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~29SNL1GIZQ7A.0 size=1048576 2024-08-08T23:35:56.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~29SNL1GIZQ7A.1 size=945836 2024-08-08T23:35:56.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.144+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=29SNL1GIZQ7A tag=A1UVYXBVTPIN type=write size=3042988 2024-08-08T23:35:56.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~3MDN9L3I6W7F.0 size=1048576 2024-08-08T23:35:56.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~3MDN9L3I6W7F.1 size=898560 2024-08-08T23:35:56.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.156+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=3MDN9L3I6W7F tag=JHDP5C667ZRY type=write size=2995712 2024-08-08T23:35:56.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.156+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=SPTU9ATCCXZJ type=del size=663940 2024-08-08T23:35:56.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.164+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=1E5Y8JNSH7A2 type=del 2024-08-08T23:35:56.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.164+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=7N3X2485X154 type=write size=936334 2024-08-08T23:35:56.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~DQ4TAVYH881G.0 size=462898 2024-08-08T23:35:56.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.172+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=DQ4TAVYH881G tag=BYPOV4CCW2QR type=write size=1511474 2024-08-08T23:35:56.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~IDHTQ75O4BK7.0 size=559155 2024-08-08T23:35:56.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.180+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=IDHTQ75O4BK7 tag=3RP7D51WR5U0 type=write size=1607731 2024-08-08T23:35:56.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.184+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=W5OVPO7BGE4S tag=KHSP6WKSWO7N type=del size=3158411: (22) Invalid argument 2024-08-08T23:35:56.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.184+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=2Y6SIVH2PC7S type=del size=2732556 2024-08-08T23:35:56.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.188+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.0 size=1048576 2024-08-08T23:35:56.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.1 size=1048576 2024-08-08T23:35:56.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~ATSFO2JX08BW.2 size=222699 2024-08-08T23:35:56.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=ATSFO2JX08BW tag=MW04T4ZOSG9S type=write size=3368427 2024-08-08T23:35:56.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.200+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=8K4LM424HPYO type=del size=319681 2024-08-08T23:35:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.204+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=JNYS0MJ4MT23 type=del 2024-08-08T23:35:56.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.208+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=49B560O9T22G type=del size=273172 2024-08-08T23:35:56.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.212+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.0 size=1048576 2024-08-08T23:35:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.212+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.1 size=1048576 2024-08-08T23:35:56.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.216+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~QZO78U6XXNHW.2 size=515797 2024-08-08T23:35:56.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.220+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=QZO78U6XXNHW tag=THDFQY1N0PM1 type=write size=3661525 2024-08-08T23:35:56.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.224+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=2EL3VVIXJ5LD type=del size=2155501 2024-08-08T23:35:56.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.228+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=45KLM9MQR3Z6 type=del 2024-08-08T23:35:56.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.232+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=IU52R2BMD6E1 type=del size=3073611 2024-08-08T23:35:56.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.232+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~FQOR2W8KDS80.0 size=455119 2024-08-08T23:35:56.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.240+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=FQOR2W8KDS80 tag=C12RDSM2CVRP type=write size=1503695 2024-08-08T23:35:56.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.240+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=DF096RG62TF0 type=del size=2949803 2024-08-08T23:35:56.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.244+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QJB9DETMSY4X.2~T8X4LT6LCHTV.0 size=832804 2024-08-08T23:35:56.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.248+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QJB9DETMSY4X upload=T8X4LT6LCHTV tag=EZGYTG459DN7 type=write size=1881380 2024-08-08T23:35:56.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.252+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=G2W4IO5FNR0I type=del size=3275053 2024-08-08T23:35:56.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.0 size=1048576 2024-08-08T23:35:56.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.1 size=1048576 2024-08-08T23:35:56.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.260+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~TS4GR2K61GV7.2 size=884386 2024-08-08T23:35:56.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.264+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=TS4GR2K61GV7 tag=IDZQKJX5RWHO type=write size=4030114 2024-08-08T23:35:56.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~MQT2T8PT92BM.0 size=579226 2024-08-08T23:35:56.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.272+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=MQT2T8PT92BM tag=NKNI7XDY1RNS type=write size=1627802 2024-08-08T23:35:56.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.276+0000 7fdbd6e2c8c0 1 < canceled operation key=QWRYLH4P94BQ tag=V1OV6PTB4MUB type=write size=39586 2024-08-08T23:35:56.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.284+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~CKNKSHJL5F1G.0 size=1048576 2024-08-08T23:35:56.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~CKNKSHJL5F1G.1 size=989564 2024-08-08T23:35:56.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.288+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=CKNKSHJL5F1G tag=2I8U33EBO31D type=write size=3086716 2024-08-08T23:35:56.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.292+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=BYENYCGD0WL1 type=del 2024-08-08T23:35:56.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.296+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=BKOETME76XET type=write size=265495 2024-08-08T23:35:56.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.296+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=Y0CJM7CLENTA type=del 2024-08-08T23:35:56.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.300+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=U3H98LI20ZVH type=del size=29502 2024-08-08T23:35:56.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.304+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~G9YV7LZ458AO.0 size=1048576 2024-08-08T23:35:56.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.304+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~G9YV7LZ458AO.1 size=85698 2024-08-08T23:35:56.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.312+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=G9YV7LZ458AO tag=EJVIYLAIRKDH type=write size=2182850 2024-08-08T23:35:56.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.316+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~C138MVMR83MA.0 size=1036285 2024-08-08T23:35:56.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.316+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=C138MVMR83MA tag=K9I4QGLWSLKG type=write size=2084861 2024-08-08T23:35:56.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~29SNL1GIZQ7A.0 size=1048576 2024-08-08T23:35:56.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.324+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~29SNL1GIZQ7A.1 size=945836 2024-08-08T23:35:56.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.328+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=29SNL1GIZQ7A tag=A1UVYXBVTPIN type=write size=3042988 2024-08-08T23:35:56.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.328+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=TCQ243A7M83L type=del size=3077763 2024-08-08T23:35:56.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.332+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=SPTU9ATCCXZJ type=del 2024-08-08T23:35:56.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.336+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=USCFA16XJNO0 type=del size=1402274 2024-08-08T23:35:56.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.340+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=7N3X2485X154 type=write size=936334 2024-08-08T23:35:56.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.0 size=1048576 2024-08-08T23:35:56.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.1 size=1048576 2024-08-08T23:35:56.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.2 size=597674 2024-08-08T23:35:56.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.348+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=B5UCKFEGH5MQ tag=ZHXK5EOIJQ9Z type=write size=3743402 2024-08-08T23:35:56.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~IDHTQ75O4BK7.0 size=559155 2024-08-08T23:35:56.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.356+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=IDHTQ75O4BK7 tag=3RP7D51WR5U0 type=write size=1607731 2024-08-08T23:35:56.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.360+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=B758YBF72ZZ6 type=del size=3040938 2024-08-08T23:35:56.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.364+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=2Y6SIVH2PC7S type=del 2024-08-08T23:35:56.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.0 size=1048576 2024-08-08T23:35:56.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.372+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.1 size=1048576 2024-08-08T23:35:56.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.372+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.2 size=563278 2024-08-08T23:35:56.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.372+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=U8W19HZ3CZ4P tag=D0TMPV5T9XXK type=write size=3709006 2024-08-08T23:35:56.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.376+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=8K4LM424HPYO type=del 2024-08-08T23:35:56.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.380+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~6VVKBJ0NP6LF.0 size=164651 2024-08-08T23:35:56.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.380+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=6VVKBJ0NP6LF tag=9E7LTYTHK2BS type=write size=1213227 2024-08-08T23:35:56.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.384+0000 7fdbd6e2c8c0 1 < canceled operation key=W5OVPO7BGE4S tag=49B560O9T22G type=del size=273172 2024-08-08T23:35:56.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~EZKYZYXJ5P3Q.0 size=1048576 2024-08-08T23:35:56.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~EZKYZYXJ5P3Q.1 size=274881 2024-08-08T23:35:56.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.392+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=EZKYZYXJ5P3Q tag=2O17SC3CZEP7 type=write size=2372033 2024-08-08T23:35:56.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.396+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=2EL3VVIXJ5LD type=del 2024-08-08T23:35:56.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.400+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.0 size=1048576 2024-08-08T23:35:56.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.400+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.1 size=1048576 2024-08-08T23:35:56.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.2 size=782795 2024-08-08T23:35:56.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.404+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=VLBNBUMO9NAJ tag=524RUT4CJTG8 type=write size=3928523 2024-08-08T23:35:56.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.408+0000 7fdbd6e2c8c0 1 < suggested remove operation key=Z5EXY8ZHZCHI tag=IU52R2BMD6E1 type=del 2024-08-08T23:35:56.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.412+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=CMML82A0DA60 type=write size=426836 2024-08-08T23:35:56.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.416+0000 7fdbd6e2c8c0 1 < canceled operation key=63GVT7KRKCSS tag=DF096RG62TF0 type=del size=2949803 2024-08-08T23:35:56.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.420+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=L9X1K0PKHAXZ type=del size=3942395 2024-08-08T23:35:56.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.420+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=G2W4IO5FNR0I type=del 2024-08-08T23:35:56.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~3S9LF47JBD6K.0 size=1048576 2024-08-08T23:35:56.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~3S9LF47JBD6K.1 size=423187 2024-08-08T23:35:56.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.428+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=3S9LF47JBD6K tag=I7O78GL7945J type=write size=2520339 2024-08-08T23:35:56.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.432+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~MQT2T8PT92BM.0 size=579226 2024-08-08T23:35:56.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.440+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=MQT2T8PT92BM tag=NKNI7XDY1RNS type=write size=1627802 2024-08-08T23:35:56.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.444+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=Z2P693DOMPK4 type=del size=3981424 2024-08-08T23:35:56.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~CKNKSHJL5F1G.0 size=1048576 2024-08-08T23:35:56.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.448+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~CKNKSHJL5F1G.1 size=989564 2024-08-08T23:35:56.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.452+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=CKNKSHJL5F1G tag=2I8U33EBO31D type=write size=3086716 2024-08-08T23:35:56.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.456+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=6GFQ9HNSBHQU type=del size=412728 2024-08-08T23:35:56.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.460+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=BKOETME76XET type=write size=265495 2024-08-08T23:35:56.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.0 size=1048576 2024-08-08T23:35:56.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.1 size=1048576 2024-08-08T23:35:56.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.472+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.2 size=20926 2024-08-08T23:35:56.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.472+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=04UDD0FU8ZFN tag=ZFOF50MS1DOL type=write size=3166654 2024-08-08T23:35:56.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.472+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=U3H98LI20ZVH type=del 2024-08-08T23:35:56.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.480+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~CYM4Y3IDY2CQ.0 size=1048576 2024-08-08T23:35:56.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.480+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~CYM4Y3IDY2CQ.1 size=115349 2024-08-08T23:35:56.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.480+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=CYM4Y3IDY2CQ tag=CXXXAU1LC9L5 type=write size=2212501 2024-08-08T23:35:56.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.484+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~C138MVMR83MA.0 size=1036285 2024-08-08T23:35:56.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.488+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=C138MVMR83MA tag=K9I4QGLWSLKG type=write size=2084861 2024-08-08T23:35:56.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.496+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~0M4ESNGFJ00Z.0 size=199198 2024-08-08T23:35:56.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.496+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=0M4ESNGFJ00Z tag=QEJUS7DKGQBS type=write size=1247774 2024-08-08T23:35:56.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.500+0000 7fdbd6e2c8c0 1 < suggested update operation key=QHN8QYEEOHYO tag=TCQ243A7M83L type=del size=3077763 2024-08-08T23:35:56.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.0 size=1048576 2024-08-08T23:35:56.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.1 size=1048576 2024-08-08T23:35:56.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.2 size=583716 2024-08-08T23:35:56.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.512+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=2UH1BLZYU5RO tag=0Z6JIWZO3IET type=write size=3729444 2024-08-08T23:35:56.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.516+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=USCFA16XJNO0 type=del size=1402274 2024-08-08T23:35:56.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.0 size=1048576 2024-08-08T23:35:56.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.1 size=1048576 2024-08-08T23:35:56.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.524+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.2 size=371183 2024-08-08T23:35:56.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.524+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=YDBKEL3TGGPU tag=AM6Y92W1AE19 type=write size=3516911 2024-08-08T23:35:56.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.524+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.0 size=1048576 2024-08-08T23:35:56.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.528+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.1 size=1048576 2024-08-08T23:35:56.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.532+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~B5UCKFEGH5MQ.2 size=597674 2024-08-08T23:35:56.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.536+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QANZ3YTL2NQV upload=B5UCKFEGH5MQ tag=ZHXK5EOIJQ9Z type=write size=3743402 2024-08-08T23:35:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.540+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=JK67UIU6HM8L type=del size=2568054 2024-08-08T23:35:56.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.540+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=B758YBF72ZZ6 type=del 2024-08-08T23:35:56.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.544+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=5QMMRHUST2RW type=del size=1104720 2024-08-08T23:35:56.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.544+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.0 size=1048576 2024-08-08T23:35:56.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.548+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.1 size=1048576 2024-08-08T23:35:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.548+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~U8W19HZ3CZ4P.2 size=563278 2024-08-08T23:35:56.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.556+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QJB9DETMSY4X upload=U8W19HZ3CZ4P tag=D0TMPV5T9XXK type=write size=3709006 2024-08-08T23:35:56.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.560+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=ZFOTXOH5NMEW type=del size=3978552 2024-08-08T23:35:56.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~6VVKBJ0NP6LF.0 size=164651 2024-08-08T23:35:56.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.568+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=6VVKBJ0NP6LF tag=9E7LTYTHK2BS type=write size=1213227 2024-08-08T23:35:56.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~UBM3BVVK41AM.0 size=1044128 2024-08-08T23:35:56.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.576+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=UBM3BVVK41AM tag=VETC3JNZ5QLZ type=write size=2092704 2024-08-08T23:35:56.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~EZKYZYXJ5P3Q.0 size=1048576 2024-08-08T23:35:56.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.580+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_XIXN9HLLSJS3.2~EZKYZYXJ5P3Q.1 size=274881 2024-08-08T23:35:56.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.584+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=XIXN9HLLSJS3 upload=EZKYZYXJ5P3Q tag=2O17SC3CZEP7 type=write size=2372033 2024-08-08T23:35:56.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.588+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=7DL1CZ511YEZ type=del size=2629529 2024-08-08T23:35:56.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.592+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.0 size=1048576 2024-08-08T23:35:56.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.592+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.1 size=1048576 2024-08-08T23:35:56.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.596+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~VLBNBUMO9NAJ.2 size=782795 2024-08-08T23:35:56.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.600+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=VLBNBUMO9NAJ tag=524RUT4CJTG8 type=write size=3928523 2024-08-08T23:35:56.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.604+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=TSQVJ3B7O6I9 type=del size=2342627 2024-08-08T23:35:56.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.608+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=CMML82A0DA60 type=write size=426836 2024-08-08T23:35:56.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~4KB3TMRPOLQP.0 size=1048576 2024-08-08T23:35:56.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.616+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~4KB3TMRPOLQP.1 size=169039 2024-08-08T23:35:56.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.616+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=4KB3TMRPOLQP tag=VEWGPAK5FXBX type=write size=2266191 2024-08-08T23:35:56.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.620+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=L9X1K0PKHAXZ type=del size=3942395 2024-08-08T23:35:56.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.624+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=5Z1RIR3MQBQX type=del size=1137806 2024-08-08T23:35:56.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.628+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~3S9LF47JBD6K.0 size=1048576 2024-08-08T23:35:56.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~3S9LF47JBD6K.1 size=423187 2024-08-08T23:35:56.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.636+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=3S9LF47JBD6K tag=I7O78GL7945J type=write size=2520339 2024-08-08T23:35:56.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.640+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=NANWM0X8Y8HZ type=del size=1845804 2024-08-08T23:35:56.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.644+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=Z2P693DOMPK4 type=del 2024-08-08T23:35:56.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.648+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=M8XTU4SANJK5 type=del size=2809195 2024-08-08T23:35:56.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.652+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=6GFQ9HNSBHQU type=del 2024-08-08T23:35:56.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.656+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=OH4P2VPSNINW type=del size=1774807 2024-08-08T23:35:56.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.656+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.0 size=1048576 2024-08-08T23:35:56.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.660+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.1 size=1048576 2024-08-08T23:35:56.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~04UDD0FU8ZFN.2 size=20926 2024-08-08T23:35:56.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.668+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=04UDD0FU8ZFN tag=ZFOF50MS1DOL type=write size=3166654 2024-08-08T23:35:56.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.672+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=WMJG98FJR1DA type=del size=1845480 2024-08-08T23:35:56.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.672+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~CYM4Y3IDY2CQ.0 size=1048576 2024-08-08T23:35:56.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.676+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~CYM4Y3IDY2CQ.1 size=115349 2024-08-08T23:35:56.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.684+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=CYM4Y3IDY2CQ tag=CXXXAU1LC9L5 type=write size=2212501 2024-08-08T23:35:56.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.688+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~NJPU21K677W8.0 size=766946 2024-08-08T23:35:56.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.688+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=NJPU21K677W8 tag=5C8VF3E9UR1K type=write size=1815522 2024-08-08T23:35:56.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~0M4ESNGFJ00Z.0 size=199198 2024-08-08T23:35:56.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.696+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=0M4ESNGFJ00Z tag=QEJUS7DKGQBS type=write size=1247774 2024-08-08T23:35:56.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.700+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=TTCQPW306KRY type=write size=665080 2024-08-08T23:35:56.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.704+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.0 size=1048576 2024-08-08T23:35:56.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.704+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.1 size=1048576 2024-08-08T23:35:56.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.708+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~2UH1BLZYU5RO.2 size=583716 2024-08-08T23:35:56.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.712+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=2UH1BLZYU5RO tag=0Z6JIWZO3IET type=write size=3729444 2024-08-08T23:35:56.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~0W05RR31Q9RE.0 size=540594 2024-08-08T23:35:56.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.720+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=0W05RR31Q9RE tag=Z1ZTV85ETH9K type=write size=1589170 2024-08-08T23:35:56.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.0 size=1048576 2024-08-08T23:35:56.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.1 size=1048576 2024-08-08T23:35:56.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.728+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YDBKEL3TGGPU.2 size=371183 2024-08-08T23:35:56.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.732+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=YDBKEL3TGGPU tag=AM6Y92W1AE19 type=write size=3516911 2024-08-08T23:35:56.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.736+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=Q0WRDMKVA2QR type=write size=49368 2024-08-08T23:35:56.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.740+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=JK67UIU6HM8L type=del 2024-08-08T23:35:56.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.744+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=EH4AFKYK98Y4 type=del size=2104113 2024-08-08T23:35:56.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.744+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=5QMMRHUST2RW type=del 2024-08-08T23:35:56.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.748+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=CKVI12EQK5LB type=del size=1297824 2024-08-08T23:35:56.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.752+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=ZFOTXOH5NMEW type=del 2024-08-08T23:35:56.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.756+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=9QFVQ3R1PIV4 type=del size=53695 2024-08-08T23:35:56.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.760+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~UBM3BVVK41AM.0 size=1044128 2024-08-08T23:35:56.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.768+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=UBM3BVVK41AM tag=VETC3JNZ5QLZ type=write size=2092704 2024-08-08T23:35:56.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.0 size=1048576 2024-08-08T23:35:56.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.1 size=1048576 2024-08-08T23:35:56.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.2 size=375088 2024-08-08T23:35:56.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=NRR2QCPTUEVL tag=RV5Q7OWPZ71Z type=write size=3520816 2024-08-08T23:35:56.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.780+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=7DL1CZ511YEZ type=del 2024-08-08T23:35:56.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~LZTDDNPMVO45.0 size=24331 2024-08-08T23:35:56.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.788+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=LZTDDNPMVO45 tag=E2J3T7TAZO9X type=write size=1072907 2024-08-08T23:35:56.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.792+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=TSQVJ3B7O6I9 type=del 2024-08-08T23:35:56.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.796+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~80B67UHLLSMA.0 size=703989 2024-08-08T23:35:56.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.796+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=80B67UHLLSMA tag=1RNO4ELNQ2EO type=write size=1752565 2024-08-08T23:35:56.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.800+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~4KB3TMRPOLQP.0 size=1048576 2024-08-08T23:35:56.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.800+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~4KB3TMRPOLQP.1 size=169039 2024-08-08T23:35:56.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.804+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=4KB3TMRPOLQP tag=VEWGPAK5FXBX type=write size=2266191 2024-08-08T23:35:56.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.808+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=V7VOU9P2S9AF type=del size=2284227 2024-08-08T23:35:56.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.812+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=5Z1RIR3MQBQX type=del 2024-08-08T23:35:56.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.816+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=0RA5FQ8NPEVS type=del size=693678 2024-08-08T23:35:56.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.820+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FBCEC998C8EJ tag=NANWM0X8Y8HZ type=del 2024-08-08T23:35:56.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.824+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=JX9BTC4NET1K type=del size=3493947 2024-08-08T23:35:56.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.832+0000 7fdbd6e2c8c0 1 < suggested remove operation key=XIXN9HLLSJS3 tag=M8XTU4SANJK5 type=del 2024-08-08T23:35:56.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.832+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=W3H7BQUHLOW8 type=del size=2762773 2024-08-08T23:35:56.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.836+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=VGT9IXWM956F tag=OH4P2VPSNINW type=del size=1774807: (22) Invalid argument 2024-08-08T23:35:56.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.840+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=4G7AP8F01M7C type=del size=734771 2024-08-08T23:35:56.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.840+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=WMJG98FJR1DA type=del 2024-08-08T23:35:56.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.848+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~FD9II40WQXWN.0 size=1048576 2024-08-08T23:35:56.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.852+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~FD9II40WQXWN.1 size=853657 2024-08-08T23:35:56.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.852+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=FD9II40WQXWN tag=JFAFG64GDUPM type=write size=2950809 2024-08-08T23:35:56.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.852+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YO2FZOR7H0EX.2~NJPU21K677W8.0 size=766946 2024-08-08T23:35:56.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.860+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YO2FZOR7H0EX upload=NJPU21K677W8 tag=5C8VF3E9UR1K type=write size=1815522 2024-08-08T23:35:56.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.864+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=K1JAMJAVCZ4U type=write size=223128 2024-08-08T23:35:56.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.864+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=TTCQPW306KRY type=write size=665080 2024-08-08T23:35:56.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.868+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~CX722XVSERYE.0 size=805832 2024-08-08T23:35:56.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.868+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=CX722XVSERYE tag=HT1PG2UDB4WO type=write size=1854408 2024-08-08T23:35:56.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.872+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~0W05RR31Q9RE.0 size=540594 2024-08-08T23:35:56.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.876+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=0W05RR31Q9RE tag=Z1ZTV85ETH9K type=write size=1589170 2024-08-08T23:35:56.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.880+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=4WFRGU656MPQ type=del size=3739490 2024-08-08T23:35:56.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.884+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=Q0WRDMKVA2QR type=write 2024-08-08T23:35:56.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.888+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=48Q48HNJWON8 type=del size=3907272 2024-08-08T23:35:56.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.892+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=EH4AFKYK98Y4 type=del 2024-08-08T23:35:56.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.896+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~9C463P7892O0.0 size=1048576 2024-08-08T23:35:56.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.896+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~9C463P7892O0.1 size=981225 2024-08-08T23:35:56.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.896+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=9C463P7892O0 tag=64P6BNSCQW5S type=write size=3078377 2024-08-08T23:35:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.904+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V3TA5KZ95NXT tag=CKVI12EQK5LB type=del 2024-08-08T23:35:56.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.904+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=U6876ON086OK type=del size=794208 2024-08-08T23:35:56.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.912+0000 7fdbd6e2c8c0 1 < suggested remove operation key=Z5EXY8ZHZCHI tag=9QFVQ3R1PIV4 type=del 2024-08-08T23:35:56.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.912+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=YKPF13ZXEX5A type=write size=89398 2024-08-08T23:35:56.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.0 size=1048576 2024-08-08T23:35:56.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.1 size=1048576 2024-08-08T23:35:56.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~NRR2QCPTUEVL.2 size=375088 2024-08-08T23:35:56.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.924+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=NRR2QCPTUEVL tag=RV5Q7OWPZ71Z type=write size=3520816 2024-08-08T23:35:56.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.924+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=SJRU96IA0H8L type=del size=509374 2024-08-08T23:35:56.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~LZTDDNPMVO45.0 size=24331 2024-08-08T23:35:56.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.932+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=LZTDDNPMVO45 tag=E2J3T7TAZO9X type=write size=1072907 2024-08-08T23:35:56.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.936+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=F46WJ6Q7HO0R type=del size=3615123 2024-08-08T23:35:56.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.936+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~80B67UHLLSMA.0 size=703989 2024-08-08T23:35:56.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.944+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=80B67UHLLSMA tag=1RNO4ELNQ2EO type=write size=1752565 2024-08-08T23:35:56.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.948+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~S5ZG5QKD866H.0 size=858943 2024-08-08T23:35:56.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.948+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=S5ZG5QKD866H tag=EHW1IOHCODUT type=write size=1907519 2024-08-08T23:35:56.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.952+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=V7VOU9P2S9AF type=del 2024-08-08T23:35:56.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~CEGLKZYXO31G.0 size=1048576 2024-08-08T23:35:56.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~CEGLKZYXO31G.1 size=923579 2024-08-08T23:35:56.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.960+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=CEGLKZYXO31G tag=NASF4H4X4KEO type=write size=3020731 2024-08-08T23:35:56.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.960+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=0RA5FQ8NPEVS type=del 2024-08-08T23:35:56.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.964+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=A1DCBWJ0V2J4 type=del size=2359173 2024-08-08T23:35:56.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.968+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=JX9BTC4NET1K type=del 2024-08-08T23:35:56.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.968+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=X5O90ZPZHNRT type=write size=152603 2024-08-08T23:35:56.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.976+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=W3H7BQUHLOW8 type=del 2024-08-08T23:35:56.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.980+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~W486THYOU29Y.0 size=1048576 2024-08-08T23:35:56.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.980+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~W486THYOU29Y.1 size=878332 2024-08-08T23:35:56.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.980+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=W486THYOU29Y tag=51GGZC1EHXTO type=write size=2975484 2024-08-08T23:35:56.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.984+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=4G7AP8F01M7C type=del 2024-08-08T23:35:56.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.988+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=84O68CJ4XDXZ type=del size=3515361 2024-08-08T23:35:56.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~FD9II40WQXWN.0 size=1048576 2024-08-08T23:35:56.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~FD9II40WQXWN.1 size=853657 2024-08-08T23:35:56.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:56.996+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=FD9II40WQXWN tag=JFAFG64GDUPM type=write size=2950809 2024-08-08T23:35:57.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.000+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=HHNK2H1ZGQPI type=del size=3382880 2024-08-08T23:35:57.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.000+0000 7fdbd6e2c8c0 1 < canceled operation key=QWRYLH4P94BQ tag=K1JAMJAVCZ4U type=write size=223128 2024-08-08T23:35:57.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.004+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=QLRT3LWV0LLV type=write size=435241 2024-08-08T23:35:57.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.008+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~CX722XVSERYE.0 size=805832 2024-08-08T23:35:57.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.012+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=CX722XVSERYE tag=HT1PG2UDB4WO type=write size=1854408 2024-08-08T23:35:57.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.012+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=6KXXH2W3NT4F type=del size=2552559 2024-08-08T23:35:57.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.016+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=4WFRGU656MPQ type=del 2024-08-08T23:35:57.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.020+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~LLC44Z246ZQE.0 size=750094 2024-08-08T23:35:57.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.020+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=LLC44Z246ZQE tag=31SIPRZODVI8 type=write size=1798670 2024-08-08T23:35:57.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.024+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=48Q48HNJWON8 type=del 2024-08-08T23:35:57.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.028+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=0EG8KT25GWOA type=del size=1442790 2024-08-08T23:35:57.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~9C463P7892O0.0 size=1048576 2024-08-08T23:35:57.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.028+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~9C463P7892O0.1 size=981225 2024-08-08T23:35:57.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.032+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=9C463P7892O0 tag=64P6BNSCQW5S type=write size=3078377 2024-08-08T23:35:57.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.036+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=T92AXO0YQ7H6 type=write size=549042 2024-08-08T23:35:57.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=U6876ON086OK type=del 2024-08-08T23:35:57.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~N3UAPT0VI58T.0 size=1048576 2024-08-08T23:35:57.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~N3UAPT0VI58T.1 size=767466 2024-08-08T23:35:57.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.044+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=N3UAPT0VI58T tag=IZNAA2J9TO7V type=write size=2864618 2024-08-08T23:35:57.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.048+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=YKPF13ZXEX5A type=write size=89398 2024-08-08T23:35:57.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.048+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=Z852Z2QXBZRL type=del size=1662066 2024-08-08T23:35:57.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.052+0000 7fdbd6e2c8c0 1 < canceled operation key=41XLZV9ZY5OP tag=SJRU96IA0H8L type=del size=509374 2024-08-08T23:35:57.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.052+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=01D4TQQ06K6I type=del size=2112672 2024-08-08T23:35:57.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.060+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=F46WJ6Q7HO0R type=del size=3615123 2024-08-08T23:35:57.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.060+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=QN3CEF195L3R type=del size=2016008 2024-08-08T23:35:57.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.064+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~S5ZG5QKD866H.0 size=858943 2024-08-08T23:35:57.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.068+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=S5ZG5QKD866H tag=EHW1IOHCODUT type=write size=1907519 2024-08-08T23:35:57.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~X90TAPWPCQR3.0 size=1048576 2024-08-08T23:35:57.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~X90TAPWPCQR3.1 size=814960 2024-08-08T23:35:57.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=X90TAPWPCQR3 tag=ZYL3GLC1DXBU type=write size=2912112 2024-08-08T23:35:57.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.076+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~CEGLKZYXO31G.0 size=1048576 2024-08-08T23:35:57.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.080+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~CEGLKZYXO31G.1 size=923579 2024-08-08T23:35:57.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.084+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=CEGLKZYXO31G tag=NASF4H4X4KEO type=write size=3020731 2024-08-08T23:35:57.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~ZGPW2D5JEQ66.0 size=1048576 2024-08-08T23:35:57.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~ZGPW2D5JEQ66.1 size=300047 2024-08-08T23:35:57.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.088+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=ZGPW2D5JEQ66 tag=NWRC5T8GZRGE type=write size=2397199 2024-08-08T23:35:57.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.092+0000 7fdbd6e2c8c0 1 < canceled operation key=Z5EXY8ZHZCHI tag=A1DCBWJ0V2J4 type=del size=2359173 2024-08-08T23:35:57.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.100+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.0 size=1048576 2024-08-08T23:35:57.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.1 size=1048576 2024-08-08T23:35:57.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.2 size=578144 2024-08-08T23:35:57.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.104+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=YJZDA8N82HDO tag=OFWHC33DOY9N type=write size=3723872 2024-08-08T23:35:57.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.108+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=X5O90ZPZHNRT type=write size=152603 2024-08-08T23:35:57.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.108+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=YL2REDGHUH7R type=write size=8588 2024-08-08T23:35:57.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.112+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~W486THYOU29Y.0 size=1048576 2024-08-08T23:35:57.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~W486THYOU29Y.1 size=878332 2024-08-08T23:35:57.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.120+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=W486THYOU29Y tag=51GGZC1EHXTO type=write size=2975484 2024-08-08T23:35:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.120+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=D83ZIU2GOHDP type=del size=4159708 2024-08-08T23:35:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.124+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=84O68CJ4XDXZ type=del 2024-08-08T23:35:57.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.128+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=6VR89K2I4920 type=del size=675079 2024-08-08T23:35:57.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.128+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=V3TA5KZ95NXT tag=HHNK2H1ZGQPI type=del size=3382880: (22) Invalid argument 2024-08-08T23:35:57.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.132+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=WNNB9V9LGWK2 type=del size=3788828 2024-08-08T23:35:57.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.136+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=QLRT3LWV0LLV type=write size=435241 2024-08-08T23:35:57.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.140+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~2FMWIAGRWTRY.0 size=887779 2024-08-08T23:35:57.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.140+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=2FMWIAGRWTRY tag=OLZRHH1896B6 type=write size=1936355 2024-08-08T23:35:57.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.144+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=6KXXH2W3NT4F type=del size=2552559 2024-08-08T23:35:57.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.148+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~NIR82ADHF007.0 size=274281 2024-08-08T23:35:57.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.148+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=NIR82ADHF007 tag=QPM0XFKH004U type=write size=1322857 2024-08-08T23:35:57.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~LLC44Z246ZQE.0 size=750094 2024-08-08T23:35:57.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.152+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=LLC44Z246ZQE tag=31SIPRZODVI8 type=write size=1798670 2024-08-08T23:35:57.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.156+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=Y6AO529LB53K type=del size=3936282 2024-08-08T23:35:57.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.160+0000 7fdbd6e2c8c0 1 < suggested remove operation key=MNV404EWJHC1 tag=0EG8KT25GWOA type=del 2024-08-08T23:35:57.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.164+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=BGSDQ7I2FFVM type=del size=1620407 2024-08-08T23:35:57.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.168+0000 7fdbd6e2c8c0 1 < completed write operation key=QJB9DETMSY4X tag=T92AXO0YQ7H6 type=write size=549042 2024-08-08T23:35:57.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.168+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=M3WB1XJE7057 type=del size=2902296 2024-08-08T23:35:57.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.168+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V6GSJH62C8TA.2~N3UAPT0VI58T.0 size=1048576 2024-08-08T23:35:57.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~N3UAPT0VI58T.1 size=767466 2024-08-08T23:35:57.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.176+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V6GSJH62C8TA upload=N3UAPT0VI58T tag=IZNAA2J9TO7V type=write size=2864618 2024-08-08T23:35:57.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~T6450WRG4HBX.0 size=1048576 2024-08-08T23:35:57.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~T6450WRG4HBX.1 size=88775 2024-08-08T23:35:57.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.184+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=T6450WRG4HBX tag=GE5WO2R2IG3C type=write size=2185927 2024-08-08T23:35:57.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.188+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=Z852Z2QXBZRL type=del size=1662066 2024-08-08T23:35:57.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.192+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=N41QH3UN3B52 type=del size=54351 2024-08-08T23:35:57.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.192+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=V3TA5KZ95NXT tag=01D4TQQ06K6I type=del size=2112672: (22) Invalid argument 2024-08-08T23:35:57.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.196+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=Y83YGXIO3JIM type=del size=2062574 2024-08-08T23:35:57.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.200+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=QN3CEF195L3R type=del 2024-08-08T23:35:57.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.200+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=MLNUMBHFJVT0 type=del size=1665005 2024-08-08T23:35:57.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.204+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~X90TAPWPCQR3.0 size=1048576 2024-08-08T23:35:57.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~X90TAPWPCQR3.1 size=814960 2024-08-08T23:35:57.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.212+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=X90TAPWPCQR3 tag=ZYL3GLC1DXBU type=write size=2912112 2024-08-08T23:35:57.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.216+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=F7REAARTWK8P type=del size=366698 2024-08-08T23:35:57.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.216+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~ZGPW2D5JEQ66.0 size=1048576 2024-08-08T23:35:57.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.220+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~ZGPW2D5JEQ66.1 size=300047 2024-08-08T23:35:57.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.224+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=ZGPW2D5JEQ66 tag=NWRC5T8GZRGE type=write size=2397199 2024-08-08T23:35:57.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.0 size=1048576 2024-08-08T23:35:57.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.1 size=1048576 2024-08-08T23:35:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.2 size=201381 2024-08-08T23:35:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.232+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=G5WMN3LPYUHK tag=YS7XZSCPLSD9 type=write size=3347109 2024-08-08T23:35:57.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.232+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.0 size=1048576 2024-08-08T23:35:57.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.236+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.1 size=1048576 2024-08-08T23:35:57.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.240+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~YJZDA8N82HDO.2 size=578144 2024-08-08T23:35:57.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.244+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=YJZDA8N82HDO tag=OFWHC33DOY9N type=write size=3723872 2024-08-08T23:35:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.244+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=P4NN6Y7DMJ8X type=del size=233210 2024-08-08T23:35:57.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.248+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=YL2REDGHUH7R type=write size=8588 2024-08-08T23:35:57.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.252+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=J9GRFEK75KR3 type=del size=1025947 2024-08-08T23:35:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.252+0000 7fdbd6e2c8c0 1 < canceled operation key=XIXN9HLLSJS3 tag=D83ZIU2GOHDP type=del size=4159708 2024-08-08T23:35:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.256+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=VHWA2JYJU4WG type=write size=787792 2024-08-08T23:35:57.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.260+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=6VR89K2I4920 type=del 2024-08-08T23:35:57.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~YZCJDCKNJQPE.0 size=873304 2024-08-08T23:35:57.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=YZCJDCKNJQPE tag=VN1TR2QOJYYW type=write size=1921880 2024-08-08T23:35:57.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.268+0000 7fdbd6e2c8c0 1 < suggested update operation key=NMB4GI8R2BKU tag=WNNB9V9LGWK2 type=del size=3788828 2024-08-08T23:35:57.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.272+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=5HZ92FG1TPVX type=del size=748742 2024-08-08T23:35:57.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.272+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~2FMWIAGRWTRY.0 size=887779 2024-08-08T23:35:57.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.280+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=2FMWIAGRWTRY tag=OLZRHH1896B6 type=write size=1936355 2024-08-08T23:35:57.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.280+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=NCIONJM1T0FG type=del size=1083106 2024-08-08T23:35:57.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~NIR82ADHF007.0 size=274281 2024-08-08T23:35:57.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.288+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=NIR82ADHF007 tag=QPM0XFKH004U type=write size=1322857 2024-08-08T23:35:57.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.292+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=3QK6ZWMWB1WO type=del size=286369 2024-08-08T23:35:57.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.296+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FWZ5TEP1P2LK tag=Y6AO529LB53K type=del 2024-08-08T23:35:57.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.300+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=3XY2BI4I1O28 type=del size=3443202 2024-08-08T23:35:57.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.300+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=BGSDQ7I2FFVM type=del 2024-08-08T23:35:57.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.304+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=3QCLDSW1NFAV type=del size=1124492 2024-08-08T23:35:57.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.312+0000 7fdbd6e2c8c0 1 < suggested update operation key=JWTLJG79MYI5 tag=M3WB1XJE7057 type=del size=2902296 2024-08-08T23:35:57.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.316+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~I7HF07SAQEZI.0 size=467621 2024-08-08T23:35:57.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.316+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=I7HF07SAQEZI tag=ZAE8W5MC6FQS type=write size=1516197 2024-08-08T23:35:57.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~T6450WRG4HBX.0 size=1048576 2024-08-08T23:35:57.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.320+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~T6450WRG4HBX.1 size=88775 2024-08-08T23:35:57.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.324+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=T6450WRG4HBX tag=GE5WO2R2IG3C type=write size=2185927 2024-08-08T23:35:57.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.324+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=QBYYI2DTUE9G type=del size=3293936 2024-08-08T23:35:57.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.328+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=N41QH3UN3B52 type=del 2024-08-08T23:35:57.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~91GL861L3SL0.0 size=896003 2024-08-08T23:35:57.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.332+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=91GL861L3SL0 tag=J0W2095NRSVJ type=write size=1944579 2024-08-08T23:35:57.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.336+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=Y83YGXIO3JIM type=del 2024-08-08T23:35:57.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.340+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~R6U0UKW3JID3.0 size=524868 2024-08-08T23:35:57.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.340+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=R6U0UKW3JID3 tag=IS1ZEYH6KAWL type=write size=1573444 2024-08-08T23:35:57.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.344+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=MLNUMBHFJVT0 type=del 2024-08-08T23:35:57.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.348+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=9FSIE5ML474B type=del size=1602279 2024-08-08T23:35:57.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.352+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=F7REAARTWK8P type=del 2024-08-08T23:35:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.360+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~2C0S9C0O2G82.0 size=1048576 2024-08-08T23:35:57.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~2C0S9C0O2G82.1 size=268102 2024-08-08T23:35:57.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.364+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=2C0S9C0O2G82 tag=SIFMXFV5RT8H type=write size=2365254 2024-08-08T23:35:57.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.368+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.0 size=1048576 2024-08-08T23:35:57.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.368+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.1 size=1048576 2024-08-08T23:35:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~G5WMN3LPYUHK.2 size=201381 2024-08-08T23:35:57.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.376+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=G5WMN3LPYUHK tag=YS7XZSCPLSD9 type=write size=3347109 2024-08-08T23:35:57.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.380+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=LTHH7UG8Z4EX type=del size=2018509 2024-08-08T23:35:57.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.384+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=P4NN6Y7DMJ8X type=del 2024-08-08T23:35:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.388+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=Y1D4GT483UGE type=write size=370472 2024-08-08T23:35:57.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.392+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=J9GRFEK75KR3 type=del 2024-08-08T23:35:57.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.392+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=IXWXDSB4NVW1 type=del size=2257269 2024-08-08T23:35:57.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.396+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=VHWA2JYJU4WG type=write size=787792 2024-08-08T23:35:57.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.400+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=QLXGIADIKI2C type=write size=203387 2024-08-08T23:35:57.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.400+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~YZCJDCKNJQPE.0 size=873304 2024-08-08T23:35:57.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.404+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=YZCJDCKNJQPE tag=VN1TR2QOJYYW type=write size=1921880 2024-08-08T23:35:57.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.408+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=GY3OLBVSRGQZ type=del size=1906419 2024-08-08T23:35:57.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.416+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=5HZ92FG1TPVX type=del 2024-08-08T23:35:57.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.416+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=H8LNNYHXN1UL type=del size=433782 2024-08-08T23:35:57.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.420+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=NCIONJM1T0FG type=del 2024-08-08T23:35:57.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.424+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~0N366GXT5LFM.0 size=541734 2024-08-08T23:35:57.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.424+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=0N366GXT5LFM tag=KER392EKZO9T type=write size=1590310 2024-08-08T23:35:57.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.428+0000 7fdbd6e2c8c0 1 < canceled operation key=YNQU8Z202QCM tag=3QK6ZWMWB1WO type=del size=286369 2024-08-08T23:35:57.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.432+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=WZGS7W5BMV1A type=del size=1903512 2024-08-08T23:35:57.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.436+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=3XY2BI4I1O28 type=del 2024-08-08T23:35:57.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.440+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=T81HARZ13VDQ type=write size=799003 2024-08-08T23:35:57.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.440+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=3QCLDSW1NFAV type=del 2024-08-08T23:35:57.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.448+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~GXPXRYTEBK61.0 size=1048576 2024-08-08T23:35:57.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.448+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~GXPXRYTEBK61.1 size=946462 2024-08-08T23:35:57.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.448+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=GXPXRYTEBK61 tag=P1VPCAC1YSKF type=write size=3043614 2024-08-08T23:35:57.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.452+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~I7HF07SAQEZI.0 size=467621 2024-08-08T23:35:57.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.456+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=I7HF07SAQEZI tag=ZAE8W5MC6FQS type=write size=1516197 2024-08-08T23:35:57.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.0 size=1048576 2024-08-08T23:35:57.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.1 size=1048576 2024-08-08T23:35:57.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.2 size=1015856 2024-08-08T23:35:57.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.468+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=LLWDW7HVDOJL tag=RI4TTBUD5JHE type=write size=4161584 2024-08-08T23:35:57.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.472+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=QBYYI2DTUE9G type=del 2024-08-08T23:35:57.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.472+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=FN545SWT5TEQ type=del size=1093771 2024-08-08T23:35:57.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~91GL861L3SL0.0 size=896003 2024-08-08T23:35:57.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.480+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=91GL861L3SL0 tag=J0W2095NRSVJ type=write size=1944579 2024-08-08T23:35:57.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.484+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=FQSGCX0G6Y0L type=del size=2313191 2024-08-08T23:35:57.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.484+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~R6U0UKW3JID3.0 size=524868 2024-08-08T23:35:57.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.488+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=R6U0UKW3JID3 tag=IS1ZEYH6KAWL type=write size=1573444 2024-08-08T23:35:57.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.492+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=RPD2WNE538SS type=del size=162092 2024-08-08T23:35:57.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.500+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QHN8QYEEOHYO tag=9FSIE5ML474B type=del 2024-08-08T23:35:57.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.504+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~9VB2W282VT1P.0 size=257708 2024-08-08T23:35:57.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.504+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=9VB2W282VT1P tag=FFAJIVKVWD1C type=write size=1306284 2024-08-08T23:35:57.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~2C0S9C0O2G82.0 size=1048576 2024-08-08T23:35:57.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~2C0S9C0O2G82.1 size=268102 2024-08-08T23:35:57.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.516+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=2C0S9C0O2G82 tag=SIFMXFV5RT8H type=write size=2365254 2024-08-08T23:35:57.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.520+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=7EULHNKME6IT type=del size=69891 2024-08-08T23:35:57.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.520+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=LTHH7UG8Z4EX type=del 2024-08-08T23:35:57.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.524+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=EFJ8BO2AJQGY type=del size=3694040 2024-08-08T23:35:57.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.528+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=Y1D4GT483UGE type=write size=370472 2024-08-08T23:35:57.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.532+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~9ATUP7DVB4S5.0 size=1048576 2024-08-08T23:35:57.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~9ATUP7DVB4S5.1 size=235240 2024-08-08T23:35:57.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.536+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=9ATUP7DVB4S5 tag=ELV1BI6IH7O1 type=write size=2332392 2024-08-08T23:35:57.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.536+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=IXWXDSB4NVW1 type=del 2024-08-08T23:35:57.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.544+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~8622207XYDNJ.0 size=385390 2024-08-08T23:35:57.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.544+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=8622207XYDNJ tag=8C2A8HC49OAW type=write size=1433966 2024-08-08T23:35:57.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.544+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=QLXGIADIKI2C type=write size=203387 2024-08-08T23:35:57.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.548+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=4E7LREE9YS55 type=write size=923554 2024-08-08T23:35:57.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.552+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QHN8QYEEOHYO tag=GY3OLBVSRGQZ type=del size=1906419: (22) Invalid argument 2024-08-08T23:35:57.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~H9SRQVH4U25A.0 size=332479 2024-08-08T23:35:57.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=H9SRQVH4U25A tag=VEQIPQ2FAWV4 type=write size=1381055 2024-08-08T23:35:57.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.564+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=H8LNNYHXN1UL type=del 2024-08-08T23:35:57.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~8O91VLL7K2M4.0 size=846273 2024-08-08T23:35:57.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=8O91VLL7K2M4 tag=0MKUBT6VYYSM type=write size=1894849 2024-08-08T23:35:57.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.568+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~0N366GXT5LFM.0 size=541734 2024-08-08T23:35:57.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.572+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=0N366GXT5LFM tag=KER392EKZO9T type=write size=1590310 2024-08-08T23:35:57.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.576+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=7LID9M2QOY63 type=del size=519402 2024-08-08T23:35:57.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.584+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0XF26POOKR3V tag=WZGS7W5BMV1A type=del 2024-08-08T23:35:57.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.588+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=BWS5FGYDG3IH type=del size=2855292 2024-08-08T23:35:57.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.588+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=0XF26POOKR3V tag=T81HARZ13VDQ type=write size=799003: (22) Invalid argument 2024-08-08T23:35:57.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.592+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=CRXX2EFV7RWL type=del size=3111110 2024-08-08T23:35:57.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.596+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~GXPXRYTEBK61.0 size=1048576 2024-08-08T23:35:57.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.600+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~GXPXRYTEBK61.1 size=946462 2024-08-08T23:35:57.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.604+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=GXPXRYTEBK61 tag=P1VPCAC1YSKF type=write size=3043614 2024-08-08T23:35:57.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.608+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~ZXOETJUQ2M3K.0 size=667684 2024-08-08T23:35:57.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.608+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=ZXOETJUQ2M3K tag=GDYM0E7N26DP type=write size=1716260 2024-08-08T23:35:57.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.612+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.0 size=1048576 2024-08-08T23:35:57.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.1 size=1048576 2024-08-08T23:35:57.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~LLWDW7HVDOJL.2 size=1015856 2024-08-08T23:35:57.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.620+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=LLWDW7HVDOJL tag=RI4TTBUD5JHE type=write size=4161584 2024-08-08T23:35:57.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.624+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=SUM4VOAIVFRB type=del size=3112103 2024-08-08T23:35:57.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.628+0000 7fdbd6e2c8c0 1 < suggested update operation key=903K2EO77YTJ tag=FN545SWT5TEQ type=del size=1093771 2024-08-08T23:35:57.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.632+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=WXGGAGF3MP14 type=write size=724224 2024-08-08T23:35:57.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.636+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=FQSGCX0G6Y0L type=del 2024-08-08T23:35:57.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~ZS1DDG8ZTEFU.0 size=1048576 2024-08-08T23:35:57.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.648+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~ZS1DDG8ZTEFU.1 size=36443 2024-08-08T23:35:57.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.648+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=ZS1DDG8ZTEFU tag=GI9VZBQYVRRF type=write size=2133595 2024-08-08T23:35:57.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.648+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=RPD2WNE538SS type=del 2024-08-08T23:35:57.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.652+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=XSBCAYSQ7EL1 type=del size=2864861 2024-08-08T23:35:57.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.656+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~9VB2W282VT1P.0 size=257708 2024-08-08T23:35:57.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.660+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=9VB2W282VT1P tag=FFAJIVKVWD1C type=write size=1306284 2024-08-08T23:35:57.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~8OJ6GZWW2GVZ.0 size=527087 2024-08-08T23:35:57.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.664+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=8OJ6GZWW2GVZ tag=KEGQ03BCYBU2 type=write size=1575663 2024-08-08T23:35:57.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.668+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=7EULHNKME6IT type=del 2024-08-08T23:35:57.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.672+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=1URH8L3WBBNC type=del size=2621244 2024-08-08T23:35:57.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.672+0000 7fdbd6e2c8c0 1 < canceled operation key=ZQ8GOX9RSTBB tag=EFJ8BO2AJQGY type=del size=3694040 2024-08-08T23:35:57.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.676+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=22KPBFV0DHTT type=del size=621980 2024-08-08T23:35:57.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.680+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~9ATUP7DVB4S5.0 size=1048576 2024-08-08T23:35:57.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.680+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~9ATUP7DVB4S5.1 size=235240 2024-08-08T23:35:57.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.688+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=9ATUP7DVB4S5 tag=ELV1BI6IH7O1 type=write size=2332392 2024-08-08T23:35:57.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.688+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=MEHPGOPTCV6I type=del size=4076495 2024-08-08T23:35:57.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.688+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~8622207XYDNJ.0 size=385390 2024-08-08T23:35:57.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.696+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=8622207XYDNJ tag=8C2A8HC49OAW type=write size=1433966 2024-08-08T23:35:57.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~HUEUFRKR9U3O.0 size=1048576 2024-08-08T23:35:57.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~HUEUFRKR9U3O.1 size=729279 2024-08-08T23:35:57.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.700+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=HUEUFRKR9U3O tag=NP74FR7BED10 type=write size=2826431 2024-08-08T23:35:57.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.704+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=4E7LREE9YS55 type=write size=923554 2024-08-08T23:35:57.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.708+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=7WH04MRZ1HVY type=write size=857319 2024-08-08T23:35:57.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.708+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~H9SRQVH4U25A.0 size=332479 2024-08-08T23:35:57.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.716+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=H9SRQVH4U25A tag=VEQIPQ2FAWV4 type=write size=1381055 2024-08-08T23:35:57.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.0 size=1048576 2024-08-08T23:35:57.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.1 size=1048576 2024-08-08T23:35:57.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.2 size=392343 2024-08-08T23:35:57.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.724+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=Z4UXQC11OBO4 tag=W9GJZ2VM2Z5J type=write size=3538071 2024-08-08T23:35:57.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.728+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~8O91VLL7K2M4.0 size=846273 2024-08-08T23:35:57.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.732+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=8O91VLL7K2M4 tag=0MKUBT6VYYSM type=write size=1894849 2024-08-08T23:35:57.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.736+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~EW8WLKC088GM.0 size=1048576 2024-08-08T23:35:57.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.740+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~EW8WLKC088GM.1 size=255029 2024-08-08T23:35:57.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.740+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=EW8WLKC088GM tag=WWOPRC8RAQ47 type=write size=2352181 2024-08-08T23:35:57.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.740+0000 7fdbd6e2c8c0 1 < canceled operation key=ZBEB2Q3J9Z0D tag=7LID9M2QOY63 type=del size=519402 2024-08-08T23:35:57.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.744+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=NCDOZXNK02Y0 type=del size=582865 2024-08-08T23:35:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.748+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=BWS5FGYDG3IH type=del size=2855292 2024-08-08T23:35:57.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.752+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=TEVP1PN0XSQ1 type=del size=2231235 2024-08-08T23:35:57.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.752+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=CRXX2EFV7RWL type=del 2024-08-08T23:35:57.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~9MTCMT9P9151.0 size=1048576 2024-08-08T23:35:57.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~9MTCMT9P9151.1 size=852277 2024-08-08T23:35:57.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.760+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=9MTCMT9P9151 tag=ERNE6R2Y26JD type=write size=2949429 2024-08-08T23:35:57.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.764+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~ZXOETJUQ2M3K.0 size=667684 2024-08-08T23:35:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.768+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=ZXOETJUQ2M3K tag=GDYM0E7N26DP type=write size=1716260 2024-08-08T23:35:57.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.772+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=06Z1UZEPYXWD type=write size=551327 2024-08-08T23:35:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.776+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=SUM4VOAIVFRB type=del 2024-08-08T23:35:57.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~YPULRY6JR12Z.0 size=296125 2024-08-08T23:35:57.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=YPULRY6JR12Z tag=WWV8TCZL9X1H type=write size=1344701 2024-08-08T23:35:57.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.784+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=WXGGAGF3MP14 type=write size=724224 2024-08-08T23:35:57.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~PWRL8NAZFPI0.0 size=1048576 2024-08-08T23:35:57.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~PWRL8NAZFPI0.1 size=505648 2024-08-08T23:35:57.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=PWRL8NAZFPI0 tag=XOYQL5Y8QYE4 type=write size=2602800 2024-08-08T23:35:57.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.792+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~ZS1DDG8ZTEFU.0 size=1048576 2024-08-08T23:35:57.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~ZS1DDG8ZTEFU.1 size=36443 2024-08-08T23:35:57.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.800+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=ZS1DDG8ZTEFU tag=GI9VZBQYVRRF type=write size=2133595 2024-08-08T23:35:57.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.804+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=NPYS14G0CGKQ type=del size=1402600 2024-08-08T23:35:57.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.808+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=XSBCAYSQ7EL1 type=del 2024-08-08T23:35:57.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.808+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=3D4TLEP68J33 type=del size=2126748 2024-08-08T23:35:57.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.812+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~8OJ6GZWW2GVZ.0 size=527087 2024-08-08T23:35:57.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.816+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=8OJ6GZWW2GVZ tag=KEGQ03BCYBU2 type=write size=1575663 2024-08-08T23:35:57.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~S3C139DNGPC8.0 size=812295 2024-08-08T23:35:57.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.820+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=S3C139DNGPC8 tag=OO7D0IQZNYD6 type=write size=1860871 2024-08-08T23:35:57.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.824+0000 7fdbd6e2c8c0 1 < suggested update operation key=0MT9FJO58ELX tag=1URH8L3WBBNC type=del size=2621244 2024-08-08T23:35:57.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.0 size=1048576 2024-08-08T23:35:57.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.1 size=1048576 2024-08-08T23:35:57.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.2 size=219535 2024-08-08T23:35:57.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.836+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=KZ02COWYE7KA tag=Z8A0PNZEWKVM type=write size=3365263 2024-08-08T23:35:57.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.836+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=0MT9FJO58ELX tag=22KPBFV0DHTT type=del size=621980: (22) Invalid argument 2024-08-08T23:35:57.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.840+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=MYMCDMWJS47E type=write size=1038765 2024-08-08T23:35:57.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.844+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=MEHPGOPTCV6I type=del 2024-08-08T23:35:57.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.848+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=AENGJ2L99W4I type=del size=1652815 2024-08-08T23:35:57.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.848+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V6GSJH62C8TA.2~HUEUFRKR9U3O.0 size=1048576 2024-08-08T23:35:57.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.852+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~HUEUFRKR9U3O.1 size=729279 2024-08-08T23:35:57.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.856+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V6GSJH62C8TA upload=HUEUFRKR9U3O tag=NP74FR7BED10 type=write size=2826431 2024-08-08T23:35:57.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~8XKHLMJ151D3.0 size=34928 2024-08-08T23:35:57.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.860+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=8XKHLMJ151D3 tag=WZEUOQ0ST9TX type=write size=1083504 2024-08-08T23:35:57.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.864+0000 7fdbd6e2c8c0 1 < suggested remove operation key=W5OVPO7BGE4S tag=7WH04MRZ1HVY type=write 2024-08-08T23:35:57.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.868+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=HK67P4OL6B7O type=del size=793919 2024-08-08T23:35:57.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.868+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.0 size=1048576 2024-08-08T23:35:57.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.872+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.1 size=1048576 2024-08-08T23:35:57.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.872+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~Z4UXQC11OBO4.2 size=392343 2024-08-08T23:35:57.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.876+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=Z4UXQC11OBO4 tag=W9GJZ2VM2Z5J type=write size=3538071 2024-08-08T23:35:57.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.880+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=5UXKV2M7547E type=del size=795821 2024-08-08T23:35:57.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~EW8WLKC088GM.0 size=1048576 2024-08-08T23:35:57.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~EW8WLKC088GM.1 size=255029 2024-08-08T23:35:57.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.888+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=EW8WLKC088GM tag=WWOPRC8RAQ47 type=write size=2352181 2024-08-08T23:35:57.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.892+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=ET81ZTIVB01S type=del size=689024 2024-08-08T23:35:57.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.896+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=NCDOZXNK02Y0 type=del 2024-08-08T23:35:57.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.904+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.0 size=1048576 2024-08-08T23:35:57.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.904+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.1 size=1048576 2024-08-08T23:35:57.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.2 size=254704 2024-08-08T23:35:57.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.908+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=R57O9Z3DC7R8 tag=1WKFRFMSLOU2 type=write size=3400432 2024-08-08T23:35:57.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.912+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=TEVP1PN0XSQ1 type=del 2024-08-08T23:35:57.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.920+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~P9MQ4PDR2TF0.0 size=1010357 2024-08-08T23:35:57.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.920+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=P9MQ4PDR2TF0 tag=FEL7CHH60TB7 type=write size=2058933 2024-08-08T23:35:57.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~9MTCMT9P9151.0 size=1048576 2024-08-08T23:35:57.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~9MTCMT9P9151.1 size=852277 2024-08-08T23:35:57.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.928+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=9MTCMT9P9151 tag=ERNE6R2Y26JD type=write size=2949429 2024-08-08T23:35:57.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.932+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.0 size=1048576 2024-08-08T23:35:57.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.1 size=1048576 2024-08-08T23:35:57.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.2 size=957669 2024-08-08T23:35:57.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.936+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=XSXPHW1P7JNC tag=T5AQ72NEACDT type=write size=4103397 2024-08-08T23:35:57.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.940+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=06Z1UZEPYXWD type=write size=551327 2024-08-08T23:35:57.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.944+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=5XPJRRASV3V0 type=write size=942699 2024-08-08T23:35:57.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.944+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~YPULRY6JR12Z.0 size=296125 2024-08-08T23:35:57.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.952+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=YPULRY6JR12Z tag=WWV8TCZL9X1H type=write size=1344701 2024-08-08T23:35:57.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.952+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=NX86BQT3Y7GJ type=del size=2645864 2024-08-08T23:35:57.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.956+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~PWRL8NAZFPI0.0 size=1048576 2024-08-08T23:35:57.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~PWRL8NAZFPI0.1 size=505648 2024-08-08T23:35:57.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.964+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=PWRL8NAZFPI0 tag=XOYQL5Y8QYE4 type=write size=2602800 2024-08-08T23:35:57.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.0 size=1048576 2024-08-08T23:35:57.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.1 size=1048576 2024-08-08T23:35:57.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.972+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.2 size=367851 2024-08-08T23:35:57.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.972+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=GXHOSREY8CAN tag=38XYHRFSRCLU type=write size=3513579 2024-08-08T23:35:57.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.976+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=0MT9FJO58ELX tag=NPYS14G0CGKQ type=del size=1402600: (22) Invalid argument 2024-08-08T23:35:57.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.976+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=RSPP4SV1ON3O type=write size=1002639 2024-08-08T23:35:57.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.980+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=3D4TLEP68J33 type=del 2024-08-08T23:35:57.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.984+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=DALLP020EI0K type=del size=484608 2024-08-08T23:35:57.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.984+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_41XLZV9ZY5OP.2~S3C139DNGPC8.0 size=812295 2024-08-08T23:35:57.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.988+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=41XLZV9ZY5OP upload=S3C139DNGPC8 tag=OO7D0IQZNYD6 type=write size=1860871 2024-08-08T23:35:57.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.992+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=YBENKJ3SZIOT type=write size=426138 2024-08-08T23:35:57.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.0 size=1048576 2024-08-08T23:35:57.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:57.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.1 size=1048576 2024-08-08T23:35:58.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.000+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~KZ02COWYE7KA.2 size=219535 2024-08-08T23:35:58.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.004+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=KZ02COWYE7KA tag=Z8A0PNZEWKVM type=write size=3365263 2024-08-08T23:35:58.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~V2BWU7ZPQC2T.0 size=516811 2024-08-08T23:35:58.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.012+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=V2BWU7ZPQC2T tag=HAJ4K10CHN2U type=write size=1565387 2024-08-08T23:35:58.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.012+0000 7fdbd6e2c8c0 1 < completed write operation key=0MT9FJO58ELX tag=MYMCDMWJS47E type=write size=1038765 2024-08-08T23:35:58.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.016+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=GLSUTSKR3BQ6 type=del size=563739 2024-08-08T23:35:58.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.020+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=AENGJ2L99W4I type=del 2024-08-08T23:35:58.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~R6H3T64HK8XT.0 size=1048576 2024-08-08T23:35:58.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.028+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~R6H3T64HK8XT.1 size=752407 2024-08-08T23:35:58.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.028+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=R6H3T64HK8XT tag=481TBLUPZ5QF type=write size=2849559 2024-08-08T23:35:58.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~8XKHLMJ151D3.0 size=34928 2024-08-08T23:35:58.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.032+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=8XKHLMJ151D3 tag=WZEUOQ0ST9TX type=write size=1083504 2024-08-08T23:35:58.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.036+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=V0R0KGDSFO1P type=del size=3032451 2024-08-08T23:35:58.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=HK67P4OL6B7O type=del 2024-08-08T23:35:58.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.040+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=4DAUWAEOUH9Y type=write size=81752 2024-08-08T23:35:58.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.040+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=5UXKV2M7547E type=del 2024-08-08T23:35:58.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.044+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=GJ61L5NIP3MN type=del size=372204 2024-08-08T23:35:58.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=ET81ZTIVB01S type=del 2024-08-08T23:35:58.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~AO14XY54UIUL.0 size=39400 2024-08-08T23:35:58.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.052+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=AO14XY54UIUL tag=WVA6S8IUJ042 type=write size=1087976 2024-08-08T23:35:58.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.0 size=1048576 2024-08-08T23:35:58.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.1 size=1048576 2024-08-08T23:35:58.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~R57O9Z3DC7R8.2 size=254704 2024-08-08T23:35:58.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=R57O9Z3DC7R8 tag=1WKFRFMSLOU2 type=write size=3400432 2024-08-08T23:35:58.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.064+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.0 size=1048576 2024-08-08T23:35:58.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.068+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.1 size=1048576 2024-08-08T23:35:58.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.068+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.2 size=316862 2024-08-08T23:35:58.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.068+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=JQA3ZXI3PSTO tag=SZDOLVCV6QTO type=write size=3462590 2024-08-08T23:35:58.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.072+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~P9MQ4PDR2TF0.0 size=1010357 2024-08-08T23:35:58.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.076+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=P9MQ4PDR2TF0 tag=FEL7CHH60TB7 type=write size=2058933 2024-08-08T23:35:58.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.080+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~6NA2JXMMTXX5.0 size=1048576 2024-08-08T23:35:58.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.080+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~6NA2JXMMTXX5.1 size=419589 2024-08-08T23:35:58.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.080+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=6NA2JXMMTXX5 tag=XYODRZVK37L3 type=write size=2516741 2024-08-08T23:35:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.0 size=1048576 2024-08-08T23:35:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.084+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.1 size=1048576 2024-08-08T23:35:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~XSXPHW1P7JNC.2 size=957669 2024-08-08T23:35:58.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.088+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QWRYLH4P94BQ upload=XSXPHW1P7JNC tag=T5AQ72NEACDT type=write size=4103397 2024-08-08T23:35:58.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.092+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=VZ277ASW3MUL type=del size=2969406 2024-08-08T23:35:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.092+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=5XPJRRASV3V0 type=write size=942699 2024-08-08T23:35:58.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.096+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=Z6QMJ8SNZTN1 type=del size=2281449 2024-08-08T23:35:58.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.100+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=NX86BQT3Y7GJ type=del size=2645864 2024-08-08T23:35:58.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.104+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=C960OT6EAJ1J type=del size=992797 2024-08-08T23:35:58.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.108+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.0 size=1048576 2024-08-08T23:35:58.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.108+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.1 size=1048576 2024-08-08T23:35:58.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.108+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~GXHOSREY8CAN.2 size=367851 2024-08-08T23:35:58.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.112+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=GXHOSREY8CAN tag=38XYHRFSRCLU type=write size=3513579 2024-08-08T23:35:58.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.116+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=CH71Z7COLJWK type=del size=2206343 2024-08-08T23:35:58.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.116+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=RSPP4SV1ON3O type=write size=1002639 2024-08-08T23:35:58.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.120+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=O1E3DC905WQ1 type=write size=986655 2024-08-08T23:35:58.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.124+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=DALLP020EI0K type=del 2024-08-08T23:35:58.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.128+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.0 size=1048576 2024-08-08T23:35:58.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.128+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.1 size=1048576 2024-08-08T23:35:58.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.132+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.2 size=946195 2024-08-08T23:35:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.132+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=ZBBL5NW0IXBC tag=YS7A0K4177FX type=write size=4091923 2024-08-08T23:35:58.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.136+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=YBENKJ3SZIOT type=write size=426138 2024-08-08T23:35:58.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.136+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=PTQQM4GT9ZZ1 type=del size=3301339 2024-08-08T23:35:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.140+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~V2BWU7ZPQC2T.0 size=516811 2024-08-08T23:35:58.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.148+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=V2BWU7ZPQC2T tag=HAJ4K10CHN2U type=write size=1565387 2024-08-08T23:35:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.148+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=S1DJMUXELJZ9 type=del size=1337020 2024-08-08T23:35:58.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.152+0000 7fdbd6e2c8c0 1 < suggested update operation key=0MT9FJO58ELX tag=GLSUTSKR3BQ6 type=del size=563739 2024-08-08T23:35:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.156+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=LB0T7S3WYAZ5 type=del size=3386911 2024-08-08T23:35:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~R6H3T64HK8XT.0 size=1048576 2024-08-08T23:35:58.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~R6H3T64HK8XT.1 size=752407 2024-08-08T23:35:58.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.164+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=R6H3T64HK8XT tag=481TBLUPZ5QF type=write size=2849559 2024-08-08T23:35:58.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.168+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=GZFPP8LMWI2A type=del size=513386 2024-08-08T23:35:58.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.172+0000 7fdbd6e2c8c0 1 < suggested update operation key=GMVEOO97I8YH tag=V0R0KGDSFO1P type=del size=3032451 2024-08-08T23:35:58.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.176+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=OX8A3QN9A442 type=del size=3629143 2024-08-08T23:35:58.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.180+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=4DAUWAEOUH9Y type=write size=81752 2024-08-08T23:35:58.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.180+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=3LX0XKYBG32W type=del size=1953265 2024-08-08T23:35:58.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.184+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=GJ61L5NIP3MN type=del 2024-08-08T23:35:58.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.184+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=GXJ6EG0UFEEV type=del size=979383 2024-08-08T23:35:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.188+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~AO14XY54UIUL.0 size=39400 2024-08-08T23:35:58.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.192+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=AO14XY54UIUL tag=WVA6S8IUJ042 type=write size=1087976 2024-08-08T23:35:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.200+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~Z3J3L27ISK1H.0 size=438688 2024-08-08T23:35:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.200+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=Z3J3L27ISK1H tag=3LJZBGPKYXFV type=write size=1487264 2024-08-08T23:35:58.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.204+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.0 size=1048576 2024-08-08T23:35:58.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.204+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.1 size=1048576 2024-08-08T23:35:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~JQA3ZXI3PSTO.2 size=316862 2024-08-08T23:35:58.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.212+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=JQA3ZXI3PSTO tag=SZDOLVCV6QTO type=write size=3462590 2024-08-08T23:35:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.216+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=HZHKV4ROTOMI type=write size=172387 2024-08-08T23:35:58.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.220+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~6NA2JXMMTXX5.0 size=1048576 2024-08-08T23:35:58.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.220+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~6NA2JXMMTXX5.1 size=419589 2024-08-08T23:35:58.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.228+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=6NA2JXMMTXX5 tag=XYODRZVK37L3 type=write size=2516741 2024-08-08T23:35:58.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.232+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=OTNV57FUKBL7 type=del size=2664583 2024-08-08T23:35:58.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.232+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=GMVEOO97I8YH tag=VZ277ASW3MUL type=del size=2969406: (22) Invalid argument 2024-08-08T23:35:58.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.236+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=7U9IOZB1ZJ1Z type=del size=3828871 2024-08-08T23:35:58.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.240+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=Z6QMJ8SNZTN1 type=del 2024-08-08T23:35:58.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.244+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=RQB7351EF1Y1 type=del size=226162 2024-08-08T23:35:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.248+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=C960OT6EAJ1J type=del 2024-08-08T23:35:58.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.252+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.0 size=1048576 2024-08-08T23:35:58.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.256+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.1 size=1048576 2024-08-08T23:35:58.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.2 size=820310 2024-08-08T23:35:58.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.260+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=6G046PQAWGK9 tag=BMQS1HNYBHR3 type=write size=3966038 2024-08-08T23:35:58.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.264+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=CH71Z7COLJWK type=del 2024-08-08T23:35:58.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~PN5Z9QLZKKAS.0 size=294897 2024-08-08T23:35:58.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.272+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=PN5Z9QLZKKAS tag=X1GC0W50DJKD type=write size=1343473 2024-08-08T23:35:58.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.276+0000 7fdbd6e2c8c0 1 < completed write operation key=41XLZV9ZY5OP tag=O1E3DC905WQ1 type=write size=986655 2024-08-08T23:35:58.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.276+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=8IH3EYQJIJF6 type=del size=1266156 2024-08-08T23:35:58.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.0 size=1048576 2024-08-08T23:35:58.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.280+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.1 size=1048576 2024-08-08T23:35:58.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~ZBBL5NW0IXBC.2 size=946195 2024-08-08T23:35:58.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.288+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=ZBBL5NW0IXBC tag=YS7A0K4177FX type=write size=4091923 2024-08-08T23:35:58.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.292+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=K667LWY4BA29 type=del size=4048062 2024-08-08T23:35:58.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.296+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=PTQQM4GT9ZZ1 type=del 2024-08-08T23:35:58.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.300+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=NLSBFWKMR2W8 type=del size=2534609 2024-08-08T23:35:58.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.304+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=S1DJMUXELJZ9 type=del 2024-08-08T23:35:58.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.304+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=H8Z4AXYUNXW7 type=del size=3738200 2024-08-08T23:35:58.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.308+0000 7fdbd6e2c8c0 1 < canceled operation key=XIXN9HLLSJS3 tag=LB0T7S3WYAZ5 type=del size=3386911 2024-08-08T23:35:58.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.312+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=VUHGY2UQPH1H type=del size=4116505 2024-08-08T23:35:58.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.316+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=GZFPP8LMWI2A type=del size=513386 2024-08-08T23:35:58.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.324+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~YZ20HRLEMVFN.0 size=165670 2024-08-08T23:35:58.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.324+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=YZ20HRLEMVFN tag=LNWZJHJS1K2U type=write size=1214246 2024-08-08T23:35:58.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.328+0000 7fdbd6e2c8c0 1 < suggested update operation key=903K2EO77YTJ tag=OX8A3QN9A442 type=del size=3629143 2024-08-08T23:35:58.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.332+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=HTOZ4VAJSHJN type=del size=3241364 2024-08-08T23:35:58.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.340+0000 7fdbd6e2c8c0 1 < suggested update operation key=QWRYLH4P94BQ tag=3LX0XKYBG32W type=del size=1953265 2024-08-08T23:35:58.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.344+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=C1LVEM4WERXG type=del size=3043269 2024-08-08T23:35:58.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.348+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=GXJ6EG0UFEEV type=del 2024-08-08T23:35:58.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.352+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=EVAONIBN8RIE type=del size=1050827 2024-08-08T23:35:58.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.356+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~Z3J3L27ISK1H.0 size=438688 2024-08-08T23:35:58.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.364+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=Z3J3L27ISK1H tag=3LJZBGPKYXFV type=write size=1487264 2024-08-08T23:35:58.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.368+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=KNYBDINI1XKE type=del size=922449 2024-08-08T23:35:58.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.376+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZBEB2Q3J9Z0D tag=HZHKV4ROTOMI type=write size=172387 2024-08-08T23:35:58.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.376+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=XY7X7NTV5RC9 type=del size=458625 2024-08-08T23:35:58.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.384+0000 7fdbd6e2c8c0 1 < suggested update operation key=464D0ROM6MHO tag=OTNV57FUKBL7 type=del size=2664583 2024-08-08T23:35:58.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.388+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=RLENYFL2T8DV type=write size=493279 2024-08-08T23:35:58.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.396+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=7U9IOZB1ZJ1Z type=del 2024-08-08T23:35:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.396+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=0E8C0BS087Q2 type=del size=630980 2024-08-08T23:35:58.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.400+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=RQB7351EF1Y1 type=del 2024-08-08T23:35:58.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.408+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~03F9D5BD9ZWI.0 size=1048576 2024-08-08T23:35:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.412+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~03F9D5BD9ZWI.1 size=840733 2024-08-08T23:35:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.412+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=03F9D5BD9ZWI tag=DLCRU4AAJS51 type=write size=2937885 2024-08-08T23:35:58.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.416+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.0 size=1048576 2024-08-08T23:35:58.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.1 size=1048576 2024-08-08T23:35:58.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~6G046PQAWGK9.2 size=820310 2024-08-08T23:35:58.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.428+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=6G046PQAWGK9 tag=BMQS1HNYBHR3 type=write size=3966038 2024-08-08T23:35:58.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~GQUBLHZA9IJW.0 size=739930 2024-08-08T23:35:58.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.436+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=GQUBLHZA9IJW tag=CZLDC849E80Z type=write size=1788506 2024-08-08T23:35:58.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.436+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~PN5Z9QLZKKAS.0 size=294897 2024-08-08T23:35:58.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.444+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=PN5Z9QLZKKAS tag=X1GC0W50DJKD type=write size=1343473 2024-08-08T23:35:58.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.448+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=0NV6HRMEPLUV type=del size=3523755 2024-08-08T23:35:58.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.452+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=8IH3EYQJIJF6 type=del 2024-08-08T23:35:58.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.456+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=KLUYJLC75O49 type=del size=539879 2024-08-08T23:35:58.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.464+0000 7fdbd6e2c8c0 1 < suggested update operation key=63GVT7KRKCSS tag=K667LWY4BA29 type=del size=4048062 2024-08-08T23:35:58.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.464+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=RKINUZ5NG5ME type=del size=2859153 2024-08-08T23:35:58.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.468+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=NLSBFWKMR2W8 type=del 2024-08-08T23:35:58.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.472+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=ZM22DC3RPXXD type=del size=2398923 2024-08-08T23:35:58.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.476+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=H8Z4AXYUNXW7 type=del 2024-08-08T23:35:58.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.480+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=YUUGCC3EMZVS type=del size=3877961 2024-08-08T23:35:58.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.480+0000 7fdbd6e2c8c0 1 < canceled operation key=VSLBN9AVZK00 tag=VUHGY2UQPH1H type=del size=4116505 2024-08-08T23:35:58.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.488+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~VVRVJP0JZ5B3.0 size=353670 2024-08-08T23:35:58.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.488+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=VVRVJP0JZ5B3 tag=TB4K5XZAZAQP type=write size=1402246 2024-08-08T23:35:58.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.492+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~YZ20HRLEMVFN.0 size=165670 2024-08-08T23:35:58.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.496+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=YZ20HRLEMVFN tag=LNWZJHJS1K2U type=write size=1214246 2024-08-08T23:35:58.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.500+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=5ZO432B2XERJ type=del size=2901973 2024-08-08T23:35:58.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.500+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=HTOZ4VAJSHJN type=del 2024-08-08T23:35:58.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.504+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=ES5LH100QNQ6 type=del size=423528 2024-08-08T23:35:58.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.508+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=C1LVEM4WERXG type=del 2024-08-08T23:35:58.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.512+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=ENWHFW8S4VKI type=del size=327078 2024-08-08T23:35:58.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.516+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=EVAONIBN8RIE type=del size=1050827 2024-08-08T23:35:58.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~XPJTD3RC34BP.0 size=1048576 2024-08-08T23:35:58.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.524+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~XPJTD3RC34BP.1 size=717058 2024-08-08T23:35:58.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.524+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=XPJTD3RC34BP tag=02ADQTJSUZM1 type=write size=2814210 2024-08-08T23:35:58.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.528+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=KNYBDINI1XKE type=del 2024-08-08T23:35:58.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.528+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=YOLSNI0E24B4 type=del size=3397086 2024-08-08T23:35:58.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.532+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=XY7X7NTV5RC9 type=del 2024-08-08T23:35:58.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~24RFGISPOSWJ.0 size=110245 2024-08-08T23:35:58.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.536+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=24RFGISPOSWJ tag=WG5P7SVJRA50 type=write size=1158821 2024-08-08T23:35:58.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.540+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=RLENYFL2T8DV type=write size=493279 2024-08-08T23:35:58.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.544+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=GWDFR2236NZ9 type=write size=775785 2024-08-08T23:35:58.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.548+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=0E8C0BS087Q2 type=del 2024-08-08T23:35:58.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.552+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~RDI60Q7L3560.0 size=1048576 2024-08-08T23:35:58.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~RDI60Q7L3560.1 size=979506 2024-08-08T23:35:58.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=RDI60Q7L3560 tag=RE2OTCMMBQDN type=write size=3076658 2024-08-08T23:35:58.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.556+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~03F9D5BD9ZWI.0 size=1048576 2024-08-08T23:35:58.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.556+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QJB9DETMSY4X.2~03F9D5BD9ZWI.1 size=840733 2024-08-08T23:35:58.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.564+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QJB9DETMSY4X upload=03F9D5BD9ZWI tag=DLCRU4AAJS51 type=write size=2937885 2024-08-08T23:35:58.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.564+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=AH12LGNBL2LB type=del size=1446491 2024-08-08T23:35:58.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.568+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~GQUBLHZA9IJW.0 size=739930 2024-08-08T23:35:58.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.572+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=GQUBLHZA9IJW tag=CZLDC849E80Z type=write size=1788506 2024-08-08T23:35:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.576+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=9MV9A8Q6RG39 type=del size=177338 2024-08-08T23:35:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.584+0000 7fdbd6e2c8c0 1 < suggested remove operation key=D81PQ0FJVNEE tag=0NV6HRMEPLUV type=del 2024-08-08T23:35:58.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.588+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=WS18L88DV3U7 type=write size=909165 2024-08-08T23:35:58.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.588+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=KLUYJLC75O49 type=del 2024-08-08T23:35:58.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.596+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~BYUQAA1VX034.0 size=807569 2024-08-08T23:35:58.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.596+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=BYUQAA1VX034 tag=C2JH2F3HQ9RN type=write size=1856145 2024-08-08T23:35:58.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.604+0000 7fdbd6e2c8c0 1 < suggested remove operation key=MNV404EWJHC1 tag=RKINUZ5NG5ME type=del 2024-08-08T23:35:58.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.608+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~OJAKWMDB82WI.0 size=1017728 2024-08-08T23:35:58.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.608+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=OJAKWMDB82WI tag=TYNLM7FUCN8O type=write size=2066304 2024-08-08T23:35:58.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.612+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=ZM22DC3RPXXD type=del 2024-08-08T23:35:58.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.616+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=5B9T2LQ6ZZET type=del size=1352711 2024-08-08T23:35:58.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.620+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=YUUGCC3EMZVS type=del 2024-08-08T23:35:58.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.620+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=NC9C4UJC3B16 type=del size=1837503 2024-08-08T23:35:58.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.624+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~VVRVJP0JZ5B3.0 size=353670 2024-08-08T23:35:58.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.628+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=VVRVJP0JZ5B3 tag=TB4K5XZAZAQP type=write size=1402246 2024-08-08T23:35:58.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.636+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.0 size=1048576 2024-08-08T23:35:58.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.636+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.1 size=1048576 2024-08-08T23:35:58.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.640+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.2 size=1040439 2024-08-08T23:35:58.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.640+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=U972UPN2E0U7 tag=2ZO9Q9WQ4MN0 type=write size=4186167 2024-08-08T23:35:58.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.644+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=MNV404EWJHC1 tag=5ZO432B2XERJ type=del size=2901973: (22) Invalid argument 2024-08-08T23:35:58.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.648+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=6UD0T59EPISA type=del size=3690441 2024-08-08T23:35:58.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.648+0000 7fdbd6e2c8c0 1 < canceled operation key=JWTLJG79MYI5 tag=ES5LH100QNQ6 type=del size=423528 2024-08-08T23:35:58.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.652+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=SC4JUPKQ4JIV type=del size=2874015 2024-08-08T23:35:58.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.656+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=ENWHFW8S4VKI type=del 2024-08-08T23:35:58.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.660+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=DYUJN8BX9L4P type=del size=122172 2024-08-08T23:35:58.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.660+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~XPJTD3RC34BP.0 size=1048576 2024-08-08T23:35:58.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~XPJTD3RC34BP.1 size=717058 2024-08-08T23:35:58.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.668+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=XPJTD3RC34BP tag=02ADQTJSUZM1 type=write size=2814210 2024-08-08T23:35:58.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.672+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=D9EEFEA9951K type=del size=2046975 2024-08-08T23:35:58.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.676+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=YOLSNI0E24B4 type=del 2024-08-08T23:35:58.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.676+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=LOMQ4S91P5FL type=write size=406488 2024-08-08T23:35:58.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.680+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~24RFGISPOSWJ.0 size=110245 2024-08-08T23:35:58.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.684+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=24RFGISPOSWJ tag=WG5P7SVJRA50 type=write size=1158821 2024-08-08T23:35:58.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.688+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=UYZ5ACFOVFXS type=del size=3103610 2024-08-08T23:35:58.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.692+0000 7fdbd6e2c8c0 1 < suggested update operation key=QANZ3YTL2NQV tag=GWDFR2236NZ9 type=write size=775785 2024-08-08T23:35:58.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.696+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=1K2PJG9K2UUX type=del size=688972 2024-08-08T23:35:58.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.700+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~RDI60Q7L3560.0 size=1048576 2024-08-08T23:35:58.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.700+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~RDI60Q7L3560.1 size=979506 2024-08-08T23:35:58.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.708+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=RDI60Q7L3560 tag=RE2OTCMMBQDN type=write size=3076658 2024-08-08T23:35:58.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.708+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=C0PW9WHDOMTC type=del size=2769424 2024-08-08T23:35:58.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.712+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=AH12LGNBL2LB type=del 2024-08-08T23:35:58.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.712+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=O3IQ0H6Y78GW type=del size=3203282 2024-08-08T23:35:58.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.716+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=9MV9A8Q6RG39 type=del 2024-08-08T23:35:58.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.0 size=1048576 2024-08-08T23:35:58.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.1 size=1048576 2024-08-08T23:35:58.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.2 size=358027 2024-08-08T23:35:58.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.724+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=GNUMOZDRY4YU tag=Y0GFNY0GUR82 type=write size=3503755 2024-08-08T23:35:58.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.728+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=WS18L88DV3U7 type=write size=909165 2024-08-08T23:35:58.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.732+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~BHWRM7Z4I3FI.0 size=1048576 2024-08-08T23:35:58.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.736+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~BHWRM7Z4I3FI.1 size=354849 2024-08-08T23:35:58.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.736+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=BHWRM7Z4I3FI tag=MIZQ8862NUU5 type=write size=2452001 2024-08-08T23:35:58.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.736+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~BYUQAA1VX034.0 size=807569 2024-08-08T23:35:58.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.744+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=BYUQAA1VX034 tag=C2JH2F3HQ9RN type=write size=1856145 2024-08-08T23:35:58.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.748+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=D3ULFKYHIH9U type=del size=1010203 2024-08-08T23:35:58.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.748+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~OJAKWMDB82WI.0 size=1017728 2024-08-08T23:35:58.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.752+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=OJAKWMDB82WI tag=TYNLM7FUCN8O type=write size=2066304 2024-08-08T23:35:58.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.756+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~NZ6TYCXXGZHT.0 size=200558 2024-08-08T23:35:58.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.756+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=NZ6TYCXXGZHT tag=Y2IMEQ2IQ40U type=write size=1249134 2024-08-08T23:35:58.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.760+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=5B9T2LQ6ZZET type=del 2024-08-08T23:35:58.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.760+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=0NCJXR00T19L type=del size=1320503 2024-08-08T23:35:58.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.764+0000 7fdbd6e2c8c0 1 < canceled operation key=0XF26POOKR3V tag=NC9C4UJC3B16 type=del size=1837503 2024-08-08T23:35:58.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.768+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~8LUZOP42FS2K.0 size=1048576 2024-08-08T23:35:58.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~8LUZOP42FS2K.1 size=998872 2024-08-08T23:35:58.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.772+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=8LUZOP42FS2K tag=T1SHJRL0TTPS type=write size=3096024 2024-08-08T23:35:58.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.776+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.0 size=1048576 2024-08-08T23:35:58.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.776+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.1 size=1048576 2024-08-08T23:35:58.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.780+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~U972UPN2E0U7.2 size=1040439 2024-08-08T23:35:58.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.784+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=U972UPN2E0U7 tag=2ZO9Q9WQ4MN0 type=write size=4186167 2024-08-08T23:35:58.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.0 size=1048576 2024-08-08T23:35:58.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.1 size=1048576 2024-08-08T23:35:58.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.2 size=129465 2024-08-08T23:35:58.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=XPX63LVV3CIP tag=8CJX5OXPJBGG type=write size=3275193 2024-08-08T23:35:58.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.796+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QANZ3YTL2NQV tag=6UD0T59EPISA type=del size=3690441: (22) Invalid argument 2024-08-08T23:35:58.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.800+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~UQD5JT682TRA.0 size=1048576 2024-08-08T23:35:58.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.800+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~UQD5JT682TRA.1 size=36437 2024-08-08T23:35:58.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.800+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=UQD5JT682TRA tag=68704QN166XM type=write size=2133589 2024-08-08T23:35:58.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.804+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=SC4JUPKQ4JIV type=del 2024-08-08T23:35:58.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.808+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=PVQFOI2K57YF type=del size=4147916 2024-08-08T23:35:58.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.808+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=DYUJN8BX9L4P type=del 2024-08-08T23:35:58.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.812+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=B9TDU8MBHQFN type=write size=1463 2024-08-08T23:35:58.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.812+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QANZ3YTL2NQV tag=D9EEFEA9951K type=del size=2046975: (22) Invalid argument 2024-08-08T23:35:58.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.816+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~ZC8IG33EII7E.0 size=1048576 2024-08-08T23:35:58.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~ZC8IG33EII7E.1 size=945933 2024-08-08T23:35:58.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.820+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=ZC8IG33EII7E tag=TQFULLW5IK40 type=write size=3043085 2024-08-08T23:35:58.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.824+0000 7fdbd6e2c8c0 1 < suggested update operation key=2SO6IPMXZUUI tag=LOMQ4S91P5FL type=write size=406488 2024-08-08T23:35:58.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~3WRHAHJHAHLV.0 size=1048576 2024-08-08T23:35:58.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~3WRHAHJHAHLV.1 size=348817 2024-08-08T23:35:58.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.828+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=3WRHAHJHAHLV tag=91QBBJGIA30H type=write size=2445969 2024-08-08T23:35:58.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.832+0000 7fdbd6e2c8c0 1 < canceled operation key=FWZ5TEP1P2LK tag=UYZ5ACFOVFXS type=del size=3103610 2024-08-08T23:35:58.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~ISD6DZCILLFB.0 size=1048576 2024-08-08T23:35:58.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~ISD6DZCILLFB.1 size=455818 2024-08-08T23:35:58.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.836+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=ISD6DZCILLFB tag=46W5MNW0N6E2 type=write size=2552970 2024-08-08T23:35:58.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.840+0000 7fdbd6e2c8c0 1 < canceled operation key=FBCEC998C8EJ tag=1K2PJG9K2UUX type=del size=688972 2024-08-08T23:35:58.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.840+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=9SHJL7F8EZ15 type=del size=3035652 2024-08-08T23:35:58.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.844+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=C0PW9WHDOMTC type=del 2024-08-08T23:35:58.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.844+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=0QTEJIF8NM9A type=del size=1275655 2024-08-08T23:35:58.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.848+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=O3IQ0H6Y78GW type=del 2024-08-08T23:35:58.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.848+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=3GYSV5MMVAKH type=del size=2598273 2024-08-08T23:35:58.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.852+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.0 size=1048576 2024-08-08T23:35:58.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.856+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.1 size=1048576 2024-08-08T23:35:58.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.856+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~GNUMOZDRY4YU.2 size=358027 2024-08-08T23:35:58.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.860+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=GNUMOZDRY4YU tag=Y0GFNY0GUR82 type=write size=3503755 2024-08-08T23:35:58.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~7JZ5MG30W89C.0 size=638497 2024-08-08T23:35:58.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.864+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=7JZ5MG30W89C tag=ZS09ZNKAF5KE type=write size=1687073 2024-08-08T23:35:58.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.864+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~BHWRM7Z4I3FI.0 size=1048576 2024-08-08T23:35:58.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~BHWRM7Z4I3FI.1 size=354849 2024-08-08T23:35:58.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.872+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=BHWRM7Z4I3FI tag=MIZQ8862NUU5 type=write size=2452001 2024-08-08T23:35:58.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.0 size=1048576 2024-08-08T23:35:58.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.1 size=1048576 2024-08-08T23:35:58.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.2 size=756502 2024-08-08T23:35:58.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.876+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=YUO0IKHT4WGC tag=UMHECFXC0IC1 type=write size=3902230 2024-08-08T23:35:58.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.880+0000 7fdbd6e2c8c0 1 < canceled operation key=ZQ8GOX9RSTBB tag=D3ULFKYHIH9U type=del size=1010203 2024-08-08T23:35:58.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.884+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=8QFZOJ25W1YW type=del size=4068008 2024-08-08T23:35:58.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.884+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~NZ6TYCXXGZHT.0 size=200558 2024-08-08T23:35:58.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.888+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QANZ3YTL2NQV upload=NZ6TYCXXGZHT tag=Y2IMEQ2IQ40U type=write size=1249134 2024-08-08T23:35:58.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~3G863MZFFVU6.0 size=1048576 2024-08-08T23:35:58.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~3G863MZFFVU6.1 size=609444 2024-08-08T23:35:58.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.892+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=3G863MZFFVU6 tag=R9UAKWI4MFBI type=write size=2706596 2024-08-08T23:35:58.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.896+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=0NCJXR00T19L type=del 2024-08-08T23:35:58.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.900+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~GGXNRQEE0Q93.0 size=1048576 2024-08-08T23:35:58.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.900+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~GGXNRQEE0Q93.1 size=925869 2024-08-08T23:35:58.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.900+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=GGXNRQEE0Q93 tag=3W4R1YNNEOE8 type=write size=3023021 2024-08-08T23:35:58.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~8LUZOP42FS2K.0 size=1048576 2024-08-08T23:35:58.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~8LUZOP42FS2K.1 size=998872 2024-08-08T23:35:58.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.908+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=8LUZOP42FS2K tag=T1SHJRL0TTPS type=write size=3096024 2024-08-08T23:35:58.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.912+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=U5WLWHJ1B2F1 type=del size=3134055 2024-08-08T23:35:58.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.912+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.0 size=1048576 2024-08-08T23:35:58.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.1 size=1048576 2024-08-08T23:35:58.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~XPX63LVV3CIP.2 size=129465 2024-08-08T23:35:58.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.920+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=XPX63LVV3CIP tag=8CJX5OXPJBGG type=write size=3275193 2024-08-08T23:35:58.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.924+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=WON9OE1LV77K type=del size=1240910 2024-08-08T23:35:58.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~UQD5JT682TRA.0 size=1048576 2024-08-08T23:35:58.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.924+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~UQD5JT682TRA.1 size=36437 2024-08-08T23:35:58.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.928+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=UQD5JT682TRA tag=68704QN166XM type=write size=2133589 2024-08-08T23:35:58.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.932+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=Q3IVZAG9B2RS type=del size=1429196 2024-08-08T23:35:58.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.936+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=PVQFOI2K57YF type=del 2024-08-08T23:35:58.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.944+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~8Z5Q33I4CC41.0 size=734793 2024-08-08T23:35:58.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.944+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=8Z5Q33I4CC41 tag=VYUXCIDHHZ0S type=write size=1783369 2024-08-08T23:35:58.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.948+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=B9TDU8MBHQFN type=write size=1463 2024-08-08T23:35:58.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.0 size=1048576 2024-08-08T23:35:58.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.1 size=1048576 2024-08-08T23:35:58.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.2 size=113185 2024-08-08T23:35:58.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=ZV8UHQJB0PXO tag=V70LEHXG8FEE type=write size=3258913 2024-08-08T23:35:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~ZC8IG33EII7E.0 size=1048576 2024-08-08T23:35:58.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~ZC8IG33EII7E.1 size=945933 2024-08-08T23:35:58.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.972+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=ZC8IG33EII7E tag=TQFULLW5IK40 type=write size=3043085 2024-08-08T23:35:58.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.972+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=B6F4UIX1FD5P type=del size=3054982 2024-08-08T23:35:58.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.976+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~3WRHAHJHAHLV.0 size=1048576 2024-08-08T23:35:58.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.976+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_Z5EXY8ZHZCHI.2~3WRHAHJHAHLV.1 size=348817 2024-08-08T23:35:58.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.980+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=Z5EXY8ZHZCHI upload=3WRHAHJHAHLV tag=91QBBJGIA30H type=write size=2445969 2024-08-08T23:35:58.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.984+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=3Q438S4FEJYV type=write size=419164 2024-08-08T23:35:58.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.984+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~ISD6DZCILLFB.0 size=1048576 2024-08-08T23:35:58.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.988+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~ISD6DZCILLFB.1 size=455818 2024-08-08T23:35:58.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.992+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=ISD6DZCILLFB tag=46W5MNW0N6E2 type=write size=2552970 2024-08-08T23:35:58.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:58.996+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=9QFFSJM3A0BC type=del size=1236847 2024-08-08T23:35:59.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.000+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=9SHJL7F8EZ15 type=del 2024-08-08T23:35:59.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.000+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=2V8XQ1U2GBUD type=del size=2188779 2024-08-08T23:35:59.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.004+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=V3TA5KZ95NXT tag=0QTEJIF8NM9A type=del size=1275655: (22) Invalid argument 2024-08-08T23:35:59.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.008+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=9D9YFQN8EL62 type=del size=1579561 2024-08-08T23:35:59.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.008+0000 7fdbd6e2c8c0 1 < canceled operation key=VSLBN9AVZK00 tag=3GYSV5MMVAKH type=del size=2598273 2024-08-08T23:35:59.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.016+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~36FH2M4JSPHQ.0 size=1007752 2024-08-08T23:35:59.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.016+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=36FH2M4JSPHQ tag=A4NJKX12L7UA type=write size=2056328 2024-08-08T23:35:59.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.016+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~7JZ5MG30W89C.0 size=638497 2024-08-08T23:35:59.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.020+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=7JZ5MG30W89C tag=ZS09ZNKAF5KE type=write size=1687073 2024-08-08T23:35:59.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.024+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=PC2RIUD2BT47 type=del size=1434854 2024-08-08T23:35:59.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.0 size=1048576 2024-08-08T23:35:59.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.1 size=1048576 2024-08-08T23:35:59.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.032+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~YUO0IKHT4WGC.2 size=756502 2024-08-08T23:35:59.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.036+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=YUO0IKHT4WGC tag=UMHECFXC0IC1 type=write size=3902230 2024-08-08T23:35:59.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.036+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=W6ZDVUD8D5GJ type=del size=2905082 2024-08-08T23:35:59.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.044+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=8QFZOJ25W1YW type=del 2024-08-08T23:35:59.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.044+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=R3RSURFEKQIT type=del size=2847386 2024-08-08T23:35:59.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.048+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~3G863MZFFVU6.0 size=1048576 2024-08-08T23:35:59.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~3G863MZFFVU6.1 size=609444 2024-08-08T23:35:59.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.056+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=3G863MZFFVU6 tag=R9UAKWI4MFBI type=write size=2706596 2024-08-08T23:35:59.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.060+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=V3GH0126ZGZY type=del size=1825868 2024-08-08T23:35:59.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.064+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~GGXNRQEE0Q93.0 size=1048576 2024-08-08T23:35:59.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.064+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~GGXNRQEE0Q93.1 size=925869 2024-08-08T23:35:59.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.068+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=GGXNRQEE0Q93 tag=3W4R1YNNEOE8 type=write size=3023021 2024-08-08T23:35:59.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.072+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=TRS85763DFZH type=del size=3056560 2024-08-08T23:35:59.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.076+0000 7fdbd6e2c8c0 1 < canceled operation key=ZBEB2Q3J9Z0D tag=U5WLWHJ1B2F1 type=del size=3134055 2024-08-08T23:35:59.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.076+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=8XR7PMATOGHI type=write size=784052 2024-08-08T23:35:59.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.080+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=VSLBN9AVZK00 tag=WON9OE1LV77K type=del size=1240910: (22) Invalid argument 2024-08-08T23:35:59.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.084+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=26S11C2T3SOU type=del size=44242 2024-08-08T23:35:59.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.084+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=Q3IVZAG9B2RS type=del 2024-08-08T23:35:59.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.092+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~F9MKAG1IV524.0 size=1048576 2024-08-08T23:35:59.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.092+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~F9MKAG1IV524.1 size=112216 2024-08-08T23:35:59.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.092+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=F9MKAG1IV524 tag=IJ5P0YP9KT7L type=write size=2209368 2024-08-08T23:35:59.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~8Z5Q33I4CC41.0 size=734793 2024-08-08T23:35:59.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.100+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=8Z5Q33I4CC41 tag=VYUXCIDHHZ0S type=write size=1783369 2024-08-08T23:35:59.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.108+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.0 size=1048576 2024-08-08T23:35:59.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.108+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.1 size=1048576 2024-08-08T23:35:59.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.112+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.2 size=802548 2024-08-08T23:35:59.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.112+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=C319W207SQXG tag=DOVKYM0YRO4L type=write size=3948276 2024-08-08T23:35:59.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.0 size=1048576 2024-08-08T23:35:59.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.1 size=1048576 2024-08-08T23:35:59.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~ZV8UHQJB0PXO.2 size=113185 2024-08-08T23:35:59.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.124+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=ZV8UHQJB0PXO tag=V70LEHXG8FEE type=write size=3258913 2024-08-08T23:35:59.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.128+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=TA0OGFO688O4 type=del size=290583 2024-08-08T23:35:59.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.132+0000 7fdbd6e2c8c0 1 < suggested update operation key=QJB9DETMSY4X tag=B6F4UIX1FD5P type=del size=3054982 2024-08-08T23:35:59.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.136+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=DNP1QKPNZTFK type=del size=3188179 2024-08-08T23:35:59.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.140+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=3Q438S4FEJYV type=write size=419164 2024-08-08T23:35:59.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.0 size=1048576 2024-08-08T23:35:59.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.1 size=1048576 2024-08-08T23:35:59.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.148+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.2 size=667338 2024-08-08T23:35:59.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.148+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=IZR13AKNZ04O tag=2B61E5E47ENC type=write size=3813066 2024-08-08T23:35:59.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.148+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=9QFFSJM3A0BC type=del 2024-08-08T23:35:59.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.152+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=D6X5VZF7OAJB type=del size=1645934 2024-08-08T23:35:59.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.156+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=2V8XQ1U2GBUD type=del 2024-08-08T23:35:59.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.160+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~7JAY66PL580Q.0 size=870851 2024-08-08T23:35:59.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.160+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=7JAY66PL580Q tag=KI6OXRC093IF type=write size=1919427 2024-08-08T23:35:59.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.164+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=9D9YFQN8EL62 type=del 2024-08-08T23:35:59.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~WXWKDH9EJ45R.0 size=1048576 2024-08-08T23:35:59.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~WXWKDH9EJ45R.1 size=1045493 2024-08-08T23:35:59.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=WXWKDH9EJ45R tag=SMD49NEC15V6 type=write size=3142645 2024-08-08T23:35:59.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~36FH2M4JSPHQ.0 size=1007752 2024-08-08T23:35:59.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.176+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=36FH2M4JSPHQ tag=A4NJKX12L7UA type=write size=2056328 2024-08-08T23:35:59.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.0 size=1048576 2024-08-08T23:35:59.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.1 size=1048576 2024-08-08T23:35:59.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.188+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.2 size=666965 2024-08-08T23:35:59.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.188+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=UYQE9C8MQ10X tag=QXIJ6JZK7Y2N type=write size=3812693 2024-08-08T23:35:59.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.188+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=PC2RIUD2BT47 type=del size=1434854 2024-08-08T23:35:59.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.192+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=HXPZ2FEYNF9T type=del size=410216 2024-08-08T23:35:59.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.196+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=W6ZDVUD8D5GJ type=del 2024-08-08T23:35:59.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.200+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~53W2L6SZIXIX.0 size=404670 2024-08-08T23:35:59.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.200+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=53W2L6SZIXIX tag=0OR71AFFFQQA type=write size=1453246 2024-08-08T23:35:59.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.204+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=R3RSURFEKQIT type=del 2024-08-08T23:35:59.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~56ZRP15P5LTE.0 size=40356 2024-08-08T23:35:59.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.208+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=56ZRP15P5LTE tag=4REP1TVK3AFQ type=write size=1088932 2024-08-08T23:35:59.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.212+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=V3GH0126ZGZY type=del 2024-08-08T23:35:59.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~Y7C0L406T2ZB.0 size=910612 2024-08-08T23:35:59.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.216+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=Y7C0L406T2ZB tag=X2J0CIO8ZTGP type=write size=1959188 2024-08-08T23:35:59.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.216+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=TRS85763DFZH type=del 2024-08-08T23:35:59.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.0 size=1048576 2024-08-08T23:35:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.1 size=1048576 2024-08-08T23:35:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.2 size=648856 2024-08-08T23:35:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.228+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=D7ZB3F9DMEC2 tag=42SRYF5ODFLH type=write size=3794584 2024-08-08T23:35:59.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.232+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=8XR7PMATOGHI type=write size=784052 2024-08-08T23:35:59.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.232+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=D60SXT40D0BD type=write size=739726 2024-08-08T23:35:59.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.236+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=26S11C2T3SOU type=del 2024-08-08T23:35:59.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.236+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=P3A7KNMPJKD3 type=del size=1932171 2024-08-08T23:35:59.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.240+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~F9MKAG1IV524.0 size=1048576 2024-08-08T23:35:59.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.240+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~F9MKAG1IV524.1 size=112216 2024-08-08T23:35:59.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.244+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=F9MKAG1IV524 tag=IJ5P0YP9KT7L type=write size=2209368 2024-08-08T23:35:59.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.248+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~ZXE6V6S5VJKE.0 size=897403 2024-08-08T23:35:59.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.248+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=ZXE6V6S5VJKE tag=1SCGMKDI2KT4 type=write size=1945979 2024-08-08T23:35:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.0 size=1048576 2024-08-08T23:35:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.1 size=1048576 2024-08-08T23:35:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.256+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QANZ3YTL2NQV.2~C319W207SQXG.2 size=802548 2024-08-08T23:35:59.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.260+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QANZ3YTL2NQV upload=C319W207SQXG tag=DOVKYM0YRO4L type=write size=3948276 2024-08-08T23:35:59.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~U0KSIUXHB9LJ.0 size=1048576 2024-08-08T23:35:59.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~U0KSIUXHB9LJ.1 size=144190 2024-08-08T23:35:59.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=U0KSIUXHB9LJ tag=SP8FMUUKKKSK type=write size=2241342 2024-08-08T23:35:59.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.268+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=TA0OGFO688O4 type=del 2024-08-08T23:35:59.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.272+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=PO9M0J61VGZK type=del size=162376 2024-08-08T23:35:59.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.272+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=DNP1QKPNZTFK type=del 2024-08-08T23:35:59.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.276+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=OURI69OCTWKR type=del size=98368 2024-08-08T23:35:59.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.0 size=1048576 2024-08-08T23:35:59.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.1 size=1048576 2024-08-08T23:35:59.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~IZR13AKNZ04O.2 size=667338 2024-08-08T23:35:59.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.288+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=IZR13AKNZ04O tag=2B61E5E47ENC type=write size=3813066 2024-08-08T23:35:59.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.288+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=Q5JNN2LRAOV2 type=write size=209730 2024-08-08T23:35:59.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.292+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=D6X5VZF7OAJB type=del 2024-08-08T23:35:59.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.296+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=IK90N1H88T27 type=del size=3402832 2024-08-08T23:35:59.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.296+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~7JAY66PL580Q.0 size=870851 2024-08-08T23:35:59.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.300+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=7JAY66PL580Q tag=KI6OXRC093IF type=write size=1919427 2024-08-08T23:35:59.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.304+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=3OFX5O5TFLJ3 type=del size=3145221 2024-08-08T23:35:59.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.304+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~WXWKDH9EJ45R.0 size=1048576 2024-08-08T23:35:59.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.304+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~WXWKDH9EJ45R.1 size=1045493 2024-08-08T23:35:59.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.308+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=WXWKDH9EJ45R tag=SMD49NEC15V6 type=write size=3142645 2024-08-08T23:35:59.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.312+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=J56DBP1DWKPI type=del size=2345356 2024-08-08T23:35:59.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.312+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.0 size=1048576 2024-08-08T23:35:59.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.316+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.1 size=1048576 2024-08-08T23:35:59.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.316+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~UYQE9C8MQ10X.2 size=666965 2024-08-08T23:35:59.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.320+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=UYQE9C8MQ10X tag=QXIJ6JZK7Y2N type=write size=3812693 2024-08-08T23:35:59.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.324+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=YJFEXW41FBQJ type=del size=2871996 2024-08-08T23:35:59.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.324+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=HXPZ2FEYNF9T type=del 2024-08-08T23:35:59.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.0 size=1048576 2024-08-08T23:35:59.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.1 size=1048576 2024-08-08T23:35:59.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.2 size=214918 2024-08-08T23:35:59.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.336+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=J073D7QR9KH6 tag=86U6CG6B6B7Z type=write size=3360646 2024-08-08T23:35:59.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.336+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~53W2L6SZIXIX.0 size=404670 2024-08-08T23:35:59.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.340+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=53W2L6SZIXIX tag=0OR71AFFFQQA type=write size=1453246 2024-08-08T23:35:59.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.344+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.0 size=1048576 2024-08-08T23:35:59.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.1 size=1048576 2024-08-08T23:35:59.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.2 size=980821 2024-08-08T23:35:59.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.348+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=L1M21823QD0K tag=LSRF8AR4WQRV type=write size=4126549 2024-08-08T23:35:59.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~56ZRP15P5LTE.0 size=40356 2024-08-08T23:35:59.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.356+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=56ZRP15P5LTE tag=4REP1TVK3AFQ type=write size=1088932 2024-08-08T23:35:59.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.360+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=J001Y85ZGLCO type=del size=2971215 2024-08-08T23:35:59.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.360+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~Y7C0L406T2ZB.0 size=910612 2024-08-08T23:35:59.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.364+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=Y7C0L406T2ZB tag=X2J0CIO8ZTGP type=write size=1959188 2024-08-08T23:35:59.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.368+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=LRE0RQS57JD8 type=del size=1312293 2024-08-08T23:35:59.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.368+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.0 size=1048576 2024-08-08T23:35:59.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.1 size=1048576 2024-08-08T23:35:59.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~D7ZB3F9DMEC2.2 size=648856 2024-08-08T23:35:59.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.376+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=D7ZB3F9DMEC2 tag=42SRYF5ODFLH type=write size=3794584 2024-08-08T23:35:59.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.380+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=2AUOSMMKDOBQ type=del size=2151159 2024-08-08T23:35:59.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.380+0000 7fdbd6e2c8c0 1 < canceled operation key=QJB9DETMSY4X tag=D60SXT40D0BD type=write size=739726 2024-08-08T23:35:59.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.384+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~DAE9SQ5UMEIH.0 size=1048576 2024-08-08T23:35:59.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~DAE9SQ5UMEIH.1 size=112864 2024-08-08T23:35:59.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.388+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=DAE9SQ5UMEIH tag=28MDF7EXEDSK type=write size=2210016 2024-08-08T23:35:59.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.388+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=P3A7KNMPJKD3 type=del 2024-08-08T23:35:59.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.396+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~WY3FR9W7KKOB.0 size=1048576 2024-08-08T23:35:59.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.396+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~WY3FR9W7KKOB.1 size=268066 2024-08-08T23:35:59.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.396+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=WY3FR9W7KKOB tag=5X7ZQHECMXEL type=write size=2365218 2024-08-08T23:35:59.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.400+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~ZXE6V6S5VJKE.0 size=897403 2024-08-08T23:35:59.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.404+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=ZXE6V6S5VJKE tag=1SCGMKDI2KT4 type=write size=1945979 2024-08-08T23:35:59.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.408+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=Y1QFHBE76U9U type=write size=917239 2024-08-08T23:35:59.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.408+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~U0KSIUXHB9LJ.0 size=1048576 2024-08-08T23:35:59.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~U0KSIUXHB9LJ.1 size=144190 2024-08-08T23:35:59.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.416+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=U0KSIUXHB9LJ tag=SP8FMUUKKKSK type=write size=2241342 2024-08-08T23:35:59.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~G3DNX4DVW45W.0 size=1048576 2024-08-08T23:35:59.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~G3DNX4DVW45W.1 size=790031 2024-08-08T23:35:59.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.420+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=G3DNX4DVW45W tag=4OR3L4GYKFQG type=write size=2887183 2024-08-08T23:35:59.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.424+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=PO9M0J61VGZK type=del 2024-08-08T23:35:59.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.0 size=1048576 2024-08-08T23:35:59.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.1 size=1048576 2024-08-08T23:35:59.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.432+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.2 size=769819 2024-08-08T23:35:59.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.432+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=GDMINK1UTL07 tag=QEPC0BFEDU03 type=write size=3915547 2024-08-08T23:35:59.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.432+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=OURI69OCTWKR type=del 2024-08-08T23:35:59.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.440+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~DM7YQIN9TRYK.0 size=797994 2024-08-08T23:35:59.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.440+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=DM7YQIN9TRYK tag=4ZZWM26NBY5K type=write size=1846570 2024-08-08T23:35:59.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.440+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=Q5JNN2LRAOV2 type=write size=209730 2024-08-08T23:35:59.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.448+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=FQQ0LP72O720 type=del size=2553731 2024-08-08T23:35:59.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.452+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=IK90N1H88T27 type=del size=3402832 2024-08-08T23:35:59.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.452+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=BHVB7SLEXEFF type=del size=2489201 2024-08-08T23:35:59.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.456+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=3OFX5O5TFLJ3 type=del 2024-08-08T23:35:59.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.460+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=JJ3Y2IK1KCAR type=del size=3905731 2024-08-08T23:35:59.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.460+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=J56DBP1DWKPI type=del size=2345356 2024-08-08T23:35:59.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.464+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~S1AJM7DD2VU7.0 size=1048576 2024-08-08T23:35:59.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~S1AJM7DD2VU7.1 size=249003 2024-08-08T23:35:59.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.468+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=S1AJM7DD2VU7 tag=WRRDOXT5QCHL type=write size=2346155 2024-08-08T23:35:59.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.472+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=YJFEXW41FBQJ type=del 2024-08-08T23:35:59.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.472+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=DF4T2T2GVA49 type=del size=243341 2024-08-08T23:35:59.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.0 size=1048576 2024-08-08T23:35:59.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.1 size=1048576 2024-08-08T23:35:59.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.480+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~J073D7QR9KH6.2 size=214918 2024-08-08T23:35:59.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.484+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=J073D7QR9KH6 tag=86U6CG6B6B7Z type=write size=3360646 2024-08-08T23:35:59.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.484+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=PBK8WL3CPPJZ type=write size=184192 2024-08-08T23:35:59.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.0 size=1048576 2024-08-08T23:35:59.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.488+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.1 size=1048576 2024-08-08T23:35:59.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.492+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~L1M21823QD0K.2 size=980821 2024-08-08T23:35:59.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.496+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GZJ8GWYBB01F upload=L1M21823QD0K tag=LSRF8AR4WQRV type=write size=4126549 2024-08-08T23:35:59.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.500+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.0 size=1048576 2024-08-08T23:35:59.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.504+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.1 size=1048576 2024-08-08T23:35:59.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.504+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.2 size=367319 2024-08-08T23:35:59.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.504+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=VAJMT6W9IMI0 tag=L0KO8863IYRT type=write size=3513047 2024-08-08T23:35:59.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.508+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=J001Y85ZGLCO type=del 2024-08-08T23:35:59.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.508+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=606OA5NCZ6SR type=del size=2267485 2024-08-08T23:35:59.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.516+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=LRE0RQS57JD8 type=del 2024-08-08T23:35:59.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.516+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=3YQXVBK1KWQU type=write size=764367 2024-08-08T23:35:59.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.520+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=2AUOSMMKDOBQ type=del 2024-08-08T23:35:59.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.524+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=6KVXSE27RIKE type=write size=992091 2024-08-08T23:35:59.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~DAE9SQ5UMEIH.0 size=1048576 2024-08-08T23:35:59.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.528+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~DAE9SQ5UMEIH.1 size=112864 2024-08-08T23:35:59.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.532+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=DAE9SQ5UMEIH tag=28MDF7EXEDSK type=write size=2210016 2024-08-08T23:35:59.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~QSLHTZ1X5RO9.0 size=709441 2024-08-08T23:35:59.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.536+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=QSLHTZ1X5RO9 tag=O0LXKP23XCG6 type=write size=1758017 2024-08-08T23:35:59.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.540+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~WY3FR9W7KKOB.0 size=1048576 2024-08-08T23:35:59.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.544+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~WY3FR9W7KKOB.1 size=268066 2024-08-08T23:35:59.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.548+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=WY3FR9W7KKOB tag=5X7ZQHECMXEL type=write size=2365218 2024-08-08T23:35:59.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.552+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~VO6UW6HKCY9M.0 size=1048576 2024-08-08T23:35:59.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~VO6UW6HKCY9M.1 size=601672 2024-08-08T23:35:59.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=VO6UW6HKCY9M tag=94C89OTCQ4F5 type=write size=2698824 2024-08-08T23:35:59.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.560+0000 7fdbd6e2c8c0 1 < completed write operation key=VGT9IXWM956F tag=Y1QFHBE76U9U type=write size=917239 2024-08-08T23:35:59.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.564+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~Y5QU0D7K6NJN.0 size=1048576 2024-08-08T23:35:59.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~Y5QU0D7K6NJN.1 size=776481 2024-08-08T23:35:59.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=Y5QU0D7K6NJN tag=QB4E1ZSSWULB type=write size=2873633 2024-08-08T23:35:59.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.568+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~G3DNX4DVW45W.0 size=1048576 2024-08-08T23:35:59.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.572+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~G3DNX4DVW45W.1 size=790031 2024-08-08T23:35:59.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.576+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=G3DNX4DVW45W tag=4OR3L4GYKFQG type=write size=2887183 2024-08-08T23:35:59.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.580+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=MOCZW5I99X7C type=del size=2494925 2024-08-08T23:35:59.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.0 size=1048576 2024-08-08T23:35:59.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.1 size=1048576 2024-08-08T23:35:59.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.588+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~GDMINK1UTL07.2 size=769819 2024-08-08T23:35:59.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.592+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=GDMINK1UTL07 tag=QEPC0BFEDU03 type=write size=3915547 2024-08-08T23:35:59.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.600+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~9IOK2VCIN4G9.0 size=327725 2024-08-08T23:35:59.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.600+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=9IOK2VCIN4G9 tag=HM9SSGTVRY5W type=write size=1376301 2024-08-08T23:35:59.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.600+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~DM7YQIN9TRYK.0 size=797994 2024-08-08T23:35:59.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.608+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=DM7YQIN9TRYK tag=4ZZWM26NBY5K type=write size=1846570 2024-08-08T23:35:59.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~RLS91ZIK05OB.0 size=221916 2024-08-08T23:35:59.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.612+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=RLS91ZIK05OB tag=GNKLT0QGG1S5 type=write size=1270492 2024-08-08T23:35:59.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.616+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=FQQ0LP72O720 type=del size=2553731 2024-08-08T23:35:59.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.620+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=MH11N0NBPQFY type=write size=111640 2024-08-08T23:35:59.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.624+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=BHVB7SLEXEFF type=del 2024-08-08T23:35:59.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.628+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=6YUDNSGF9TJU type=del size=2289931 2024-08-08T23:35:59.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.632+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=JJ3Y2IK1KCAR type=del size=3905731 2024-08-08T23:35:59.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.632+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=8VXGYUUU2DG5 type=del size=877691 2024-08-08T23:35:59.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.636+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~S1AJM7DD2VU7.0 size=1048576 2024-08-08T23:35:59.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.640+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~S1AJM7DD2VU7.1 size=249003 2024-08-08T23:35:59.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.644+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=S1AJM7DD2VU7 tag=WRRDOXT5QCHL type=write size=2346155 2024-08-08T23:35:59.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.652+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.0 size=1048576 2024-08-08T23:35:59.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.652+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.1 size=1048576 2024-08-08T23:35:59.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.656+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.2 size=990183 2024-08-08T23:35:59.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.656+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=HAGWBZNNSBN1 tag=427LJ79BURSF type=write size=4135911 2024-08-08T23:35:59.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.660+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=DF4T2T2GVA49 type=del 2024-08-08T23:35:59.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.664+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=DVXXCFCP1UCR type=del size=1132147 2024-08-08T23:35:59.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.664+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=PBK8WL3CPPJZ type=write size=184192 2024-08-08T23:35:59.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.672+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.0 size=1048576 2024-08-08T23:35:59.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.1 size=1048576 2024-08-08T23:35:59.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.2 size=955300 2024-08-08T23:35:59.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.676+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=7IJYJHFI91WT tag=XOWOIW7N9KTI type=write size=4101028 2024-08-08T23:35:59.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.680+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.0 size=1048576 2024-08-08T23:35:59.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.684+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.1 size=1048576 2024-08-08T23:35:59.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.688+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~VAJMT6W9IMI0.2 size=367319 2024-08-08T23:35:59.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.692+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=VAJMT6W9IMI0 tag=L0KO8863IYRT type=write size=3513047 2024-08-08T23:35:59.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.696+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=V27IMS7SUD1H type=del size=3404672 2024-08-08T23:35:59.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.704+0000 7fdbd6e2c8c0 1 < suggested remove operation key=JWTLJG79MYI5 tag=606OA5NCZ6SR type=del 2024-08-08T23:35:59.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.704+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=ULHXJ1593EE0 type=del size=2567681 2024-08-08T23:35:59.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.708+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=3YQXVBK1KWQU type=write size=764367 2024-08-08T23:35:59.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.712+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=VXM4DTV31540 type=write size=274559 2024-08-08T23:35:59.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.716+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=6KVXSE27RIKE type=write size=992091 2024-08-08T23:35:59.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.720+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=RCXJ68JALR2H type=del size=1497478 2024-08-08T23:35:59.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~QSLHTZ1X5RO9.0 size=709441 2024-08-08T23:35:59.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.728+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=QSLHTZ1X5RO9 tag=O0LXKP23XCG6 type=write size=1758017 2024-08-08T23:35:59.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.732+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=PPKNQUW2MBCW type=del size=2658315 2024-08-08T23:35:59.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.736+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~VO6UW6HKCY9M.0 size=1048576 2024-08-08T23:35:59.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.736+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~VO6UW6HKCY9M.1 size=601672 2024-08-08T23:35:59.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.744+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=VO6UW6HKCY9M tag=94C89OTCQ4F5 type=write size=2698824 2024-08-08T23:35:59.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.744+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=VA0BD3F6ASWS type=del size=2848496 2024-08-08T23:35:59.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~Y5QU0D7K6NJN.0 size=1048576 2024-08-08T23:35:59.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~Y5QU0D7K6NJN.1 size=776481 2024-08-08T23:35:59.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=Y5QU0D7K6NJN tag=QB4E1ZSSWULB type=write size=2873633 2024-08-08T23:35:59.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.0 size=1048576 2024-08-08T23:35:59.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.1 size=1048576 2024-08-08T23:35:59.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.768+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.2 size=243329 2024-08-08T23:35:59.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.768+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=1GTD0V2C88SG tag=L2QRBNF0M7HW type=write size=3389057 2024-08-08T23:35:59.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.772+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=MOCZW5I99X7C type=del 2024-08-08T23:35:59.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~8ZCG347SJ6CL.0 size=1048576 2024-08-08T23:35:59.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~8ZCG347SJ6CL.1 size=224757 2024-08-08T23:35:59.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=8ZCG347SJ6CL tag=VJFVL3B4AW5P type=write size=2321909 2024-08-08T23:35:59.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.784+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~9IOK2VCIN4G9.0 size=327725 2024-08-08T23:35:59.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.788+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=9IOK2VCIN4G9 tag=HM9SSGTVRY5W type=write size=1376301 2024-08-08T23:35:59.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~PSDTH9C30U2J.0 size=1002246 2024-08-08T23:35:59.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=PSDTH9C30U2J tag=3QSLDMY52LN4 type=write size=2050822 2024-08-08T23:35:59.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~RLS91ZIK05OB.0 size=221916 2024-08-08T23:35:59.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.800+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=RLS91ZIK05OB tag=GNKLT0QGG1S5 type=write size=1270492 2024-08-08T23:35:59.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.804+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=O2GVO47GNTPJ type=del size=2398558 2024-08-08T23:35:59.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.808+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=MH11N0NBPQFY type=write size=111640 2024-08-08T23:35:59.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.808+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=7E3DGSC3EVTD type=write size=745683 2024-08-08T23:35:59.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.812+0000 7fdbd6e2c8c0 1 < suggested update operation key=FBCEC998C8EJ tag=6YUDNSGF9TJU type=del size=2289931 2024-08-08T23:35:59.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~L6NTKCXU1J9B.0 size=1048576 2024-08-08T23:35:59.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~L6NTKCXU1J9B.1 size=1400 2024-08-08T23:35:59.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=L6NTKCXU1J9B tag=ODRKJKSSG9RD type=write size=2098552 2024-08-08T23:35:59.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.824+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=8VXGYUUU2DG5 type=del 2024-08-08T23:35:59.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.828+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.0 size=1048576 2024-08-08T23:35:59.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.1 size=1048576 2024-08-08T23:35:59.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.2 size=436982 2024-08-08T23:35:59.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.832+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=Q2FRGA3X50SR tag=YN8F15QXAS3N type=write size=3582710 2024-08-08T23:35:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.836+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.0 size=1048576 2024-08-08T23:35:59.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.836+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.1 size=1048576 2024-08-08T23:35:59.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.840+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~HAGWBZNNSBN1.2 size=990183 2024-08-08T23:35:59.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.844+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=HAGWBZNNSBN1 tag=427LJ79BURSF type=write size=4135911 2024-08-08T23:35:59.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.848+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=1OONR7UFD3KJ type=del size=3419412 2024-08-08T23:35:59.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.852+0000 7fdbd6e2c8c0 1 < suggested update operation key=V6GSJH62C8TA tag=DVXXCFCP1UCR type=del size=1132147 2024-08-08T23:35:59.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.0 size=1048576 2024-08-08T23:35:59.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.1 size=1048576 2024-08-08T23:35:59.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.2 size=134690 2024-08-08T23:35:59.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.864+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=AEGHPP2N5WS7 tag=RAFY3I7UW2V2 type=write size=3280418 2024-08-08T23:35:59.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.864+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.0 size=1048576 2024-08-08T23:35:59.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.1 size=1048576 2024-08-08T23:35:59.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~7IJYJHFI91WT.2 size=955300 2024-08-08T23:35:59.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.872+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=7IJYJHFI91WT tag=XOWOIW7N9KTI type=write size=4101028 2024-08-08T23:35:59.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.876+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=6ZBPAOSIMVGD type=del size=3110394 2024-08-08T23:35:59.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.880+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=V27IMS7SUD1H type=del 2024-08-08T23:35:59.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.0 size=1048576 2024-08-08T23:35:59.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.1 size=1048576 2024-08-08T23:35:59.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.888+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.2 size=468681 2024-08-08T23:35:59.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.888+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=NZX55HZJDA4P tag=V1FRM5YQAJVZ type=write size=3614409 2024-08-08T23:35:59.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.892+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=ULHXJ1593EE0 type=del size=2567681 2024-08-08T23:35:59.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.892+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=SOG238GEMISX type=del size=400877 2024-08-08T23:35:59.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.900+0000 7fdbd6e2c8c0 1 < suggested remove operation key=63GVT7KRKCSS tag=VXM4DTV31540 type=write 2024-08-08T23:35:59.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.900+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=4GQR6EVLJKIS type=write size=185401 2024-08-08T23:35:59.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.904+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=RCXJ68JALR2H type=del 2024-08-08T23:35:59.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.908+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=XOVESW6I9C27 type=del size=3950367 2024-08-08T23:35:59.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.908+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=PPKNQUW2MBCW type=del 2024-08-08T23:35:59.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.912+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=ATUTT74Y8LIF type=del size=896957 2024-08-08T23:35:59.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.916+0000 7fdbd6e2c8c0 1 < suggested update operation key=0XF26POOKR3V tag=VA0BD3F6ASWS type=del size=2848496 2024-08-08T23:35:59.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.920+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=1SMIZQZ24N98 type=del size=1460956 2024-08-08T23:35:59.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.0 size=1048576 2024-08-08T23:35:59.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.1 size=1048576 2024-08-08T23:35:59.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~1GTD0V2C88SG.2 size=243329 2024-08-08T23:35:59.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.932+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=1GTD0V2C88SG tag=L2QRBNF0M7HW type=write size=3389057 2024-08-08T23:35:59.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~199O4CC2NS3M.0 size=1048576 2024-08-08T23:35:59.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~199O4CC2NS3M.1 size=863074 2024-08-08T23:35:59.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.936+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=199O4CC2NS3M tag=TSHDF2CWCFKW type=write size=2960226 2024-08-08T23:35:59.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~8ZCG347SJ6CL.0 size=1048576 2024-08-08T23:35:59.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.944+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~8ZCG347SJ6CL.1 size=224757 2024-08-08T23:35:59.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.948+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=8ZCG347SJ6CL tag=VJFVL3B4AW5P type=write size=2321909 2024-08-08T23:35:59.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.948+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=SP559C2A8LAO type=write size=532794 2024-08-08T23:35:59.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.952+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~PSDTH9C30U2J.0 size=1002246 2024-08-08T23:35:59.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.956+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=PSDTH9C30U2J tag=3QSLDMY52LN4 type=write size=2050822 2024-08-08T23:35:59.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~NDL4RS7J7QHT.0 size=1048576 2024-08-08T23:35:59.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~NDL4RS7J7QHT.1 size=15449 2024-08-08T23:35:59.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.964+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=NDL4RS7J7QHT tag=ITK9EPML8QBI type=write size=2112601 2024-08-08T23:35:59.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.964+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=O2GVO47GNTPJ type=del 2024-08-08T23:35:59.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.968+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=RGYGTAL88IVD type=del size=1701301 2024-08-08T23:35:59.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.972+0000 7fdbd6e2c8c0 1 < completed write operation key=903K2EO77YTJ tag=7E3DGSC3EVTD type=write size=745683 2024-08-08T23:35:59.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.972+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=SPEKSPJDKKWB type=del size=2329057 2024-08-08T23:35:59.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~L6NTKCXU1J9B.0 size=1048576 2024-08-08T23:35:59.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.980+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~L6NTKCXU1J9B.1 size=1400 2024-08-08T23:35:59.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.988+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=L6NTKCXU1J9B tag=ODRKJKSSG9RD type=write size=2098552 2024-08-08T23:35:59.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.988+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=NCQUX14PAMWK type=write size=560849 2024-08-08T23:35:59.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.0 size=1048576 2024-08-08T23:35:59.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.1 size=1048576 2024-08-08T23:35:59.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:35:59.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~Q2FRGA3X50SR.2 size=436982 2024-08-08T23:36:00.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.004+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=Q2FRGA3X50SR tag=YN8F15QXAS3N type=write size=3582710 2024-08-08T23:36:00.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.004+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=MLCLL8BS7335 type=del size=1955974 2024-08-08T23:36:00.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.008+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=1OONR7UFD3KJ type=del 2024-08-08T23:36:00.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.0 size=1048576 2024-08-08T23:36:00.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.016+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.1 size=1048576 2024-08-08T23:36:00.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.016+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.2 size=591064 2024-08-08T23:36:00.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.016+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=P98IZ5EVUPAQ tag=MYN6XKB36G2F type=write size=3736792 2024-08-08T23:36:00.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.020+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.0 size=1048576 2024-08-08T23:36:00.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.020+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.1 size=1048576 2024-08-08T23:36:00.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.024+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~AEGHPP2N5WS7.2 size=134690 2024-08-08T23:36:00.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.028+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=AEGHPP2N5WS7 tag=RAFY3I7UW2V2 type=write size=3280418 2024-08-08T23:36:00.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.036+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.0 size=1048576 2024-08-08T23:36:00.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.036+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.1 size=1048576 2024-08-08T23:36:00.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.2 size=46895 2024-08-08T23:36:00.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.040+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=W5HZ8P408IP5 tag=028VCBV3VHRY type=write size=3192623 2024-08-08T23:36:00.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.044+0000 7fdbd6e2c8c0 1 < suggested update operation key=9S8TBVP20KTG tag=6ZBPAOSIMVGD type=del size=3110394 2024-08-08T23:36:00.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~U85D9IJVIF5N.0 size=317716 2024-08-08T23:36:00.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.052+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=U85D9IJVIF5N tag=6AM01JIP5W35 type=write size=1366292 2024-08-08T23:36:00.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.0 size=1048576 2024-08-08T23:36:00.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.1 size=1048576 2024-08-08T23:36:00.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~NZX55HZJDA4P.2 size=468681 2024-08-08T23:36:00.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=NZX55HZJDA4P tag=V1FRM5YQAJVZ type=write size=3614409 2024-08-08T23:36:00.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.064+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=UB0GH50T30RL type=write size=515973 2024-08-08T23:36:00.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.068+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=SOG238GEMISX type=del 2024-08-08T23:36:00.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~8JR8DXHCKCHJ.0 size=1048576 2024-08-08T23:36:00.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~8JR8DXHCKCHJ.1 size=781183 2024-08-08T23:36:00.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.072+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=8JR8DXHCKCHJ tag=XDDFWOT8WFFP type=write size=2878335 2024-08-08T23:36:00.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.080+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=4GQR6EVLJKIS type=write 2024-08-08T23:36:00.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.084+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~Z3NGB9COYYLF.0 size=435282 2024-08-08T23:36:00.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.084+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=Z3NGB9COYYLF tag=2IN14PMK4Q5O type=write size=1483858 2024-08-08T23:36:00.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.084+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=XOVESW6I9C27 type=del 2024-08-08T23:36:00.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.088+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=941EMTSGDWPF type=del size=2598542 2024-08-08T23:36:00.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.092+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VGT9IXWM956F tag=ATUTT74Y8LIF type=del 2024-08-08T23:36:00.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.096+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=2GXXR3ONMW1M type=del size=410783 2024-08-08T23:36:00.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.096+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=1SMIZQZ24N98 type=del 2024-08-08T23:36:00.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.100+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=5K261PF5BS1C type=del size=3805243 2024-08-08T23:36:00.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.100+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~199O4CC2NS3M.0 size=1048576 2024-08-08T23:36:00.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.104+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~199O4CC2NS3M.1 size=863074 2024-08-08T23:36:00.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.108+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=199O4CC2NS3M tag=TSHDF2CWCFKW type=write size=2960226 2024-08-08T23:36:00.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.112+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.0 size=1048576 2024-08-08T23:36:00.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.112+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.1 size=1048576 2024-08-08T23:36:00.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.116+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.2 size=60583 2024-08-08T23:36:00.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.116+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=K4VAH58XD6PM tag=YPLDT1VQUW19 type=write size=3206311 2024-08-08T23:36:00.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.120+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=SP559C2A8LAO type=write size=532794 2024-08-08T23:36:00.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.124+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~ZGB267AM27TT.0 size=1048576 2024-08-08T23:36:00.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.124+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~ZGB267AM27TT.1 size=231066 2024-08-08T23:36:00.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.124+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=ZGB267AM27TT tag=J7B6710YNNBP type=write size=2328218 2024-08-08T23:36:00.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~NDL4RS7J7QHT.0 size=1048576 2024-08-08T23:36:00.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~NDL4RS7J7QHT.1 size=15449 2024-08-08T23:36:00.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.132+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=NDL4RS7J7QHT tag=ITK9EPML8QBI type=write size=2112601 2024-08-08T23:36:00.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.136+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~YS5F4BAJ36MU.0 size=490090 2024-08-08T23:36:00.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.136+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=YS5F4BAJ36MU tag=R6P77N5ZEUDQ type=write size=1538666 2024-08-08T23:36:00.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.136+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=RGYGTAL88IVD type=del 2024-08-08T23:36:00.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.140+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=1CYJLWHX84MU type=del size=1759726 2024-08-08T23:36:00.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.140+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=SPEKSPJDKKWB type=del 2024-08-08T23:36:00.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.144+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=L0OVNL9VYC7U type=del size=2318547 2024-08-08T23:36:00.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.144+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=NCQUX14PAMWK type=write size=560849 2024-08-08T23:36:00.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.148+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~XOF5PCWL0OK0.0 size=992964 2024-08-08T23:36:00.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.148+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=XOF5PCWL0OK0 tag=B6NT46E2IV9W type=write size=2041540 2024-08-08T23:36:00.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.152+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=MLCLL8BS7335 type=del 2024-08-08T23:36:00.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~9617RTP2VPC9.0 size=416585 2024-08-08T23:36:00.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.152+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=9617RTP2VPC9 tag=14FVNBUC6495 type=write size=1465161 2024-08-08T23:36:00.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.156+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.0 size=1048576 2024-08-08T23:36:00.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.156+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.1 size=1048576 2024-08-08T23:36:00.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~P98IZ5EVUPAQ.2 size=591064 2024-08-08T23:36:00.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.164+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=P98IZ5EVUPAQ tag=MYN6XKB36G2F type=write size=3736792 2024-08-08T23:36:00.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.164+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=UB8UWQJLIZTF type=del size=560467 2024-08-08T23:36:00.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.0 size=1048576 2024-08-08T23:36:00.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.1 size=1048576 2024-08-08T23:36:00.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~W5HZ8P408IP5.2 size=46895 2024-08-08T23:36:00.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.172+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=W5HZ8P408IP5 tag=028VCBV3VHRY type=write size=3192623 2024-08-08T23:36:00.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.176+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~Q86FPTF6FH67.0 size=1048576 2024-08-08T23:36:00.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~Q86FPTF6FH67.1 size=997325 2024-08-08T23:36:00.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.180+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=Q86FPTF6FH67 tag=RQSKOSDSWQ9V type=write size=3094477 2024-08-08T23:36:00.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.180+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~U85D9IJVIF5N.0 size=317716 2024-08-08T23:36:00.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.184+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=U85D9IJVIF5N tag=6AM01JIP5W35 type=write size=1366292 2024-08-08T23:36:00.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.188+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=5BVYHWSE9OJ9 type=del size=1540655 2024-08-08T23:36:00.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.188+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=UB0GH50T30RL type=write size=515973 2024-08-08T23:36:00.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.192+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=8PSZ4Y2ZVENF type=del size=3975988 2024-08-08T23:36:00.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.192+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~8JR8DXHCKCHJ.0 size=1048576 2024-08-08T23:36:00.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~8JR8DXHCKCHJ.1 size=781183 2024-08-08T23:36:00.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.196+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=8JR8DXHCKCHJ tag=XDDFWOT8WFFP type=write size=2878335 2024-08-08T23:36:00.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.200+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=NTCERSX4F2PU type=write size=175041 2024-08-08T23:36:00.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.200+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~Z3NGB9COYYLF.0 size=435282 2024-08-08T23:36:00.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.204+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=Z3NGB9COYYLF tag=2IN14PMK4Q5O type=write size=1483858 2024-08-08T23:36:00.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~WZ33P34PBSJI.0 size=1048576 2024-08-08T23:36:00.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.212+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~WZ33P34PBSJI.1 size=273498 2024-08-08T23:36:00.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.212+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=WZ33P34PBSJI tag=B1KQO4T6KW1A type=write size=2370650 2024-08-08T23:36:00.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.212+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=VGT9IXWM956F tag=941EMTSGDWPF type=del size=2598542: (22) Invalid argument 2024-08-08T23:36:00.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.216+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=ZPUTB3F3ETAI type=del size=3250478 2024-08-08T23:36:00.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.220+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=2GXXR3ONMW1M type=del 2024-08-08T23:36:00.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~RMW94RUPZWKW.0 size=1048576 2024-08-08T23:36:00.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~RMW94RUPZWKW.1 size=394402 2024-08-08T23:36:00.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.224+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=RMW94RUPZWKW tag=QL4PTUM7006J type=write size=2491554 2024-08-08T23:36:00.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.228+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=5K261PF5BS1C type=del 2024-08-08T23:36:00.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.232+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=D13NR03H8ZRE type=del size=2365279 2024-08-08T23:36:00.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.232+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.0 size=1048576 2024-08-08T23:36:00.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.236+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.1 size=1048576 2024-08-08T23:36:00.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.236+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~K4VAH58XD6PM.2 size=60583 2024-08-08T23:36:00.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.240+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=K4VAH58XD6PM tag=YPLDT1VQUW19 type=write size=3206311 2024-08-08T23:36:00.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.244+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=WXAF8J60TD2C type=write size=107277 2024-08-08T23:36:00.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.244+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~ZGB267AM27TT.0 size=1048576 2024-08-08T23:36:00.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.248+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~ZGB267AM27TT.1 size=231066 2024-08-08T23:36:00.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.252+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=ZGB267AM27TT tag=J7B6710YNNBP type=write size=2328218 2024-08-08T23:36:00.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.252+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=7GS6J497WL8B type=del size=1481507 2024-08-08T23:36:00.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~YS5F4BAJ36MU.0 size=490090 2024-08-08T23:36:00.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.260+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=YS5F4BAJ36MU tag=R6P77N5ZEUDQ type=write size=1538666 2024-08-08T23:36:00.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.264+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=O3P4MBUCICWS type=del size=3743262 2024-08-08T23:36:00.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.264+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=1CYJLWHX84MU type=del 2024-08-08T23:36:00.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.268+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=8M1R5E49LR4K type=write size=248071 2024-08-08T23:36:00.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.272+0000 7fdbd6e2c8c0 1 < suggested update operation key=D81PQ0FJVNEE tag=L0OVNL9VYC7U type=del size=2318547 2024-08-08T23:36:00.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.276+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=RE9DPL4XBRRE type=del size=1993136 2024-08-08T23:36:00.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.276+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~XOF5PCWL0OK0.0 size=992964 2024-08-08T23:36:00.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.280+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=XOF5PCWL0OK0 tag=B6NT46E2IV9W type=write size=2041540 2024-08-08T23:36:00.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.284+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=3CPZX1C4NP08 type=del size=1034428 2024-08-08T23:36:00.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.284+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~9617RTP2VPC9.0 size=416585 2024-08-08T23:36:00.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.292+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=9617RTP2VPC9 tag=14FVNBUC6495 type=write size=1465161 2024-08-08T23:36:00.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.292+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=8V570WIUYYBL type=write size=604850 2024-08-08T23:36:00.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.296+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=UB8UWQJLIZTF type=del 2024-08-08T23:36:00.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.300+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~DBNRBS06HSQP.0 size=1048576 2024-08-08T23:36:00.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.304+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~DBNRBS06HSQP.1 size=692392 2024-08-08T23:36:00.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.304+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=DBNRBS06HSQP tag=FLD49C9ZJ5SA type=write size=2789544 2024-08-08T23:36:00.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.308+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~Q86FPTF6FH67.0 size=1048576 2024-08-08T23:36:00.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.308+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~Q86FPTF6FH67.1 size=997325 2024-08-08T23:36:00.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.316+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=Q86FPTF6FH67 tag=RQSKOSDSWQ9V type=write size=3094477 2024-08-08T23:36:00.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.316+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=ICD30M62P5A1 type=del size=1715331 2024-08-08T23:36:00.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.320+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=5BVYHWSE9OJ9 type=del size=1540655 2024-08-08T23:36:00.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.324+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=Y9X8ED7ZAIP8 type=del size=3312182 2024-08-08T23:36:00.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.324+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=D81PQ0FJVNEE tag=8PSZ4Y2ZVENF type=del size=3975988: (22) Invalid argument 2024-08-08T23:36:00.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~QWORKI7VSKBP.0 size=1034694 2024-08-08T23:36:00.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.332+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=QWORKI7VSKBP tag=7ODOSQM1K9YZ type=write size=2083270 2024-08-08T23:36:00.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.332+0000 7fdbd6e2c8c0 1 < completed write operation key=VSLBN9AVZK00 tag=NTCERSX4F2PU type=write size=175041 2024-08-08T23:36:00.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.340+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~47LO5L9VUU51.0 size=858464 2024-08-08T23:36:00.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.340+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=47LO5L9VUU51 tag=24ZR6CNL7Q2I type=write size=1907040 2024-08-08T23:36:00.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~WZ33P34PBSJI.0 size=1048576 2024-08-08T23:36:00.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.344+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~WZ33P34PBSJI.1 size=273498 2024-08-08T23:36:00.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.348+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=WZ33P34PBSJI tag=B1KQO4T6KW1A type=write size=2370650 2024-08-08T23:36:00.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.352+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=NVZ54B5KF7A0 type=del size=2996349 2024-08-08T23:36:00.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.356+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=ZPUTB3F3ETAI type=del 2024-08-08T23:36:00.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.360+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~Y4RIWL7ZMC9B.0 size=1048576 2024-08-08T23:36:00.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.360+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~Y4RIWL7ZMC9B.1 size=1043841 2024-08-08T23:36:00.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.360+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=Y4RIWL7ZMC9B tag=TFAKNCWVVOYM type=write size=3140993 2024-08-08T23:36:00.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.364+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~RMW94RUPZWKW.0 size=1048576 2024-08-08T23:36:00.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.364+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~RMW94RUPZWKW.1 size=394402 2024-08-08T23:36:00.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.368+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=RMW94RUPZWKW tag=QL4PTUM7006J type=write size=2491554 2024-08-08T23:36:00.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.372+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=H9EAA0ZND8XY type=del size=2417382 2024-08-08T23:36:00.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.376+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=D13NR03H8ZRE type=del 2024-08-08T23:36:00.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.376+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=VV2M3Y8KW779 type=del size=220964 2024-08-08T23:36:00.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.380+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=WXAF8J60TD2C type=write size=107277 2024-08-08T23:36:00.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.380+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=V3EAT8ZX7Q75 type=del size=3023645 2024-08-08T23:36:00.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.384+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=7GS6J497WL8B type=del 2024-08-08T23:36:00.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.388+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=YGMLGYUH3IQA type=del size=1543625 2024-08-08T23:36:00.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.388+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=O3P4MBUCICWS type=del 2024-08-08T23:36:00.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.0 size=1048576 2024-08-08T23:36:00.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.396+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.1 size=1048576 2024-08-08T23:36:00.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.396+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.2 size=912515 2024-08-08T23:36:00.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.396+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=2FYPMSHIBPL1 tag=DTEKXDLAWJZR type=write size=4058243 2024-08-08T23:36:00.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.400+0000 7fdbd6e2c8c0 1 < canceled operation key=V6GSJH62C8TA tag=8M1R5E49LR4K type=write size=248071 2024-08-08T23:36:00.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~E4DKOSM7ZAN6.0 size=79905 2024-08-08T23:36:00.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.404+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=E4DKOSM7ZAN6 tag=Q2DGD2Y40HHR type=write size=1128481 2024-08-08T23:36:00.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.408+0000 7fdbd6e2c8c0 1 < suggested update operation key=QANZ3YTL2NQV tag=RE9DPL4XBRRE type=del size=1993136 2024-08-08T23:36:00.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.412+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=2ZS3EKYXRE45 type=del size=1325355 2024-08-08T23:36:00.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.412+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=3CPZX1C4NP08 type=del 2024-08-08T23:36:00.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.416+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=FTD4PWP5PMY8 type=del size=4119484 2024-08-08T23:36:00.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.416+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=8V570WIUYYBL type=write size=604850 2024-08-08T23:36:00.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.420+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=9K11ORD799B0 type=del size=3764180 2024-08-08T23:36:00.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~DBNRBS06HSQP.0 size=1048576 2024-08-08T23:36:00.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~DBNRBS06HSQP.1 size=692392 2024-08-08T23:36:00.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.428+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=DBNRBS06HSQP tag=FLD49C9ZJ5SA type=write size=2789544 2024-08-08T23:36:00.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.432+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=PAPXD6Q4FB8M type=del size=545153 2024-08-08T23:36:00.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.440+0000 7fdbd6e2c8c0 1 < suggested remove operation key=2SO6IPMXZUUI tag=ICD30M62P5A1 type=del 2024-08-08T23:36:00.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.444+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=GNF82D5JHV9X type=del size=3400481 2024-08-08T23:36:00.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.444+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=Y9X8ED7ZAIP8 type=del 2024-08-08T23:36:00.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.448+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=DCA8QQ60WOVF type=write size=630620 2024-08-08T23:36:00.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.448+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~QWORKI7VSKBP.0 size=1034694 2024-08-08T23:36:00.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.456+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=QWORKI7VSKBP tag=7ODOSQM1K9YZ type=write size=2083270 2024-08-08T23:36:00.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.456+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=BG7GU20RD7P0 type=del size=2209897 2024-08-08T23:36:00.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.460+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~47LO5L9VUU51.0 size=858464 2024-08-08T23:36:00.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.464+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=47LO5L9VUU51 tag=24ZR6CNL7Q2I type=write size=1907040 2024-08-08T23:36:00.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.472+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.0 size=1048576 2024-08-08T23:36:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.472+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.1 size=1048576 2024-08-08T23:36:00.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.476+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.2 size=818277 2024-08-08T23:36:00.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.476+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=Y7T2FFI918IJ tag=PC5KKSEFCM0Y type=write size=3964005 2024-08-08T23:36:00.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.484+0000 7fdbd6e2c8c0 1 < suggested update operation key=GMVEOO97I8YH tag=NVZ54B5KF7A0 type=del size=2996349 2024-08-08T23:36:00.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.484+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=CY931EB1YONX type=del size=938438 2024-08-08T23:36:00.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.484+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FBCEC998C8EJ.2~Y4RIWL7ZMC9B.0 size=1048576 2024-08-08T23:36:00.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~Y4RIWL7ZMC9B.1 size=1043841 2024-08-08T23:36:00.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.492+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FBCEC998C8EJ upload=Y4RIWL7ZMC9B tag=TFAKNCWVVOYM type=write size=3140993 2024-08-08T23:36:00.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.492+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=0BE6WM6606C0 type=write size=147649 2024-08-08T23:36:00.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.496+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=H9EAA0ZND8XY type=del 2024-08-08T23:36:00.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.500+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=AE2M2CCMCWYA type=del size=2605899 2024-08-08T23:36:00.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.500+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=VV2M3Y8KW779 type=del 2024-08-08T23:36:00.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.504+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=IH46OLAVHSDP type=del size=1760459 2024-08-08T23:36:00.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.508+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=V3EAT8ZX7Q75 type=del 2024-08-08T23:36:00.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~PKVWYZ8FEQYL.0 size=1048576 2024-08-08T23:36:00.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~PKVWYZ8FEQYL.1 size=35917 2024-08-08T23:36:00.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.512+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=PKVWYZ8FEQYL tag=VC1EQT94UQ2B type=write size=2133069 2024-08-08T23:36:00.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.516+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=YGMLGYUH3IQA type=del 2024-08-08T23:36:00.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.520+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=8L9HUS8GI3R9 type=del size=3695613 2024-08-08T23:36:00.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.0 size=1048576 2024-08-08T23:36:00.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.1 size=1048576 2024-08-08T23:36:00.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.528+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~2FYPMSHIBPL1.2 size=912515 2024-08-08T23:36:00.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.536+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=2FYPMSHIBPL1 tag=DTEKXDLAWJZR type=write size=4058243 2024-08-08T23:36:00.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.536+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=RQP6BK5D698F type=del size=471788 2024-08-08T23:36:00.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.540+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~E4DKOSM7ZAN6.0 size=79905 2024-08-08T23:36:00.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.548+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=E4DKOSM7ZAN6 tag=Q2DGD2Y40HHR type=write size=1128481 2024-08-08T23:36:00.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.552+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~2R4XZQURH454.0 size=1048576 2024-08-08T23:36:00.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~2R4XZQURH454.1 size=702008 2024-08-08T23:36:00.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=2R4XZQURH454 tag=951C9N2QIELN type=write size=2799160 2024-08-08T23:36:00.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.560+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=2ZS3EKYXRE45 type=del 2024-08-08T23:36:00.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.564+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.0 size=1048576 2024-08-08T23:36:00.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.1 size=1048576 2024-08-08T23:36:00.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.2 size=38812 2024-08-08T23:36:00.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=G7UFAN1JSWS7 tag=XFQGA4O67TRN type=write size=3184540 2024-08-08T23:36:00.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.572+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=FTD4PWP5PMY8 type=del 2024-08-08T23:36:00.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.576+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=XP87NL758R4P type=del size=544682 2024-08-08T23:36:00.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.580+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=9K11ORD799B0 type=del 2024-08-08T23:36:00.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.584+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=IPC8VUULPZYT type=del size=3601215 2024-08-08T23:36:00.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.592+0000 7fdbd6e2c8c0 1 < suggested remove operation key=GZJ8GWYBB01F tag=PAPXD6Q4FB8M type=del 2024-08-08T23:36:00.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.592+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=BF50CHE4WLT7 type=del size=996956 2024-08-08T23:36:00.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.596+0000 7fdbd6e2c8c0 1 < canceled operation key=VGT9IXWM956F tag=GNF82D5JHV9X type=del size=3400481 2024-08-08T23:36:00.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.604+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.0 size=1048576 2024-08-08T23:36:00.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.604+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.1 size=1048576 2024-08-08T23:36:00.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.608+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.2 size=977273 2024-08-08T23:36:00.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.608+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=SWBYSRNG626M tag=JOQY75LW4N4B type=write size=4123001 2024-08-08T23:36:00.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.612+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=DCA8QQ60WOVF type=write size=630620 2024-08-08T23:36:00.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.616+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=ZEFSHP99WKWN type=del size=2885301 2024-08-08T23:36:00.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.620+0000 7fdbd6e2c8c0 1 < suggested update operation key=QJB9DETMSY4X tag=BG7GU20RD7P0 type=del size=2209897 2024-08-08T23:36:00.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.628+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~1ERKPYI27ULY.0 size=1048576 2024-08-08T23:36:00.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.632+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~1ERKPYI27ULY.1 size=939130 2024-08-08T23:36:00.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.632+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=1ERKPYI27ULY tag=TWF6JRELJCZP type=write size=3036282 2024-08-08T23:36:00.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.636+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.0 size=1048576 2024-08-08T23:36:00.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.640+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.1 size=1048576 2024-08-08T23:36:00.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.640+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~Y7T2FFI918IJ.2 size=818277 2024-08-08T23:36:00.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.648+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=Y7T2FFI918IJ tag=PC5KKSEFCM0Y type=write size=3964005 2024-08-08T23:36:00.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.648+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=5HSVLZD1C9QE type=del size=4009089 2024-08-08T23:36:00.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.652+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QJB9DETMSY4X tag=CY931EB1YONX type=del size=938438: (22) Invalid argument 2024-08-08T23:36:00.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.656+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=9KFR4N06NDC8 type=del size=3160313 2024-08-08T23:36:00.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.656+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=GZJ8GWYBB01F tag=0BE6WM6606C0 type=write size=147649: (22) Invalid argument 2024-08-08T23:36:00.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.660+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=4YJCD5JA3SDR type=del size=3314571 2024-08-08T23:36:00.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.664+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=AE2M2CCMCWYA type=del 2024-08-08T23:36:00.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.668+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=GA0LSD39FTE5 type=del size=2010477 2024-08-08T23:36:00.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.668+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=GZJ8GWYBB01F tag=IH46OLAVHSDP type=del size=1760459: (22) Invalid argument 2024-08-08T23:36:00.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.0 size=1048576 2024-08-08T23:36:00.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.1 size=1048576 2024-08-08T23:36:00.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.2 size=986830 2024-08-08T23:36:00.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.680+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=A3U6ZAE75EFT tag=D31US38QRKJV type=write size=4132558 2024-08-08T23:36:00.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.684+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~PKVWYZ8FEQYL.0 size=1048576 2024-08-08T23:36:00.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.688+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~PKVWYZ8FEQYL.1 size=35917 2024-08-08T23:36:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.692+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=PKVWYZ8FEQYL tag=VC1EQT94UQ2B type=write size=2133069 2024-08-08T23:36:00.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.696+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~X4F2P6JO80KK.0 size=904445 2024-08-08T23:36:00.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.696+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=X4F2P6JO80KK tag=60WGH28VANXU type=write size=1953021 2024-08-08T23:36:00.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.700+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=8L9HUS8GI3R9 type=del 2024-08-08T23:36:00.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.0 size=1048576 2024-08-08T23:36:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.708+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.1 size=1048576 2024-08-08T23:36:00.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.708+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.2 size=131182 2024-08-08T23:36:00.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.708+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=58HFEDQ0DSYD tag=J4N8OF2KJI6Y type=write size=3276910 2024-08-08T23:36:00.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.716+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=RQP6BK5D698F type=del 2024-08-08T23:36:00.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.0 size=1048576 2024-08-08T23:36:00.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.1 size=1048576 2024-08-08T23:36:00.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.728+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.2 size=924453 2024-08-08T23:36:00.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.728+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=T3UCUSSM1JSW tag=TDU4WR5JFU91 type=write size=4070181 2024-08-08T23:36:00.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~2R4XZQURH454.0 size=1048576 2024-08-08T23:36:00.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.732+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~2R4XZQURH454.1 size=702008 2024-08-08T23:36:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.740+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=2R4XZQURH454 tag=951C9N2QIELN type=write size=2799160 2024-08-08T23:36:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.744+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=FO6NLW6PU34U type=del size=1613786 2024-08-08T23:36:00.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.0 size=1048576 2024-08-08T23:36:00.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.1 size=1048576 2024-08-08T23:36:00.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.748+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YO2FZOR7H0EX.2~G7UFAN1JSWS7.2 size=38812 2024-08-08T23:36:00.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.756+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YO2FZOR7H0EX upload=G7UFAN1JSWS7 tag=XFQGA4O67TRN type=write size=3184540 2024-08-08T23:36:00.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~43L93ZW6N6X4.0 size=1048576 2024-08-08T23:36:00.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~43L93ZW6N6X4.1 size=375107 2024-08-08T23:36:00.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.764+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=43L93ZW6N6X4 tag=3EXUJN0RUCXV type=write size=2472259 2024-08-08T23:36:00.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.768+0000 7fdbd6e2c8c0 1 < suggested remove operation key=9S8TBVP20KTG tag=XP87NL758R4P type=del 2024-08-08T23:36:00.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.0 size=1048576 2024-08-08T23:36:00.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.1 size=1048576 2024-08-08T23:36:00.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.2 size=140648 2024-08-08T23:36:00.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=V6RW7S68GT01 tag=NV96NK8YRFLA type=write size=3286376 2024-08-08T23:36:00.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.788+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=IPC8VUULPZYT type=del size=3601215 2024-08-08T23:36:00.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.0 size=1048576 2024-08-08T23:36:00.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.796+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.1 size=1048576 2024-08-08T23:36:00.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.800+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.2 size=564460 2024-08-08T23:36:00.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.800+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=90H3N5HMUYLF tag=4AR1JTIXACEL type=write size=3710188 2024-08-08T23:36:00.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.800+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=W5OVPO7BGE4S tag=BF50CHE4WLT7 type=del size=996956: (22) Invalid argument 2024-08-08T23:36:00.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.804+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=IB3F49NWH7QE type=del size=656071 2024-08-08T23:36:00.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.808+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.0 size=1048576 2024-08-08T23:36:00.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.812+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.1 size=1048576 2024-08-08T23:36:00.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.812+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~SWBYSRNG626M.2 size=977273 2024-08-08T23:36:00.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.816+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=SWBYSRNG626M tag=JOQY75LW4N4B type=write size=4123001 2024-08-08T23:36:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.0 size=1048576 2024-08-08T23:36:00.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.1 size=1048576 2024-08-08T23:36:00.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.2 size=664355 2024-08-08T23:36:00.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=7I63TSEUZ0CO tag=5HVG9WRP1MC2 type=write size=3810083 2024-08-08T23:36:00.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.828+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=ZEFSHP99WKWN type=del 2024-08-08T23:36:00.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.0 size=1048576 2024-08-08T23:36:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.1 size=1048576 2024-08-08T23:36:00.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.840+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.2 size=880344 2024-08-08T23:36:00.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.840+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=R7PSX1QXIGT3 tag=YR7HJOZRZJB6 type=write size=4026072 2024-08-08T23:36:00.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.840+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~1ERKPYI27ULY.0 size=1048576 2024-08-08T23:36:00.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.844+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~1ERKPYI27ULY.1 size=939130 2024-08-08T23:36:00.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.848+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=1ERKPYI27ULY tag=TWF6JRELJCZP type=write size=3036282 2024-08-08T23:36:00.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.852+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=WALHDN0GG2D2 type=del size=2655808 2024-08-08T23:36:00.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.852+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=5HSVLZD1C9QE type=del 2024-08-08T23:36:00.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~D0I7JG4MOWJF.0 size=1048576 2024-08-08T23:36:00.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~D0I7JG4MOWJF.1 size=517264 2024-08-08T23:36:00.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.860+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=D0I7JG4MOWJF tag=CSY0WLFIFT3Q type=write size=2614416 2024-08-08T23:36:00.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.864+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=9KFR4N06NDC8 type=del 2024-08-08T23:36:00.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.864+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=EE2YC39OEX4A type=del size=3045177 2024-08-08T23:36:00.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.868+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=4YJCD5JA3SDR type=del 2024-08-08T23:36:00.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.872+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=YTERIY9WEJ28 type=write size=506831 2024-08-08T23:36:00.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.872+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=GA0LSD39FTE5 type=del 2024-08-08T23:36:00.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~ALQ3VACEWLQE.0 size=1048576 2024-08-08T23:36:00.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.880+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~ALQ3VACEWLQE.1 size=998777 2024-08-08T23:36:00.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.880+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=ALQ3VACEWLQE tag=XMJDO1210IZ7 type=write size=3095929 2024-08-08T23:36:00.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.880+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.0 size=1048576 2024-08-08T23:36:00.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.1 size=1048576 2024-08-08T23:36:00.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.884+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~A3U6ZAE75EFT.2 size=986830 2024-08-08T23:36:00.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.888+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=A3U6ZAE75EFT tag=D31US38QRKJV type=write size=4132558 2024-08-08T23:36:00.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.892+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=ZEPMHBUI8PCS type=del size=4016955 2024-08-08T23:36:00.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~X4F2P6JO80KK.0 size=904445 2024-08-08T23:36:00.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.900+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=X4F2P6JO80KK tag=60WGH28VANXU type=write size=1953021 2024-08-08T23:36:00.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.900+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=0S8BU9NK3LM7 type=write size=703313 2024-08-08T23:36:00.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.0 size=1048576 2024-08-08T23:36:00.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.1 size=1048576 2024-08-08T23:36:00.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~58HFEDQ0DSYD.2 size=131182 2024-08-08T23:36:00.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.912+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=58HFEDQ0DSYD tag=J4N8OF2KJI6Y type=write size=3276910 2024-08-08T23:36:00.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.916+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=EY4LF1VWU9HU type=write size=852725 2024-08-08T23:36:00.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.916+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.0 size=1048576 2024-08-08T23:36:00.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.1 size=1048576 2024-08-08T23:36:00.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~T3UCUSSM1JSW.2 size=924453 2024-08-08T23:36:00.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.924+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=T3UCUSSM1JSW tag=TDU4WR5JFU91 type=write size=4070181 2024-08-08T23:36:00.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.928+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=EM49T3H9B8QU type=write size=707033 2024-08-08T23:36:00.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.928+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=FO6NLW6PU34U type=del 2024-08-08T23:36:00.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~VN4WUS1WL53A.0 size=159327 2024-08-08T23:36:00.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.936+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=VN4WUS1WL53A tag=F0XTEEYGME99 type=write size=1207903 2024-08-08T23:36:00.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.936+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~43L93ZW6N6X4.0 size=1048576 2024-08-08T23:36:00.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.936+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_GMVEOO97I8YH.2~43L93ZW6N6X4.1 size=375107 2024-08-08T23:36:00.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.940+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=GMVEOO97I8YH upload=43L93ZW6N6X4 tag=3EXUJN0RUCXV type=write size=2472259 2024-08-08T23:36:00.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.944+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=UUM9T38WG63I type=del size=4114769 2024-08-08T23:36:00.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.944+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.0 size=1048576 2024-08-08T23:36:00.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.1 size=1048576 2024-08-08T23:36:00.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~V6RW7S68GT01.2 size=140648 2024-08-08T23:36:00.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.952+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=V6RW7S68GT01 tag=NV96NK8YRFLA type=write size=3286376 2024-08-08T23:36:00.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.0 size=1048576 2024-08-08T23:36:00.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.1 size=1048576 2024-08-08T23:36:00.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.2 size=680940 2024-08-08T23:36:00.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.960+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=XPYA9OEWDN1U tag=Q9QWYNY0IK6A type=write size=3826668 2024-08-08T23:36:00.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.0 size=1048576 2024-08-08T23:36:00.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.1 size=1048576 2024-08-08T23:36:00.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.968+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~90H3N5HMUYLF.2 size=564460 2024-08-08T23:36:00.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.972+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=90H3N5HMUYLF tag=4AR1JTIXACEL type=write size=3710188 2024-08-08T23:36:00.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.972+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=ULPMABVIKYTE type=del size=405155 2024-08-08T23:36:00.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.976+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=IB3F49NWH7QE type=del 2024-08-08T23:36:00.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.980+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.0 size=1048576 2024-08-08T23:36:00.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.984+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.1 size=1048576 2024-08-08T23:36:00.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.2 size=705627 2024-08-08T23:36:00.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.988+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=C7FDX5V0ZBFN tag=ST87N4SL0549 type=write size=3851355 2024-08-08T23:36:00.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.988+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.0 size=1048576 2024-08-08T23:36:00.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.1 size=1048576 2024-08-08T23:36:00.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~7I63TSEUZ0CO.2 size=664355 2024-08-08T23:36:00.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:00.996+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=7I63TSEUZ0CO tag=5HVG9WRP1MC2 type=write size=3810083 2024-08-08T23:36:01.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.000+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=HD9CYYB8ABH6 type=write size=985607 2024-08-08T23:36:01.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.004+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.0 size=1048576 2024-08-08T23:36:01.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.004+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.1 size=1048576 2024-08-08T23:36:01.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.008+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~R7PSX1QXIGT3.2 size=880344 2024-08-08T23:36:01.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.012+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=R7PSX1QXIGT3 tag=YR7HJOZRZJB6 type=write size=4026072 2024-08-08T23:36:01.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.012+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=H7WXU4WEZM3K type=del size=770549 2024-08-08T23:36:01.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.016+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=WALHDN0GG2D2 type=del 2024-08-08T23:36:01.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.020+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~C1ZZ2GLOVM0R.0 size=1048576 2024-08-08T23:36:01.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~C1ZZ2GLOVM0R.1 size=443371 2024-08-08T23:36:01.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.024+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=C1ZZ2GLOVM0R tag=16YZXM49IV09 type=write size=2540523 2024-08-08T23:36:01.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.024+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~D0I7JG4MOWJF.0 size=1048576 2024-08-08T23:36:01.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~D0I7JG4MOWJF.1 size=517264 2024-08-08T23:36:01.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.032+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=D0I7JG4MOWJF tag=CSY0WLFIFT3Q type=write size=2614416 2024-08-08T23:36:01.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.036+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=DJ1QIBY5I9CX type=write size=687341 2024-08-08T23:36:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=EE2YC39OEX4A type=del 2024-08-08T23:36:01.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.0 size=1048576 2024-08-08T23:36:01.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.1 size=1048576 2024-08-08T23:36:01.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.2 size=377147 2024-08-08T23:36:01.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.044+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=3ZA7IULAUGG6 tag=YKVLJA34ZPUH type=write size=3522875 2024-08-08T23:36:01.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.048+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=YTERIY9WEJ28 type=write size=506831 2024-08-08T23:36:01.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.048+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=IZ3DGUTMNPF9 type=write size=1007358 2024-08-08T23:36:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.052+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~ALQ3VACEWLQE.0 size=1048576 2024-08-08T23:36:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~ALQ3VACEWLQE.1 size=998777 2024-08-08T23:36:01.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=ALQ3VACEWLQE tag=XMJDO1210IZ7 type=write size=3095929 2024-08-08T23:36:01.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.060+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=EVJ9F60MTYZA type=del size=2628219 2024-08-08T23:36:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.064+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=ZEPMHBUI8PCS type=del 2024-08-08T23:36:01.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.068+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=MWHHRG64B0QH type=del size=3137841 2024-08-08T23:36:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.068+0000 7fdbd6e2c8c0 1 < canceled operation key=QWRYLH4P94BQ tag=0S8BU9NK3LM7 type=write size=703313 2024-08-08T23:36:01.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.0 size=1048576 2024-08-08T23:36:01.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.1 size=1048576 2024-08-08T23:36:01.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.2 size=899708 2024-08-08T23:36:01.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=9CLY63H15ZOH tag=KPQO8FI1V2L2 type=write size=4045436 2024-08-08T23:36:01.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.080+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=EY4LF1VWU9HU type=write size=852725 2024-08-08T23:36:01.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.084+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=9A764FFET7BW type=del size=817409 2024-08-08T23:36:01.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.084+0000 7fdbd6e2c8c0 1 < canceled operation key=ZQ8GOX9RSTBB tag=EM49T3H9B8QU type=write size=707033 2024-08-08T23:36:01.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.088+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=GWLQR7CB6TUZ type=del size=312066 2024-08-08T23:36:01.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.088+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~VN4WUS1WL53A.0 size=159327 2024-08-08T23:36:01.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.092+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=VN4WUS1WL53A tag=F0XTEEYGME99 type=write size=1207903 2024-08-08T23:36:01.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.092+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=QL1ZZDFWTPKX type=del size=1690064 2024-08-08T23:36:01.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.096+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=UUM9T38WG63I type=del size=4114769 2024-08-08T23:36:01.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.100+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=LWTPZKS5IXCI type=write size=187934 2024-08-08T23:36:01.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.100+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.0 size=1048576 2024-08-08T23:36:01.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.104+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.1 size=1048576 2024-08-08T23:36:01.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.104+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~XPYA9OEWDN1U.2 size=680940 2024-08-08T23:36:01.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.108+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=XPYA9OEWDN1U tag=Q9QWYNY0IK6A type=write size=3826668 2024-08-08T23:36:01.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.112+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=IJ20SVMS4B4S type=write size=1039714 2024-08-08T23:36:01.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.112+0000 7fdbd6e2c8c0 1 < canceled operation key=V3TA5KZ95NXT tag=ULPMABVIKYTE type=del size=405155 2024-08-08T23:36:01.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.116+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=0TKXOGG52IJP type=del size=349755 2024-08-08T23:36:01.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.0 size=1048576 2024-08-08T23:36:01.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.1 size=1048576 2024-08-08T23:36:01.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~C7FDX5V0ZBFN.2 size=705627 2024-08-08T23:36:01.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.124+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=C7FDX5V0ZBFN tag=ST87N4SL0549 type=write size=3851355 2024-08-08T23:36:01.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.128+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=CZTP1PSE680R type=write size=357289 2024-08-08T23:36:01.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.128+0000 7fdbd6e2c8c0 1 < completed write operation key=Z5EXY8ZHZCHI tag=HD9CYYB8ABH6 type=write size=985607 2024-08-08T23:36:01.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.132+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=UCBW7JWJWPQ1 type=del size=2841980 2024-08-08T23:36:01.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.132+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=H7WXU4WEZM3K type=del 2024-08-08T23:36:01.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.140+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~8KQ26DXDN08C.0 size=1048576 2024-08-08T23:36:01.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.140+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~8KQ26DXDN08C.1 size=148738 2024-08-08T23:36:01.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.140+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=8KQ26DXDN08C tag=UZXNXGNA1VTP type=write size=2245890 2024-08-08T23:36:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.144+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~C1ZZ2GLOVM0R.0 size=1048576 2024-08-08T23:36:01.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.144+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~C1ZZ2GLOVM0R.1 size=443371 2024-08-08T23:36:01.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.148+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=C1ZZ2GLOVM0R tag=16YZXM49IV09 type=write size=2540523 2024-08-08T23:36:01.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~XGFHRE93GV51.0 size=43786 2024-08-08T23:36:01.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.152+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=XGFHRE93GV51 tag=FJJ7AKCA828T type=write size=1092362 2024-08-08T23:36:01.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.156+0000 7fdbd6e2c8c0 1 < completed write operation key=V3TA5KZ95NXT tag=DJ1QIBY5I9CX type=write size=687341 2024-08-08T23:36:01.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.156+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=8AQVR00LAIJK type=del size=2263528 2024-08-08T23:36:01.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.0 size=1048576 2024-08-08T23:36:01.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.160+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.1 size=1048576 2024-08-08T23:36:01.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.164+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~3ZA7IULAUGG6.2 size=377147 2024-08-08T23:36:01.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.168+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=3ZA7IULAUGG6 tag=YKVLJA34ZPUH type=write size=3522875 2024-08-08T23:36:01.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.168+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=OXWGTYQ7BGU1 type=del size=3048324 2024-08-08T23:36:01.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.172+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=IZ3DGUTMNPF9 type=write size=1007358 2024-08-08T23:36:01.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.172+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=73LR9OVIC7NE type=del size=2436434 2024-08-08T23:36:01.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.176+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=EVJ9F60MTYZA type=del 2024-08-08T23:36:01.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.0 size=1048576 2024-08-08T23:36:01.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.1 size=1048576 2024-08-08T23:36:01.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.2 size=321138 2024-08-08T23:36:01.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.184+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=5M20WBFITPGK tag=NMZTBOMUGKR4 type=write size=3466866 2024-08-08T23:36:01.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.184+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=MWHHRG64B0QH type=del 2024-08-08T23:36:01.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.188+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=F0LIDBICZMR7 type=del size=390423 2024-08-08T23:36:01.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.0 size=1048576 2024-08-08T23:36:01.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.1 size=1048576 2024-08-08T23:36:01.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~9CLY63H15ZOH.2 size=899708 2024-08-08T23:36:01.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=9CLY63H15ZOH tag=KPQO8FI1V2L2 type=write size=4045436 2024-08-08T23:36:01.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.200+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=UB71XG7FQM9Z type=del size=129849 2024-08-08T23:36:01.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.208+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=9A764FFET7BW type=del 2024-08-08T23:36:01.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.212+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=RMWFRIOPLIAI type=del size=1766182 2024-08-08T23:36:01.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.212+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=GWLQR7CB6TUZ type=del 2024-08-08T23:36:01.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~STBWJ578NH77.0 size=1048576 2024-08-08T23:36:01.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.220+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~STBWJ578NH77.1 size=996518 2024-08-08T23:36:01.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.220+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=STBWJ578NH77 tag=BNS0B277THBC type=write size=3093670 2024-08-08T23:36:01.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.220+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=QL1ZZDFWTPKX type=del 2024-08-08T23:36:01.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~2NEDJ7OPK52S.0 size=592926 2024-08-08T23:36:01.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.224+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=2NEDJ7OPK52S tag=RNHBM3F4BBO0 type=write size=1641502 2024-08-08T23:36:01.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.228+0000 7fdbd6e2c8c0 1 < completed write operation key=VSLBN9AVZK00 tag=LWTPZKS5IXCI type=write size=187934 2024-08-08T23:36:01.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.232+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=GYKA4JG4YE0J type=write size=414805 2024-08-08T23:36:01.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.232+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=IJ20SVMS4B4S type=write size=1039714 2024-08-08T23:36:01.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.236+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=4RXA0PH9BNV5 type=write size=959687 2024-08-08T23:36:01.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.240+0000 7fdbd6e2c8c0 1 < canceled operation key=63GVT7KRKCSS tag=0TKXOGG52IJP type=del size=349755 2024-08-08T23:36:01.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~QL7OWJFT93DC.0 size=197468 2024-08-08T23:36:01.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.244+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=QL7OWJFT93DC tag=U1IP5EVIIXVM type=write size=1246044 2024-08-08T23:36:01.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.248+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FWZ5TEP1P2LK tag=CZTP1PSE680R type=write 2024-08-08T23:36:01.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.252+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=P9M62ZINK88R type=write size=997550 2024-08-08T23:36:01.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.256+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=UCBW7JWJWPQ1 type=del 2024-08-08T23:36:01.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.0 size=1048576 2024-08-08T23:36:01.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.1 size=1048576 2024-08-08T23:36:01.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.2 size=661316 2024-08-08T23:36:01.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=KAZPXZE9LTG6 tag=3HK4ASKJOOP1 type=write size=3807044 2024-08-08T23:36:01.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.264+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~8KQ26DXDN08C.0 size=1048576 2024-08-08T23:36:01.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.268+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~8KQ26DXDN08C.1 size=148738 2024-08-08T23:36:01.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.272+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=8KQ26DXDN08C tag=UZXNXGNA1VTP type=write size=2245890 2024-08-08T23:36:01.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~IUQJJ1960QQK.0 size=1048576 2024-08-08T23:36:01.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~IUQJJ1960QQK.1 size=488553 2024-08-08T23:36:01.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.276+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=IUQJJ1960QQK tag=G3CGS83T0GSG type=write size=2585705 2024-08-08T23:36:01.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~XGFHRE93GV51.0 size=43786 2024-08-08T23:36:01.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.284+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=XGFHRE93GV51 tag=FJJ7AKCA828T type=write size=1092362 2024-08-08T23:36:01.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~L7U8YLLZ9D6J.0 size=1048576 2024-08-08T23:36:01.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~L7U8YLLZ9D6J.1 size=267436 2024-08-08T23:36:01.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.292+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=L7U8YLLZ9D6J tag=JH2GGBG9LEMM type=write size=2364588 2024-08-08T23:36:01.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.292+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=8AQVR00LAIJK type=del 2024-08-08T23:36:01.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.300+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~VWAFV5CKDDR1.0 size=1048576 2024-08-08T23:36:01.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.300+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~VWAFV5CKDDR1.1 size=604591 2024-08-08T23:36:01.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.300+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=VWAFV5CKDDR1 tag=XSZH34GFS0SN type=write size=2701743 2024-08-08T23:36:01.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.304+0000 7fdbd6e2c8c0 1 < canceled operation key=V3TA5KZ95NXT tag=OXWGTYQ7BGU1 type=del size=3048324 2024-08-08T23:36:01.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~56NDQHN9OFBB.0 size=631461 2024-08-08T23:36:01.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.308+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=56NDQHN9OFBB tag=YGOTMRT4MYEY type=write size=1680037 2024-08-08T23:36:01.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.312+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=73LR9OVIC7NE type=del 2024-08-08T23:36:01.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.316+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~DUQ05G8WFXDP.0 size=669977 2024-08-08T23:36:01.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.316+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=DUQ05G8WFXDP tag=GO24T4CXD4GZ type=write size=1718553 2024-08-08T23:36:01.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.0 size=1048576 2024-08-08T23:36:01.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.1 size=1048576 2024-08-08T23:36:01.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.324+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~5M20WBFITPGK.2 size=321138 2024-08-08T23:36:01.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.328+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=5M20WBFITPGK tag=NMZTBOMUGKR4 type=write size=3466866 2024-08-08T23:36:01.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.332+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=HGN6RQ49LU57 type=del size=2261341 2024-08-08T23:36:01.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.332+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=F0LIDBICZMR7 type=del 2024-08-08T23:36:01.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.336+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=5OI9LTX4YO87 type=del size=1432254 2024-08-08T23:36:01.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.340+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=UB71XG7FQM9Z type=del 2024-08-08T23:36:01.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.340+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=1ZHZXOKF1KCX type=del size=1614918 2024-08-08T23:36:01.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.344+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=RMWFRIOPLIAI type=del 2024-08-08T23:36:01.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.348+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=SK7JXVX00FZ8 type=del size=2451627 2024-08-08T23:36:01.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.348+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~STBWJ578NH77.0 size=1048576 2024-08-08T23:36:01.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~STBWJ578NH77.1 size=996518 2024-08-08T23:36:01.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.356+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=STBWJ578NH77 tag=BNS0B277THBC type=write size=3093670 2024-08-08T23:36:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.360+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=L0H6M2W1CL5E type=del size=2503490 2024-08-08T23:36:01.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.360+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~2NEDJ7OPK52S.0 size=592926 2024-08-08T23:36:01.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.364+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=2NEDJ7OPK52S tag=RNHBM3F4BBO0 type=write size=1641502 2024-08-08T23:36:01.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.368+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=9JMN5367AXOY type=del size=2887182 2024-08-08T23:36:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.372+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=GYKA4JG4YE0J type=write size=414805 2024-08-08T23:36:01.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.376+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~0K6GHQA50YXO.0 size=709927 2024-08-08T23:36:01.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.376+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=0K6GHQA50YXO tag=SZC2G2ZNBPO7 type=write size=1758503 2024-08-08T23:36:01.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.380+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=4RXA0PH9BNV5 type=write size=959687 2024-08-08T23:36:01.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.384+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.0 size=1048576 2024-08-08T23:36:01.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.1 size=1048576 2024-08-08T23:36:01.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.388+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.2 size=402190 2024-08-08T23:36:01.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.388+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=HQYXNYW266NS tag=0PLAAD8M92ZY type=write size=3547918 2024-08-08T23:36:01.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.388+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FBCEC998C8EJ.2~QL7OWJFT93DC.0 size=197468 2024-08-08T23:36:01.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.392+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FBCEC998C8EJ upload=QL7OWJFT93DC tag=U1IP5EVIIXVM type=write size=1246044 2024-08-08T23:36:01.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.396+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=E122KY9TKA5P type=del size=2433962 2024-08-08T23:36:01.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.400+0000 7fdbd6e2c8c0 1 < canceled operation key=VGT9IXWM956F tag=P9M62ZINK88R type=write size=997550 2024-08-08T23:36:01.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~TYE1IYOI61T3.0 size=1048576 2024-08-08T23:36:01.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.408+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~TYE1IYOI61T3.1 size=939595 2024-08-08T23:36:01.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.408+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=TYE1IYOI61T3 tag=1SED3PS02XB3 type=write size=3036747 2024-08-08T23:36:01.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.408+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.0 size=1048576 2024-08-08T23:36:01.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.1 size=1048576 2024-08-08T23:36:01.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.412+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~KAZPXZE9LTG6.2 size=661316 2024-08-08T23:36:01.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.416+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=KAZPXZE9LTG6 tag=3HK4ASKJOOP1 type=write size=3807044 2024-08-08T23:36:01.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.420+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=018D6BEZKUX3 type=del size=3326732 2024-08-08T23:36:01.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~IUQJJ1960QQK.0 size=1048576 2024-08-08T23:36:01.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.424+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~IUQJJ1960QQK.1 size=488553 2024-08-08T23:36:01.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.428+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=IUQJJ1960QQK tag=G3CGS83T0GSG type=write size=2585705 2024-08-08T23:36:01.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.428+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=PLM9G9OJTLE4 type=del size=2523616 2024-08-08T23:36:01.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.432+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~L7U8YLLZ9D6J.0 size=1048576 2024-08-08T23:36:01.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.436+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~L7U8YLLZ9D6J.1 size=267436 2024-08-08T23:36:01.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.440+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=L7U8YLLZ9D6J tag=JH2GGBG9LEMM type=write size=2364588 2024-08-08T23:36:01.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.444+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=1WPRWSHC71RW type=del size=4185087 2024-08-08T23:36:01.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.448+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~VWAFV5CKDDR1.0 size=1048576 2024-08-08T23:36:01.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.448+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~VWAFV5CKDDR1.1 size=604591 2024-08-08T23:36:01.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.452+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=VWAFV5CKDDR1 tag=XSZH34GFS0SN type=write size=2701743 2024-08-08T23:36:01.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.460+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=G5I7TKCAFGG6 type=del size=4084110 2024-08-08T23:36:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.464+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~56NDQHN9OFBB.0 size=631461 2024-08-08T23:36:01.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.468+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=56NDQHN9OFBB tag=YGOTMRT4MYEY type=write size=1680037 2024-08-08T23:36:01.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.472+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~4O4L4LCBAUZE.0 size=299023 2024-08-08T23:36:01.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.472+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=4O4L4LCBAUZE tag=286FFO4D2LCW type=write size=1347599 2024-08-08T23:36:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~DUQ05G8WFXDP.0 size=669977 2024-08-08T23:36:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.480+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=DUQ05G8WFXDP tag=GO24T4CXD4GZ type=write size=1718553 2024-08-08T23:36:01.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.480+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=03A679GLODTZ type=del size=974267 2024-08-08T23:36:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.484+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=HGN6RQ49LU57 type=del 2024-08-08T23:36:01.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.488+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=XW1IIDO3KVYC type=del size=57259 2024-08-08T23:36:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.488+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=5OI9LTX4YO87 type=del 2024-08-08T23:36:01.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.492+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=20AJALNNF2CC type=del size=2464211 2024-08-08T23:36:01.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.492+0000 7fdbd6e2c8c0 1 < canceled operation key=464D0ROM6MHO tag=1ZHZXOKF1KCX type=del size=1614918 2024-08-08T23:36:01.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.496+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=ZLI7F7BTRQL5 type=del size=321289 2024-08-08T23:36:01.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.500+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=SK7JXVX00FZ8 type=del 2024-08-08T23:36:01.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.504+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~XXRDPYFKKHSC.0 size=90149 2024-08-08T23:36:01.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.504+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=XXRDPYFKKHSC tag=LV996J2XNSLE type=write size=1138725 2024-08-08T23:36:01.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.504+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=L0H6M2W1CL5E type=del size=2503490 2024-08-08T23:36:01.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.0 size=1048576 2024-08-08T23:36:01.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.1 size=1048576 2024-08-08T23:36:01.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.2 size=1040058 2024-08-08T23:36:01.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.512+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=NNOY6QY54CC0 tag=EIJ125B2H66H type=write size=4185786 2024-08-08T23:36:01.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.520+0000 7fdbd6e2c8c0 1 < suggested update operation key=2SO6IPMXZUUI tag=9JMN5367AXOY type=del size=2887182 2024-08-08T23:36:01.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.520+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=7F9NUZIYK56L type=del size=496317 2024-08-08T23:36:01.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~0K6GHQA50YXO.0 size=709927 2024-08-08T23:36:01.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.528+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=0K6GHQA50YXO tag=SZC2G2ZNBPO7 type=write size=1758503 2024-08-08T23:36:01.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.532+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=24N1XIBROS3S type=del size=3944498 2024-08-08T23:36:01.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.532+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.0 size=1048576 2024-08-08T23:36:01.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.536+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.1 size=1048576 2024-08-08T23:36:01.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.536+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~HQYXNYW266NS.2 size=402190 2024-08-08T23:36:01.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.544+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=HQYXNYW266NS tag=0PLAAD8M92ZY type=write size=3547918 2024-08-08T23:36:01.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.544+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=L3TQQUTROYWO type=del size=4054481 2024-08-08T23:36:01.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.548+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=E122KY9TKA5P type=del 2024-08-08T23:36:01.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.552+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=M0F6B369LSVX type=del size=2780997 2024-08-08T23:36:01.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.552+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~TYE1IYOI61T3.0 size=1048576 2024-08-08T23:36:01.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.556+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~TYE1IYOI61T3.1 size=939595 2024-08-08T23:36:01.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.560+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=TYE1IYOI61T3 tag=1SED3PS02XB3 type=write size=3036747 2024-08-08T23:36:01.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.564+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~9NI1Q6WQYLJD.0 size=1048576 2024-08-08T23:36:01.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~9NI1Q6WQYLJD.1 size=611053 2024-08-08T23:36:01.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=9NI1Q6WQYLJD tag=SL4IEYNGC2CP type=write size=2708205 2024-08-08T23:36:01.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.572+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=018D6BEZKUX3 type=del 2024-08-08T23:36:01.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.0 size=1048576 2024-08-08T23:36:01.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.1 size=1048576 2024-08-08T23:36:01.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.580+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.2 size=838703 2024-08-08T23:36:01.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.580+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=J34SV9L9MZMU tag=0158WXQEVWXE type=write size=3984431 2024-08-08T23:36:01.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.580+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=PLM9G9OJTLE4 type=del 2024-08-08T23:36:01.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.584+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=3FRHBD34MT2V type=write size=501140 2024-08-08T23:36:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.588+0000 7fdbd6e2c8c0 1 < suggested update operation key=63GVT7KRKCSS tag=1WPRWSHC71RW type=del size=4185087 2024-08-08T23:36:01.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.592+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=1GSWDW3AC1U8 type=del size=3988895 2024-08-08T23:36:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.596+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=G5I7TKCAFGG6 type=del 2024-08-08T23:36:01.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.600+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=IH9M5S2TCGAL type=del size=3738384 2024-08-08T23:36:01.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.604+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~4O4L4LCBAUZE.0 size=299023 2024-08-08T23:36:01.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.608+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=4O4L4LCBAUZE tag=286FFO4D2LCW type=write size=1347599 2024-08-08T23:36:01.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~AK1WNZCF0BMD.0 size=1045528 2024-08-08T23:36:01.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.612+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=AK1WNZCF0BMD tag=KSZPUZ7SBZVF type=write size=2094104 2024-08-08T23:36:01.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.616+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=03A679GLODTZ type=del 2024-08-08T23:36:01.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.620+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=0U41Q7FP1WL6 type=del size=3277648 2024-08-08T23:36:01.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.624+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QANZ3YTL2NQV tag=XW1IIDO3KVYC type=del 2024-08-08T23:36:01.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.628+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~PHZD7QS428NA.0 size=348706 2024-08-08T23:36:01.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.628+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=PHZD7QS428NA tag=R0SLHPB79DCF type=write size=1397282 2024-08-08T23:36:01.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.636+0000 7fdbd6e2c8c0 1 < suggested update operation key=0MT9FJO58ELX tag=20AJALNNF2CC type=del size=2464211 2024-08-08T23:36:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.640+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.0 size=1048576 2024-08-08T23:36:01.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.1 size=1048576 2024-08-08T23:36:01.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.644+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.2 size=983859 2024-08-08T23:36:01.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.644+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=JYQMZRX69VJ1 tag=KFB7TFL26BGG type=write size=4129587 2024-08-08T23:36:01.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.648+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=2SO6IPMXZUUI tag=ZLI7F7BTRQL5 type=del size=321289: (22) Invalid argument 2024-08-08T23:36:01.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.652+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=G0N6RU9EVYT6 type=del size=158668 2024-08-08T23:36:01.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.656+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~XXRDPYFKKHSC.0 size=90149 2024-08-08T23:36:01.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.660+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=XXRDPYFKKHSC tag=LV996J2XNSLE type=write size=1138725 2024-08-08T23:36:01.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.664+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~Y7FWQ3PGXL8D.0 size=477847 2024-08-08T23:36:01.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.664+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=Y7FWQ3PGXL8D tag=30ECO8EWAC5H type=write size=1526423 2024-08-08T23:36:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.668+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.0 size=1048576 2024-08-08T23:36:01.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.668+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.1 size=1048576 2024-08-08T23:36:01.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.672+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~NNOY6QY54CC0.2 size=1040058 2024-08-08T23:36:01.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.676+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=NNOY6QY54CC0 tag=EIJ125B2H66H type=write size=4185786 2024-08-08T23:36:01.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.0 size=1048576 2024-08-08T23:36:01.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.684+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.1 size=1048576 2024-08-08T23:36:01.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.684+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.2 size=677086 2024-08-08T23:36:01.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.684+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=F83XNGDOKT6X tag=4BDK2U3SXYWU type=write size=3822814 2024-08-08T23:36:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.688+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=7F9NUZIYK56L type=del 2024-08-08T23:36:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.692+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=IMA06NTJM0Z9 type=write size=32318 2024-08-08T23:36:01.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.696+0000 7fdbd6e2c8c0 1 < suggested remove operation key=464D0ROM6MHO tag=24N1XIBROS3S type=del 2024-08-08T23:36:01.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.0 size=1048576 2024-08-08T23:36:01.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.1 size=1048576 2024-08-08T23:36:01.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.2 size=553708 2024-08-08T23:36:01.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.704+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=3821GI3J6P1P tag=SX53QU1JO9IJ type=write size=3699436 2024-08-08T23:36:01.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.708+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=L3TQQUTROYWO type=del size=4054481 2024-08-08T23:36:01.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.716+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=WO62NZJUQEVJ type=del size=1296547 2024-08-08T23:36:01.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.724+0000 7fdbd6e2c8c0 1 < suggested remove operation key=XIXN9HLLSJS3 tag=M0F6B369LSVX type=del 2024-08-08T23:36:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.724+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=15XNCZIYV8QJ type=del size=397053 2024-08-08T23:36:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.728+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~9NI1Q6WQYLJD.0 size=1048576 2024-08-08T23:36:01.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~9NI1Q6WQYLJD.1 size=611053 2024-08-08T23:36:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.736+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=9NI1Q6WQYLJD tag=SL4IEYNGC2CP type=write size=2708205 2024-08-08T23:36:01.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.740+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=2JC7TD41E3FH type=del size=3594476 2024-08-08T23:36:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.744+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.0 size=1048576 2024-08-08T23:36:01.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.1 size=1048576 2024-08-08T23:36:01.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~J34SV9L9MZMU.2 size=838703 2024-08-08T23:36:01.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=J34SV9L9MZMU tag=0158WXQEVWXE type=write size=3984431 2024-08-08T23:36:01.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~JGE2TAOJKNTQ.0 size=803820 2024-08-08T23:36:01.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.764+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=JGE2TAOJKNTQ tag=C0HSL2LH77LF type=write size=1852396 2024-08-08T23:36:01.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.768+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YNQU8Z202QCM tag=3FRHBD34MT2V type=write 2024-08-08T23:36:01.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~7R4IUTRYBG2V.0 size=1048576 2024-08-08T23:36:01.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~7R4IUTRYBG2V.1 size=171928 2024-08-08T23:36:01.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.776+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=7R4IUTRYBG2V tag=Z21FPB51865E type=write size=2269080 2024-08-08T23:36:01.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.780+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=1GSWDW3AC1U8 type=del 2024-08-08T23:36:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.0 size=1048576 2024-08-08T23:36:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.1 size=1048576 2024-08-08T23:36:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.2 size=1028688 2024-08-08T23:36:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=NMX2DEFMS6V0 tag=RWV8OPYAR3NN type=write size=4174416 2024-08-08T23:36:01.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.796+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=IH9M5S2TCGAL type=del 2024-08-08T23:36:01.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.800+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=AEEYY30MMHMV type=del size=3928475 2024-08-08T23:36:01.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.800+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_41XLZV9ZY5OP.2~AK1WNZCF0BMD.0 size=1045528 2024-08-08T23:36:01.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.804+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=41XLZV9ZY5OP upload=AK1WNZCF0BMD tag=KSZPUZ7SBZVF type=write size=2094104 2024-08-08T23:36:01.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.808+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=T3KOV0TAQKOP type=del size=3634659 2024-08-08T23:36:01.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.812+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=0U41Q7FP1WL6 type=del 2024-08-08T23:36:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.0 size=1048576 2024-08-08T23:36:01.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.1 size=1048576 2024-08-08T23:36:01.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.2 size=101600 2024-08-08T23:36:01.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=3GT8U1HQU1EK tag=W3V0D4MYIKLN type=write size=3247328 2024-08-08T23:36:01.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.828+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~PHZD7QS428NA.0 size=348706 2024-08-08T23:36:01.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.832+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=PHZD7QS428NA tag=R0SLHPB79DCF type=write size=1397282 2024-08-08T23:36:01.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.836+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=5ZAL4ABHXMU5 type=del size=1552991 2024-08-08T23:36:01.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.840+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.0 size=1048576 2024-08-08T23:36:01.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.840+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.1 size=1048576 2024-08-08T23:36:01.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.844+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~JYQMZRX69VJ1.2 size=983859 2024-08-08T23:36:01.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.848+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=JYQMZRX69VJ1 tag=KFB7TFL26BGG type=write size=4129587 2024-08-08T23:36:01.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.0 size=1048576 2024-08-08T23:36:01.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.856+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.1 size=1048576 2024-08-08T23:36:01.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.2 size=168750 2024-08-08T23:36:01.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.860+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=36HV06QIJE43 tag=E1EPDX6ZDSWG type=write size=3314478 2024-08-08T23:36:01.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.864+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=G0N6RU9EVYT6 type=del 2024-08-08T23:36:01.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.868+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=N9D80RXVLXYX type=del size=1181210 2024-08-08T23:36:01.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.868+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~Y7FWQ3PGXL8D.0 size=477847 2024-08-08T23:36:01.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.876+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=Y7FWQ3PGXL8D tag=30ECO8EWAC5H type=write size=1526423 2024-08-08T23:36:01.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.876+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=BCCC5AHDDUJM type=del size=2675822 2024-08-08T23:36:01.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.880+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.0 size=1048576 2024-08-08T23:36:01.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.1 size=1048576 2024-08-08T23:36:01.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~F83XNGDOKT6X.2 size=677086 2024-08-08T23:36:01.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.892+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=F83XNGDOKT6X tag=4BDK2U3SXYWU type=write size=3822814 2024-08-08T23:36:01.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.892+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=QZCBWO62MFL9 type=del size=3482454 2024-08-08T23:36:01.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.896+0000 7fdbd6e2c8c0 -1 < no bi entry to suggest for operation key=464D0ROM6MHO tag=IMA06NTJM0Z9 type=write size=32318: (2) No such file or directory 2024-08-08T23:36:01.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.896+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=DN0UVKY4F9KV type=del size=18432 2024-08-08T23:36:01.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.900+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.0 size=1048576 2024-08-08T23:36:01.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.1 size=1048576 2024-08-08T23:36:01.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~3821GI3J6P1P.2 size=553708 2024-08-08T23:36:01.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.912+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=3821GI3J6P1P tag=SX53QU1JO9IJ type=write size=3699436 2024-08-08T23:36:01.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~QYG5YFW7GG06.0 size=1048576 2024-08-08T23:36:01.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~QYG5YFW7GG06.1 size=148459 2024-08-08T23:36:01.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.916+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=QYG5YFW7GG06 tag=UUARJ3Y1OI5I type=write size=2245611 2024-08-08T23:36:01.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.920+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=WO62NZJUQEVJ type=del 2024-08-08T23:36:01.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.924+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=MK98HNWEJ38K type=del size=3823465 2024-08-08T23:36:01.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.928+0000 7fdbd6e2c8c0 1 < canceled operation key=VSLBN9AVZK00 tag=15XNCZIYV8QJ type=del size=397053 2024-08-08T23:36:01.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.932+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=LZ70H6WJG6U3 type=del size=2068255 2024-08-08T23:36:01.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.932+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=2JC7TD41E3FH type=del 2024-08-08T23:36:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.936+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=S4EGJT7K44PL type=del size=1606310 2024-08-08T23:36:01.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.940+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_2SO6IPMXZUUI.2~JGE2TAOJKNTQ.0 size=803820 2024-08-08T23:36:01.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.944+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=2SO6IPMXZUUI upload=JGE2TAOJKNTQ tag=C0HSL2LH77LF type=write size=1852396 2024-08-08T23:36:01.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.948+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=KPUBVWBGV9L1 type=write size=693048 2024-08-08T23:36:01.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.952+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~7R4IUTRYBG2V.0 size=1048576 2024-08-08T23:36:01.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.952+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~7R4IUTRYBG2V.1 size=171928 2024-08-08T23:36:01.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.960+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=7R4IUTRYBG2V tag=Z21FPB51865E type=write size=2269080 2024-08-08T23:36:01.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.960+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=JLBU06YDGJBZ type=del size=2132901 2024-08-08T23:36:01.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.964+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.0 size=1048576 2024-08-08T23:36:01.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.1 size=1048576 2024-08-08T23:36:01.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.964+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~NMX2DEFMS6V0.2 size=1028688 2024-08-08T23:36:01.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.972+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=NMX2DEFMS6V0 tag=RWV8OPYAR3NN type=write size=4174416 2024-08-08T23:36:01.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.972+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=PGZRDUWLWWIP type=del size=192190 2024-08-08T23:36:01.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.976+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=AEEYY30MMHMV type=del 2024-08-08T23:36:01.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.980+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=7MUDYMYD5OEL type=del size=2592639 2024-08-08T23:36:01.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.984+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=T3KOV0TAQKOP type=del 2024-08-08T23:36:01.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.988+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=A2GEG5FBWIOC type=write size=1000641 2024-08-08T23:36:01.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.988+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.0 size=1048576 2024-08-08T23:36:01.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.1 size=1048576 2024-08-08T23:36:01.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:01.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~3GT8U1HQU1EK.2 size=101600 2024-08-08T23:36:02.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.000+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=3GT8U1HQU1EK tag=W3V0D4MYIKLN type=write size=3247328 2024-08-08T23:36:02.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.0 size=1048576 2024-08-08T23:36:02.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.1 size=1048576 2024-08-08T23:36:02.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.016+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.2 size=450390 2024-08-08T23:36:02.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.016+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=T4P9CU0YLN5Y tag=3NIWMU9Y88AW type=write size=3596118 2024-08-08T23:36:02.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.020+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=5ZAL4ABHXMU5 type=del 2024-08-08T23:36:02.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.024+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=P2Y0QDHH5M0E type=del size=2514853 2024-08-08T23:36:02.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.0 size=1048576 2024-08-08T23:36:02.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.1 size=1048576 2024-08-08T23:36:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.032+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~36HV06QIJE43.2 size=168750 2024-08-08T23:36:02.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.036+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=36HV06QIJE43 tag=E1EPDX6ZDSWG type=write size=3314478 2024-08-08T23:36:02.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.0 size=1048576 2024-08-08T23:36:02.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.1 size=1048576 2024-08-08T23:36:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.2 size=825375 2024-08-08T23:36:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.044+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=1G0KU8TF8JSU tag=QA45RE5LB2LO type=write size=3971103 2024-08-08T23:36:02.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=N9D80RXVLXYX type=del 2024-08-08T23:36:02.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.0 size=1048576 2024-08-08T23:36:02.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.1 size=1048576 2024-08-08T23:36:02.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.2 size=886477 2024-08-08T23:36:02.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.056+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=IIGMYI7LZ3H8 tag=B29TU1LKGEMA type=write size=4032205 2024-08-08T23:36:02.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.060+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=BCCC5AHDDUJM type=del 2024-08-08T23:36:02.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.064+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~5IY6UA7E3OUI.0 size=1048576 2024-08-08T23:36:02.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.068+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~5IY6UA7E3OUI.1 size=866985 2024-08-08T23:36:02.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.068+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=5IY6UA7E3OUI tag=L36O2K8ZCXHM type=write size=2964137 2024-08-08T23:36:02.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.072+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=QZCBWO62MFL9 type=del 2024-08-08T23:36:02.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.072+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=1L5UVI6XJ5EW type=del size=2033072 2024-08-08T23:36:02.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.076+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=DN0UVKY4F9KV type=del 2024-08-08T23:36:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.080+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=LTE00WYOPXY6 type=del size=2059975 2024-08-08T23:36:02.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~QYG5YFW7GG06.0 size=1048576 2024-08-08T23:36:02.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~QYG5YFW7GG06.1 size=148459 2024-08-08T23:36:02.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.088+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=QYG5YFW7GG06 tag=UUARJ3Y1OI5I type=write size=2245611 2024-08-08T23:36:02.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.092+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=AAK33BQB6F5K type=del size=423478 2024-08-08T23:36:02.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.092+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=MK98HNWEJ38K type=del 2024-08-08T23:36:02.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.096+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=YMKW357W1Y3N type=del size=171526 2024-08-08T23:36:02.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.100+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=LZ70H6WJG6U3 type=del 2024-08-08T23:36:02.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.0 size=1048576 2024-08-08T23:36:02.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.1 size=1048576 2024-08-08T23:36:02.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.108+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.2 size=806754 2024-08-08T23:36:02.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.108+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=K6ERSCOQF54K tag=M37RUOAXLA2U type=write size=3952482 2024-08-08T23:36:02.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.112+0000 7fdbd6e2c8c0 1 < canceled operation key=QANZ3YTL2NQV tag=S4EGJT7K44PL type=del size=1606310 2024-08-08T23:36:02.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.112+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=WDW1LV2L5H6J type=write size=720488 2024-08-08T23:36:02.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.116+0000 7fdbd6e2c8c0 1 < completed write operation key=903K2EO77YTJ tag=KPUBVWBGV9L1 type=write size=693048 2024-08-08T23:36:02.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.120+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=ZV2KAVXMQVIL type=del size=1643663 2024-08-08T23:36:02.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.124+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=JLBU06YDGJBZ type=del 2024-08-08T23:36:02.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.124+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=Z34SOGVL08NP type=del size=2692556 2024-08-08T23:36:02.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.132+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YNQU8Z202QCM tag=PGZRDUWLWWIP type=del 2024-08-08T23:36:02.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.132+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=KEVX9KTMY5KR type=del size=2820086 2024-08-08T23:36:02.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.140+0000 7fdbd6e2c8c0 1 < suggested remove operation key=VSLBN9AVZK00 tag=7MUDYMYD5OEL type=del 2024-08-08T23:36:02.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.140+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=7K2RIL81I2WY type=del size=4114983 2024-08-08T23:36:02.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.144+0000 7fdbd6e2c8c0 1 < completed write operation key=2SO6IPMXZUUI tag=A2GEG5FBWIOC type=write size=1000641 2024-08-08T23:36:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.148+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=TJRLMV33T786 type=del size=959882 2024-08-08T23:36:02.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.0 size=1048576 2024-08-08T23:36:02.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.148+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.1 size=1048576 2024-08-08T23:36:02.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.152+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~T4P9CU0YLN5Y.2 size=450390 2024-08-08T23:36:02.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.156+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZQ8GOX9RSTBB upload=T4P9CU0YLN5Y tag=3NIWMU9Y88AW type=write size=3596118 2024-08-08T23:36:02.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.160+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=MGWV2FHZQ31W type=del size=3070699 2024-08-08T23:36:02.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.160+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=P2Y0QDHH5M0E type=del 2024-08-08T23:36:02.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~VUQ0SUGTWBYO.0 size=1048576 2024-08-08T23:36:02.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~VUQ0SUGTWBYO.1 size=709112 2024-08-08T23:36:02.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=VUQ0SUGTWBYO tag=WCNF6216CB93 type=write size=2806264 2024-08-08T23:36:02.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.168+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.0 size=1048576 2024-08-08T23:36:02.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.1 size=1048576 2024-08-08T23:36:02.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.176+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~1G0KU8TF8JSU.2 size=825375 2024-08-08T23:36:02.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.180+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=1G0KU8TF8JSU tag=QA45RE5LB2LO type=write size=3971103 2024-08-08T23:36:02.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~QCL5HFJ1AV3S.0 size=1048576 2024-08-08T23:36:02.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.188+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~QCL5HFJ1AV3S.1 size=382647 2024-08-08T23:36:02.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.188+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=QCL5HFJ1AV3S tag=934VUUHCZD6H type=write size=2479799 2024-08-08T23:36:02.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.0 size=1048576 2024-08-08T23:36:02.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.1 size=1048576 2024-08-08T23:36:02.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.196+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~IIGMYI7LZ3H8.2 size=886477 2024-08-08T23:36:02.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=IIGMYI7LZ3H8 tag=B29TU1LKGEMA type=write size=4032205 2024-08-08T23:36:02.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.204+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=O37MV6YS1I4J type=write size=248965 2024-08-08T23:36:02.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~5IY6UA7E3OUI.0 size=1048576 2024-08-08T23:36:02.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~5IY6UA7E3OUI.1 size=866985 2024-08-08T23:36:02.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.216+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=5IY6UA7E3OUI tag=L36O2K8ZCXHM type=write size=2964137 2024-08-08T23:36:02.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.216+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=6FXRBWFTCSIB type=del size=3726522 2024-08-08T23:36:02.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.220+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=YNQU8Z202QCM tag=1L5UVI6XJ5EW type=del size=2033072: (22) Invalid argument 2024-08-08T23:36:02.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.0 size=1048576 2024-08-08T23:36:02.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.1 size=1048576 2024-08-08T23:36:02.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.2 size=816121 2024-08-08T23:36:02.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.232+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=JXOCYKRQ800B tag=1JQBSBCEWOTX type=write size=3961849 2024-08-08T23:36:02.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.232+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=LTE00WYOPXY6 type=del 2024-08-08T23:36:02.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.240+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.0 size=1048576 2024-08-08T23:36:02.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.1 size=1048576 2024-08-08T23:36:02.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.2 size=726675 2024-08-08T23:36:02.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.244+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=RHVS3P88SW3K tag=65PIDENVMNP4 type=write size=3872403 2024-08-08T23:36:02.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.248+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=AAK33BQB6F5K type=del 2024-08-08T23:36:02.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.252+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~H5IPXLPMXYRS.0 size=43488 2024-08-08T23:36:02.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.252+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=H5IPXLPMXYRS tag=H144RO58XKC9 type=write size=1092064 2024-08-08T23:36:02.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.256+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=YMKW357W1Y3N type=del 2024-08-08T23:36:02.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~Q95JKDVGJ65I.0 size=1048576 2024-08-08T23:36:02.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~Q95JKDVGJ65I.1 size=347465 2024-08-08T23:36:02.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=Q95JKDVGJ65I tag=QBLNK63YW0XJ type=write size=2444617 2024-08-08T23:36:02.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.268+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.0 size=1048576 2024-08-08T23:36:02.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.272+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.1 size=1048576 2024-08-08T23:36:02.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.272+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~K6ERSCOQF54K.2 size=806754 2024-08-08T23:36:02.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.280+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=K6ERSCOQF54K tag=M37RUOAXLA2U type=write size=3952482 2024-08-08T23:36:02.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~WJ4L7UCU0BY7.0 size=1048576 2024-08-08T23:36:02.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~WJ4L7UCU0BY7.1 size=499343 2024-08-08T23:36:02.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.288+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=WJ4L7UCU0BY7 tag=DWUQAFZA12R8 type=write size=2596495 2024-08-08T23:36:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.292+0000 7fdbd6e2c8c0 1 < canceled operation key=V3TA5KZ95NXT tag=WDW1LV2L5H6J type=write size=720488 2024-08-08T23:36:02.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.296+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~GUNNPC3E7K4M.0 size=1048576 2024-08-08T23:36:02.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.300+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~GUNNPC3E7K4M.1 size=776545 2024-08-08T23:36:02.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.300+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=GUNNPC3E7K4M tag=R5KAQD5HCA3T type=write size=2873697 2024-08-08T23:36:02.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.304+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=ZV2KAVXMQVIL type=del 2024-08-08T23:36:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.308+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=SSD0REBAR13Q type=del size=1576070 2024-08-08T23:36:02.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.312+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZBEB2Q3J9Z0D tag=Z34SOGVL08NP type=del size=2692556 2024-08-08T23:36:02.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.320+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.0 size=1048576 2024-08-08T23:36:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.320+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.1 size=1048576 2024-08-08T23:36:02.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.324+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.2 size=866880 2024-08-08T23:36:02.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.324+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=KRQXNZEZX1DT tag=YMKRG7W5UGGL type=write size=4012608 2024-08-08T23:36:02.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.324+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=ZBEB2Q3J9Z0D tag=KEVX9KTMY5KR type=del size=2820086: (22) Invalid argument 2024-08-08T23:36:02.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~166BUO4YHEUF.0 size=521530 2024-08-08T23:36:02.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.332+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=166BUO4YHEUF tag=H7KQ49M09429 type=write size=1570106 2024-08-08T23:36:02.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.336+0000 7fdbd6e2c8c0 1 < suggested remove operation key=P3H05VKM0ZGJ tag=7K2RIL81I2WY type=del 2024-08-08T23:36:02.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.340+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=E3L37WOTSI9F type=del size=2378896 2024-08-08T23:36:02.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.344+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=TJRLMV33T786 type=del 2024-08-08T23:36:02.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.348+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=U1J8WTI2TZZ2 type=write size=851823 2024-08-08T23:36:02.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.348+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=MGWV2FHZQ31W type=del 2024-08-08T23:36:02.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.356+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~D77NSD8YIE85.0 size=1048576 2024-08-08T23:36:02.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.356+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~D77NSD8YIE85.1 size=399903 2024-08-08T23:36:02.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.356+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=D77NSD8YIE85 tag=PW050UBRIVKL type=write size=2497055 2024-08-08T23:36:02.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.360+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~VUQ0SUGTWBYO.0 size=1048576 2024-08-08T23:36:02.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.360+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_41XLZV9ZY5OP.2~VUQ0SUGTWBYO.1 size=709112 2024-08-08T23:36:02.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.368+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=41XLZV9ZY5OP upload=VUQ0SUGTWBYO tag=WCNF6216CB93 type=write size=2806264 2024-08-08T23:36:02.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.372+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~452184CQKNRW.0 size=1048576 2024-08-08T23:36:02.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.376+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~452184CQKNRW.1 size=533691 2024-08-08T23:36:02.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.376+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=452184CQKNRW tag=901HSLO9AX9F type=write size=2630843 2024-08-08T23:36:02.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.380+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~QCL5HFJ1AV3S.0 size=1048576 2024-08-08T23:36:02.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.380+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~QCL5HFJ1AV3S.1 size=382647 2024-08-08T23:36:02.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.384+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=QCL5HFJ1AV3S tag=934VUUHCZD6H type=write size=2479799 2024-08-08T23:36:02.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~8Y7Y1VLEMZQC.0 size=1048576 2024-08-08T23:36:02.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~8Y7Y1VLEMZQC.1 size=891266 2024-08-08T23:36:02.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.392+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=8Y7Y1VLEMZQC tag=JJWL3KRQC5YK type=write size=2988418 2024-08-08T23:36:02.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.396+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=O37MV6YS1I4J type=write size=248965 2024-08-08T23:36:02.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~3N2QLWGH1FVU.0 size=1048576 2024-08-08T23:36:02.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~3N2QLWGH1FVU.1 size=952367 2024-08-08T23:36:02.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.404+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=3N2QLWGH1FVU tag=WS7EJOKK1WW5 type=write size=3049519 2024-08-08T23:36:02.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.408+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=6FXRBWFTCSIB type=del 2024-08-08T23:36:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.412+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=JASQQ6OVTQ60 type=write size=998787 2024-08-08T23:36:02.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.416+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.0 size=1048576 2024-08-08T23:36:02.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.1 size=1048576 2024-08-08T23:36:02.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.420+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0MT9FJO58ELX.2~JXOCYKRQ800B.2 size=816121 2024-08-08T23:36:02.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.428+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0MT9FJO58ELX upload=JXOCYKRQ800B tag=1JQBSBCEWOTX type=write size=3961849 2024-08-08T23:36:02.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.432+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=98C6JWWSRKV1 type=del size=4106743 2024-08-08T23:36:02.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.432+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.0 size=1048576 2024-08-08T23:36:02.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.436+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.1 size=1048576 2024-08-08T23:36:02.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~RHVS3P88SW3K.2 size=726675 2024-08-08T23:36:02.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.448+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=RHVS3P88SW3K tag=65PIDENVMNP4 type=write size=3872403 2024-08-08T23:36:02.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.452+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.0 size=1048576 2024-08-08T23:36:02.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.456+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.1 size=1048576 2024-08-08T23:36:02.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.460+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.2 size=121281 2024-08-08T23:36:02.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.460+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=H6IZBEZ34BUY tag=SVAGDDOECDWK type=write size=3267009 2024-08-08T23:36:02.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.460+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~H5IPXLPMXYRS.0 size=43488 2024-08-08T23:36:02.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.468+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=H5IPXLPMXYRS tag=H144RO58XKC9 type=write size=1092064 2024-08-08T23:36:02.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.472+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=NZ0ODKD9RGNA type=del size=3899232 2024-08-08T23:36:02.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.472+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~Q95JKDVGJ65I.0 size=1048576 2024-08-08T23:36:02.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~Q95JKDVGJ65I.1 size=347465 2024-08-08T23:36:02.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.480+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=Q95JKDVGJ65I tag=QBLNK63YW0XJ type=write size=2444617 2024-08-08T23:36:02.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.484+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~6OM2G8K16PQW.0 size=1048576 2024-08-08T23:36:02.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.488+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~6OM2G8K16PQW.1 size=471064 2024-08-08T23:36:02.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.488+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=6OM2G8K16PQW tag=LCD642BZN5P0 type=write size=2568216 2024-08-08T23:36:02.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.492+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~WJ4L7UCU0BY7.0 size=1048576 2024-08-08T23:36:02.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.496+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~WJ4L7UCU0BY7.1 size=499343 2024-08-08T23:36:02.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.500+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=WJ4L7UCU0BY7 tag=DWUQAFZA12R8 type=write size=2596495 2024-08-08T23:36:02.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.504+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=60NN23KCJNVA type=del size=3000599 2024-08-08T23:36:02.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~GUNNPC3E7K4M.0 size=1048576 2024-08-08T23:36:02.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~GUNNPC3E7K4M.1 size=776545 2024-08-08T23:36:02.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.516+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=GUNNPC3E7K4M tag=R5KAQD5HCA3T type=write size=2873697 2024-08-08T23:36:02.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.520+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=X0F6FSLSDUL8 type=del size=1700443 2024-08-08T23:36:02.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.520+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=SSD0REBAR13Q type=del 2024-08-08T23:36:02.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.528+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~1CDHRC2Q93J6.0 size=239181 2024-08-08T23:36:02.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.528+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=1CDHRC2Q93J6 tag=Z71HJR9GXPE0 type=write size=1287757 2024-08-08T23:36:02.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.528+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.0 size=1048576 2024-08-08T23:36:02.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.528+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.1 size=1048576 2024-08-08T23:36:02.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.532+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~KRQXNZEZX1DT.2 size=866880 2024-08-08T23:36:02.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.536+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=KRQXNZEZX1DT tag=YMKRG7W5UGGL type=write size=4012608 2024-08-08T23:36:02.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.540+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=30XESR5ZI9I0 type=del size=858681 2024-08-08T23:36:02.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.540+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_0XF26POOKR3V.2~166BUO4YHEUF.0 size=521530 2024-08-08T23:36:02.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.548+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=0XF26POOKR3V upload=166BUO4YHEUF tag=H7KQ49M09429 type=write size=1570106 2024-08-08T23:36:02.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.552+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~IW8VJCM9PVDQ.0 size=669452 2024-08-08T23:36:02.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.552+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=IW8VJCM9PVDQ tag=DT1PQF44IV90 type=write size=1718028 2024-08-08T23:36:02.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.556+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=E3L37WOTSI9F type=del 2024-08-08T23:36:02.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.560+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.0 size=1048576 2024-08-08T23:36:02.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.564+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.1 size=1048576 2024-08-08T23:36:02.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.2 size=15259 2024-08-08T23:36:02.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=9XHA13QFY5IB tag=1YP7Q4PXXMZL type=write size=3160987 2024-08-08T23:36:02.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.572+0000 7fdbd6e2c8c0 1 < completed write operation key=0MT9FJO58ELX tag=U1J8WTI2TZZ2 type=write size=851823 2024-08-08T23:36:02.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~69CZ0YUTQ937.0 size=753579 2024-08-08T23:36:02.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.576+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=69CZ0YUTQ937 tag=N9AO91G0WPTM type=write size=1802155 2024-08-08T23:36:02.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~D77NSD8YIE85.0 size=1048576 2024-08-08T23:36:02.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.584+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~D77NSD8YIE85.1 size=399903 2024-08-08T23:36:02.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.592+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=D77NSD8YIE85 tag=PW050UBRIVKL type=write size=2497055 2024-08-08T23:36:02.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.596+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.0 size=1048576 2024-08-08T23:36:02.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.600+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.1 size=1048576 2024-08-08T23:36:02.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.600+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.2 size=382972 2024-08-08T23:36:02.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.600+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=HN4IHHNOF1OI tag=BMLANNXI1B4H type=write size=3528700 2024-08-08T23:36:02.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.604+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~452184CQKNRW.0 size=1048576 2024-08-08T23:36:02.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.608+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~452184CQKNRW.1 size=533691 2024-08-08T23:36:02.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.612+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=452184CQKNRW tag=901HSLO9AX9F type=write size=2630843 2024-08-08T23:36:02.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.616+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=OSIKTCW50MBN type=del size=1190077 2024-08-08T23:36:02.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.620+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~8Y7Y1VLEMZQC.0 size=1048576 2024-08-08T23:36:02.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.624+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~8Y7Y1VLEMZQC.1 size=891266 2024-08-08T23:36:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.628+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=8Y7Y1VLEMZQC tag=JJWL3KRQC5YK type=write size=2988418 2024-08-08T23:36:02.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.632+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=XQOFTVCWW0K5 type=del size=2462926 2024-08-08T23:36:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.636+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~3N2QLWGH1FVU.0 size=1048576 2024-08-08T23:36:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.636+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~3N2QLWGH1FVU.1 size=952367 2024-08-08T23:36:02.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.640+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=3N2QLWGH1FVU tag=WS7EJOKK1WW5 type=write size=3049519 2024-08-08T23:36:02.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.644+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=ERN39DMDTFRV type=del size=2680429 2024-08-08T23:36:02.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.648+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=JASQQ6OVTQ60 type=write size=998787 2024-08-08T23:36:02.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.652+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=KFZBSFZNVU0I type=del size=825982 2024-08-08T23:36:02.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.656+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=98C6JWWSRKV1 type=del 2024-08-08T23:36:02.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.656+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=W46GVDEJK6LD type=del size=449119 2024-08-08T23:36:02.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.660+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.0 size=1048576 2024-08-08T23:36:02.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.1 size=1048576 2024-08-08T23:36:02.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~H6IZBEZ34BUY.2 size=121281 2024-08-08T23:36:02.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.672+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=H6IZBEZ34BUY tag=SVAGDDOECDWK type=write size=3267009 2024-08-08T23:36:02.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.676+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~QQF4ZTEWQUYX.0 size=1048576 2024-08-08T23:36:02.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~QQF4ZTEWQUYX.1 size=490693 2024-08-08T23:36:02.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.680+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=QQF4ZTEWQUYX tag=ZDKVEU3PWWV9 type=write size=2587845 2024-08-08T23:36:02.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.684+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=NZ0ODKD9RGNA type=del 2024-08-08T23:36:02.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.684+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=RXJO9K3GXJI2 type=del size=2532578 2024-08-08T23:36:02.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.688+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~6OM2G8K16PQW.0 size=1048576 2024-08-08T23:36:02.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~6OM2G8K16PQW.1 size=471064 2024-08-08T23:36:02.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.696+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=6OM2G8K16PQW tag=LCD642BZN5P0 type=write size=2568216 2024-08-08T23:36:02.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.0 size=1048576 2024-08-08T23:36:02.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.1 size=1048576 2024-08-08T23:36:02.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.2 size=154747 2024-08-08T23:36:02.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.704+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=KO29QS2LQF5U tag=W1TEFL5E4TFW type=write size=3300475 2024-08-08T23:36:02.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.708+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=60NN23KCJNVA type=del 2024-08-08T23:36:02.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.716+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~9B9MM0BP71WK.0 size=1048576 2024-08-08T23:36:02.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.716+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~9B9MM0BP71WK.1 size=366465 2024-08-08T23:36:02.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.716+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=9B9MM0BP71WK tag=RRGJYH5WIPXO type=write size=2463617 2024-08-08T23:36:02.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.720+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=X0F6FSLSDUL8 type=del 2024-08-08T23:36:02.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.724+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=SKYSPW7JUM2X type=write size=39975 2024-08-08T23:36:02.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~1CDHRC2Q93J6.0 size=239181 2024-08-08T23:36:02.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.732+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=1CDHRC2Q93J6 tag=Z71HJR9GXPE0 type=write size=1287757 2024-08-08T23:36:02.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.736+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.0 size=1048576 2024-08-08T23:36:02.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.740+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.1 size=1048576 2024-08-08T23:36:02.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.740+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.2 size=32233 2024-08-08T23:36:02.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.740+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=E8AOM13RWE2H tag=6T8YS5A3MVQ8 type=write size=3177961 2024-08-08T23:36:02.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.744+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=30XESR5ZI9I0 type=del 2024-08-08T23:36:02.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.748+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=TW2VEBKYTXMH type=write size=44543 2024-08-08T23:36:02.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~IW8VJCM9PVDQ.0 size=669452 2024-08-08T23:36:02.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=IW8VJCM9PVDQ tag=DT1PQF44IV90 type=write size=1718028 2024-08-08T23:36:02.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.760+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=2NHHBPMLMZ3E type=del size=3913470 2024-08-08T23:36:02.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.760+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.0 size=1048576 2024-08-08T23:36:02.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.760+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.1 size=1048576 2024-08-08T23:36:02.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.764+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~9XHA13QFY5IB.2 size=15259 2024-08-08T23:36:02.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.768+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=9XHA13QFY5IB tag=1YP7Q4PXXMZL type=write size=3160987 2024-08-08T23:36:02.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.772+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=D7HDECBRMD7A type=del size=533172 2024-08-08T23:36:02.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.776+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~69CZ0YUTQ937.0 size=753579 2024-08-08T23:36:02.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.780+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=69CZ0YUTQ937 tag=N9AO91G0WPTM type=write size=1802155 2024-08-08T23:36:02.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.784+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.0 size=1048576 2024-08-08T23:36:02.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.1 size=1048576 2024-08-08T23:36:02.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.2 size=717245 2024-08-08T23:36:02.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.788+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=UZUV5WET3MLT tag=8D1I6MG7PHVR type=write size=3862973 2024-08-08T23:36:02.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.792+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.0 size=1048576 2024-08-08T23:36:02.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.792+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.1 size=1048576 2024-08-08T23:36:02.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~HN4IHHNOF1OI.2 size=382972 2024-08-08T23:36:02.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.800+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=JWTLJG79MYI5 upload=HN4IHHNOF1OI tag=BMLANNXI1B4H type=write size=3528700 2024-08-08T23:36:02.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.804+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=4BE99VQCGU5N type=write size=773100 2024-08-08T23:36:02.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.808+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=OSIKTCW50MBN type=del 2024-08-08T23:36:02.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.812+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.0 size=1048576 2024-08-08T23:36:02.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.816+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.1 size=1048576 2024-08-08T23:36:02.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.816+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.2 size=198566 2024-08-08T23:36:02.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.816+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=YD67I9PHTESF tag=TFQOEGK7SPWY type=write size=3344294 2024-08-08T23:36:02.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.820+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=XQOFTVCWW0K5 type=del 2024-08-08T23:36:02.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~VFPCMHINUGNY.0 size=437394 2024-08-08T23:36:02.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=VFPCMHINUGNY tag=D9289OIVCPQ4 type=write size=1485970 2024-08-08T23:36:02.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.828+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=ERN39DMDTFRV type=del 2024-08-08T23:36:02.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.828+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=WO2IY6Z44LSN type=write size=752689 2024-08-08T23:36:02.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.836+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=KFZBSFZNVU0I type=del 2024-08-08T23:36:02.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.840+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.0 size=1048576 2024-08-08T23:36:02.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.1 size=1048576 2024-08-08T23:36:02.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.2 size=56698 2024-08-08T23:36:02.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.844+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=VZTFXKE2KVJA tag=OR63ATFAZEUP type=write size=3202426 2024-08-08T23:36:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.848+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=W46GVDEJK6LD type=del 2024-08-08T23:36:02.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.852+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~PDZ063QL5VKZ.0 size=484780 2024-08-08T23:36:02.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.852+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=PDZ063QL5VKZ tag=8AE5G9CU0XLM type=write size=1533356 2024-08-08T23:36:02.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.856+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~QQF4ZTEWQUYX.0 size=1048576 2024-08-08T23:36:02.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.860+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~QQF4ZTEWQUYX.1 size=490693 2024-08-08T23:36:02.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.864+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=QQF4ZTEWQUYX tag=ZDKVEU3PWWV9 type=write size=2587845 2024-08-08T23:36:02.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.868+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=22QUNY7I6JKO type=del size=3852180 2024-08-08T23:36:02.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.868+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=RXJO9K3GXJI2 type=del 2024-08-08T23:36:02.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.872+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=H7567PNLF02A type=del size=409395 2024-08-08T23:36:02.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.872+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.0 size=1048576 2024-08-08T23:36:02.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.876+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.1 size=1048576 2024-08-08T23:36:02.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.876+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~KO29QS2LQF5U.2 size=154747 2024-08-08T23:36:02.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.880+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=KO29QS2LQF5U tag=W1TEFL5E4TFW type=write size=3300475 2024-08-08T23:36:02.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~JDA235GR068E.0 size=1048576 2024-08-08T23:36:02.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.888+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~JDA235GR068E.1 size=121094 2024-08-08T23:36:02.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.888+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=JDA235GR068E tag=PSGP0RII2FQJ type=write size=2218246 2024-08-08T23:36:02.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.888+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~9B9MM0BP71WK.0 size=1048576 2024-08-08T23:36:02.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~9B9MM0BP71WK.1 size=366465 2024-08-08T23:36:02.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.896+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=9B9MM0BP71WK tag=RRGJYH5WIPXO type=write size=2463617 2024-08-08T23:36:02.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.896+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=HVTGZF4G5YFG type=write size=462698 2024-08-08T23:36:02.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.900+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=SKYSPW7JUM2X type=write size=39975 2024-08-08T23:36:02.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.900+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=BK8176U0Z6FH type=del size=2045599 2024-08-08T23:36:02.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.904+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.0 size=1048576 2024-08-08T23:36:02.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.1 size=1048576 2024-08-08T23:36:02.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.908+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~E8AOM13RWE2H.2 size=32233 2024-08-08T23:36:02.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.912+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=E8AOM13RWE2H tag=6T8YS5A3MVQ8 type=write size=3177961 2024-08-08T23:36:02.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~MAFTX52MYEMJ.0 size=373244 2024-08-08T23:36:02.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.916+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=MAFTX52MYEMJ tag=RE5Z1LVFH3W6 type=write size=1421820 2024-08-08T23:36:02.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.920+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YO2FZOR7H0EX tag=TW2VEBKYTXMH type=write 2024-08-08T23:36:02.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.920+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=BGW6NQ7IWO09 type=del size=170308 2024-08-08T23:36:02.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.928+0000 7fdbd6e2c8c0 1 < suggested update operation key=QJB9DETMSY4X tag=2NHHBPMLMZ3E type=del size=3913470 2024-08-08T23:36:02.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.928+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=FGINNZZ97733 type=write size=255711 2024-08-08T23:36:02.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.932+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=D7HDECBRMD7A type=del 2024-08-08T23:36:02.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~TF5OKFJ49951.0 size=1048576 2024-08-08T23:36:02.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~TF5OKFJ49951.1 size=411348 2024-08-08T23:36:02.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.936+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=TF5OKFJ49951 tag=YR3NJ8VK6ELM type=write size=2508500 2024-08-08T23:36:02.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.0 size=1048576 2024-08-08T23:36:02.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.940+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.1 size=1048576 2024-08-08T23:36:02.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~UZUV5WET3MLT.2 size=717245 2024-08-08T23:36:02.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.944+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=D81PQ0FJVNEE upload=UZUV5WET3MLT tag=8D1I6MG7PHVR type=write size=3862973 2024-08-08T23:36:02.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.948+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.0 size=1048576 2024-08-08T23:36:02.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.1 size=1048576 2024-08-08T23:36:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.2 size=147803 2024-08-08T23:36:02.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.952+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=Y98U1IPF1RE1 tag=JL3T6V9V0871 type=write size=3293531 2024-08-08T23:36:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.956+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=4BE99VQCGU5N type=write size=773100 2024-08-08T23:36:02.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.956+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=ZNQZP5Z0FBXQ type=del size=3221498 2024-08-08T23:36:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.0 size=1048576 2024-08-08T23:36:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.960+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.1 size=1048576 2024-08-08T23:36:02.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~YD67I9PHTESF.2 size=198566 2024-08-08T23:36:02.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.968+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=YD67I9PHTESF tag=TFQOEGK7SPWY type=write size=3344294 2024-08-08T23:36:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.968+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=ZSDKACPTGD75 type=del size=1683224 2024-08-08T23:36:02.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~VFPCMHINUGNY.0 size=437394 2024-08-08T23:36:02.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.976+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=VFPCMHINUGNY tag=D9289OIVCPQ4 type=write size=1485970 2024-08-08T23:36:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.980+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~H3IMGPVYGC0J.0 size=367590 2024-08-08T23:36:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.980+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=H3IMGPVYGC0J tag=8OU0VF6KF1JI type=write size=1416166 2024-08-08T23:36:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.984+0000 7fdbd6e2c8c0 1 < completed write operation key=MNV404EWJHC1 tag=WO2IY6Z44LSN type=write size=752689 2024-08-08T23:36:02.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~Z15QTZXURCUU.0 size=1048576 2024-08-08T23:36:02.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~Z15QTZXURCUU.1 size=417547 2024-08-08T23:36:02.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.988+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=Z15QTZXURCUU tag=EQ3751BVHM3E type=write size=2514699 2024-08-08T23:36:02.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.0 size=1048576 2024-08-08T23:36:02.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.992+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.1 size=1048576 2024-08-08T23:36:02.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.996+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~VZTFXKE2KVJA.2 size=56698 2024-08-08T23:36:02.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:02.996+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=VZTFXKE2KVJA tag=OR63ATFAZEUP type=write size=3202426 2024-08-08T23:36:03.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~39X7M3FX0AHJ.0 size=521930 2024-08-08T23:36:03.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.004+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=39X7M3FX0AHJ tag=7PN8EBJGAJ2G type=write size=1570506 2024-08-08T23:36:03.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.004+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~PDZ063QL5VKZ.0 size=484780 2024-08-08T23:36:03.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.008+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=PDZ063QL5VKZ tag=8AE5G9CU0XLM type=write size=1533356 2024-08-08T23:36:03.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.012+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=2U5A5SY4KG7N type=del size=1697798 2024-08-08T23:36:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.012+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=QJB9DETMSY4X tag=22QUNY7I6JKO type=del size=3852180: (22) Invalid argument 2024-08-08T23:36:03.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.016+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=UF5P9N5K5ZOT type=del size=2714803 2024-08-08T23:36:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.020+0000 7fdbd6e2c8c0 1 < suggested remove operation key=GMVEOO97I8YH tag=H7567PNLF02A type=del 2024-08-08T23:36:03.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.024+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~YXT90N2U32S0.0 size=12035 2024-08-08T23:36:03.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.024+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=YXT90N2U32S0 tag=02JR70CN3GQ7 type=write size=1060611 2024-08-08T23:36:03.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~JDA235GR068E.0 size=1048576 2024-08-08T23:36:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~JDA235GR068E.1 size=121094 2024-08-08T23:36:03.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.032+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=JDA235GR068E tag=PSGP0RII2FQJ type=write size=2218246 2024-08-08T23:36:03.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.036+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=YC1XPRUEANR0 type=write size=257540 2024-08-08T23:36:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.036+0000 7fdbd6e2c8c0 1 < completed write operation key=JWTLJG79MYI5 tag=HVTGZF4G5YFG type=write size=462698 2024-08-08T23:36:03.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.0 size=1048576 2024-08-08T23:36:03.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.1 size=1048576 2024-08-08T23:36:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.2 size=304771 2024-08-08T23:36:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.044+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=L4TUE5FO7TBH tag=DCMOYGPJQA1A type=write size=3450499 2024-08-08T23:36:03.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=BK8176U0Z6FH type=del 2024-08-08T23:36:03.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~3025R1OCNHOJ.0 size=1048576 2024-08-08T23:36:03.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.052+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~3025R1OCNHOJ.1 size=496310 2024-08-08T23:36:03.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.052+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=3025R1OCNHOJ tag=DPZM7FT7OT3B type=write size=2593462 2024-08-08T23:36:03.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~MAFTX52MYEMJ.0 size=373244 2024-08-08T23:36:03.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=MAFTX52MYEMJ tag=RE5Z1LVFH3W6 type=write size=1421820 2024-08-08T23:36:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.060+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=BYSZ6M2W6Y6A type=del size=767961 2024-08-08T23:36:03.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.068+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=BGW6NQ7IWO09 type=del 2024-08-08T23:36:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.0 size=1048576 2024-08-08T23:36:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.1 size=1048576 2024-08-08T23:36:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.2 size=267517 2024-08-08T23:36:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=UT7ZSM3RIT01 tag=NSH7U1RPCAXU type=write size=3413245 2024-08-08T23:36:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.080+0000 7fdbd6e2c8c0 1 < completed write operation key=MNV404EWJHC1 tag=FGINNZZ97733 type=write size=255711 2024-08-08T23:36:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.080+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=JD0C5Q6NPI8S type=del size=3489789 2024-08-08T23:36:03.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~TF5OKFJ49951.0 size=1048576 2024-08-08T23:36:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~TF5OKFJ49951.1 size=411348 2024-08-08T23:36:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.088+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=TF5OKFJ49951 tag=YR3NJ8VK6ELM type=write size=2508500 2024-08-08T23:36:03.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.092+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=XM83N4XHM50D type=del size=2491342 2024-08-08T23:36:03.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.092+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.0 size=1048576 2024-08-08T23:36:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.092+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.1 size=1048576 2024-08-08T23:36:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~Y98U1IPF1RE1.2 size=147803 2024-08-08T23:36:03.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.100+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=Y98U1IPF1RE1 tag=JL3T6V9V0871 type=write size=3293531 2024-08-08T23:36:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~ZT2L9QMBLUV0.0 size=1048576 2024-08-08T23:36:03.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.104+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~ZT2L9QMBLUV0.1 size=995051 2024-08-08T23:36:03.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.104+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=ZT2L9QMBLUV0 tag=TZ8VOTIM2P5E type=write size=3092203 2024-08-08T23:36:03.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.108+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=ZNQZP5Z0FBXQ type=del 2024-08-08T23:36:03.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.108+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=B1I512UL5ZAC type=del size=674387 2024-08-08T23:36:03.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.112+0000 7fdbd6e2c8c0 1 < canceled operation key=QJB9DETMSY4X tag=ZSDKACPTGD75 type=del size=1683224 2024-08-08T23:36:03.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.116+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~6AOZDMRPHBM3.0 size=1027020 2024-08-08T23:36:03.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.116+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=6AOZDMRPHBM3 tag=OD5Z2Y846EWK type=write size=2075596 2024-08-08T23:36:03.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.116+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~H3IMGPVYGC0J.0 size=367590 2024-08-08T23:36:03.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.120+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=H3IMGPVYGC0J tag=8OU0VF6KF1JI type=write size=1416166 2024-08-08T23:36:03.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.124+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=932220LZHHKE type=del size=1192288 2024-08-08T23:36:03.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.124+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~Z15QTZXURCUU.0 size=1048576 2024-08-08T23:36:03.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~Z15QTZXURCUU.1 size=417547 2024-08-08T23:36:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.132+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=Z15QTZXURCUU tag=EQ3751BVHM3E type=write size=2514699 2024-08-08T23:36:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.132+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=KL2WRDD4OPHW type=del size=1795199 2024-08-08T23:36:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.136+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~39X7M3FX0AHJ.0 size=521930 2024-08-08T23:36:03.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.140+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=39X7M3FX0AHJ tag=7PN8EBJGAJ2G type=write size=1570506 2024-08-08T23:36:03.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~38JYGIW84N7I.0 size=1048576 2024-08-08T23:36:03.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~38JYGIW84N7I.1 size=66956 2024-08-08T23:36:03.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.144+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=38JYGIW84N7I tag=11JEVF6R53EO type=write size=2164108 2024-08-08T23:36:03.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.148+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=2U5A5SY4KG7N type=del 2024-08-08T23:36:03.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.148+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=TIOCWBXO8L6C type=del size=2137849 2024-08-08T23:36:03.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.152+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=UF5P9N5K5ZOT type=del 2024-08-08T23:36:03.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.152+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=842M61H0NC3T type=del size=665422 2024-08-08T23:36:03.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.156+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~YXT90N2U32S0.0 size=12035 2024-08-08T23:36:03.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.160+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=YXT90N2U32S0 tag=02JR70CN3GQ7 type=write size=1060611 2024-08-08T23:36:03.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.0 size=1048576 2024-08-08T23:36:03.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.1 size=1048576 2024-08-08T23:36:03.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.2 size=701343 2024-08-08T23:36:03.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=WJ71N3DVXQCK tag=S2S2SU0WFSKZ type=write size=3847071 2024-08-08T23:36:03.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.168+0000 7fdbd6e2c8c0 1 < completed write operation key=P3H05VKM0ZGJ tag=YC1XPRUEANR0 type=write size=257540 2024-08-08T23:36:03.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.172+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=HU5WWG5EXOPD type=del size=678248 2024-08-08T23:36:03.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.0 size=1048576 2024-08-08T23:36:03.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.176+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.1 size=1048576 2024-08-08T23:36:03.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.176+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~L4TUE5FO7TBH.2 size=304771 2024-08-08T23:36:03.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.184+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=L4TUE5FO7TBH tag=DCMOYGPJQA1A type=write size=3450499 2024-08-08T23:36:03.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.184+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=HA3KTS25SSQ9 type=del size=2369054 2024-08-08T23:36:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~3025R1OCNHOJ.0 size=1048576 2024-08-08T23:36:03.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.192+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~3025R1OCNHOJ.1 size=496310 2024-08-08T23:36:03.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.200+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=3025R1OCNHOJ tag=DPZM7FT7OT3B type=write size=2593462 2024-08-08T23:36:03.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.200+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=543IAYLSXU3Q type=del size=3090047 2024-08-08T23:36:03.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.204+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=BYSZ6M2W6Y6A type=del 2024-08-08T23:36:03.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.208+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=VX220HYB54BZ type=write size=925801 2024-08-08T23:36:03.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.212+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.0 size=1048576 2024-08-08T23:36:03.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.216+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.1 size=1048576 2024-08-08T23:36:03.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.216+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~UT7ZSM3RIT01.2 size=267517 2024-08-08T23:36:03.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.224+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=UT7ZSM3RIT01 tag=NSH7U1RPCAXU type=write size=3413245 2024-08-08T23:36:03.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~L802IOO2OAK4.0 size=1048576 2024-08-08T23:36:03.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~L802IOO2OAK4.1 size=79069 2024-08-08T23:36:03.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.232+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=L802IOO2OAK4 tag=MOH1V74F38PG type=write size=2176221 2024-08-08T23:36:03.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.236+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=JD0C5Q6NPI8S type=del 2024-08-08T23:36:03.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~Q1TM723IYC0A.0 size=1048576 2024-08-08T23:36:03.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~Q1TM723IYC0A.1 size=354656 2024-08-08T23:36:03.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.244+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=Q1TM723IYC0A tag=DV38I8JORYAC type=write size=2451808 2024-08-08T23:36:03.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.248+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=XM83N4XHM50D type=del 2024-08-08T23:36:03.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.252+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=A3Z2E8282F92 type=del size=1070268 2024-08-08T23:36:03.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~ZT2L9QMBLUV0.0 size=1048576 2024-08-08T23:36:03.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~ZT2L9QMBLUV0.1 size=995051 2024-08-08T23:36:03.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.260+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=ZT2L9QMBLUV0 tag=TZ8VOTIM2P5E type=write size=3092203 2024-08-08T23:36:03.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.264+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=WJR04YGL2XXY type=del size=1511342 2024-08-08T23:36:03.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.272+0000 7fdbd6e2c8c0 1 < suggested remove operation key=9S8TBVP20KTG tag=B1I512UL5ZAC type=del 2024-08-08T23:36:03.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.276+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=TVI9JA6F2JI9 type=del size=2226129 2024-08-08T23:36:03.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.276+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~6AOZDMRPHBM3.0 size=1027020 2024-08-08T23:36:03.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.284+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=6AOZDMRPHBM3 tag=OD5Z2Y846EWK type=write size=2075596 2024-08-08T23:36:03.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.0 size=1048576 2024-08-08T23:36:03.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.1 size=1048576 2024-08-08T23:36:03.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.2 size=469737 2024-08-08T23:36:03.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.292+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=70BUMDK94WUR tag=9YHEL5PY80N9 type=write size=3615465 2024-08-08T23:36:03.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.300+0000 7fdbd6e2c8c0 1 < suggested remove operation key=63GVT7KRKCSS tag=932220LZHHKE type=del 2024-08-08T23:36:03.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.304+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.0 size=1048576 2024-08-08T23:36:03.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.1 size=1048576 2024-08-08T23:36:03.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.312+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.2 size=864340 2024-08-08T23:36:03.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.312+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=CKH533R1TROJ tag=BIRLDQLC86KP type=write size=4010068 2024-08-08T23:36:03.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.316+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=KL2WRDD4OPHW type=del 2024-08-08T23:36:03.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.320+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=MGRQ4DVM0LCR type=write size=349410 2024-08-08T23:36:03.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.324+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~38JYGIW84N7I.0 size=1048576 2024-08-08T23:36:03.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.324+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~38JYGIW84N7I.1 size=66956 2024-08-08T23:36:03.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.328+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=38JYGIW84N7I tag=11JEVF6R53EO type=write size=2164108 2024-08-08T23:36:03.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.332+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=0T3YIY00N3VH type=del size=4188970 2024-08-08T23:36:03.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.336+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=TIOCWBXO8L6C type=del 2024-08-08T23:36:03.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.340+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=RXDS5A7JKTBR type=del size=395984 2024-08-08T23:36:03.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.340+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=842M61H0NC3T type=del 2024-08-08T23:36:03.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.344+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=42PZCI616J28 type=write size=685082 2024-08-08T23:36:03.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.348+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.0 size=1048576 2024-08-08T23:36:03.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.348+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.1 size=1048576 2024-08-08T23:36:03.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~WJ71N3DVXQCK.2 size=701343 2024-08-08T23:36:03.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.356+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=WJ71N3DVXQCK tag=S2S2SU0WFSKZ type=write size=3847071 2024-08-08T23:36:03.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.360+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=7ZC2ZD0ROJMQ type=write size=953088 2024-08-08T23:36:03.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.364+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=HU5WWG5EXOPD type=del 2024-08-08T23:36:03.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~DJSB30HM8OMH.0 size=1048576 2024-08-08T23:36:03.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.372+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~DJSB30HM8OMH.1 size=896367 2024-08-08T23:36:03.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.372+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=DJSB30HM8OMH tag=JGI0VOABMUA5 type=write size=2993519 2024-08-08T23:36:03.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.372+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=HA3KTS25SSQ9 type=del 2024-08-08T23:36:03.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.376+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=8BCDZC41WNQX type=del size=4085850 2024-08-08T23:36:03.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.380+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=9S8TBVP20KTG tag=543IAYLSXU3Q type=del size=3090047: (22) Invalid argument 2024-08-08T23:36:03.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.384+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=JXYNTCVR80X2 type=del size=1781306 2024-08-08T23:36:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.384+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=VX220HYB54BZ type=write size=925801 2024-08-08T23:36:03.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~2GGQT9Q7980R.0 size=1048576 2024-08-08T23:36:03.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~2GGQT9Q7980R.1 size=662506 2024-08-08T23:36:03.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.392+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=2GGQT9Q7980R tag=7HXKAU04JAFC type=write size=2759658 2024-08-08T23:36:03.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.396+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~L802IOO2OAK4.0 size=1048576 2024-08-08T23:36:03.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.400+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~L802IOO2OAK4.1 size=79069 2024-08-08T23:36:03.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.404+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=L802IOO2OAK4 tag=MOH1V74F38PG type=write size=2176221 2024-08-08T23:36:03.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.408+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=G9V0IO4DP5M4 type=write size=528441 2024-08-08T23:36:03.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.408+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~Q1TM723IYC0A.0 size=1048576 2024-08-08T23:36:03.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~Q1TM723IYC0A.1 size=354656 2024-08-08T23:36:03.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.416+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=Q1TM723IYC0A tag=DV38I8JORYAC type=write size=2451808 2024-08-08T23:36:03.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.424+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~4BM977APY2ZM.0 size=1048576 2024-08-08T23:36:03.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.424+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~4BM977APY2ZM.1 size=326284 2024-08-08T23:36:03.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.424+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=4BM977APY2ZM tag=2SP58G6NQ3CK type=write size=2423436 2024-08-08T23:36:03.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.428+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=A3Z2E8282F92 type=del 2024-08-08T23:36:03.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~4OPZ80DNRHBJ.0 size=1048576 2024-08-08T23:36:03.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~4OPZ80DNRHBJ.1 size=29846 2024-08-08T23:36:03.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.436+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=4OPZ80DNRHBJ tag=LU58FX8AJTDQ type=write size=2126998 2024-08-08T23:36:03.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.440+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=WJR04YGL2XXY type=del 2024-08-08T23:36:03.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.444+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=QBQ7HNXKM3S7 type=del size=996757 2024-08-08T23:36:03.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.448+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=TVI9JA6F2JI9 type=del 2024-08-08T23:36:03.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.452+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=TTY2KTVO5O6B type=del size=476587 2024-08-08T23:36:03.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.452+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.0 size=1048576 2024-08-08T23:36:03.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.1 size=1048576 2024-08-08T23:36:03.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.460+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~70BUMDK94WUR.2 size=469737 2024-08-08T23:36:03.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.464+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=70BUMDK94WUR tag=9YHEL5PY80N9 type=write size=3615465 2024-08-08T23:36:03.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.468+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=6AATSEKJ2MBN type=del size=2742206 2024-08-08T23:36:03.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.0 size=1048576 2024-08-08T23:36:03.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.1 size=1048576 2024-08-08T23:36:03.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.476+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~CKH533R1TROJ.2 size=864340 2024-08-08T23:36:03.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.480+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=CKH533R1TROJ tag=BIRLDQLC86KP type=write size=4010068 2024-08-08T23:36:03.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.484+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~FYGFQ9O5Y9W0.0 size=96892 2024-08-08T23:36:03.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.484+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=FYGFQ9O5Y9W0 tag=0473CJ8S2MT9 type=write size=1145468 2024-08-08T23:36:03.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.488+0000 7fdbd6e2c8c0 1 < canceled operation key=FWZ5TEP1P2LK tag=MGRQ4DVM0LCR type=write size=349410 2024-08-08T23:36:03.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.492+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~EK1A5NPD897T.0 size=958309 2024-08-08T23:36:03.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.492+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=EK1A5NPD897T tag=PBA15SNAH2Z4 type=write size=2006885 2024-08-08T23:36:03.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.496+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=0T3YIY00N3VH type=del size=4188970 2024-08-08T23:36:03.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.500+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~CWUSFB5EC8BN.0 size=902213 2024-08-08T23:36:03.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.500+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=CWUSFB5EC8BN tag=1WLI3L8WM017 type=write size=1950789 2024-08-08T23:36:03.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.504+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=RXDS5A7JKTBR type=del 2024-08-08T23:36:03.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~3W2RSJBBT424.0 size=72416 2024-08-08T23:36:03.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.508+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=3W2RSJBBT424 tag=1Y6EC7J31FBN type=write size=1120992 2024-08-08T23:36:03.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.516+0000 7fdbd6e2c8c0 1 < suggested update operation key=YNQU8Z202QCM tag=42PZCI616J28 type=write size=685082 2024-08-08T23:36:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~M12V34ZVR9GM.0 size=1048576 2024-08-08T23:36:03.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~M12V34ZVR9GM.1 size=357806 2024-08-08T23:36:03.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.520+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=M12V34ZVR9GM tag=UWBPPTYEXP9M type=write size=2454958 2024-08-08T23:36:03.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.524+0000 7fdbd6e2c8c0 1 < canceled operation key=NMB4GI8R2BKU tag=7ZC2ZD0ROJMQ type=write size=953088 2024-08-08T23:36:03.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.528+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=X7C6WDFQRI1N type=del size=1152012 2024-08-08T23:36:03.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.528+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~DJSB30HM8OMH.0 size=1048576 2024-08-08T23:36:03.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.532+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~DJSB30HM8OMH.1 size=896367 2024-08-08T23:36:03.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.536+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=DJSB30HM8OMH tag=JGI0VOABMUA5 type=write size=2993519 2024-08-08T23:36:03.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.540+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=1MLCRMV5PB58 type=del size=2254516 2024-08-08T23:36:03.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.540+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=8BCDZC41WNQX type=del 2024-08-08T23:36:03.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.544+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=3FEP3MZ93BD8 type=del size=936929 2024-08-08T23:36:03.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.548+0000 7fdbd6e2c8c0 1 < canceled operation key=0MT9FJO58ELX tag=JXYNTCVR80X2 type=del size=1781306 2024-08-08T23:36:03.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.548+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=SI5FWV98A099 type=write size=634528 2024-08-08T23:36:03.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.552+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~2GGQT9Q7980R.0 size=1048576 2024-08-08T23:36:03.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.556+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~2GGQT9Q7980R.1 size=662506 2024-08-08T23:36:03.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.560+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=2GGQT9Q7980R tag=7HXKAU04JAFC type=write size=2759658 2024-08-08T23:36:03.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.560+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=FAMKTUV060Z9 type=del size=3391386 2024-08-08T23:36:03.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.564+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=G9V0IO4DP5M4 type=write size=528441 2024-08-08T23:36:03.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.568+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~T5L8IFR5HC3Z.0 size=626705 2024-08-08T23:36:03.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.568+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=T5L8IFR5HC3Z tag=7A5AOP9SCBF5 type=write size=1675281 2024-08-08T23:36:03.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.572+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~4BM977APY2ZM.0 size=1048576 2024-08-08T23:36:03.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.572+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~4BM977APY2ZM.1 size=326284 2024-08-08T23:36:03.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.580+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=4BM977APY2ZM tag=2SP58G6NQ3CK type=write size=2423436 2024-08-08T23:36:03.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.584+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~3LA86ASVDGEQ.0 size=660807 2024-08-08T23:36:03.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.584+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=3LA86ASVDGEQ tag=2BTBZNAFNENK type=write size=1709383 2024-08-08T23:36:03.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.588+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~4OPZ80DNRHBJ.0 size=1048576 2024-08-08T23:36:03.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.592+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~4OPZ80DNRHBJ.1 size=29846 2024-08-08T23:36:03.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.596+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=4OPZ80DNRHBJ tag=LU58FX8AJTDQ type=write size=2126998 2024-08-08T23:36:03.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.600+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=QIYVN4RCA6HQ type=del size=416408 2024-08-08T23:36:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.600+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=QBQ7HNXKM3S7 type=del 2024-08-08T23:36:03.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.604+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=AIGN55UXRUX5 type=write size=551589 2024-08-08T23:36:03.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.608+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=TTY2KTVO5O6B type=del 2024-08-08T23:36:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~Z8N2Z9OQ5FEZ.0 size=884560 2024-08-08T23:36:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.612+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=Z8N2Z9OQ5FEZ tag=0MK605WAAM2I type=write size=1933136 2024-08-08T23:36:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.620+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZBEB2Q3J9Z0D tag=6AATSEKJ2MBN type=del size=2742206 2024-08-08T23:36:03.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.620+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=U713G5TAEY7E type=write size=338960 2024-08-08T23:36:03.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.624+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~FYGFQ9O5Y9W0.0 size=96892 2024-08-08T23:36:03.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.628+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=FYGFQ9O5Y9W0 tag=0473CJ8S2MT9 type=write size=1145468 2024-08-08T23:36:03.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.632+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=QDW903FOBZLL type=del size=3440625 2024-08-08T23:36:03.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.632+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~EK1A5NPD897T.0 size=958309 2024-08-08T23:36:03.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.636+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=EK1A5NPD897T tag=PBA15SNAH2Z4 type=write size=2006885 2024-08-08T23:36:03.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.640+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~ADZ5T9A3K8Q6.0 size=653629 2024-08-08T23:36:03.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.640+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=ADZ5T9A3K8Q6 tag=LUGEJIX4DPAL type=write size=1702205 2024-08-08T23:36:03.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.644+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~CWUSFB5EC8BN.0 size=902213 2024-08-08T23:36:03.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.648+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=CWUSFB5EC8BN tag=1WLI3L8WM017 type=write size=1950789 2024-08-08T23:36:03.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.652+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=OPZZLEPYMQ0W type=del size=1129479 2024-08-08T23:36:03.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.652+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VSLBN9AVZK00.2~3W2RSJBBT424.0 size=72416 2024-08-08T23:36:03.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.656+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VSLBN9AVZK00 upload=3W2RSJBBT424 tag=1Y6EC7J31FBN type=write size=1120992 2024-08-08T23:36:03.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.660+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=LTZI9U1JSBLR type=write size=173919 2024-08-08T23:36:03.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~M12V34ZVR9GM.0 size=1048576 2024-08-08T23:36:03.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.664+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~M12V34ZVR9GM.1 size=357806 2024-08-08T23:36:03.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.668+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=M12V34ZVR9GM tag=UWBPPTYEXP9M type=write size=2454958 2024-08-08T23:36:03.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.672+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=2KYT1AC1T1T2 type=del size=3299116 2024-08-08T23:36:03.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.676+0000 7fdbd6e2c8c0 1 < canceled operation key=63GVT7KRKCSS tag=X7C6WDFQRI1N type=del size=1152012 2024-08-08T23:36:03.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.680+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=PRLIGKKQ1WUS type=del size=356417 2024-08-08T23:36:03.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.684+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=1MLCRMV5PB58 type=del 2024-08-08T23:36:03.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.684+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=3OFNAGDU547X type=del size=206568 2024-08-08T23:36:03.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.692+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZBEB2Q3J9Z0D tag=3FEP3MZ93BD8 type=del size=936929 2024-08-08T23:36:03.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.696+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=HMW7FF0Z832V type=write size=74762 2024-08-08T23:36:03.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.696+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=SI5FWV98A099 type=write size=634528 2024-08-08T23:36:03.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.700+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=NNLTT4NGI5VH type=del size=2739773 2024-08-08T23:36:03.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.704+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZQ8GOX9RSTBB tag=FAMKTUV060Z9 type=del size=3391386 2024-08-08T23:36:03.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.708+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=UFX40XUEVCCH type=del size=864425 2024-08-08T23:36:03.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.708+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~T5L8IFR5HC3Z.0 size=626705 2024-08-08T23:36:03.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.716+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=T5L8IFR5HC3Z tag=7A5AOP9SCBF5 type=write size=1675281 2024-08-08T23:36:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.716+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=GXXXE9L3UI1O type=del size=1823166 2024-08-08T23:36:03.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.720+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~3LA86ASVDGEQ.0 size=660807 2024-08-08T23:36:03.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.724+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=3LA86ASVDGEQ tag=2BTBZNAFNENK type=write size=1709383 2024-08-08T23:36:03.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.728+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~8LBHVLVPGT8D.0 size=888387 2024-08-08T23:36:03.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.728+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=8LBHVLVPGT8D tag=TI8UY7SSYOO6 type=write size=1936963 2024-08-08T23:36:03.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.732+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=QIYVN4RCA6HQ type=del 2024-08-08T23:36:03.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.736+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=AJPYLYIFL7R1 type=del size=3448008 2024-08-08T23:36:03.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.740+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=AIGN55UXRUX5 type=write size=551589 2024-08-08T23:36:03.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.740+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=1O8O7GREKDL1 type=del size=1131136 2024-08-08T23:36:03.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.744+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~Z8N2Z9OQ5FEZ.0 size=884560 2024-08-08T23:36:03.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.752+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=Z8N2Z9OQ5FEZ tag=0MK605WAAM2I type=write size=1933136 2024-08-08T23:36:03.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.756+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~38G3MYJZJEQP.0 size=1048576 2024-08-08T23:36:03.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~38G3MYJZJEQP.1 size=530350 2024-08-08T23:36:03.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.760+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=38G3MYJZJEQP tag=2TBB1RIF10VH type=write size=2627502 2024-08-08T23:36:03.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.768+0000 7fdbd6e2c8c0 1 < suggested update operation key=0MT9FJO58ELX tag=U713G5TAEY7E type=write size=338960 2024-08-08T23:36:03.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.772+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.0 size=1048576 2024-08-08T23:36:03.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.1 size=1048576 2024-08-08T23:36:03.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.2 size=583055 2024-08-08T23:36:03.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=5QR012WWA2OV tag=4NGQ4WH902RX type=write size=3728783 2024-08-08T23:36:03.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.784+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=QDW903FOBZLL type=del 2024-08-08T23:36:03.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.788+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5RH6ZADPE3R6.0 size=1048576 2024-08-08T23:36:03.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5RH6ZADPE3R6.1 size=190070 2024-08-08T23:36:03.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=5RH6ZADPE3R6 tag=9M2ZS9MQZR83 type=write size=2287222 2024-08-08T23:36:03.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.796+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~ADZ5T9A3K8Q6.0 size=653629 2024-08-08T23:36:03.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.800+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=ADZ5T9A3K8Q6 tag=LUGEJIX4DPAL type=write size=1702205 2024-08-08T23:36:03.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.0 size=1048576 2024-08-08T23:36:03.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.812+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.1 size=1048576 2024-08-08T23:36:03.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.812+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.2 size=982634 2024-08-08T23:36:03.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.812+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=FCDB1VAWFECD tag=A9W4R6PNTX77 type=write size=4128362 2024-08-08T23:36:03.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.816+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=OPZZLEPYMQ0W type=del 2024-08-08T23:36:03.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.820+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=XJ0BVTEZNTE6 type=del size=447666 2024-08-08T23:36:03.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.824+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=LTZI9U1JSBLR type=write size=173919 2024-08-08T23:36:03.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.0 size=1048576 2024-08-08T23:36:03.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.1 size=1048576 2024-08-08T23:36:03.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.2 size=820183 2024-08-08T23:36:03.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.836+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=QRD5S3AIKSH9 tag=XDSOEPMM2BZZ type=write size=3965911 2024-08-08T23:36:03.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.836+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=2KYT1AC1T1T2 type=del 2024-08-08T23:36:03.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.840+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=AKC0ZSQHBD1F type=del size=2156269 2024-08-08T23:36:03.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.844+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=PRLIGKKQ1WUS type=del 2024-08-08T23:36:03.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.848+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=NYU1I23SRDFU type=write size=247172 2024-08-08T23:36:03.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.848+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=3OFNAGDU547X type=del 2024-08-08T23:36:03.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.852+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=1TV33AV65LUH type=write size=383803 2024-08-08T23:36:03.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.856+0000 7fdbd6e2c8c0 1 < completed write operation key=D81PQ0FJVNEE tag=HMW7FF0Z832V type=write size=74762 2024-08-08T23:36:03.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.860+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.0 size=1048576 2024-08-08T23:36:03.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.1 size=1048576 2024-08-08T23:36:03.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.2 size=124126 2024-08-08T23:36:03.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.864+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=YMD95V6G9771 tag=GGAYS2QE1P9D type=write size=3269854 2024-08-08T23:36:03.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.868+0000 7fdbd6e2c8c0 1 < canceled operation key=JWTLJG79MYI5 tag=NNLTT4NGI5VH type=del size=2739773 2024-08-08T23:36:03.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.872+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=3NIIQ099YASW type=del size=1676187 2024-08-08T23:36:03.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.876+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=UFX40XUEVCCH type=del 2024-08-08T23:36:03.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.876+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=6EQRPJCI2LQ2 type=del size=1788183 2024-08-08T23:36:03.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.880+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=GXXXE9L3UI1O type=del 2024-08-08T23:36:03.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.880+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=ER3964KA56IB type=del size=801714 2024-08-08T23:36:03.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.884+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~8LBHVLVPGT8D.0 size=888387 2024-08-08T23:36:03.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.888+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=8LBHVLVPGT8D tag=TI8UY7SSYOO6 type=write size=1936963 2024-08-08T23:36:03.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~3XDE7ZJJ9BAZ.0 size=689534 2024-08-08T23:36:03.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.892+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=3XDE7ZJJ9BAZ tag=JFN1ZPG064RG type=write size=1738110 2024-08-08T23:36:03.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.896+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=AJPYLYIFL7R1 type=del size=3448008 2024-08-08T23:36:03.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.896+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=JHDIMIWW13F4 type=del size=1768011 2024-08-08T23:36:03.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.900+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=1O8O7GREKDL1 type=del 2024-08-08T23:36:03.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.904+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~LCLVFE1AOF0D.0 size=841839 2024-08-08T23:36:03.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.904+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=LCLVFE1AOF0D tag=6KKDM1FCSQBB type=write size=1890415 2024-08-08T23:36:03.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~38G3MYJZJEQP.0 size=1048576 2024-08-08T23:36:03.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.908+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~38G3MYJZJEQP.1 size=530350 2024-08-08T23:36:03.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.912+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=38G3MYJZJEQP tag=2TBB1RIF10VH type=write size=2627502 2024-08-08T23:36:03.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.916+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=6MPRZBAMBNAB type=del size=2477025 2024-08-08T23:36:03.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.0 size=1048576 2024-08-08T23:36:03.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.1 size=1048576 2024-08-08T23:36:03.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.924+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~5QR012WWA2OV.2 size=583055 2024-08-08T23:36:03.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.928+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=5QR012WWA2OV tag=4NGQ4WH902RX type=write size=3728783 2024-08-08T23:36:03.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.932+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~I10PFKR5V9DQ.0 size=51149 2024-08-08T23:36:03.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.932+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=I10PFKR5V9DQ tag=EDWFUY2PN8H8 type=write size=1099725 2024-08-08T23:36:03.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.932+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~5RH6ZADPE3R6.0 size=1048576 2024-08-08T23:36:03.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.936+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~5RH6ZADPE3R6.1 size=190070 2024-08-08T23:36:03.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.940+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=5RH6ZADPE3R6 tag=9M2ZS9MQZR83 type=write size=2287222 2024-08-08T23:36:03.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.944+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=M5WHETOETXXI type=del size=578423 2024-08-08T23:36:03.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.944+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.0 size=1048576 2024-08-08T23:36:03.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.1 size=1048576 2024-08-08T23:36:03.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.948+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~FCDB1VAWFECD.2 size=982634 2024-08-08T23:36:03.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.952+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=FCDB1VAWFECD tag=A9W4R6PNTX77 type=write size=4128362 2024-08-08T23:36:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.956+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=GJNRDLFF9G5W type=del size=1302709 2024-08-08T23:36:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.960+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=XJ0BVTEZNTE6 type=del 2024-08-08T23:36:03.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.964+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=YXW9WNUSNW87 type=del size=911312 2024-08-08T23:36:03.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.964+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.0 size=1048576 2024-08-08T23:36:03.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.1 size=1048576 2024-08-08T23:36:03.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~QRD5S3AIKSH9.2 size=820183 2024-08-08T23:36:03.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.976+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=QRD5S3AIKSH9 tag=XDSOEPMM2BZZ type=write size=3965911 2024-08-08T23:36:03.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.976+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=2S0PNKK3S3L0 type=del size=3973090 2024-08-08T23:36:03.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.980+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=AKC0ZSQHBD1F type=del 2024-08-08T23:36:03.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.984+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=CASLOQF4WBZ8 type=write size=42779 2024-08-08T23:36:03.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.988+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=NYU1I23SRDFU type=write size=247172 2024-08-08T23:36:03.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.992+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~04DIFFV55K69.0 size=1048576 2024-08-08T23:36:03.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.992+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~04DIFFV55K69.1 size=191156 2024-08-08T23:36:03.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.992+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=04DIFFV55K69 tag=XU0D5X2NZ2AX type=write size=2288308 2024-08-08T23:36:03.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:03.996+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=1TV33AV65LUH type=write size=383803 2024-08-08T23:36:04.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.000+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~B5AXTASA29UJ.0 size=89848 2024-08-08T23:36:04.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.000+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=B5AXTASA29UJ tag=DPSJSQGYHEPX type=write size=1138424 2024-08-08T23:36:04.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.004+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.0 size=1048576 2024-08-08T23:36:04.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.008+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.1 size=1048576 2024-08-08T23:36:04.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.008+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YMD95V6G9771.2 size=124126 2024-08-08T23:36:04.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.012+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=YMD95V6G9771 tag=GGAYS2QE1P9D type=write size=3269854 2024-08-08T23:36:04.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.020+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~A8BPRCAMCBBS.0 size=1048576 2024-08-08T23:36:04.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.020+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~A8BPRCAMCBBS.1 size=368862 2024-08-08T23:36:04.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.020+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=A8BPRCAMCBBS tag=HXR6FJR7DDFA type=write size=2466014 2024-08-08T23:36:04.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.028+0000 7fdbd6e2c8c0 1 < suggested remove operation key=NMB4GI8R2BKU tag=3NIIQ099YASW type=del 2024-08-08T23:36:04.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.028+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=UMRY3OCWSQUY type=write size=755138 2024-08-08T23:36:04.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.032+0000 7fdbd6e2c8c0 1 < canceled operation key=VGT9IXWM956F tag=6EQRPJCI2LQ2 type=del size=1788183 2024-08-08T23:36:04.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.036+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=M2MWAW18RTA0 type=del size=3455707 2024-08-08T23:36:04.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=ER3964KA56IB type=del 2024-08-08T23:36:04.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.040+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=PJHQ1XJ1UTCT type=del size=2034514 2024-08-08T23:36:04.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.044+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~3XDE7ZJJ9BAZ.0 size=689534 2024-08-08T23:36:04.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.048+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=3XDE7ZJJ9BAZ tag=JFN1ZPG064RG type=write size=1738110 2024-08-08T23:36:04.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.052+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=DOW5A2MTWCS9 type=del size=2768664 2024-08-08T23:36:04.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.052+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=JHDIMIWW13F4 type=del 2024-08-08T23:36:04.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.056+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.0 size=1048576 2024-08-08T23:36:04.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.060+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.1 size=1048576 2024-08-08T23:36:04.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.064+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.2 size=572052 2024-08-08T23:36:04.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.064+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=EDSQDNTJALZI tag=GLQSHL4AZM1I type=write size=3717780 2024-08-08T23:36:04.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.064+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~LCLVFE1AOF0D.0 size=841839 2024-08-08T23:36:04.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.068+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=LCLVFE1AOF0D tag=6KKDM1FCSQBB type=write size=1890415 2024-08-08T23:36:04.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.072+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=XUPDVFQVJ96I type=del size=3845892 2024-08-08T23:36:04.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.072+0000 7fdbd6e2c8c0 1 < completed delete operation key=MNV404EWJHC1 tag=6MPRZBAMBNAB type=del 2024-08-08T23:36:04.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.076+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=32EVHNJ9K3Q9 type=write size=745778 2024-08-08T23:36:04.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.080+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~I10PFKR5V9DQ.0 size=51149 2024-08-08T23:36:04.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.084+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=I10PFKR5V9DQ tag=EDWFUY2PN8H8 type=write size=1099725 2024-08-08T23:36:04.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.0 size=1048576 2024-08-08T23:36:04.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.1 size=1048576 2024-08-08T23:36:04.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.092+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.2 size=652665 2024-08-08T23:36:04.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.092+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=ZA57WZJHQEE1 tag=D3CJY7CRRPF2 type=write size=3798393 2024-08-08T23:36:04.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.096+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=M5WHETOETXXI type=del 2024-08-08T23:36:04.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.096+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=TIS2F10JWLEV type=del size=1090621 2024-08-08T23:36:04.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.100+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=GJNRDLFF9G5W type=del 2024-08-08T23:36:04.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.100+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=HF41ISH19X34 type=write size=22288 2024-08-08T23:36:04.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.108+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=YXW9WNUSNW87 type=del size=911312 2024-08-08T23:36:04.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.108+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=HP10SULBHOJT type=del size=1197644 2024-08-08T23:36:04.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.112+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=2S0PNKK3S3L0 type=del 2024-08-08T23:36:04.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.116+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=MZ1D4PEG21HF type=write size=855838 2024-08-08T23:36:04.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.120+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=CASLOQF4WBZ8 type=write size=42779 2024-08-08T23:36:04.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.124+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=F86GP13QFXQ2 type=write size=135744 2024-08-08T23:36:04.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.124+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~04DIFFV55K69.0 size=1048576 2024-08-08T23:36:04.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~04DIFFV55K69.1 size=191156 2024-08-08T23:36:04.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.132+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=04DIFFV55K69 tag=XU0D5X2NZ2AX type=write size=2288308 2024-08-08T23:36:04.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.136+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=PVEMEG32KNZZ type=del size=3751688 2024-08-08T23:36:04.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.136+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~B5AXTASA29UJ.0 size=89848 2024-08-08T23:36:04.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.140+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=B5AXTASA29UJ tag=DPSJSQGYHEPX type=write size=1138424 2024-08-08T23:36:04.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.144+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=YH2311I6D6BY type=del size=2678676 2024-08-08T23:36:04.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~A8BPRCAMCBBS.0 size=1048576 2024-08-08T23:36:04.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~A8BPRCAMCBBS.1 size=368862 2024-08-08T23:36:04.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.152+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=A8BPRCAMCBBS tag=HXR6FJR7DDFA type=write size=2466014 2024-08-08T23:36:04.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.156+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=DNTU8CQ4BO7L type=write size=816833 2024-08-08T23:36:04.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.160+0000 7fdbd6e2c8c0 1 < completed write operation key=QHN8QYEEOHYO tag=UMRY3OCWSQUY type=write size=755138 2024-08-08T23:36:04.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~TGMA4YS4TQQ9.0 size=1048576 2024-08-08T23:36:04.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~TGMA4YS4TQQ9.1 size=1011276 2024-08-08T23:36:04.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.164+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=TGMA4YS4TQQ9 tag=EGM29G38G7SH type=write size=3108428 2024-08-08T23:36:04.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.168+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=M2MWAW18RTA0 type=del 2024-08-08T23:36:04.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.176+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~3IBZ50IAZ6VZ.0 size=1048576 2024-08-08T23:36:04.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.176+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~3IBZ50IAZ6VZ.1 size=927994 2024-08-08T23:36:04.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.176+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=3IBZ50IAZ6VZ tag=6IKH3Q830JYZ type=write size=3025146 2024-08-08T23:36:04.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.180+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=PJHQ1XJ1UTCT type=del 2024-08-08T23:36:04.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.184+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.0 size=1048576 2024-08-08T23:36:04.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.188+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.1 size=1048576 2024-08-08T23:36:04.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.188+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.2 size=405500 2024-08-08T23:36:04.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.188+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=U8QIC8WLGR5F tag=DHO66NTR4JN9 type=write size=3551228 2024-08-08T23:36:04.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.192+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=DOW5A2MTWCS9 type=del 2024-08-08T23:36:04.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.196+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~SAJ7ZIWN223O.0 size=368541 2024-08-08T23:36:04.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.196+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=SAJ7ZIWN223O tag=HHMNWV6JSF31 type=write size=1417117 2024-08-08T23:36:04.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.200+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.0 size=1048576 2024-08-08T23:36:04.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.204+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.1 size=1048576 2024-08-08T23:36:04.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.208+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~EDSQDNTJALZI.2 size=572052 2024-08-08T23:36:04.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.212+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=EDSQDNTJALZI tag=GLQSHL4AZM1I type=write size=3717780 2024-08-08T23:36:04.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~YPG4D25QSV9I.0 size=1048576 2024-08-08T23:36:04.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.220+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~YPG4D25QSV9I.1 size=940011 2024-08-08T23:36:04.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.220+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=YPG4D25QSV9I tag=I81P5QFDVV3Y type=write size=3037163 2024-08-08T23:36:04.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.224+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=XUPDVFQVJ96I type=del 2024-08-08T23:36:04.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.0 size=1048576 2024-08-08T23:36:04.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.1 size=1048576 2024-08-08T23:36:04.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.236+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.2 size=881231 2024-08-08T23:36:04.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.236+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=J1I8MWD3NJ91 tag=C95VX38630YW type=write size=4026959 2024-08-08T23:36:04.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.236+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=32EVHNJ9K3Q9 type=write size=745778 2024-08-08T23:36:04.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.240+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=9ZC2V5NDUCDE type=del size=3491834 2024-08-08T23:36:04.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.244+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.0 size=1048576 2024-08-08T23:36:04.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.248+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.1 size=1048576 2024-08-08T23:36:04.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.248+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~ZA57WZJHQEE1.2 size=652665 2024-08-08T23:36:04.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.252+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=ZA57WZJHQEE1 tag=D3CJY7CRRPF2 type=write size=3798393 2024-08-08T23:36:04.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.260+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~RQ8QR2AKJYAG.0 size=945033 2024-08-08T23:36:04.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.260+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=RQ8QR2AKJYAG tag=PHI4TQ1A62Y7 type=write size=1993609 2024-08-08T23:36:04.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.264+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=TIS2F10JWLEV type=del 2024-08-08T23:36:04.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.264+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=WE7ULUR123U1 type=write size=689651 2024-08-08T23:36:04.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.268+0000 7fdbd6e2c8c0 1 < canceled operation key=GMVEOO97I8YH tag=HF41ISH19X34 type=write size=22288 2024-08-08T23:36:04.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.0 size=1048576 2024-08-08T23:36:04.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.1 size=1048576 2024-08-08T23:36:04.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.2 size=657747 2024-08-08T23:36:04.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.276+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=HHVBV562WY1Z tag=P7PDON2YHOXI type=write size=3803475 2024-08-08T23:36:04.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.284+0000 7fdbd6e2c8c0 1 < suggested update operation key=FBCEC998C8EJ tag=HP10SULBHOJT type=del size=1197644 2024-08-08T23:36:04.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.288+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~S5KNPJTO2QEG.0 size=1048576 2024-08-08T23:36:04.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~S5KNPJTO2QEG.1 size=162147 2024-08-08T23:36:04.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.292+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=S5KNPJTO2QEG tag=3QDDS9BC6YS8 type=write size=2259299 2024-08-08T23:36:04.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.296+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=MZ1D4PEG21HF type=write size=855838 2024-08-08T23:36:04.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.300+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=AFGE3WBJWP6K type=del size=4180260 2024-08-08T23:36:04.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.300+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=F86GP13QFXQ2 type=write size=135744 2024-08-08T23:36:04.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.304+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=7KA4JT0UO62P type=del size=2231416 2024-08-08T23:36:04.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.308+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=PVEMEG32KNZZ type=del size=3751688 2024-08-08T23:36:04.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.312+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=HO217JC77LMT type=del size=1948055 2024-08-08T23:36:04.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.312+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=YH2311I6D6BY type=del 2024-08-08T23:36:04.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.316+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=XYSORIWUH8PU type=del size=1554565 2024-08-08T23:36:04.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.324+0000 7fdbd6e2c8c0 1 < suggested update operation key=W5OVPO7BGE4S tag=DNTU8CQ4BO7L type=write size=816833 2024-08-08T23:36:04.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.328+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.0 size=1048576 2024-08-08T23:36:04.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.1 size=1048576 2024-08-08T23:36:04.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.2 size=462213 2024-08-08T23:36:04.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.336+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=3DCG7C8ZWWDJ tag=CWEDJC08VYUN type=write size=3607941 2024-08-08T23:36:04.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~TGMA4YS4TQQ9.0 size=1048576 2024-08-08T23:36:04.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~TGMA4YS4TQQ9.1 size=1011276 2024-08-08T23:36:04.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.348+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=TGMA4YS4TQQ9 tag=EGM29G38G7SH type=write size=3108428 2024-08-08T23:36:04.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.352+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=K3MVYXD69TDZ type=del size=3695932 2024-08-08T23:36:04.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.352+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YNQU8Z202QCM.2~3IBZ50IAZ6VZ.0 size=1048576 2024-08-08T23:36:04.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.356+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~3IBZ50IAZ6VZ.1 size=927994 2024-08-08T23:36:04.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.360+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YNQU8Z202QCM upload=3IBZ50IAZ6VZ tag=6IKH3Q830JYZ type=write size=3025146 2024-08-08T23:36:04.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.364+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=6PS7K2R9V4A6 type=write size=573481 2024-08-08T23:36:04.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.368+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.0 size=1048576 2024-08-08T23:36:04.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.368+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.1 size=1048576 2024-08-08T23:36:04.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.372+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~U8QIC8WLGR5F.2 size=405500 2024-08-08T23:36:04.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.376+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=U8QIC8WLGR5F tag=DHO66NTR4JN9 type=write size=3551228 2024-08-08T23:36:04.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.380+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=I3UCTDIHPYEA type=del size=1946707 2024-08-08T23:36:04.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.384+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~SAJ7ZIWN223O.0 size=368541 2024-08-08T23:36:04.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.388+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=SAJ7ZIWN223O tag=HHMNWV6JSF31 type=write size=1417117 2024-08-08T23:36:04.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.392+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=YMYS2772LGUO type=del size=3452689 2024-08-08T23:36:04.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.392+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~YPG4D25QSV9I.0 size=1048576 2024-08-08T23:36:04.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.396+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~YPG4D25QSV9I.1 size=940011 2024-08-08T23:36:04.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.404+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=YPG4D25QSV9I tag=I81P5QFDVV3Y type=write size=3037163 2024-08-08T23:36:04.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.408+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=YLN0KFOB6G46 type=del size=2550336 2024-08-08T23:36:04.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.0 size=1048576 2024-08-08T23:36:04.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.412+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.1 size=1048576 2024-08-08T23:36:04.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.416+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~J1I8MWD3NJ91.2 size=881231 2024-08-08T23:36:04.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.420+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=J1I8MWD3NJ91 tag=C95VX38630YW type=write size=4026959 2024-08-08T23:36:04.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.424+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.0 size=1048576 2024-08-08T23:36:04.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.1 size=1048576 2024-08-08T23:36:04.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.2 size=359718 2024-08-08T23:36:04.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.428+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=H5741TOIZZH6 tag=XDIH6IZPG6YK type=write size=3505446 2024-08-08T23:36:04.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.436+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=9ZC2V5NDUCDE type=del 2024-08-08T23:36:04.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.436+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=4UTNKT0G607M type=del size=2768003 2024-08-08T23:36:04.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.436+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~RQ8QR2AKJYAG.0 size=945033 2024-08-08T23:36:04.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.440+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=RQ8QR2AKJYAG tag=PHI4TQ1A62Y7 type=write size=1993609 2024-08-08T23:36:04.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.444+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=WI5AN7Q9AW4J type=del size=402811 2024-08-08T23:36:04.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.448+0000 7fdbd6e2c8c0 1 < completed write operation key=XIXN9HLLSJS3 tag=WE7ULUR123U1 type=write size=689651 2024-08-08T23:36:04.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.448+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=98O28ZSRNSVU type=del size=3157526 2024-08-08T23:36:04.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.452+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.0 size=1048576 2024-08-08T23:36:04.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.1 size=1048576 2024-08-08T23:36:04.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.456+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~HHVBV562WY1Z.2 size=657747 2024-08-08T23:36:04.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.464+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FWZ5TEP1P2LK upload=HHVBV562WY1Z tag=P7PDON2YHOXI type=write size=3803475 2024-08-08T23:36:04.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~KB30MSZLGTPZ.0 size=1048576 2024-08-08T23:36:04.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~KB30MSZLGTPZ.1 size=209746 2024-08-08T23:36:04.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.468+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=KB30MSZLGTPZ tag=TGYNH9TCFIDN type=write size=2306898 2024-08-08T23:36:04.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~S5KNPJTO2QEG.0 size=1048576 2024-08-08T23:36:04.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~S5KNPJTO2QEG.1 size=162147 2024-08-08T23:36:04.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.476+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=S5KNPJTO2QEG tag=3QDDS9BC6YS8 type=write size=2259299 2024-08-08T23:36:04.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.480+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~DI59E2KVOEL3.0 size=3272 2024-08-08T23:36:04.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.480+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=DI59E2KVOEL3 tag=L6IWMMMT6FQ5 type=write size=1051848 2024-08-08T23:36:04.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.484+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=903K2EO77YTJ tag=AFGE3WBJWP6K type=del size=4180260: (22) Invalid argument 2024-08-08T23:36:04.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.488+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=A43JXRPZM516 type=del size=637049 2024-08-08T23:36:04.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.488+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=7KA4JT0UO62P type=del 2024-08-08T23:36:04.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.492+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=D3VPJG5MJ543 type=del size=473693 2024-08-08T23:36:04.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.496+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=HO217JC77LMT type=del 2024-08-08T23:36:04.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.500+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=V3CC7K1BV98K type=del size=745542 2024-08-08T23:36:04.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.500+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=XYSORIWUH8PU type=del 2024-08-08T23:36:04.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~D09SCZCRS35U.0 size=462339 2024-08-08T23:36:04.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.508+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=D09SCZCRS35U tag=6TRAMKVWU6V1 type=write size=1510915 2024-08-08T23:36:04.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.0 size=1048576 2024-08-08T23:36:04.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.1 size=1048576 2024-08-08T23:36:04.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~3DCG7C8ZWWDJ.2 size=462213 2024-08-08T23:36:04.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.516+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=3DCG7C8ZWWDJ tag=CWEDJC08VYUN type=write size=3607941 2024-08-08T23:36:04.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.520+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=HSYT8Z7780NB type=del size=3127963 2024-08-08T23:36:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.524+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=K3MVYXD69TDZ type=del 2024-08-08T23:36:04.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.528+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~XBE82WWBB2ZE.0 size=1037419 2024-08-08T23:36:04.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.528+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=XBE82WWBB2ZE tag=WYMCIQFQ7GII type=write size=2085995 2024-08-08T23:36:04.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.532+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=6PS7K2R9V4A6 type=write size=573481 2024-08-08T23:36:04.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~V5BP7JOBL5XZ.0 size=1048576 2024-08-08T23:36:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~V5BP7JOBL5XZ.1 size=410159 2024-08-08T23:36:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.536+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=V5BP7JOBL5XZ tag=LUXCH9ATRJY4 type=write size=2507311 2024-08-08T23:36:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.540+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=I3UCTDIHPYEA type=del 2024-08-08T23:36:04.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.548+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~EWNO9USENDOH.0 size=418273 2024-08-08T23:36:04.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.548+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=EWNO9USENDOH tag=HTM40BX4UTSU type=write size=1466849 2024-08-08T23:36:04.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.548+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=YMYS2772LGUO type=del 2024-08-08T23:36:04.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.552+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=N1VYH0U91OC8 type=del size=1907796 2024-08-08T23:36:04.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.556+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=YLN0KFOB6G46 type=del 2024-08-08T23:36:04.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.556+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=KSQVH83MQ1NK type=del size=936860 2024-08-08T23:36:04.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.560+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.0 size=1048576 2024-08-08T23:36:04.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.1 size=1048576 2024-08-08T23:36:04.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~H5741TOIZZH6.2 size=359718 2024-08-08T23:36:04.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.568+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=H5741TOIZZH6 tag=XDIH6IZPG6YK type=write size=3505446 2024-08-08T23:36:04.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~1H25ITVB2KNT.0 size=888198 2024-08-08T23:36:04.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.576+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=1H25ITVB2KNT tag=J19W0919MC3A type=write size=1936774 2024-08-08T23:36:04.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.580+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=4UTNKT0G607M type=del 2024-08-08T23:36:04.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.584+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=GJQXZKT2T2AZ type=del size=287711 2024-08-08T23:36:04.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.584+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=WI5AN7Q9AW4J type=del 2024-08-08T23:36:04.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.0 size=1048576 2024-08-08T23:36:04.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.1 size=1048576 2024-08-08T23:36:04.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.596+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.2 size=285570 2024-08-08T23:36:04.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.596+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=OZH1WW3X9HJN tag=38D33CQTZ2KO type=write size=3431298 2024-08-08T23:36:04.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.596+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=98O28ZSRNSVU type=del 2024-08-08T23:36:04.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.600+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=XPREKL89KQFY type=write size=748410 2024-08-08T23:36:04.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.600+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V6GSJH62C8TA.2~KB30MSZLGTPZ.0 size=1048576 2024-08-08T23:36:04.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.604+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~KB30MSZLGTPZ.1 size=209746 2024-08-08T23:36:04.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.608+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V6GSJH62C8TA upload=KB30MSZLGTPZ tag=TGYNH9TCFIDN type=write size=2306898 2024-08-08T23:36:04.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.0 size=1048576 2024-08-08T23:36:04.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.1 size=1048576 2024-08-08T23:36:04.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.616+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.2 size=295940 2024-08-08T23:36:04.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.616+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=D129LLR0V7T2 tag=QIKURMIP0RPI type=write size=3441668 2024-08-08T23:36:04.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~DI59E2KVOEL3.0 size=3272 2024-08-08T23:36:04.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.624+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=DI59E2KVOEL3 tag=L6IWMMMT6FQ5 type=write size=1051848 2024-08-08T23:36:04.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.624+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=CTN6PQZDNXK9 type=del size=3543254 2024-08-08T23:36:04.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.628+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=A43JXRPZM516 type=del 2024-08-08T23:36:04.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.632+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=58APOKPB0K6V type=del size=3402314 2024-08-08T23:36:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.632+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=D3VPJG5MJ543 type=del 2024-08-08T23:36:04.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.636+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=6WG9FYA7L1XE type=write size=373633 2024-08-08T23:36:04.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.640+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=V3CC7K1BV98K type=del 2024-08-08T23:36:04.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.644+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=IWU779TNCD2Y type=del size=1127208 2024-08-08T23:36:04.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.644+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_VGT9IXWM956F.2~D09SCZCRS35U.0 size=462339 2024-08-08T23:36:04.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.648+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=VGT9IXWM956F upload=D09SCZCRS35U tag=6TRAMKVWU6V1 type=write size=1510915 2024-08-08T23:36:04.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.656+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.0 size=1048576 2024-08-08T23:36:04.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.660+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.1 size=1048576 2024-08-08T23:36:04.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.660+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.2 size=228252 2024-08-08T23:36:04.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.660+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=3YSR4QL5TNVZ tag=6IIR0HSE4GZK type=write size=3373980 2024-08-08T23:36:04.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.664+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=HSYT8Z7780NB type=del 2024-08-08T23:36:04.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.668+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=E3WM3575ASJX type=del size=452891 2024-08-08T23:36:04.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.668+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~XBE82WWBB2ZE.0 size=1037419 2024-08-08T23:36:04.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.676+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=XBE82WWBB2ZE tag=WYMCIQFQ7GII type=write size=2085995 2024-08-08T23:36:04.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~23XECYAR8JG6.0 size=714453 2024-08-08T23:36:04.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.680+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=23XECYAR8JG6 tag=THJZQRWSQYMB type=write size=1763029 2024-08-08T23:36:04.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.684+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~V5BP7JOBL5XZ.0 size=1048576 2024-08-08T23:36:04.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.684+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~V5BP7JOBL5XZ.1 size=410159 2024-08-08T23:36:04.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.688+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=V5BP7JOBL5XZ tag=LUXCH9ATRJY4 type=write size=2507311 2024-08-08T23:36:04.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.692+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=E059AFKYG0RB type=del size=2221928 2024-08-08T23:36:04.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.692+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_Z5EXY8ZHZCHI.2~EWNO9USENDOH.0 size=418273 2024-08-08T23:36:04.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.696+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=Z5EXY8ZHZCHI upload=EWNO9USENDOH tag=HTM40BX4UTSU type=write size=1466849 2024-08-08T23:36:04.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.700+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.0 size=1048576 2024-08-08T23:36:04.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.1 size=1048576 2024-08-08T23:36:04.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.704+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.2 size=924754 2024-08-08T23:36:04.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.704+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=2AAYBBEA0HQX tag=MIYWA23WZ1MS type=write size=4070482 2024-08-08T23:36:04.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.708+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=N1VYH0U91OC8 type=del 2024-08-08T23:36:04.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.712+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=E0060VQ0545S type=del size=2143711 2024-08-08T23:36:04.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.716+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=KSQVH83MQ1NK type=del 2024-08-08T23:36:04.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.0 size=1048576 2024-08-08T23:36:04.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.1 size=1048576 2024-08-08T23:36:04.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.728+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.2 size=284603 2024-08-08T23:36:04.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.728+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=ABB74QTD4SBP tag=KBQLJ4GFY8D9 type=write size=3430331 2024-08-08T23:36:04.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.732+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~1H25ITVB2KNT.0 size=888198 2024-08-08T23:36:04.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.736+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=1H25ITVB2KNT tag=J19W0919MC3A type=write size=1936774 2024-08-08T23:36:04.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.736+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=5HICRUNPBUZO type=write size=204218 2024-08-08T23:36:04.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.740+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=GJQXZKT2T2AZ type=del 2024-08-08T23:36:04.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.744+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=ANJ04R6XS6LK type=write size=596153 2024-08-08T23:36:04.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.744+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.0 size=1048576 2024-08-08T23:36:04.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.1 size=1048576 2024-08-08T23:36:04.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~OZH1WW3X9HJN.2 size=285570 2024-08-08T23:36:04.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=OZH1WW3X9HJN tag=38D33CQTZ2KO type=write size=3431298 2024-08-08T23:36:04.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.760+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.0 size=1048576 2024-08-08T23:36:04.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.1 size=1048576 2024-08-08T23:36:04.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.764+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.2 size=973309 2024-08-08T23:36:04.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.764+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=37M26MMO06CY tag=A1OB3OE5WVV9 type=write size=4119037 2024-08-08T23:36:04.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.768+0000 7fdbd6e2c8c0 1 < suggested update operation key=QWRYLH4P94BQ tag=XPREKL89KQFY type=write size=748410 2024-08-08T23:36:04.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~VR7HVYVCUYYO.0 size=1048576 2024-08-08T23:36:04.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~VR7HVYVCUYYO.1 size=788118 2024-08-08T23:36:04.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.776+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=VR7HVYVCUYYO tag=KIDEOC0RVEJD type=write size=2885270 2024-08-08T23:36:04.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.780+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.0 size=1048576 2024-08-08T23:36:04.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.784+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.1 size=1048576 2024-08-08T23:36:04.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.784+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~D129LLR0V7T2.2 size=295940 2024-08-08T23:36:04.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.788+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=D129LLR0V7T2 tag=QIKURMIP0RPI type=write size=3441668 2024-08-08T23:36:04.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.796+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~MWZMTLNUOPDT.0 size=110300 2024-08-08T23:36:04.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.796+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=MWZMTLNUOPDT tag=W01AEXZ5EWQL type=write size=1158876 2024-08-08T23:36:04.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.796+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=CTN6PQZDNXK9 type=del 2024-08-08T23:36:04.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.800+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=MJMM5PCZSP0N type=write size=471186 2024-08-08T23:36:04.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.804+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=58APOKPB0K6V type=del 2024-08-08T23:36:04.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.808+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~7CC0Y2KPDU7W.0 size=175970 2024-08-08T23:36:04.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.808+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=7CC0Y2KPDU7W tag=K2GMXJNKQ7UZ type=write size=1224546 2024-08-08T23:36:04.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.816+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=6WG9FYA7L1XE type=write 2024-08-08T23:36:04.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.816+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=VO3MJRG36ZFS type=del size=3737973 2024-08-08T23:36:04.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.824+0000 7fdbd6e2c8c0 1 < suggested update operation key=JWTLJG79MYI5 tag=IWU779TNCD2Y type=del size=1127208 2024-08-08T23:36:04.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.828+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=A27H1KR9YF9H type=del size=4174791 2024-08-08T23:36:04.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.828+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.0 size=1048576 2024-08-08T23:36:04.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.832+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.1 size=1048576 2024-08-08T23:36:04.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.832+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_MNV404EWJHC1.2~3YSR4QL5TNVZ.2 size=228252 2024-08-08T23:36:04.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.836+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=MNV404EWJHC1 upload=3YSR4QL5TNVZ tag=6IIR0HSE4GZK type=write size=3373980 2024-08-08T23:36:04.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.840+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=4J1T7E8FAHVW type=del size=2221449 2024-08-08T23:36:04.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.844+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZQ8GOX9RSTBB tag=E3WM3575ASJX type=del size=452891 2024-08-08T23:36:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.852+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~UHSN93ATPIQO.0 size=764785 2024-08-08T23:36:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.852+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=UHSN93ATPIQO tag=T2SCCDGTHT6M type=write size=1813361 2024-08-08T23:36:04.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.852+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~23XECYAR8JG6.0 size=714453 2024-08-08T23:36:04.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.860+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=23XECYAR8JG6 tag=THJZQRWSQYMB type=write size=1763029 2024-08-08T23:36:04.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.860+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=NU9UY6Z8BUBO type=write size=54294 2024-08-08T23:36:04.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.868+0000 7fdbd6e2c8c0 1 < suggested update operation key=QJB9DETMSY4X tag=E059AFKYG0RB type=del size=2221928 2024-08-08T23:36:04.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.872+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=YFQP0EZZGAAF type=del size=2607074 2024-08-08T23:36:04.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.876+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.0 size=1048576 2024-08-08T23:36:04.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.876+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.1 size=1048576 2024-08-08T23:36:04.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.880+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~2AAYBBEA0HQX.2 size=924754 2024-08-08T23:36:04.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.884+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=2AAYBBEA0HQX tag=MIYWA23WZ1MS type=write size=4070482 2024-08-08T23:36:04.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.888+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=RGBSCUHACP9E type=del size=1385345 2024-08-08T23:36:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.888+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=E0060VQ0545S type=del 2024-08-08T23:36:04.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.892+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=GMJVSOF1WETC type=del size=2019888 2024-08-08T23:36:04.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.892+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.0 size=1048576 2024-08-08T23:36:04.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.1 size=1048576 2024-08-08T23:36:04.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.896+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_63GVT7KRKCSS.2~ABB74QTD4SBP.2 size=284603 2024-08-08T23:36:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.900+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=63GVT7KRKCSS upload=ABB74QTD4SBP tag=KBQLJ4GFY8D9 type=write size=3430331 2024-08-08T23:36:04.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.900+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=5T920OQ6MCCU type=del size=587498 2024-08-08T23:36:04.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.904+0000 7fdbd6e2c8c0 1 < completed write operation key=GZJ8GWYBB01F tag=5HICRUNPBUZO type=write size=204218 2024-08-08T23:36:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~J1RM313GIG7U.0 size=1019198 2024-08-08T23:36:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.908+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=J1RM313GIG7U tag=7K21IB5ORZUH type=write size=2067774 2024-08-08T23:36:04.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.912+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=ANJ04R6XS6LK type=write size=596153 2024-08-08T23:36:04.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.916+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=J6ZE5CABY3JP type=del size=1229000 2024-08-08T23:36:04.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.920+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.0 size=1048576 2024-08-08T23:36:04.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.920+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.1 size=1048576 2024-08-08T23:36:04.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.920+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~37M26MMO06CY.2 size=973309 2024-08-08T23:36:04.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.924+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=37M26MMO06CY tag=A1OB3OE5WVV9 type=write size=4119037 2024-08-08T23:36:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.928+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=0RLMT2U0RR9P type=write size=82461 2024-08-08T23:36:04.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~VR7HVYVCUYYO.0 size=1048576 2024-08-08T23:36:04.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.932+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~VR7HVYVCUYYO.1 size=788118 2024-08-08T23:36:04.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.936+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=VR7HVYVCUYYO tag=KIDEOC0RVEJD type=write size=2885270 2024-08-08T23:36:04.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.940+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=GNYN14D6W4A8 type=del size=3444388 2024-08-08T23:36:04.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.940+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_MNV404EWJHC1.2~MWZMTLNUOPDT.0 size=110300 2024-08-08T23:36:04.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.944+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=MNV404EWJHC1 upload=MWZMTLNUOPDT tag=W01AEXZ5EWQL type=write size=1158876 2024-08-08T23:36:04.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.948+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~LMVIOUTRCZLE.0 size=1048576 2024-08-08T23:36:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.948+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~LMVIOUTRCZLE.1 size=111546 2024-08-08T23:36:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.948+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=LMVIOUTRCZLE tag=8SEWHH14DE3Q type=write size=2208698 2024-08-08T23:36:04.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.956+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZBEB2Q3J9Z0D tag=MJMM5PCZSP0N type=write size=471186 2024-08-08T23:36:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.956+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=T5TEBEXEO6XQ type=write size=790168 2024-08-08T23:36:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.960+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YO2FZOR7H0EX.2~7CC0Y2KPDU7W.0 size=175970 2024-08-08T23:36:04.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.964+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YO2FZOR7H0EX upload=7CC0Y2KPDU7W tag=K2GMXJNKQ7UZ type=write size=1224546 2024-08-08T23:36:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~KNONMRIOQNH7.0 size=1048576 2024-08-08T23:36:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~KNONMRIOQNH7.1 size=766131 2024-08-08T23:36:04.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.968+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=KNONMRIOQNH7 tag=G8C6KAYE9JH6 type=write size=2863283 2024-08-08T23:36:04.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.972+0000 7fdbd6e2c8c0 1 < canceled operation key=V6GSJH62C8TA tag=VO3MJRG36ZFS type=del size=3737973 2024-08-08T23:36:04.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.976+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~HZGUDE2MERXI.0 size=1048576 2024-08-08T23:36:04.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.980+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~HZGUDE2MERXI.1 size=578616 2024-08-08T23:36:04.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.980+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=HZGUDE2MERXI tag=92EJSI3UY4UJ type=write size=2675768 2024-08-08T23:36:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.984+0000 7fdbd6e2c8c0 1 < suggested update operation key=D81PQ0FJVNEE tag=A27H1KR9YF9H type=del size=4174791 2024-08-08T23:36:04.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~5E4G7KIE3CNV.0 size=1048576 2024-08-08T23:36:04.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.992+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~5E4G7KIE3CNV.1 size=983138 2024-08-08T23:36:04.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.992+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=5E4G7KIE3CNV tag=8QALQ1KH531F type=write size=3080290 2024-08-08T23:36:04.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:04.996+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=4J1T7E8FAHVW type=del 2024-08-08T23:36:05.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.000+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~6Q36CGT14PCS.0 size=377466 2024-08-08T23:36:05.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.000+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=6Q36CGT14PCS tag=74KX40MG1UTU type=write size=1426042 2024-08-08T23:36:05.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.000+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~UHSN93ATPIQO.0 size=764785 2024-08-08T23:36:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.004+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=UHSN93ATPIQO tag=T2SCCDGTHT6M type=write size=1813361 2024-08-08T23:36:05.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.0 size=1048576 2024-08-08T23:36:05.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.1 size=1048576 2024-08-08T23:36:05.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.016+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.2 size=361980 2024-08-08T23:36:05.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.016+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=K1RLDKKHZS2Q tag=2TV2RDWZ0OOJ type=write size=3507708 2024-08-08T23:36:05.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.024+0000 7fdbd6e2c8c0 1 < suggested remove operation key=NMB4GI8R2BKU tag=NU9UY6Z8BUBO type=write 2024-08-08T23:36:05.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.028+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~64RJDV8R1974.0 size=1048576 2024-08-08T23:36:05.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.028+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~64RJDV8R1974.1 size=54583 2024-08-08T23:36:05.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.028+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=64RJDV8R1974 tag=5F3SSSV8SPP2 type=write size=2151735 2024-08-08T23:36:05.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.032+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=YFQP0EZZGAAF type=del 2024-08-08T23:36:05.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.036+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~MD0B3PIK8DGF.0 size=614050 2024-08-08T23:36:05.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.036+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=MD0B3PIK8DGF tag=4WQJDFYIPNAT type=write size=1662626 2024-08-08T23:36:05.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.040+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QHN8QYEEOHYO tag=RGBSCUHACP9E type=del 2024-08-08T23:36:05.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.044+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=JOQ3XJCETRVM type=write size=590570 2024-08-08T23:36:05.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=GMJVSOF1WETC type=del 2024-08-08T23:36:05.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.048+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=8RAHQINY5UGW type=del size=2856351 2024-08-08T23:36:05.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.052+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=5T920OQ6MCCU type=del 2024-08-08T23:36:05.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.056+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=FP34XD7D2YYG type=del size=3685759 2024-08-08T23:36:05.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~J1RM313GIG7U.0 size=1019198 2024-08-08T23:36:05.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=J1RM313GIG7U tag=7K21IB5ORZUH type=write size=2067774 2024-08-08T23:36:05.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.064+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=03XBX89IE2KT type=write size=834491 2024-08-08T23:36:05.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.068+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=J6ZE5CABY3JP type=del 2024-08-08T23:36:05.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.068+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=L38NYD0MHM48 type=write size=64967 2024-08-08T23:36:05.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.072+0000 7fdbd6e2c8c0 1 < completed write operation key=903K2EO77YTJ tag=0RLMT2U0RR9P type=write size=82461 2024-08-08T23:36:05.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.076+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VGT9IXWM956F.2~ZTJ3LW2VPYAJ.0 size=895846 2024-08-08T23:36:05.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.076+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VGT9IXWM956F upload=ZTJ3LW2VPYAJ tag=XR1SU1XBX3TX type=write size=1944422 2024-08-08T23:36:05.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.084+0000 7fdbd6e2c8c0 1 < suggested remove operation key=P3H05VKM0ZGJ tag=GNYN14D6W4A8 type=del 2024-08-08T23:36:05.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.0 size=1048576 2024-08-08T23:36:05.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.088+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.1 size=1048576 2024-08-08T23:36:05.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.092+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.2 size=682486 2024-08-08T23:36:05.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.092+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=B89CJVRBG19V tag=FUIFDAOJ8O21 type=write size=3828214 2024-08-08T23:36:05.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.092+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~LMVIOUTRCZLE.0 size=1048576 2024-08-08T23:36:05.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~LMVIOUTRCZLE.1 size=111546 2024-08-08T23:36:05.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.100+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=LMVIOUTRCZLE tag=8SEWHH14DE3Q type=write size=2208698 2024-08-08T23:36:05.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.100+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=0MAEA7YD36JR type=del size=2008430 2024-08-08T23:36:05.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.104+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V3TA5KZ95NXT tag=T5TEBEXEO6XQ type=write 2024-08-08T23:36:05.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.108+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=QY24PC0013SH type=del size=465477 2024-08-08T23:36:05.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.112+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~KNONMRIOQNH7.0 size=1048576 2024-08-08T23:36:05.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.112+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~KNONMRIOQNH7.1 size=766131 2024-08-08T23:36:05.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.116+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=KNONMRIOQNH7 tag=G8C6KAYE9JH6 type=write size=2863283 2024-08-08T23:36:05.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.120+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~OOFYSZYMC2AI.0 size=1048576 2024-08-08T23:36:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.124+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~OOFYSZYMC2AI.1 size=874177 2024-08-08T23:36:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.124+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=OOFYSZYMC2AI tag=SPQRD95W60MK type=write size=2971329 2024-08-08T23:36:05.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~HZGUDE2MERXI.0 size=1048576 2024-08-08T23:36:05.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~HZGUDE2MERXI.1 size=578616 2024-08-08T23:36:05.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.132+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=HZGUDE2MERXI tag=92EJSI3UY4UJ type=write size=2675768 2024-08-08T23:36:05.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.136+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=7SNWJHXSD0IN type=del size=2921129 2024-08-08T23:36:05.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.140+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~5E4G7KIE3CNV.0 size=1048576 2024-08-08T23:36:05.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.140+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~5E4G7KIE3CNV.1 size=983138 2024-08-08T23:36:05.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.144+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=5E4G7KIE3CNV tag=8QALQ1KH531F type=write size=3080290 2024-08-08T23:36:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~J1HKPFFEE9AE.0 size=1048576 2024-08-08T23:36:05.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.152+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~J1HKPFFEE9AE.1 size=964320 2024-08-08T23:36:05.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.152+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=J1HKPFFEE9AE tag=G339ZD37MB4T type=write size=3061472 2024-08-08T23:36:05.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.156+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~6Q36CGT14PCS.0 size=377466 2024-08-08T23:36:05.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.160+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=6Q36CGT14PCS tag=74KX40MG1UTU type=write size=1426042 2024-08-08T23:36:05.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.164+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=UNDA54N6AHO2 type=write size=194315 2024-08-08T23:36:05.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.0 size=1048576 2024-08-08T23:36:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.172+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.1 size=1048576 2024-08-08T23:36:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.172+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_9S8TBVP20KTG.2~K1RLDKKHZS2Q.2 size=361980 2024-08-08T23:36:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.176+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=9S8TBVP20KTG upload=K1RLDKKHZS2Q tag=2TV2RDWZ0OOJ type=write size=3507708 2024-08-08T23:36:05.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.180+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=ZNW60WCITKUP type=del size=1056538 2024-08-08T23:36:05.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.180+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~64RJDV8R1974.0 size=1048576 2024-08-08T23:36:05.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.184+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~64RJDV8R1974.1 size=54583 2024-08-08T23:36:05.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.188+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=64RJDV8R1974 tag=5F3SSSV8SPP2 type=write size=2151735 2024-08-08T23:36:05.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.196+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~4J32LPTF1I2Z.0 size=709112 2024-08-08T23:36:05.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.196+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=4J32LPTF1I2Z tag=1W9GT0AHKSM2 type=write size=1757688 2024-08-08T23:36:05.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.200+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~MD0B3PIK8DGF.0 size=614050 2024-08-08T23:36:05.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.204+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=MD0B3PIK8DGF tag=4WQJDFYIPNAT type=write size=1662626 2024-08-08T23:36:05.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.208+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=CAKVP5VDQJIE type=del size=1628420 2024-08-08T23:36:05.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.208+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=V3TA5KZ95NXT tag=JOQ3XJCETRVM type=write size=590570: (22) Invalid argument 2024-08-08T23:36:05.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.212+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~74MW7G04Y8CX.0 size=1048576 2024-08-08T23:36:05.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.216+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~74MW7G04Y8CX.1 size=848480 2024-08-08T23:36:05.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.216+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=74MW7G04Y8CX tag=J0JJGFUWMG4F type=write size=2945632 2024-08-08T23:36:05.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.220+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=P3H05VKM0ZGJ tag=8RAHQINY5UGW type=del size=2856351: (22) Invalid argument 2024-08-08T23:36:05.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.220+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=47ITEBKHONJD type=write size=766171 2024-08-08T23:36:05.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.224+0000 7fdbd6e2c8c0 1 < suggested update operation key=V6GSJH62C8TA tag=FP34XD7D2YYG type=del size=3685759 2024-08-08T23:36:05.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.228+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=DWVPGKUIGD24 type=del size=3706863 2024-08-08T23:36:05.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.232+0000 7fdbd6e2c8c0 1 < completed write operation key=FWZ5TEP1P2LK tag=03XBX89IE2KT type=write size=834491 2024-08-08T23:36:05.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.232+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=IHDQ8KCRQMKX type=del size=586113 2024-08-08T23:36:05.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.236+0000 7fdbd6e2c8c0 1 < canceled operation key=VGT9IXWM956F tag=L38NYD0MHM48 type=write size=64967 2024-08-08T23:36:05.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.240+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=8ZDVKPZOTC50 type=del size=243372 2024-08-08T23:36:05.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.240+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VGT9IXWM956F.2~ZTJ3LW2VPYAJ.0 size=895846 2024-08-08T23:36:05.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.248+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VGT9IXWM956F upload=ZTJ3LW2VPYAJ tag=XR1SU1XBX3TX type=write size=1944422 2024-08-08T23:36:05.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.248+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=IHTLO4W124TT type=del size=3457194 2024-08-08T23:36:05.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.0 size=1048576 2024-08-08T23:36:05.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.1 size=1048576 2024-08-08T23:36:05.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.256+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~B89CJVRBG19V.2 size=682486 2024-08-08T23:36:05.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.260+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=B89CJVRBG19V tag=FUIFDAOJ8O21 type=write size=3828214 2024-08-08T23:36:05.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.264+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=103HGTW61J4W type=del size=4140364 2024-08-08T23:36:05.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.268+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=0MAEA7YD36JR type=del 2024-08-08T23:36:05.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.268+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=GBRBJ3C6O0YM type=write size=1033102 2024-08-08T23:36:05.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.272+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=QY24PC0013SH type=del 2024-08-08T23:36:05.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.276+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=BUFAVXEE3F0R type=del size=3043592 2024-08-08T23:36:05.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.276+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~OOFYSZYMC2AI.0 size=1048576 2024-08-08T23:36:05.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.280+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~OOFYSZYMC2AI.1 size=874177 2024-08-08T23:36:05.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.284+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=OOFYSZYMC2AI tag=SPQRD95W60MK type=write size=2971329 2024-08-08T23:36:05.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.284+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=JX19R0BK5EJH type=del size=4034496 2024-08-08T23:36:05.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.288+0000 7fdbd6e2c8c0 1 < canceled operation key=903K2EO77YTJ tag=7SNWJHXSD0IN type=del size=2921129 2024-08-08T23:36:05.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.292+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=U66DQ7L5X93R type=del size=35321 2024-08-08T23:36:05.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.292+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~J1HKPFFEE9AE.0 size=1048576 2024-08-08T23:36:05.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.296+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~J1HKPFFEE9AE.1 size=964320 2024-08-08T23:36:05.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.300+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=J1HKPFFEE9AE tag=G339ZD37MB4T type=write size=3061472 2024-08-08T23:36:05.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.304+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.0 size=1048576 2024-08-08T23:36:05.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.1 size=1048576 2024-08-08T23:36:05.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.2 size=486734 2024-08-08T23:36:05.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.308+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=XWDZW1QDU9K8 tag=0YT1PLP6IKR8 type=write size=3632462 2024-08-08T23:36:05.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.316+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=UNDA54N6AHO2 type=write 2024-08-08T23:36:05.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.320+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=CIM0Q0BSHGQ6 type=del size=1134965 2024-08-08T23:36:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.324+0000 7fdbd6e2c8c0 1 < canceled operation key=FBCEC998C8EJ tag=ZNW60WCITKUP type=del size=1056538 2024-08-08T23:36:05.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.324+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=38YDEYJPW2DR type=write size=1012461 2024-08-08T23:36:05.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.328+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~4J32LPTF1I2Z.0 size=709112 2024-08-08T23:36:05.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.332+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=4J32LPTF1I2Z tag=1W9GT0AHKSM2 type=write size=1757688 2024-08-08T23:36:05.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~GN8RFAINKCNS.0 size=1048576 2024-08-08T23:36:05.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.340+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~GN8RFAINKCNS.1 size=172210 2024-08-08T23:36:05.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.340+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=GN8RFAINKCNS tag=L94KD8VNUGFR type=write size=2269362 2024-08-08T23:36:05.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.340+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=CAKVP5VDQJIE type=del 2024-08-08T23:36:05.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.0 size=1048576 2024-08-08T23:36:05.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.348+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.1 size=1048576 2024-08-08T23:36:05.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.352+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.2 size=697 2024-08-08T23:36:05.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.352+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=L06Z5ZXF7FLZ tag=FOH44OY134JJ type=write size=3146425 2024-08-08T23:36:05.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.356+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~74MW7G04Y8CX.0 size=1048576 2024-08-08T23:36:05.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.356+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~74MW7G04Y8CX.1 size=848480 2024-08-08T23:36:05.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.360+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=74MW7G04Y8CX tag=J0JJGFUWMG4F type=write size=2945632 2024-08-08T23:36:05.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.0 size=1048576 2024-08-08T23:36:05.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.1 size=1048576 2024-08-08T23:36:05.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.2 size=384226 2024-08-08T23:36:05.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.368+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=W4CVC0ZSN5CE tag=D1ZF2CK2Z6IO type=write size=3529954 2024-08-08T23:36:05.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.372+0000 7fdbd6e2c8c0 1 < suggested remove operation key=JWTLJG79MYI5 tag=47ITEBKHONJD type=write 2024-08-08T23:36:05.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.380+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~VIK7846MCIRV.0 size=911831 2024-08-08T23:36:05.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.380+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=VIK7846MCIRV tag=40WNAQGHM12G type=write size=1960407 2024-08-08T23:36:05.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.384+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FBCEC998C8EJ tag=DWVPGKUIGD24 type=del 2024-08-08T23:36:05.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.384+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=A884W5HP917P type=del size=582199 2024-08-08T23:36:05.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.388+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=IHDQ8KCRQMKX type=del 2024-08-08T23:36:05.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.392+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=BVHLVJ68ADXM type=del size=2701946 2024-08-08T23:36:05.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.392+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=8ZDVKPZOTC50 type=del 2024-08-08T23:36:05.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.396+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=NN3DB34IDUPE type=write size=470107 2024-08-08T23:36:05.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.400+0000 7fdbd6e2c8c0 1 < canceled operation key=MNV404EWJHC1 tag=IHTLO4W124TT type=del size=3457194 2024-08-08T23:36:05.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.400+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=2RTUO5P40QZH type=del size=3598499 2024-08-08T23:36:05.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.404+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=103HGTW61J4W type=del 2024-08-08T23:36:05.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.408+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=KR5080Y1W3E9 type=del size=2195328 2024-08-08T23:36:05.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.408+0000 7fdbd6e2c8c0 1 < completed write operation key=41XLZV9ZY5OP tag=GBRBJ3C6O0YM type=write size=1033102 2024-08-08T23:36:05.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.412+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~5NQ3D0FBI5WO.0 size=1048576 2024-08-08T23:36:05.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~5NQ3D0FBI5WO.1 size=453646 2024-08-08T23:36:05.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.420+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=5NQ3D0FBI5WO tag=ZKR0VO9F9DOL type=write size=2550798 2024-08-08T23:36:05.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.420+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=BUFAVXEE3F0R type=del 2024-08-08T23:36:05.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.424+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=KWIPZG8S2381 type=del size=3163279 2024-08-08T23:36:05.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.428+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=JX19R0BK5EJH type=del 2024-08-08T23:36:05.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.428+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=GY8DAXCHMF1K type=write size=804752 2024-08-08T23:36:05.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.432+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=U66DQ7L5X93R type=del 2024-08-08T23:36:05.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.436+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=F172PQCJVB77 type=del size=279867 2024-08-08T23:36:05.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.0 size=1048576 2024-08-08T23:36:05.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.1 size=1048576 2024-08-08T23:36:05.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~XWDZW1QDU9K8.2 size=486734 2024-08-08T23:36:05.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.448+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=XWDZW1QDU9K8 tag=0YT1PLP6IKR8 type=write size=3632462 2024-08-08T23:36:05.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.452+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=BB1ONOJXGB2V type=del size=2778245 2024-08-08T23:36:05.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.456+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=JWTLJG79MYI5 tag=CIM0Q0BSHGQ6 type=del size=1134965: (22) Invalid argument 2024-08-08T23:36:05.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.460+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~JJ97WB4E11LE.0 size=365356 2024-08-08T23:36:05.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.460+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=JJ97WB4E11LE tag=525R6KK3T31J type=write size=1413932 2024-08-08T23:36:05.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.464+0000 7fdbd6e2c8c0 1 < completed write operation key=YO2FZOR7H0EX tag=38YDEYJPW2DR type=write size=1012461 2024-08-08T23:36:05.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.464+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=0HH0YRAWDK7W type=del size=2048843 2024-08-08T23:36:05.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.468+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~GN8RFAINKCNS.0 size=1048576 2024-08-08T23:36:05.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~GN8RFAINKCNS.1 size=172210 2024-08-08T23:36:05.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.476+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=GN8RFAINKCNS tag=L94KD8VNUGFR type=write size=2269362 2024-08-08T23:36:05.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.480+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~996S0CDE2V6S.0 size=1048576 2024-08-08T23:36:05.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.484+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~996S0CDE2V6S.1 size=644842 2024-08-08T23:36:05.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.484+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=996S0CDE2V6S tag=V4B2XJTCC5H0 type=write size=2741994 2024-08-08T23:36:05.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.0 size=1048576 2024-08-08T23:36:05.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.488+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.1 size=1048576 2024-08-08T23:36:05.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.488+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_41XLZV9ZY5OP.2~L06Z5ZXF7FLZ.2 size=697 2024-08-08T23:36:05.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.492+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=41XLZV9ZY5OP upload=L06Z5ZXF7FLZ tag=FOH44OY134JJ type=write size=3146425 2024-08-08T23:36:05.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.500+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.0 size=1048576 2024-08-08T23:36:05.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.500+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.1 size=1048576 2024-08-08T23:36:05.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.504+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.2 size=885399 2024-08-08T23:36:05.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.504+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=ILTQCYQKKI1B tag=6IAJSRMEJJTE type=write size=4031127 2024-08-08T23:36:05.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.0 size=1048576 2024-08-08T23:36:05.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.1 size=1048576 2024-08-08T23:36:05.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~W4CVC0ZSN5CE.2 size=384226 2024-08-08T23:36:05.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.516+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=W4CVC0ZSN5CE tag=D1ZF2CK2Z6IO type=write size=3529954 2024-08-08T23:36:05.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.520+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GMVEOO97I8YH.2~12LLB89GHA76.0 size=889482 2024-08-08T23:36:05.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.520+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GMVEOO97I8YH upload=12LLB89GHA76 tag=3374UGY04CA4 type=write size=1938058 2024-08-08T23:36:05.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.524+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_2SO6IPMXZUUI.2~VIK7846MCIRV.0 size=911831 2024-08-08T23:36:05.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.528+0000 7fdbd6e2c8c0 1 < completed multipart upload key=2SO6IPMXZUUI upload=VIK7846MCIRV tag=40WNAQGHM12G type=write size=1960407 2024-08-08T23:36:05.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.532+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~9V4GIQ9KOA01.0 size=684597 2024-08-08T23:36:05.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.532+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=9V4GIQ9KOA01 tag=J036OBHNA5R2 type=write size=1733173 2024-08-08T23:36:05.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.536+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=A884W5HP917P type=del 2024-08-08T23:36:05.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.536+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=4ZGNZSUVRI5E type=del size=2792450 2024-08-08T23:36:05.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.540+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=BVHLVJ68ADXM type=del 2024-08-08T23:36:05.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.544+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=ZEES90YF8R5J type=del size=3335985 2024-08-08T23:36:05.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.544+0000 7fdbd6e2c8c0 1 < completed write operation key=ZBEB2Q3J9Z0D tag=NN3DB34IDUPE type=write size=470107 2024-08-08T23:36:05.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.548+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=XUSOMYBYI45P type=del size=3686875 2024-08-08T23:36:05.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.552+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=2RTUO5P40QZH type=del 2024-08-08T23:36:05.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.556+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~H7O0FGMF8WLQ.0 size=749093 2024-08-08T23:36:05.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.556+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=H7O0FGMF8WLQ tag=U4O31OY6VM68 type=write size=1797669 2024-08-08T23:36:05.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.560+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=KR5080Y1W3E9 type=del 2024-08-08T23:36:05.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.560+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=A0CBM71029WG type=del size=3149721 2024-08-08T23:36:05.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~5NQ3D0FBI5WO.0 size=1048576 2024-08-08T23:36:05.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.568+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~5NQ3D0FBI5WO.1 size=453646 2024-08-08T23:36:05.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.572+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=5NQ3D0FBI5WO tag=ZKR0VO9F9DOL type=write size=2550798 2024-08-08T23:36:05.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~LK0F8H7ET7YC.0 size=140535 2024-08-08T23:36:05.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.576+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=LK0F8H7ET7YC tag=FDNEQ9EAHQQF type=write size=1189111 2024-08-08T23:36:05.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.580+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=KWIPZG8S2381 type=del 2024-08-08T23:36:05.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.580+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=NA0YFUAFO4SA type=del size=1590624 2024-08-08T23:36:05.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.584+0000 7fdbd6e2c8c0 1 < completed write operation key=GMVEOO97I8YH tag=GY8DAXCHMF1K type=write size=804752 2024-08-08T23:36:05.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.0 size=1048576 2024-08-08T23:36:05.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.1 size=1048576 2024-08-08T23:36:05.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.596+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.2 size=148679 2024-08-08T23:36:05.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.596+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V6GSJH62C8TA upload=RDK6WYOUVMY5 tag=7NK6PM4H3FGX type=write size=3294407 2024-08-08T23:36:05.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.600+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FWZ5TEP1P2LK tag=F172PQCJVB77 type=del 2024-08-08T23:36:05.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.608+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~HW2QFWIO3GI3.0 size=597447 2024-08-08T23:36:05.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.608+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=HW2QFWIO3GI3 tag=L36VYOVW6FJR type=write size=1646023 2024-08-08T23:36:05.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.612+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=BB1ONOJXGB2V type=del 2024-08-08T23:36:05.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.612+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=URRHA5VL29QA type=write size=504166 2024-08-08T23:36:05.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~JJ97WB4E11LE.0 size=365356 2024-08-08T23:36:05.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.620+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=JJ97WB4E11LE tag=525R6KK3T31J type=write size=1413932 2024-08-08T23:36:05.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.624+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=BSTHWR2ZRXSB type=del size=1872985 2024-08-08T23:36:05.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.628+0000 7fdbd6e2c8c0 1 < completed delete operation key=V3TA5KZ95NXT tag=0HH0YRAWDK7W type=del 2024-08-08T23:36:05.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.632+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=DCE5MBWE9XDB type=del size=970614 2024-08-08T23:36:05.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~996S0CDE2V6S.0 size=1048576 2024-08-08T23:36:05.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.636+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~996S0CDE2V6S.1 size=644842 2024-08-08T23:36:05.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.644+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=996S0CDE2V6S tag=V4B2XJTCC5H0 type=write size=2741994 2024-08-08T23:36:05.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.648+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=D3IXMIDLECYT type=del size=1075671 2024-08-08T23:36:05.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.648+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.0 size=1048576 2024-08-08T23:36:05.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.652+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.1 size=1048576 2024-08-08T23:36:05.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.652+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~ILTQCYQKKI1B.2 size=885399 2024-08-08T23:36:05.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.660+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=ILTQCYQKKI1B tag=6IAJSRMEJJTE type=write size=4031127 2024-08-08T23:36:05.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.664+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=IM8BMMBVYA6U type=del size=587735 2024-08-08T23:36:05.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.668+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GMVEOO97I8YH.2~12LLB89GHA76.0 size=889482 2024-08-08T23:36:05.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.672+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GMVEOO97I8YH upload=12LLB89GHA76 tag=3374UGY04CA4 type=write size=1938058 2024-08-08T23:36:05.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.676+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=TQYPL9H08OA2 type=del size=633990 2024-08-08T23:36:05.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.676+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~9V4GIQ9KOA01.0 size=684597 2024-08-08T23:36:05.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.684+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=9V4GIQ9KOA01 tag=J036OBHNA5R2 type=write size=1733173 2024-08-08T23:36:05.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.692+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.0 size=1048576 2024-08-08T23:36:05.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.696+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.1 size=1048576 2024-08-08T23:36:05.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.696+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.2 size=718227 2024-08-08T23:36:05.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.696+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=9S8TBVP20KTG upload=GLQZ5GM601DE tag=Y1NZ1QXKWO21 type=write size=3863955 2024-08-08T23:36:05.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.700+0000 7fdbd6e2c8c0 1 < canceled operation key=QANZ3YTL2NQV tag=4ZGNZSUVRI5E type=del size=2792450 2024-08-08T23:36:05.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.704+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=ALAYU1IJGBAR type=del size=3106444 2024-08-08T23:36:05.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.704+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=ZEES90YF8R5J type=del 2024-08-08T23:36:05.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.712+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~WDUH51G4SFI4.0 size=652495 2024-08-08T23:36:05.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.712+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=WDUH51G4SFI4 tag=F7VP7VN92RN0 type=write size=1701071 2024-08-08T23:36:05.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.712+0000 7fdbd6e2c8c0 1 < canceled operation key=YNQU8Z202QCM tag=XUSOMYBYI45P type=del size=3686875 2024-08-08T23:36:05.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.716+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=33HTODLMLNIC type=del size=1037483 2024-08-08T23:36:05.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.716+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~H7O0FGMF8WLQ.0 size=749093 2024-08-08T23:36:05.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.720+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=H7O0FGMF8WLQ tag=U4O31OY6VM68 type=write size=1797669 2024-08-08T23:36:05.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.724+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=F36ZQ7QZUWLU type=del size=1773020 2024-08-08T23:36:05.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.728+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=A0CBM71029WG type=del 2024-08-08T23:36:05.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.728+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=1RH68Z4H8QIQ type=del size=2390944 2024-08-08T23:36:05.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.732+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_MNV404EWJHC1.2~LK0F8H7ET7YC.0 size=140535 2024-08-08T23:36:05.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.736+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=MNV404EWJHC1 upload=LK0F8H7ET7YC tag=FDNEQ9EAHQQF type=write size=1189111 2024-08-08T23:36:05.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.736+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=VCJES0U2W9D0 type=del size=396818 2024-08-08T23:36:05.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.740+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=NA0YFUAFO4SA type=del 2024-08-08T23:36:05.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.744+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=P2CKE5OEX7QP type=del size=1046165 2024-08-08T23:36:05.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.0 size=1048576 2024-08-08T23:36:05.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.748+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.1 size=1048576 2024-08-08T23:36:05.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V6GSJH62C8TA.2~RDK6WYOUVMY5.2 size=148679 2024-08-08T23:36:05.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V6GSJH62C8TA upload=RDK6WYOUVMY5 tag=7NK6PM4H3FGX type=write size=3294407 2024-08-08T23:36:05.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.760+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=T30KBUCRZO79 type=del size=291308 2024-08-08T23:36:05.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.760+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_P3H05VKM0ZGJ.2~HW2QFWIO3GI3.0 size=597447 2024-08-08T23:36:05.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.764+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=P3H05VKM0ZGJ upload=HW2QFWIO3GI3 tag=L36VYOVW6FJR type=write size=1646023 2024-08-08T23:36:05.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.768+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=GJNXNZSARLPX type=del size=566974 2024-08-08T23:36:05.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.772+0000 7fdbd6e2c8c0 1 < completed write operation key=FBCEC998C8EJ tag=URRHA5VL29QA type=write size=504166 2024-08-08T23:36:05.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.776+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~3JVEQ7PV24OA.0 size=1048576 2024-08-08T23:36:05.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.780+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~3JVEQ7PV24OA.1 size=274261 2024-08-08T23:36:05.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.780+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=3JVEQ7PV24OA tag=W34UZB2B5OFY type=write size=2371413 2024-08-08T23:36:05.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.784+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=BSTHWR2ZRXSB type=del 2024-08-08T23:36:05.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.784+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=HK6ZR10HFL72 type=del size=602514 2024-08-08T23:36:05.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.788+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=DCE5MBWE9XDB type=del 2024-08-08T23:36:05.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.792+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=CH5O82NVF2P7 type=del size=1615400 2024-08-08T23:36:05.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.796+0000 7fdbd6e2c8c0 1 < completed delete operation key=YO2FZOR7H0EX tag=D3IXMIDLECYT type=del 2024-08-08T23:36:05.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.800+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.0 size=1048576 2024-08-08T23:36:05.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.1 size=1048576 2024-08-08T23:36:05.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.804+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.2 size=757801 2024-08-08T23:36:05.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.804+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=M094TIHBT6V6 tag=PBU66J1ECUQS type=write size=3903529 2024-08-08T23:36:05.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.812+0000 7fdbd6e2c8c0 1 < suggested remove operation key=YO2FZOR7H0EX tag=IM8BMMBVYA6U type=del 2024-08-08T23:36:05.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.816+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~LVKHVMWUUH6W.0 size=1048576 2024-08-08T23:36:05.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.820+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~LVKHVMWUUH6W.1 size=212610 2024-08-08T23:36:05.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.820+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=LVKHVMWUUH6W tag=DX70HZSCDV2C type=write size=2309762 2024-08-08T23:36:05.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.820+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=TQYPL9H08OA2 type=del 2024-08-08T23:36:05.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.824+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=4DBW0I8PV2NN type=write size=27339 2024-08-08T23:36:05.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.828+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.0 size=1048576 2024-08-08T23:36:05.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.832+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.1 size=1048576 2024-08-08T23:36:05.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.832+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_9S8TBVP20KTG.2~GLQZ5GM601DE.2 size=718227 2024-08-08T23:36:05.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.840+0000 7fdbd6e2c8c0 1 < completed multipart upload key=9S8TBVP20KTG upload=GLQZ5GM601DE tag=Y1NZ1QXKWO21 type=write size=3863955 2024-08-08T23:36:05.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.844+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~PMU3FM539S85.0 size=583643 2024-08-08T23:36:05.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.844+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=PMU3FM539S85 tag=R091D6N2J4DZ type=write size=1632219 2024-08-08T23:36:05.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.848+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=ALAYU1IJGBAR type=del 2024-08-08T23:36:05.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.852+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=A53OC9MZX60S type=del size=4104741 2024-08-08T23:36:05.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.856+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~WDUH51G4SFI4.0 size=652495 2024-08-08T23:36:05.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.860+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=WDUH51G4SFI4 tag=F7VP7VN92RN0 type=write size=1701071 2024-08-08T23:36:05.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.864+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=A29LITDGBYBQ type=del size=876715 2024-08-08T23:36:05.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.868+0000 7fdbd6e2c8c0 1 < suggested remove operation key=464D0ROM6MHO tag=33HTODLMLNIC type=del 2024-08-08T23:36:05.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.876+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~91SAQ8S50JNW.0 size=630880 2024-08-08T23:36:05.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.876+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=91SAQ8S50JNW tag=D12KO3RH6FCP type=write size=1679456 2024-08-08T23:36:05.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.876+0000 7fdbd6e2c8c0 1 < completed delete operation key=2SO6IPMXZUUI tag=F36ZQ7QZUWLU type=del 2024-08-08T23:36:05.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.880+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=PFGK18OJZEVU type=del size=1855006 2024-08-08T23:36:05.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.884+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=1RH68Z4H8QIQ type=del 2024-08-08T23:36:05.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.884+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=LGL2EYNPL7J5 type=del size=450932 2024-08-08T23:36:05.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.888+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=VCJES0U2W9D0 type=del 2024-08-08T23:36:05.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.892+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=R729462A13SQ type=del size=3210345 2024-08-08T23:36:05.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.896+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=P2CKE5OEX7QP type=del size=1046165 2024-08-08T23:36:05.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.900+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~ZF5ZTJ05O5G7.0 size=1048576 2024-08-08T23:36:05.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.904+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~ZF5ZTJ05O5G7.1 size=603813 2024-08-08T23:36:05.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.904+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=ZF5ZTJ05O5G7 tag=8N9S1YA1RKDA type=write size=2700965 2024-08-08T23:36:05.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.908+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=T30KBUCRZO79 type=del 2024-08-08T23:36:05.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.0 size=1048576 2024-08-08T23:36:05.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.1 size=1048576 2024-08-08T23:36:05.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.920+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.2 size=93505 2024-08-08T23:36:05.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.920+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=E0ZATTPPY7ER tag=S2GDUWZX7CZM type=write size=3239233 2024-08-08T23:36:05.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.924+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=GJNXNZSARLPX type=del 2024-08-08T23:36:05.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.924+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=59GMR6357PMD type=del size=385377 2024-08-08T23:36:05.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.928+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~3JVEQ7PV24OA.0 size=1048576 2024-08-08T23:36:05.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.932+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~3JVEQ7PV24OA.1 size=274261 2024-08-08T23:36:05.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.936+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=3JVEQ7PV24OA tag=W34UZB2B5OFY type=write size=2371413 2024-08-08T23:36:05.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.940+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~B5ZKQ8FDXSD4.0 size=1048576 2024-08-08T23:36:05.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.944+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QANZ3YTL2NQV.2~B5ZKQ8FDXSD4.1 size=156634 2024-08-08T23:36:05.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.944+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QANZ3YTL2NQV upload=B5ZKQ8FDXSD4 tag=SYIF0N65DDJ0 type=write size=2253786 2024-08-08T23:36:05.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.944+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=HK6ZR10HFL72 type=del 2024-08-08T23:36:05.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.0 size=1048576 2024-08-08T23:36:05.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.1 size=1048576 2024-08-08T23:36:05.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.2 size=998403 2024-08-08T23:36:05.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=W74ODXSJBFHT tag=82QM3YAT1WWW type=write size=4144131 2024-08-08T23:36:05.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.956+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=CH5O82NVF2P7 type=del 2024-08-08T23:36:05.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.960+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~ANF3U6KE45D9.0 size=1048576 2024-08-08T23:36:05.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~ANF3U6KE45D9.1 size=196997 2024-08-08T23:36:05.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.964+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=ANF3U6KE45D9 tag=A8RO6BU9VIHV type=write size=2294149 2024-08-08T23:36:05.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.968+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.0 size=1048576 2024-08-08T23:36:05.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.1 size=1048576 2024-08-08T23:36:05.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~M094TIHBT6V6.2 size=757801 2024-08-08T23:36:05.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.976+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=M094TIHBT6V6 tag=PBU66J1ECUQS type=write size=3903529 2024-08-08T23:36:05.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.980+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=MMRCWN76HKJ1 type=del size=3957640 2024-08-08T23:36:05.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.984+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~LVKHVMWUUH6W.0 size=1048576 2024-08-08T23:36:05.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.984+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~LVKHVMWUUH6W.1 size=212610 2024-08-08T23:36:05.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.992+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=LVKHVMWUUH6W tag=DX70HZSCDV2C type=write size=2309762 2024-08-08T23:36:05.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.992+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=8EQS0X1TGRLM type=del size=2076056 2024-08-08T23:36:05.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:05.996+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=4DBW0I8PV2NN type=write size=27339 2024-08-08T23:36:05.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.000+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=9GSHAIYIRZ71 type=write size=307829 2024-08-08T23:36:06.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.000+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~PMU3FM539S85.0 size=583643 2024-08-08T23:36:06.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.004+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=PMU3FM539S85 tag=R091D6N2J4DZ type=write size=1632219 2024-08-08T23:36:06.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~FKHKFZYY557M.0 size=1048576 2024-08-08T23:36:06.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.012+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~FKHKFZYY557M.1 size=402071 2024-08-08T23:36:06.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.012+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=FKHKFZYY557M tag=ZVO2ENZBO90B type=write size=2499223 2024-08-08T23:36:06.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.016+0000 7fdbd6e2c8c0 1 < canceled operation key=ZBEB2Q3J9Z0D tag=A53OC9MZX60S type=del size=4104741 2024-08-08T23:36:06.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.016+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=BVJE0TWCA4W7 type=del size=2309757 2024-08-08T23:36:06.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.020+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=A29LITDGBYBQ type=del 2024-08-08T23:36:06.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.024+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=1YS5DAPEQ15T type=del size=145839 2024-08-08T23:36:06.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.028+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~91SAQ8S50JNW.0 size=630880 2024-08-08T23:36:06.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.032+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=91SAQ8S50JNW tag=D12KO3RH6FCP type=write size=1679456 2024-08-08T23:36:06.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.032+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=321HP5O2OWYL type=del size=602968 2024-08-08T23:36:06.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.036+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=PFGK18OJZEVU type=del 2024-08-08T23:36:06.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.040+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=FT06SH89TFRX type=del size=2577349 2024-08-08T23:36:06.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.044+0000 7fdbd6e2c8c0 1 < completed delete operation key=464D0ROM6MHO tag=LGL2EYNPL7J5 type=del 2024-08-08T23:36:06.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.044+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=H17CZFMK8A3B type=write size=710292 2024-08-08T23:36:06.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=R729462A13SQ type=del 2024-08-08T23:36:06.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.052+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=2V8M5AOHQGGK type=write size=91551 2024-08-08T23:36:06.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~ZF5ZTJ05O5G7.0 size=1048576 2024-08-08T23:36:06.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.056+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~ZF5ZTJ05O5G7.1 size=603813 2024-08-08T23:36:06.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.060+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=ZF5ZTJ05O5G7 tag=8N9S1YA1RKDA type=write size=2700965 2024-08-08T23:36:06.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.064+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=CMWR6PGB8JP7 type=del size=271290 2024-08-08T23:36:06.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.068+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.0 size=1048576 2024-08-08T23:36:06.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.068+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.1 size=1048576 2024-08-08T23:36:06.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.072+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~E0ZATTPPY7ER.2 size=93505 2024-08-08T23:36:06.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.076+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=E0ZATTPPY7ER tag=S2GDUWZX7CZM type=write size=3239233 2024-08-08T23:36:06.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.076+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=PGHPWC1CTTZK type=del size=460163 2024-08-08T23:36:06.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.080+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=59GMR6357PMD type=del 2024-08-08T23:36:06.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.084+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=3LLL3U4RCG2M type=del size=2118717 2024-08-08T23:36:06.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.084+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~B5ZKQ8FDXSD4.0 size=1048576 2024-08-08T23:36:06.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.088+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QANZ3YTL2NQV.2~B5ZKQ8FDXSD4.1 size=156634 2024-08-08T23:36:06.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.092+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QANZ3YTL2NQV upload=B5ZKQ8FDXSD4 tag=SYIF0N65DDJ0 type=write size=2253786 2024-08-08T23:36:06.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.096+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=PAMJI9M8PHNB type=del size=1802064 2024-08-08T23:36:06.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.0 size=1048576 2024-08-08T23:36:06.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.100+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.1 size=1048576 2024-08-08T23:36:06.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.104+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~W74ODXSJBFHT.2 size=998403 2024-08-08T23:36:06.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.108+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=W74ODXSJBFHT tag=82QM3YAT1WWW type=write size=4144131 2024-08-08T23:36:06.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.112+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.0 size=1048576 2024-08-08T23:36:06.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.116+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.1 size=1048576 2024-08-08T23:36:06.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.116+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.2 size=226101 2024-08-08T23:36:06.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.116+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=YSJOD1YORFHH tag=9M6FR2MSIYNC type=write size=3371829 2024-08-08T23:36:06.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~ANF3U6KE45D9.0 size=1048576 2024-08-08T23:36:06.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~ANF3U6KE45D9.1 size=196997 2024-08-08T23:36:06.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.128+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=ANF3U6KE45D9 tag=A8RO6BU9VIHV type=write size=2294149 2024-08-08T23:36:06.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.128+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=SCWDP5TTU615 type=del size=2923913 2024-08-08T23:36:06.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.132+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=MMRCWN76HKJ1 type=del 2024-08-08T23:36:06.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.136+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=30JCHO6XGQ7F type=del size=2819122 2024-08-08T23:36:06.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.136+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=8EQS0X1TGRLM type=del 2024-08-08T23:36:06.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.140+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=9KEMG5OEWEHR type=del size=977688 2024-08-08T23:36:06.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.144+0000 7fdbd6e2c8c0 1 < canceled operation key=FBCEC998C8EJ tag=9GSHAIYIRZ71 type=write size=307829 2024-08-08T23:36:06.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.144+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=560KD4CS3IJE type=write size=918122 2024-08-08T23:36:06.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.148+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~FKHKFZYY557M.0 size=1048576 2024-08-08T23:36:06.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.152+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~FKHKFZYY557M.1 size=402071 2024-08-08T23:36:06.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.156+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=FKHKFZYY557M tag=ZVO2ENZBO90B type=write size=2499223 2024-08-08T23:36:06.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.160+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=D99L7FYY8PCG type=del size=3411965 2024-08-08T23:36:06.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.160+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=BVJE0TWCA4W7 type=del 2024-08-08T23:36:06.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.164+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~26YB5YHIHC9I.0 size=1048576 2024-08-08T23:36:06.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.168+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~26YB5YHIHC9I.1 size=611767 2024-08-08T23:36:06.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.168+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=26YB5YHIHC9I tag=IOXCGIFU2BFP type=write size=2708919 2024-08-08T23:36:06.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.172+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=1YS5DAPEQ15T type=del 2024-08-08T23:36:06.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.176+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~70C91349ESFO.0 size=142163 2024-08-08T23:36:06.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.176+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=70C91349ESFO tag=WP8JADDX7MOO type=write size=1190739 2024-08-08T23:36:06.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.176+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=321HP5O2OWYL type=del size=602968 2024-08-08T23:36:06.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.180+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=P17TRULIUGK4 type=del size=2633530 2024-08-08T23:36:06.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.184+0000 7fdbd6e2c8c0 1 < suggested remove operation key=Z5EXY8ZHZCHI tag=FT06SH89TFRX type=del 2024-08-08T23:36:06.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.188+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=Y3O3A14FC5CA type=del size=378998 2024-08-08T23:36:06.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.192+0000 7fdbd6e2c8c0 1 < completed write operation key=YNQU8Z202QCM tag=H17CZFMK8A3B type=write size=710292 2024-08-08T23:36:06.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.196+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=30L83OYTFYII type=write size=520685 2024-08-08T23:36:06.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.196+0000 7fdbd6e2c8c0 1 < completed write operation key=QWRYLH4P94BQ tag=2V8M5AOHQGGK type=write size=91551 2024-08-08T23:36:06.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.200+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=6A2LDWE4U7D5 type=write size=655700 2024-08-08T23:36:06.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.204+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=CMWR6PGB8JP7 type=del 2024-08-08T23:36:06.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QWRYLH4P94BQ.2~YGG50AMUEZOK.0 size=30517 2024-08-08T23:36:06.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.208+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QWRYLH4P94BQ upload=YGG50AMUEZOK tag=ZPHC7O73D15R type=write size=1079093 2024-08-08T23:36:06.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.212+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=PGHPWC1CTTZK type=del 2024-08-08T23:36:06.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.216+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=ZFU3R4VRK1P4 type=del size=1183250 2024-08-08T23:36:06.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.220+0000 7fdbd6e2c8c0 1 < suggested update operation key=QANZ3YTL2NQV tag=3LLL3U4RCG2M type=del size=2118717 2024-08-08T23:36:06.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.228+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.0 size=1048576 2024-08-08T23:36:06.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.232+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.1 size=1048576 2024-08-08T23:36:06.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.236+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.2 size=998868 2024-08-08T23:36:06.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.236+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=BDWS00GXC7RX tag=6JCPYYBCQZGN type=write size=4144596 2024-08-08T23:36:06.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.240+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=PAMJI9M8PHNB type=del 2024-08-08T23:36:06.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.244+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~MKC8N1RQVR1Z.0 size=1048576 2024-08-08T23:36:06.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.248+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~MKC8N1RQVR1Z.1 size=458379 2024-08-08T23:36:06.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.248+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=MKC8N1RQVR1Z tag=9L7DGMGQ16J1 type=write size=2555531 2024-08-08T23:36:06.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.0 size=1048576 2024-08-08T23:36:06.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.252+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.1 size=1048576 2024-08-08T23:36:06.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.252+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_NMB4GI8R2BKU.2~YSJOD1YORFHH.2 size=226101 2024-08-08T23:36:06.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.256+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=NMB4GI8R2BKU upload=YSJOD1YORFHH tag=9M6FR2MSIYNC type=write size=3371829 2024-08-08T23:36:06.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.260+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=EK1VISFSVIMX type=del size=1569313 2024-08-08T23:36:06.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.268+0000 7fdbd6e2c8c0 1 < suggested update operation key=0XF26POOKR3V tag=SCWDP5TTU615 type=del size=2923913 2024-08-08T23:36:06.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.272+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~FYFEXNGTFD93.0 size=1048576 2024-08-08T23:36:06.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.276+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~FYFEXNGTFD93.1 size=612574 2024-08-08T23:36:06.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.276+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=FYFEXNGTFD93 tag=SLT23IOS18OH type=write size=2709726 2024-08-08T23:36:06.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.280+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=0XF26POOKR3V tag=30JCHO6XGQ7F type=del size=2819122: (22) Invalid argument 2024-08-08T23:36:06.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.280+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=GEH7IX1TV8OS type=del size=1910830 2024-08-08T23:36:06.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.284+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=9KEMG5OEWEHR type=del 2024-08-08T23:36:06.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~J5UU0QWCQ1UU.0 size=1048576 2024-08-08T23:36:06.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.292+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~J5UU0QWCQ1UU.1 size=1015244 2024-08-08T23:36:06.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.292+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=J5UU0QWCQ1UU tag=J8RR10QH0242 type=write size=3112396 2024-08-08T23:36:06.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.296+0000 7fdbd6e2c8c0 1 < completed write operation key=YO2FZOR7H0EX tag=560KD4CS3IJE type=write size=918122 2024-08-08T23:36:06.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.300+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.0 size=1048576 2024-08-08T23:36:06.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.304+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.1 size=1048576 2024-08-08T23:36:06.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.308+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.2 size=196493 2024-08-08T23:36:06.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.308+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=70DAEV4FKBZT tag=4WVZ7RRAJ98P type=write size=3342221 2024-08-08T23:36:06.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.308+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=D99L7FYY8PCG type=del 2024-08-08T23:36:06.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.312+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=CC7EUXNGO0RE type=del size=1221749 2024-08-08T23:36:06.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.316+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~26YB5YHIHC9I.0 size=1048576 2024-08-08T23:36:06.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.320+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~26YB5YHIHC9I.1 size=611767 2024-08-08T23:36:06.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.324+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=26YB5YHIHC9I tag=IOXCGIFU2BFP type=write size=2708919 2024-08-08T23:36:06.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.332+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~LCRE2D3X4N4F.0 size=1048576 2024-08-08T23:36:06.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.336+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~LCRE2D3X4N4F.1 size=1026803 2024-08-08T23:36:06.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.336+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=LCRE2D3X4N4F tag=XTK48S84Y4GL type=write size=3123955 2024-08-08T23:36:06.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~70C91349ESFO.0 size=142163 2024-08-08T23:36:06.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.344+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=70C91349ESFO tag=WP8JADDX7MOO type=write size=1190739 2024-08-08T23:36:06.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.352+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~817F0NFB4HGS.0 size=1048576 2024-08-08T23:36:06.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.352+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~817F0NFB4HGS.1 size=351844 2024-08-08T23:36:06.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.352+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=817F0NFB4HGS tag=3O5QP1T9K17S type=write size=2448996 2024-08-08T23:36:06.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.360+0000 7fdbd6e2c8c0 1 < suggested remove operation key=903K2EO77YTJ tag=P17TRULIUGK4 type=del 2024-08-08T23:36:06.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.364+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~APVP70HF6CLA.0 size=1048576 2024-08-08T23:36:06.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.368+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~APVP70HF6CLA.1 size=269356 2024-08-08T23:36:06.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.368+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=APVP70HF6CLA tag=E4VNJD4XI9HW type=write size=2366508 2024-08-08T23:36:06.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.372+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=Y3O3A14FC5CA type=del 2024-08-08T23:36:06.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.376+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=V49N10NU4K04 type=write size=132863 2024-08-08T23:36:06.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.380+0000 7fdbd6e2c8c0 1 < completed write operation key=41XLZV9ZY5OP tag=30L83OYTFYII type=write size=520685 2024-08-08T23:36:06.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.380+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=WI21F2AMEI5P type=del size=1487371 2024-08-08T23:36:06.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.384+0000 7fdbd6e2c8c0 1 < completed write operation key=ZQ8GOX9RSTBB tag=6A2LDWE4U7D5 type=write size=655700 2024-08-08T23:36:06.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.392+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~K0P4L2QIXYL3.0 size=893303 2024-08-08T23:36:06.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.392+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=K0P4L2QIXYL3 tag=YWUFKX1ECHJO type=write size=1941879 2024-08-08T23:36:06.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.396+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QWRYLH4P94BQ.2~YGG50AMUEZOK.0 size=30517 2024-08-08T23:36:06.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.400+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QWRYLH4P94BQ upload=YGG50AMUEZOK tag=ZPHC7O73D15R type=write size=1079093 2024-08-08T23:36:06.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.404+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~XGAQCSWOTW1T.0 size=1048576 2024-08-08T23:36:06.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.408+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_NMB4GI8R2BKU.2~XGAQCSWOTW1T.1 size=295072 2024-08-08T23:36:06.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.408+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=NMB4GI8R2BKU upload=XGAQCSWOTW1T tag=YXIA0MKSPXKM type=write size=2392224 2024-08-08T23:36:06.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.416+0000 7fdbd6e2c8c0 1 < suggested update operation key=D81PQ0FJVNEE tag=ZFU3R4VRK1P4 type=del size=1183250 2024-08-08T23:36:06.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.420+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=PHJ97WEU7ANH type=del size=2885434 2024-08-08T23:36:06.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.0 size=1048576 2024-08-08T23:36:06.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.424+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.1 size=1048576 2024-08-08T23:36:06.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.428+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~BDWS00GXC7RX.2 size=998868 2024-08-08T23:36:06.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.436+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=BDWS00GXC7RX tag=6JCPYYBCQZGN type=write size=4144596 2024-08-08T23:36:06.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.440+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=M136IILV2UIZ type=del size=3039451 2024-08-08T23:36:06.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~MKC8N1RQVR1Z.0 size=1048576 2024-08-08T23:36:06.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.444+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~MKC8N1RQVR1Z.1 size=458379 2024-08-08T23:36:06.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.452+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=MKC8N1RQVR1Z tag=9L7DGMGQ16J1 type=write size=2555531 2024-08-08T23:36:06.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.452+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=960EF0QMMMLG type=write size=459889 2024-08-08T23:36:06.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.460+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QWRYLH4P94BQ tag=EK1VISFSVIMX type=del 2024-08-08T23:36:06.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.468+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~NUX62YG5OEXI.0 size=141598 2024-08-08T23:36:06.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.468+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=NUX62YG5OEXI tag=XZDUCQBP8CUE type=write size=1190174 2024-08-08T23:36:06.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~FYFEXNGTFD93.0 size=1048576 2024-08-08T23:36:06.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.472+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~FYFEXNGTFD93.1 size=612574 2024-08-08T23:36:06.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.480+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=FYFEXNGTFD93 tag=SLT23IOS18OH type=write size=2709726 2024-08-08T23:36:06.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.484+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=H2Z8ECT0QRH9 type=del size=3473167 2024-08-08T23:36:06.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.488+0000 7fdbd6e2c8c0 1 < suggested update operation key=9S8TBVP20KTG tag=GEH7IX1TV8OS type=del size=1910830 2024-08-08T23:36:06.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.492+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=5X0CF8R45OMF type=del size=2457300 2024-08-08T23:36:06.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.496+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~J5UU0QWCQ1UU.0 size=1048576 2024-08-08T23:36:06.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.500+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~J5UU0QWCQ1UU.1 size=1015244 2024-08-08T23:36:06.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.504+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=J5UU0QWCQ1UU tag=J8RR10QH0242 type=write size=3112396 2024-08-08T23:36:06.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.508+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.0 size=1048576 2024-08-08T23:36:06.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.1 size=1048576 2024-08-08T23:36:06.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.512+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.2 size=185153 2024-08-08T23:36:06.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.512+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=C9W8723C6ZWF tag=THET1809AGVC type=write size=3330881 2024-08-08T23:36:06.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.516+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.0 size=1048576 2024-08-08T23:36:06.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.520+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.1 size=1048576 2024-08-08T23:36:06.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.520+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~70DAEV4FKBZT.2 size=196493 2024-08-08T23:36:06.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.528+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=70DAEV4FKBZT tag=4WVZ7RRAJ98P type=write size=3342221 2024-08-08T23:36:06.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.532+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=YJ4GQT145ZHG type=write size=533848 2024-08-08T23:36:06.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.536+0000 7fdbd6e2c8c0 1 < canceled operation key=P3H05VKM0ZGJ tag=CC7EUXNGO0RE type=del size=1221749 2024-08-08T23:36:06.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.544+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~E8NLGOO1ZRUQ.0 size=1048576 2024-08-08T23:36:06.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.544+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~E8NLGOO1ZRUQ.1 size=700738 2024-08-08T23:36:06.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.544+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=E8NLGOO1ZRUQ tag=537Q8Y8YFGUU type=write size=2797890 2024-08-08T23:36:06.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.548+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~LCRE2D3X4N4F.0 size=1048576 2024-08-08T23:36:06.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.552+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~LCRE2D3X4N4F.1 size=1026803 2024-08-08T23:36:06.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.556+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=LCRE2D3X4N4F tag=XTK48S84Y4GL type=write size=3123955 2024-08-08T23:36:06.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.560+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=4ZAFOWLCR4NR type=del size=3237771 2024-08-08T23:36:06.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~817F0NFB4HGS.0 size=1048576 2024-08-08T23:36:06.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.564+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~817F0NFB4HGS.1 size=351844 2024-08-08T23:36:06.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.568+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=817F0NFB4HGS tag=3O5QP1T9K17S type=write size=2448996 2024-08-08T23:36:06.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.576+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~NYMNI17BEPHZ.0 size=543159 2024-08-08T23:36:06.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.576+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=NYMNI17BEPHZ tag=2XHIW561OM3G type=write size=1591735 2024-08-08T23:36:06.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~APVP70HF6CLA.0 size=1048576 2024-08-08T23:36:06.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~APVP70HF6CLA.1 size=269356 2024-08-08T23:36:06.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.588+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=APVP70HF6CLA tag=E4VNJD4XI9HW type=write size=2366508 2024-08-08T23:36:06.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_41XLZV9ZY5OP.2~MLR9Z3T5NRVF.0 size=557531 2024-08-08T23:36:06.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.592+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=41XLZV9ZY5OP upload=MLR9Z3T5NRVF tag=8GM4A7JSPPPG type=write size=1606107 2024-08-08T23:36:06.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.600+0000 7fdbd6e2c8c0 1 < suggested remove operation key=P3H05VKM0ZGJ tag=V49N10NU4K04 type=write 2024-08-08T23:36:06.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.604+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=LHHZ6X782IV8 type=del size=2542026 2024-08-08T23:36:06.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.608+0000 7fdbd6e2c8c0 1 < suggested remove operation key=FBCEC998C8EJ tag=WI21F2AMEI5P type=del 2024-08-08T23:36:06.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.612+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=CHGNGUNZHOSL type=write size=644155 2024-08-08T23:36:06.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.616+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~K0P4L2QIXYL3.0 size=893303 2024-08-08T23:36:06.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.620+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=K0P4L2QIXYL3 tag=YWUFKX1ECHJO type=write size=1941879 2024-08-08T23:36:06.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.624+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=ERBLSCZR0O2E type=del size=242866 2024-08-08T23:36:06.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.628+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~XGAQCSWOTW1T.0 size=1048576 2024-08-08T23:36:06.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_NMB4GI8R2BKU.2~XGAQCSWOTW1T.1 size=295072 2024-08-08T23:36:06.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.636+0000 7fdbd6e2c8c0 1 < completed multipart upload key=NMB4GI8R2BKU upload=XGAQCSWOTW1T tag=YXIA0MKSPXKM type=write size=2392224 2024-08-08T23:36:06.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.636+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=FLR43DYFC1PB type=write size=765495 2024-08-08T23:36:06.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.640+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=PHJ97WEU7ANH type=del 2024-08-08T23:36:06.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.648+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~AIFE8ETMMK48.0 size=1048576 2024-08-08T23:36:06.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.648+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~AIFE8ETMMK48.1 size=927236 2024-08-08T23:36:06.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.648+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=AIFE8ETMMK48 tag=N0S32MKNRANT type=write size=3024388 2024-08-08T23:36:06.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.652+0000 7fdbd6e2c8c0 1 < completed delete operation key=VSLBN9AVZK00 tag=M136IILV2UIZ type=del 2024-08-08T23:36:06.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.656+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=4ZOLT8I2HQCW type=del size=3234450 2024-08-08T23:36:06.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.656+0000 7fdbd6e2c8c0 1 < completed write operation key=NMB4GI8R2BKU tag=960EF0QMMMLG type=write size=459889 2024-08-08T23:36:06.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.660+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=IEXMNNBPQY1N type=write size=581630 2024-08-08T23:36:06.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.660+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_W5OVPO7BGE4S.2~NUX62YG5OEXI.0 size=141598 2024-08-08T23:36:06.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.668+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=W5OVPO7BGE4S upload=NUX62YG5OEXI tag=XZDUCQBP8CUE type=write size=1190174 2024-08-08T23:36:06.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.668+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=6AW1R56FMPLA type=del size=2040011 2024-08-08T23:36:06.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.672+0000 7fdbd6e2c8c0 1 < completed delete operation key=YNQU8Z202QCM tag=H2Z8ECT0QRH9 type=del 2024-08-08T23:36:06.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.0 size=1048576 2024-08-08T23:36:06.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.680+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.1 size=1048576 2024-08-08T23:36:06.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.684+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.2 size=801586 2024-08-08T23:36:06.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.684+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=O6I2O5GGX9W2 tag=MWBE2A59EK5R type=write size=3947314 2024-08-08T23:36:06.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.688+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=5X0CF8R45OMF type=del 2024-08-08T23:36:06.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.692+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~W1I30H8ISZB9.0 size=1048576 2024-08-08T23:36:06.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.696+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~W1I30H8ISZB9.1 size=585524 2024-08-08T23:36:06.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.696+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=W1I30H8ISZB9 tag=YYDZS8H8MG92 type=write size=2682676 2024-08-08T23:36:06.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.696+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.0 size=1048576 2024-08-08T23:36:06.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.700+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.1 size=1048576 2024-08-08T23:36:06.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.704+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~C9W8723C6ZWF.2 size=185153 2024-08-08T23:36:06.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.708+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=C9W8723C6ZWF tag=THET1809AGVC type=write size=3330881 2024-08-08T23:36:06.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.712+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=HH1D4IE9ARNP type=del size=3432161 2024-08-08T23:36:06.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.716+0000 7fdbd6e2c8c0 1 < suggested update operation key=MNV404EWJHC1 tag=YJ4GQT145ZHG type=write size=533848 2024-08-08T23:36:06.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.720+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=GQS55JEYN75Q type=del size=3117442 2024-08-08T23:36:06.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~E8NLGOO1ZRUQ.0 size=1048576 2024-08-08T23:36:06.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.724+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~E8NLGOO1ZRUQ.1 size=700738 2024-08-08T23:36:06.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.732+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=E8NLGOO1ZRUQ tag=537Q8Y8YFGUU type=write size=2797890 2024-08-08T23:36:06.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.736+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.0 size=1048576 2024-08-08T23:36:06.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.740+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.1 size=1048576 2024-08-08T23:36:06.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.740+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.2 size=110243 2024-08-08T23:36:06.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.740+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=H293ZAWBHTSB tag=0FTDYCS3CTAG type=write size=3255971 2024-08-08T23:36:06.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.744+0000 7fdbd6e2c8c0 1 < completed delete operation key=QHN8QYEEOHYO tag=4ZAFOWLCR4NR type=del 2024-08-08T23:36:06.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.748+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=LK01SVGIRNWM type=del size=2691984 2024-08-08T23:36:06.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.752+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~NYMNI17BEPHZ.0 size=543159 2024-08-08T23:36:06.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.756+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=NYMNI17BEPHZ tag=2XHIW561OM3G type=write size=1591735 2024-08-08T23:36:06.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.760+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=C1WW3CG250BI type=del size=2705785 2024-08-08T23:36:06.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.760+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_41XLZV9ZY5OP.2~MLR9Z3T5NRVF.0 size=557531 2024-08-08T23:36:06.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.768+0000 7fdbd6e2c8c0 1 < completed multipart upload key=41XLZV9ZY5OP upload=MLR9Z3T5NRVF tag=8GM4A7JSPPPG type=write size=1606107 2024-08-08T23:36:06.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.768+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=SDUOL0S4KBAL type=write size=126237 2024-08-08T23:36:06.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.772+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=LHHZ6X782IV8 type=del 2024-08-08T23:36:06.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.776+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=7HW267ERM0R3 type=write size=62343 2024-08-08T23:36:06.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.776+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=CHGNGUNZHOSL type=write size=644155 2024-08-08T23:36:06.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.780+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=GEYQ7C6HCV5M type=del size=3460823 2024-08-08T23:36:06.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.784+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=ERBLSCZR0O2E type=del 2024-08-08T23:36:06.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.788+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=65XFUB62JDA4 type=write size=838013 2024-08-08T23:36:06.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.792+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=FLR43DYFC1PB type=write size=765495 2024-08-08T23:36:06.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.796+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~KHV2JOCCR8HE.0 size=1048576 2024-08-08T23:36:06.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.800+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_W5OVPO7BGE4S.2~KHV2JOCCR8HE.1 size=192248 2024-08-08T23:36:06.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.800+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=W5OVPO7BGE4S upload=KHV2JOCCR8HE tag=UDI07104RA2D type=write size=2289400 2024-08-08T23:36:06.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.800+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~AIFE8ETMMK48.0 size=1048576 2024-08-08T23:36:06.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.804+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_D81PQ0FJVNEE.2~AIFE8ETMMK48.1 size=927236 2024-08-08T23:36:06.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.808+0000 7fdbd6e2c8c0 1 < completed multipart upload key=D81PQ0FJVNEE upload=AIFE8ETMMK48 tag=N0S32MKNRANT type=write size=3024388 2024-08-08T23:36:06.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.812+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=9TTT05NNDAPR type=write size=680824 2024-08-08T23:36:06.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.816+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=4ZOLT8I2HQCW type=del 2024-08-08T23:36:06.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.820+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=APXTB2TMB3M1 type=del size=1253193 2024-08-08T23:36:06.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.824+0000 7fdbd6e2c8c0 1 < completed write operation key=QANZ3YTL2NQV tag=IEXMNNBPQY1N type=write size=581630 2024-08-08T23:36:06.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.0 size=1048576 2024-08-08T23:36:06.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.832+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.1 size=1048576 2024-08-08T23:36:06.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.836+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.2 size=789477 2024-08-08T23:36:06.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.836+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=QYNKED8X17D0 tag=UZ4V1P23EMAG type=write size=3935205 2024-08-08T23:36:06.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.840+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=6AW1R56FMPLA type=del 2024-08-08T23:36:06.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.844+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=4RLOZ0VRPC2S type=del size=1577252 2024-08-08T23:36:06.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.848+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.0 size=1048576 2024-08-08T23:36:06.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.848+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.1 size=1048576 2024-08-08T23:36:06.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.848+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~O6I2O5GGX9W2.2 size=801586 2024-08-08T23:36:06.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.852+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=O6I2O5GGX9W2 tag=MWBE2A59EK5R type=write size=3947314 2024-08-08T23:36:06.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.856+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=ZQUZTPFXOWS6 type=del size=3056208 2024-08-08T23:36:06.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.860+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~W1I30H8ISZB9.0 size=1048576 2024-08-08T23:36:06.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.864+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~W1I30H8ISZB9.1 size=585524 2024-08-08T23:36:06.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.868+0000 7fdbd6e2c8c0 1 < completed multipart upload key=V3TA5KZ95NXT upload=W1I30H8ISZB9 tag=YYDZS8H8MG92 type=write size=2682676 2024-08-08T23:36:06.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.872+0000 7fdbd6e2c8c0 1 > prepared operation key=JWTLJG79MYI5 tag=TVIK3DM4SN2D type=del size=2355061 2024-08-08T23:36:06.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.876+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=HH1D4IE9ARNP type=del 2024-08-08T23:36:06.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.880+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=08E11P4F523P type=del size=47216 2024-08-08T23:36:06.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.884+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=GQS55JEYN75Q type=del 2024-08-08T23:36:06.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.888+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~DNSU6RQ1PAQ6.0 size=1048576 2024-08-08T23:36:06.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.892+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~DNSU6RQ1PAQ6.1 size=887084 2024-08-08T23:36:06.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.892+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=DNSU6RQ1PAQ6 tag=WZV8D56KH3GO type=write size=2984236 2024-08-08T23:36:06.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.0 size=1048576 2024-08-08T23:36:06.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.1 size=1048576 2024-08-08T23:36:06.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.896+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~H293ZAWBHTSB.2 size=110243 2024-08-08T23:36:06.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.904+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=H293ZAWBHTSB tag=0FTDYCS3CTAG type=write size=3255971 2024-08-08T23:36:06.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.904+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=FRRQNXL7DTP0 type=write size=850908 2024-08-08T23:36:06.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.908+0000 7fdbd6e2c8c0 1 < canceled operation key=QHN8QYEEOHYO tag=LK01SVGIRNWM type=del size=2691984 2024-08-08T23:36:06.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.0 size=1048576 2024-08-08T23:36:06.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.916+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.1 size=1048576 2024-08-08T23:36:06.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.920+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.2 size=306653 2024-08-08T23:36:06.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.920+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=4N5T573RYMTV tag=DKPWFU5F7H3A type=write size=3452381 2024-08-08T23:36:06.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.924+0000 7fdbd6e2c8c0 1 < canceled operation key=VGT9IXWM956F tag=C1WW3CG250BI type=del size=2705785 2024-08-08T23:36:06.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.928+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=2TEQIJ9VC90C type=del size=2456146 2024-08-08T23:36:06.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.928+0000 7fdbd6e2c8c0 1 < completed write operation key=903K2EO77YTJ tag=SDUOL0S4KBAL type=write size=126237 2024-08-08T23:36:06.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.0 size=1048576 2024-08-08T23:36:06.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.936+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.1 size=1048576 2024-08-08T23:36:06.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.940+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.2 size=146884 2024-08-08T23:36:06.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.940+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=KIZBBD4YFHOR tag=DKQF34M59YEG type=write size=3292612 2024-08-08T23:36:06.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.944+0000 7fdbd6e2c8c0 1 < canceled operation key=QWRYLH4P94BQ tag=7HW267ERM0R3 type=write size=62343 2024-08-08T23:36:06.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.948+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=W9Z6ZVU8XXJ6 type=del size=2849092 2024-08-08T23:36:06.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.952+0000 7fdbd6e2c8c0 1 < suggested remove operation key=P3H05VKM0ZGJ tag=GEYQ7C6HCV5M type=del 2024-08-08T23:36:06.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.956+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=P9HZ3KSOKV1Q type=del size=4145536 2024-08-08T23:36:06.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.960+0000 7fdbd6e2c8c0 1 < suggested update operation key=V3TA5KZ95NXT tag=65XFUB62JDA4 type=write size=838013 2024-08-08T23:36:06.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.0 size=1048576 2024-08-08T23:36:06.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.1 size=1048576 2024-08-08T23:36:06.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.968+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.2 size=656620 2024-08-08T23:36:06.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.968+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=MNV404EWJHC1 upload=BZKNTCZFZMHC tag=EDX9K1WROYXD type=write size=3802348 2024-08-08T23:36:06.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.972+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~KHV2JOCCR8HE.0 size=1048576 2024-08-08T23:36:06.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.976+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_W5OVPO7BGE4S.2~KHV2JOCCR8HE.1 size=192248 2024-08-08T23:36:06.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.980+0000 7fdbd6e2c8c0 1 < completed multipart upload key=W5OVPO7BGE4S upload=KHV2JOCCR8HE tag=UDI07104RA2D type=write size=2289400 2024-08-08T23:36:06.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.984+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~JYSGSKDAQBAV.0 size=1048576 2024-08-08T23:36:06.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.988+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~JYSGSKDAQBAV.1 size=618042 2024-08-08T23:36:06.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.988+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=JYSGSKDAQBAV tag=4K4Q0AIGMKRS type=write size=2715194 2024-08-08T23:36:06.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.992+0000 7fdbd6e2c8c0 1 < completed write operation key=YO2FZOR7H0EX tag=9TTT05NNDAPR type=write size=680824 2024-08-08T23:36:06.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.996+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~CYT6I19YU8HF.0 size=876021 2024-08-08T23:36:06.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:06.996+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=CYT6I19YU8HF tag=1POML768PHV0 type=write size=1924597 2024-08-08T23:36:07.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.000+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=P3H05VKM0ZGJ tag=APXTB2TMB3M1 type=del size=1253193: (22) Invalid argument 2024-08-08T23:36:07.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.008+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_903K2EO77YTJ.2~RWHUQPZV2ZGU.0 size=489251 2024-08-08T23:36:07.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.008+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=903K2EO77YTJ upload=RWHUQPZV2ZGU tag=M879LBUTS2Z3 type=write size=1537827 2024-08-08T23:36:07.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.012+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.0 size=1048576 2024-08-08T23:36:07.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.016+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.1 size=1048576 2024-08-08T23:36:07.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.016+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~QYNKED8X17D0.2 size=789477 2024-08-08T23:36:07.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.024+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=QYNKED8X17D0 tag=UZ4V1P23EMAG type=write size=3935205 2024-08-08T23:36:07.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.028+0000 7fdbd6e2c8c0 1 > prepared operation key=QANZ3YTL2NQV tag=JSIUYK1PWWZS type=del size=2696375 2024-08-08T23:36:07.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.032+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=4RLOZ0VRPC2S type=del 2024-08-08T23:36:07.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.036+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.0 size=1048576 2024-08-08T23:36:07.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.040+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.1 size=1048576 2024-08-08T23:36:07.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.044+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.2 size=513335 2024-08-08T23:36:07.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.044+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=GZJ8GWYBB01F upload=K7QZJL3BPUKP tag=CG80FH0BYLQV type=write size=3659063 2024-08-08T23:36:07.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.048+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=ZQUZTPFXOWS6 type=del 2024-08-08T23:36:07.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.052+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=F7H3JD0E0LPN type=write size=99908 2024-08-08T23:36:07.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.056+0000 7fdbd6e2c8c0 1 < completed delete operation key=JWTLJG79MYI5 tag=TVIK3DM4SN2D type=del 2024-08-08T23:36:07.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.056+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=X9YKOUCCCL21 type=del size=833880 2024-08-08T23:36:07.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.060+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=08E11P4F523P type=del 2024-08-08T23:36:07.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.068+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.0 size=1048576 2024-08-08T23:36:07.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.068+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.1 size=1048576 2024-08-08T23:36:07.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.072+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.2 size=299304 2024-08-08T23:36:07.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.072+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=V3TA5KZ95NXT upload=5FWMFYPNBOFC tag=8P5HGBOCIG7E type=write size=3445032 2024-08-08T23:36:07.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.076+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~DNSU6RQ1PAQ6.0 size=1048576 2024-08-08T23:36:07.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.076+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_903K2EO77YTJ.2~DNSU6RQ1PAQ6.1 size=887084 2024-08-08T23:36:07.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.080+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=903K2EO77YTJ upload=DNSU6RQ1PAQ6 tag=WZV8D56KH3GO type=write size=2984236 2024-08-08T23:36:07.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.084+0000 7fdbd6e2c8c0 1 > prepared operation key=Z5EXY8ZHZCHI tag=Y463V51EF3JA type=del size=2638535 2024-08-08T23:36:07.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.088+0000 7fdbd6e2c8c0 1 < suggested remove operation key=9S8TBVP20KTG tag=FRRQNXL7DTP0 type=write 2024-08-08T23:36:07.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.092+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=YCWKXWYN4F2J type=del size=2811454 2024-08-08T23:36:07.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.0 size=1048576 2024-08-08T23:36:07.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.096+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.1 size=1048576 2024-08-08T23:36:07.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.100+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~4N5T573RYMTV.2 size=306653 2024-08-08T23:36:07.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.108+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=4N5T573RYMTV tag=DKPWFU5F7H3A type=write size=3452381 2024-08-08T23:36:07.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.108+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=8NO9M0B4PKF2 type=del size=2030127 2024-08-08T23:36:07.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.112+0000 7fdbd6e2c8c0 1 < canceled operation key=QJB9DETMSY4X tag=2TEQIJ9VC90C type=del size=2456146 2024-08-08T23:36:07.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.116+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=RTUB3L2L1FJX type=del size=238865 2024-08-08T23:36:07.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.120+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.0 size=1048576 2024-08-08T23:36:07.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.128+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.1 size=1048576 2024-08-08T23:36:07.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.128+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_QHN8QYEEOHYO.2~KIZBBD4YFHOR.2 size=146884 2024-08-08T23:36:07.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.132+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=QHN8QYEEOHYO upload=KIZBBD4YFHOR tag=DKQF34M59YEG type=write size=3292612 2024-08-08T23:36:07.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.136+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=K78RO8BTJNGV type=del size=2766464 2024-08-08T23:36:07.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.140+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=W9Z6ZVU8XXJ6 type=del 2024-08-08T23:36:07.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.144+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~1QY06EYR00JX.0 size=1048576 2024-08-08T23:36:07.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.148+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~1QY06EYR00JX.1 size=463422 2024-08-08T23:36:07.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.148+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=1QY06EYR00JX tag=R91Q8WPLKXWS type=write size=2560574 2024-08-08T23:36:07.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.152+0000 7fdbd6e2c8c0 1 < completed delete operation key=903K2EO77YTJ tag=P9HZ3KSOKV1Q type=del 2024-08-08T23:36:07.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.156+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~5YYON4HBAR6Y.0 size=1048576 2024-08-08T23:36:07.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.160+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~5YYON4HBAR6Y.1 size=675403 2024-08-08T23:36:07.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.160+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=5YYON4HBAR6Y tag=PB0AL56E3DZA type=write size=2772555 2024-08-08T23:36:07.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.164+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.0 size=1048576 2024-08-08T23:36:07.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.164+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.1 size=1048576 2024-08-08T23:36:07.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.168+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_MNV404EWJHC1.2~BZKNTCZFZMHC.2 size=656620 2024-08-08T23:36:07.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.172+0000 7fdbd6e2c8c0 1 < completed multipart upload key=MNV404EWJHC1 upload=BZKNTCZFZMHC tag=EDX9K1WROYXD type=write size=3802348 2024-08-08T23:36:07.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~VLKMVHS0FEGP.0 size=1048576 2024-08-08T23:36:07.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.180+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~VLKMVHS0FEGP.1 size=222728 2024-08-08T23:36:07.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.180+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=VLKMVHS0FEGP tag=2N54KVSPGIJL type=write size=2319880 2024-08-08T23:36:07.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.184+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~JYSGSKDAQBAV.0 size=1048576 2024-08-08T23:36:07.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.188+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~JYSGSKDAQBAV.1 size=618042 2024-08-08T23:36:07.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.192+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=JYSGSKDAQBAV tag=4K4Q0AIGMKRS type=write size=2715194 2024-08-08T23:36:07.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.196+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=E3TZPNZYGWQS type=del size=2423210 2024-08-08T23:36:07.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.196+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_0XF26POOKR3V.2~CYT6I19YU8HF.0 size=876021 2024-08-08T23:36:07.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.204+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=0XF26POOKR3V upload=CYT6I19YU8HF tag=1POML768PHV0 type=write size=1924597 2024-08-08T23:36:07.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~SNV392PBN5SV.0 size=1048576 2024-08-08T23:36:07.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.208+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~SNV392PBN5SV.1 size=60110 2024-08-08T23:36:07.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.208+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=SNV392PBN5SV tag=2T5J2FDB5KSN type=write size=2157262 2024-08-08T23:36:07.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.212+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_903K2EO77YTJ.2~RWHUQPZV2ZGU.0 size=489251 2024-08-08T23:36:07.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.216+0000 7fdbd6e2c8c0 1 < completed multipart upload key=903K2EO77YTJ upload=RWHUQPZV2ZGU tag=M879LBUTS2Z3 type=write size=1537827 2024-08-08T23:36:07.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.224+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~4ZMGVOQQBWYI.0 size=217022 2024-08-08T23:36:07.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.224+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=4ZMGVOQQBWYI tag=43O3Q3IABXPH type=write size=1265598 2024-08-08T23:36:07.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.224+0000 7fdbd6e2c8c0 1 < completed delete operation key=QANZ3YTL2NQV tag=JSIUYK1PWWZS type=del 2024-08-08T23:36:07.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.228+0000 7fdbd6e2c8c0 1 > prepared operation key=YO2FZOR7H0EX tag=9CFUZ0JBNKTG type=del size=1400307 2024-08-08T23:36:07.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.232+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.0 size=1048576 2024-08-08T23:36:07.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.236+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.1 size=1048576 2024-08-08T23:36:07.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.236+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_GZJ8GWYBB01F.2~K7QZJL3BPUKP.2 size=513335 2024-08-08T23:36:07.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.240+0000 7fdbd6e2c8c0 1 < completed multipart upload key=GZJ8GWYBB01F upload=K7QZJL3BPUKP tag=CG80FH0BYLQV type=write size=3659063 2024-08-08T23:36:07.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.244+0000 7fdbd6e2c8c0 1 > prepared operation key=YNQU8Z202QCM tag=33L1EDCH0ERS type=del size=3539634 2024-08-08T23:36:07.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.248+0000 7fdbd6e2c8c0 1 < completed write operation key=0XF26POOKR3V tag=F7H3JD0E0LPN type=write size=99908 2024-08-08T23:36:07.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.252+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~BHZLAHEEGP08.0 size=1048576 2024-08-08T23:36:07.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.256+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~BHZLAHEEGP08.1 size=331362 2024-08-08T23:36:07.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.256+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=BHZLAHEEGP08 tag=WCU09E19ED0P type=write size=2428514 2024-08-08T23:36:07.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.260+0000 7fdbd6e2c8c0 1 < suggested remove operation key=0MT9FJO58ELX tag=X9YKOUCCCL21 type=del 2024-08-08T23:36:07.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.264+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_63GVT7KRKCSS.2~Q3TWV5M5HM8K.0 size=547728 2024-08-08T23:36:07.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.264+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=63GVT7KRKCSS upload=Q3TWV5M5HM8K tag=DCOZTGI3HW2I type=write size=1596304 2024-08-08T23:36:07.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.268+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.0 size=1048576 2024-08-08T23:36:07.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.268+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.1 size=1048576 2024-08-08T23:36:07.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.272+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_V3TA5KZ95NXT.2~5FWMFYPNBOFC.2 size=299304 2024-08-08T23:36:07.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.276+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=V3TA5KZ95NXT upload=5FWMFYPNBOFC tag=8P5HGBOCIG7E type=write size=3445032 2024-08-08T23:36:07.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.280+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~31WX11KD19ZV.0 size=125534 2024-08-08T23:36:07.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.280+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=31WX11KD19ZV tag=MK7VZV2KSK5C type=write size=1174110 2024-08-08T23:36:07.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.284+0000 7fdbd6e2c8c0 1 < completed delete operation key=Z5EXY8ZHZCHI tag=Y463V51EF3JA type=del 2024-08-08T23:36:07.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.288+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=3A5STW2DC6IQ type=del size=2762091 2024-08-08T23:36:07.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.292+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZQ8GOX9RSTBB tag=YCWKXWYN4F2J type=del 2024-08-08T23:36:07.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.292+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=OOU4882DS9MH type=write size=770032 2024-08-08T23:36:07.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.296+0000 7fdbd6e2c8c0 1 < completed delete operation key=0XF26POOKR3V tag=8NO9M0B4PKF2 type=del 2024-08-08T23:36:07.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.300+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=GAHG8HZ15NBO type=del size=559885 2024-08-08T23:36:07.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.304+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=RTUB3L2L1FJX type=del size=238865 2024-08-08T23:36:07.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.312+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~F1A2ADZJTJ02.0 size=35573 2024-08-08T23:36:07.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.312+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=F1A2ADZJTJ02 tag=N42HX6UQRIBQ type=write size=1084149 2024-08-08T23:36:07.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.312+0000 7fdbd6e2c8c0 1 < completed delete operation key=W5OVPO7BGE4S tag=K78RO8BTJNGV type=del 2024-08-08T23:36:07.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.320+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.0 size=1048576 2024-08-08T23:36:07.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.320+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.1 size=1048576 2024-08-08T23:36:07.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.324+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.2 size=881150 2024-08-08T23:36:07.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.324+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=Z5EXY8ZHZCHI upload=O4JT6731IQIX tag=TIOT907XBIRP type=write size=4026878 2024-08-08T23:36:07.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.328+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~1QY06EYR00JX.0 size=1048576 2024-08-08T23:36:07.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.328+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_464D0ROM6MHO.2~1QY06EYR00JX.1 size=463422 2024-08-08T23:36:07.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.332+0000 7fdbd6e2c8c0 1 < completed multipart upload key=464D0ROM6MHO upload=1QY06EYR00JX tag=R91Q8WPLKXWS type=write size=2560574 2024-08-08T23:36:07.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.336+0000 7fdbd6e2c8c0 1 > prepared operation key=464D0ROM6MHO tag=L7IHB5IEGWXL type=write size=278364 2024-08-08T23:36:07.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~5YYON4HBAR6Y.0 size=1048576 2024-08-08T23:36:07.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.340+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~5YYON4HBAR6Y.1 size=675403 2024-08-08T23:36:07.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.348+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=5YYON4HBAR6Y tag=PB0AL56E3DZA type=write size=2772555 2024-08-08T23:36:07.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.348+0000 7fdbd6e2c8c0 1 > prepared operation key=VGT9IXWM956F tag=I2SLJD4V89OX type=del size=2181757 2024-08-08T23:36:07.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.352+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~VLKMVHS0FEGP.0 size=1048576 2024-08-08T23:36:07.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.356+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~VLKMVHS0FEGP.1 size=222728 2024-08-08T23:36:07.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.360+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=VLKMVHS0FEGP tag=2N54KVSPGIJL type=write size=2319880 2024-08-08T23:36:07.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.364+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=7RYF4PQXXSBN type=write size=259516 2024-08-08T23:36:07.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.368+0000 7fdbd6e2c8c0 1 < completed delete operation key=41XLZV9ZY5OP tag=E3TZPNZYGWQS type=del 2024-08-08T23:36:07.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.372+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=SZVXM5HX65X5 type=del size=738748 2024-08-08T23:36:07.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.376+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~SNV392PBN5SV.0 size=1048576 2024-08-08T23:36:07.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.380+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QHN8QYEEOHYO.2~SNV392PBN5SV.1 size=60110 2024-08-08T23:36:07.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.384+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QHN8QYEEOHYO upload=SNV392PBN5SV tag=2T5J2FDB5KSN type=write size=2157262 2024-08-08T23:36:07.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.388+0000 7fdbd6e2c8c0 1 > prepared operation key=XIXN9HLLSJS3 tag=QOA16UBAIRMG type=del size=838472 2024-08-08T23:36:07.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.392+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~4ZMGVOQQBWYI.0 size=217022 2024-08-08T23:36:07.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.396+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=4ZMGVOQQBWYI tag=43O3Q3IABXPH type=write size=1265598 2024-08-08T23:36:07.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.400+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=RSQ1SM5R8BO7 type=del size=2094139 2024-08-08T23:36:07.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.404+0000 7fdbd6e2c8c0 1 < canceled operation key=YO2FZOR7H0EX tag=9CFUZ0JBNKTG type=del size=1400307 2024-08-08T23:36:07.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.416+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.0 size=1048576 2024-08-08T23:36:07.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.416+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.1 size=1048576 2024-08-08T23:36:07.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.420+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.2 size=960531 2024-08-08T23:36:07.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.420+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FWZ5TEP1P2LK upload=LUM2XPT3A42R tag=VAM9GB5PB5KF type=write size=4106259 2024-08-08T23:36:07.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.424+0000 7fdbd6e2c8c0 1 < canceled operation key=YNQU8Z202QCM tag=33L1EDCH0ERS type=del size=3539634 2024-08-08T23:36:07.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.428+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.0 size=1048576 2024-08-08T23:36:07.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.432+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.1 size=1048576 2024-08-08T23:36:07.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.436+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.2 size=569260 2024-08-08T23:36:07.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.436+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=1BT5VXRNLESZ tag=DSWW31A610DE type=write size=3714988 2024-08-08T23:36:07.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.436+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~BHZLAHEEGP08.0 size=1048576 2024-08-08T23:36:07.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.440+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~BHZLAHEEGP08.1 size=331362 2024-08-08T23:36:07.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.444+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YO2FZOR7H0EX upload=BHZLAHEEGP08 tag=WCU09E19ED0P type=write size=2428514 2024-08-08T23:36:07.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.448+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=4L1MJDKM5ZIP type=del size=847946 2024-08-08T23:36:07.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.452+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_63GVT7KRKCSS.2~Q3TWV5M5HM8K.0 size=547728 2024-08-08T23:36:07.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.456+0000 7fdbd6e2c8c0 1 < completed multipart upload key=63GVT7KRKCSS upload=Q3TWV5M5HM8K tag=DCOZTGI3HW2I type=write size=1596304 2024-08-08T23:36:07.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.460+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=394Z4T965V2G type=del size=1695269 2024-08-08T23:36:07.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.464+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_P3H05VKM0ZGJ.2~31WX11KD19ZV.0 size=125534 2024-08-08T23:36:07.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.468+0000 7fdbd6e2c8c0 1 < completed multipart upload key=P3H05VKM0ZGJ upload=31WX11KD19ZV tag=MK7VZV2KSK5C type=write size=1174110 2024-08-08T23:36:07.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.472+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~7AEJLVRI5LLH.0 size=1048576 2024-08-08T23:36:07.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.476+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZQ8GOX9RSTBB.2~7AEJLVRI5LLH.1 size=1021568 2024-08-08T23:36:07.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.476+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZQ8GOX9RSTBB upload=7AEJLVRI5LLH tag=2UXEO6EQY82W type=write size=3118720 2024-08-08T23:36:07.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.480+0000 7fdbd6e2c8c0 1 < completed delete operation key=QJB9DETMSY4X tag=3A5STW2DC6IQ type=del 2024-08-08T23:36:07.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.480+0000 7fdbd6e2c8c0 1 > prepared operation key=NMB4GI8R2BKU tag=QBPUNOC01893 type=del size=2172409 2024-08-08T23:36:07.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.484+0000 7fdbd6e2c8c0 1 < canceled operation key=9S8TBVP20KTG tag=OOU4882DS9MH type=write size=770032 2024-08-08T23:36:07.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.488+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=5LVJJZZBB71J type=del size=1392065 2024-08-08T23:36:07.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.492+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=GAHG8HZ15NBO type=del 2024-08-08T23:36:07.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.496+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=OBYVOGN7NQ7O type=del size=1687490 2024-08-08T23:36:07.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.500+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_0XF26POOKR3V.2~F1A2ADZJTJ02.0 size=35573 2024-08-08T23:36:07.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.504+0000 7fdbd6e2c8c0 1 < completed multipart upload key=0XF26POOKR3V upload=F1A2ADZJTJ02 tag=N42HX6UQRIBQ type=write size=1084149 2024-08-08T23:36:07.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.508+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=R2JVAHIN90CZ type=write size=2204 2024-08-08T23:36:07.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.508+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.0 size=1048576 2024-08-08T23:36:07.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.512+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.1 size=1048576 2024-08-08T23:36:07.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.516+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_Z5EXY8ZHZCHI.2~O4JT6731IQIX.2 size=881150 2024-08-08T23:36:07.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.520+0000 7fdbd6e2c8c0 1 < completed multipart upload key=Z5EXY8ZHZCHI upload=O4JT6731IQIX tag=TIOT907XBIRP type=write size=4026878 2024-08-08T23:36:07.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.524+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.0 size=1048576 2024-08-08T23:36:07.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.528+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.1 size=1048576 2024-08-08T23:36:07.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.528+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.2 size=197282 2024-08-08T23:36:07.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.528+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=GGA3IWL8VYLL tag=0R2DF4EH1CNK type=write size=3343010 2024-08-08T23:36:07.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.532+0000 7fdbd6e2c8c0 1 < completed write operation key=464D0ROM6MHO tag=L7IHB5IEGWXL type=write size=278364 2024-08-08T23:36:07.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.536+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~TDMAVZHITTKS.0 size=1048576 2024-08-08T23:36:07.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.540+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_XIXN9HLLSJS3.2~TDMAVZHITTKS.1 size=753717 2024-08-08T23:36:07.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.540+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=XIXN9HLLSJS3 upload=TDMAVZHITTKS tag=S5FIT1CE6WLT type=write size=2850869 2024-08-08T23:36:07.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.544+0000 7fdbd6e2c8c0 1 < completed delete operation key=VGT9IXWM956F tag=I2SLJD4V89OX type=del 2024-08-08T23:36:07.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.544+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=YCRHXUISAW3N type=del size=1987918 2024-08-08T23:36:07.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.552+0000 7fdbd6e2c8c0 1 < suggested remove operation key=ZBEB2Q3J9Z0D tag=7RYF4PQXXSBN type=write 2024-08-08T23:36:07.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.556+0000 7fdbd6e2c8c0 1 > prepared operation key=QWRYLH4P94BQ tag=BD4UXNLIX0ZO type=del size=921440 2024-08-08T23:36:07.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.556+0000 7fdbd6e2c8c0 1 < canceled operation key=2SO6IPMXZUUI tag=SZVXM5HX65X5 type=del size=738748 2024-08-08T23:36:07.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.560+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=G0JAWCW6X5BL type=del size=2388286 2024-08-08T23:36:07.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.564+0000 7fdbd6e2c8c0 1 < completed delete operation key=XIXN9HLLSJS3 tag=QOA16UBAIRMG type=del 2024-08-08T23:36:07.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.568+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=D7O5H4RAZERU type=del size=79816 2024-08-08T23:36:07.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.572+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=RSQ1SM5R8BO7 type=del 2024-08-08T23:36:07.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.576+0000 7fdbd6e2c8c0 1 > prepared operation key=ZQ8GOX9RSTBB tag=VASSE2SCH0UQ type=del size=919802 2024-08-08T23:36:07.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.0 size=1048576 2024-08-08T23:36:07.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.580+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.1 size=1048576 2024-08-08T23:36:07.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.580+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FWZ5TEP1P2LK.2~LUM2XPT3A42R.2 size=960531 2024-08-08T23:36:07.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.584+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=FWZ5TEP1P2LK upload=LUM2XPT3A42R tag=VAM9GB5PB5KF type=write size=4106259 2024-08-08T23:36:07.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.592+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QJB9DETMSY4X.2~C30OO4XJQCZT.0 size=483224 2024-08-08T23:36:07.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.592+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QJB9DETMSY4X upload=C30OO4XJQCZT tag=NB3FIJRIVDHH type=write size=1531800 2024-08-08T23:36:07.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.592+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.0 size=1048576 2024-08-08T23:36:07.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.592+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.1 size=1048576 2024-08-08T23:36:07.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.592+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_ZBEB2Q3J9Z0D.2~1BT5VXRNLESZ.2 size=569260 2024-08-08T23:36:07.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.600+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=ZBEB2Q3J9Z0D upload=1BT5VXRNLESZ tag=DSWW31A610DE type=write size=3714988 2024-08-08T23:36:07.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.600+0000 7fdbd6e2c8c0 1 > prepared operation key=41XLZV9ZY5OP tag=98SH56PHOL40 type=del size=2028466 2024-08-08T23:36:07.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.604+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=4L1MJDKM5ZIP type=del 2024-08-08T23:36:07.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.612+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.0 size=1048576 2024-08-08T23:36:07.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.616+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.1 size=1048576 2024-08-08T23:36:07.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.620+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.2 size=576384 2024-08-08T23:36:07.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.620+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=P0Z1H24BCA0P tag=L779NKBOVEJI type=write size=3722112 2024-08-08T23:36:07.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.620+0000 7fdbd6e2c8c0 1 < completed delete operation key=9S8TBVP20KTG tag=394Z4T965V2G type=del 2024-08-08T23:36:07.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.624+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=OORN0583GS0A type=del size=3084873 2024-08-08T23:36:07.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.628+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~7AEJLVRI5LLH.0 size=1048576 2024-08-08T23:36:07.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.632+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZQ8GOX9RSTBB.2~7AEJLVRI5LLH.1 size=1021568 2024-08-08T23:36:07.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.636+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZQ8GOX9RSTBB upload=7AEJLVRI5LLH tag=2UXEO6EQY82W type=write size=3118720 2024-08-08T23:36:07.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.640+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=YT1IV5Y2ZHI4 type=write size=1012044 2024-08-08T23:36:07.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.644+0000 7fdbd6e2c8c0 1 < completed delete operation key=NMB4GI8R2BKU tag=QBPUNOC01893 type=del 2024-08-08T23:36:07.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.648+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ZRD45SWLRL1N.0 size=1048576 2024-08-08T23:36:07.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.652+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_FBCEC998C8EJ.2~ZRD45SWLRL1N.1 size=408032 2024-08-08T23:36:07.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.652+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=FBCEC998C8EJ upload=ZRD45SWLRL1N tag=YAVLB2BLLNZP type=write size=2505184 2024-08-08T23:36:07.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.656+0000 7fdbd6e2c8c0 1 < completed delete operation key=0MT9FJO58ELX tag=5LVJJZZBB71J type=del 2024-08-08T23:36:07.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.660+0000 7fdbd6e2c8c0 1 > prepared operation key=2SO6IPMXZUUI tag=D21PBQEPF4I2 type=del size=3704083 2024-08-08T23:36:07.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.660+0000 7fdbd6e2c8c0 1 < completed delete operation key=V6GSJH62C8TA tag=OBYVOGN7NQ7O type=del 2024-08-08T23:36:07.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.664+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=E4VN0ICGOAFJ type=del size=3548135 2024-08-08T23:36:07.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.668+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=ZBEB2Q3J9Z0D tag=R2JVAHIN90CZ type=write size=2204: (22) Invalid argument 2024-08-08T23:36:07.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.672+0000 7fdbd6e2c8c0 1 > prepared operation key=9S8TBVP20KTG tag=88LAWD0AAP4F type=write size=816932 2024-08-08T23:36:07.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.676+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.0 size=1048576 2024-08-08T23:36:07.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.676+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.1 size=1048576 2024-08-08T23:36:07.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.680+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~GGA3IWL8VYLL.2 size=197282 2024-08-08T23:36:07.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.684+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=GGA3IWL8VYLL tag=0R2DF4EH1CNK type=write size=3343010 2024-08-08T23:36:07.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.688+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=88TNGOYJCOJ3 type=del size=4016970 2024-08-08T23:36:07.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~TDMAVZHITTKS.0 size=1048576 2024-08-08T23:36:07.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.692+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_XIXN9HLLSJS3.2~TDMAVZHITTKS.1 size=753717 2024-08-08T23:36:07.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.704+0000 7fdbd6e2c8c0 1 < completed multipart upload key=XIXN9HLLSJS3 upload=TDMAVZHITTKS tag=S5FIT1CE6WLT type=write size=2850869 2024-08-08T23:36:07.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.704+0000 7fdbd6e2c8c0 1 > prepared operation key=FWZ5TEP1P2LK tag=UTQSR2RKGYM7 type=del size=1747607 2024-08-08T23:36:07.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.712+0000 7fdbd6e2c8c0 1 < suggested update operation key=ZQ8GOX9RSTBB tag=YCRHXUISAW3N type=del size=1987918 2024-08-08T23:36:07.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.716+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.0 size=1048576 2024-08-08T23:36:07.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.720+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.1 size=1048576 2024-08-08T23:36:07.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.724+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.2 size=741151 2024-08-08T23:36:07.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.724+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YO2FZOR7H0EX upload=YQVCGJDZW1LF tag=1ZMTLLIAI5F3 type=write size=3886879 2024-08-08T23:36:07.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.724+0000 7fdbd6e2c8c0 1 < completed delete operation key=QWRYLH4P94BQ tag=BD4UXNLIX0ZO type=del 2024-08-08T23:36:07.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.728+0000 7fdbd6e2c8c0 1 > prepared operation key=VSLBN9AVZK00 tag=FQ630DJH2BMA type=del size=1769896 2024-08-08T23:36:07.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.736+0000 7fdbd6e2c8c0 1 < suggested remove operation key=V6GSJH62C8TA tag=G0JAWCW6X5BL type=del 2024-08-08T23:36:07.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.736+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=55SWR9DQ7P7K type=del size=1239381 2024-08-08T23:36:07.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.740+0000 7fdbd6e2c8c0 1 < completed delete operation key=63GVT7KRKCSS tag=D7O5H4RAZERU type=del 2024-08-08T23:36:07.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.748+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~W1CVUN3GWG20.0 size=1048576 2024-08-08T23:36:07.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.748+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_ZBEB2Q3J9Z0D.2~W1CVUN3GWG20.1 size=895492 2024-08-08T23:36:07.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.748+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=ZBEB2Q3J9Z0D upload=W1CVUN3GWG20 tag=11NKHDBDE0YN type=write size=2992644 2024-08-08T23:36:07.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.752+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=ZQ8GOX9RSTBB tag=VASSE2SCH0UQ type=del size=919802: (22) Invalid argument 2024-08-08T23:36:07.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.756+0000 7fdbd6e2c8c0 1 > prepared operation key=GMVEOO97I8YH tag=5WLRDCWU25V4 type=del size=2942891 2024-08-08T23:36:07.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.756+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_QJB9DETMSY4X.2~C30OO4XJQCZT.0 size=483224 2024-08-08T23:36:07.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.764+0000 7fdbd6e2c8c0 1 < completed multipart upload key=QJB9DETMSY4X upload=C30OO4XJQCZT tag=NB3FIJRIVDHH type=write size=1531800 2024-08-08T23:36:07.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.764+0000 7fdbd6e2c8c0 1 > prepared operation key=QJB9DETMSY4X tag=P2H5TYP66QCU type=del size=3741246 2024-08-08T23:36:07.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.772+0000 7fdbd6e2c8c0 1 < suggested remove operation key=41XLZV9ZY5OP tag=98SH56PHOL40 type=del 2024-08-08T23:36:07.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.776+0000 7fdbd6e2c8c0 1 > prepared operation key=D81PQ0FJVNEE tag=N70Z3NAKVH56 type=del size=2529424 2024-08-08T23:36:07.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.776+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.0 size=1048576 2024-08-08T23:36:07.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.780+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.1 size=1048576 2024-08-08T23:36:07.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.780+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~P0Z1H24BCA0P.2 size=576384 2024-08-08T23:36:07.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.788+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=P0Z1H24BCA0P tag=L779NKBOVEJI type=write size=3722112 2024-08-08T23:36:07.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.792+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_JWTLJG79MYI5.2~S40LR958FH9G.0 size=380311 2024-08-08T23:36:07.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.792+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=JWTLJG79MYI5 upload=S40LR958FH9G tag=9ZS28GWGL98Y type=write size=1428887 2024-08-08T23:36:07.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.792+0000 7fdbd6e2c8c0 1 < completed delete operation key=GZJ8GWYBB01F tag=OORN0583GS0A type=del 2024-08-08T23:36:07.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.796+0000 7fdbd6e2c8c0 1 > prepared operation key=63GVT7KRKCSS tag=ARZ013D9K6JY type=write size=589569 2024-08-08T23:36:07.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.800+0000 7fdbd6e2c8c0 1 < completed write operation key=63GVT7KRKCSS tag=YT1IV5Y2ZHI4 type=write size=1012044 2024-08-08T23:36:07.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.804+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=4PJ61Y6827V4 type=del size=2222383 2024-08-08T23:36:07.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.804+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ZRD45SWLRL1N.0 size=1048576 2024-08-08T23:36:07.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.808+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_FBCEC998C8EJ.2~ZRD45SWLRL1N.1 size=408032 2024-08-08T23:36:07.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.812+0000 7fdbd6e2c8c0 1 < completed multipart upload key=FBCEC998C8EJ upload=ZRD45SWLRL1N tag=YAVLB2BLLNZP type=write size=2505184 2024-08-08T23:36:07.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.816+0000 7fdbd6e2c8c0 1 > prepared operation key=QHN8QYEEOHYO tag=408UIF6L7Y42 type=write size=1010698 2024-08-08T23:36:07.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.816+0000 7fdbd6e2c8c0 1 < canceled operation key=2SO6IPMXZUUI tag=D21PBQEPF4I2 type=del size=3704083 2024-08-08T23:36:07.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.824+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~ZC6HR3YGU1SQ.0 size=967612 2024-08-08T23:36:07.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.824+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=ZC6HR3YGU1SQ tag=AI15GMY7O0ZZ type=write size=2016188 2024-08-08T23:36:07.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.828+0000 7fdbd6e2c8c0 1 < suggested remove operation key=63GVT7KRKCSS tag=E4VN0ICGOAFJ type=del 2024-08-08T23:36:07.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.832+0000 7fdbd6e2c8c0 1 > prepared operation key=FBCEC998C8EJ tag=5LTU1ZIFDR0L type=del size=1683141 2024-08-08T23:36:07.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.832+0000 7fdbd6e2c8c0 1 < completed write operation key=9S8TBVP20KTG tag=88LAWD0AAP4F type=write size=816932 2024-08-08T23:36:07.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.836+0000 7fdbd6e2c8c0 1 > prepared operation key=P3H05VKM0ZGJ tag=47CLSKL34EO7 type=del size=66258 2024-08-08T23:36:07.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.840+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=88TNGOYJCOJ3 type=del 2024-08-08T23:36:07.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.844+0000 7fdbd6e2c8c0 1 > prepared operation key=ZBEB2Q3J9Z0D tag=2LI431DKWMRO type=del size=1705201 2024-08-08T23:36:07.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.844+0000 7fdbd6e2c8c0 1 < completed delete operation key=FWZ5TEP1P2LK tag=UTQSR2RKGYM7 type=del 2024-08-08T23:36:07.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.852+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_464D0ROM6MHO.2~EWDRSHBDTWU5.0 size=425514 2024-08-08T23:36:07.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.852+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=464D0ROM6MHO upload=EWDRSHBDTWU5 tag=RSE57N4Z061M type=write size=1474090 2024-08-08T23:36:07.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.852+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.0 size=1048576 2024-08-08T23:36:07.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.852+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.1 size=1048576 2024-08-08T23:36:07.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.856+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YO2FZOR7H0EX.2~YQVCGJDZW1LF.2 size=741151 2024-08-08T23:36:07.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.860+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=YO2FZOR7H0EX upload=YQVCGJDZW1LF tag=1ZMTLLIAI5F3 type=write size=3886879 2024-08-08T23:36:07.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.864+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~9M8AAAXCGFMN.0 size=1048576 2024-08-08T23:36:07.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.868+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_VSLBN9AVZK00.2~9M8AAAXCGFMN.1 size=789148 2024-08-08T23:36:07.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.868+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=VSLBN9AVZK00 upload=9M8AAAXCGFMN tag=1DVS5T28QLIR type=write size=2886300 2024-08-08T23:36:07.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.872+0000 7fdbd6e2c8c0 1 < suggested update operation key=VSLBN9AVZK00 tag=FQ630DJH2BMA type=del size=1769896 2024-08-08T23:36:07.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.876+0000 7fdbd6e2c8c0 1 > prepared operation key=V6GSJH62C8TA tag=0AVFD0VIA213 type=del size=3724330 2024-08-08T23:36:07.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.880+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=55SWR9DQ7P7K type=del 2024-08-08T23:36:07.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.884+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~QC2J8HOUS2O7.0 size=1048576 2024-08-08T23:36:07.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.888+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~QC2J8HOUS2O7.1 size=1048576 2024-08-08T23:36:07.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.888+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_D81PQ0FJVNEE.2~QC2J8HOUS2O7.2 size=508811 2024-08-08T23:36:07.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.888+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=D81PQ0FJVNEE upload=QC2J8HOUS2O7 tag=HMO53UC3XXNL type=write size=3654539 2024-08-08T23:36:07.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.892+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~W1CVUN3GWG20.0 size=1048576 2024-08-08T23:36:07.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.896+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_ZBEB2Q3J9Z0D.2~W1CVUN3GWG20.1 size=895492 2024-08-08T23:36:07.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.900+0000 7fdbd6e2c8c0 1 < completed multipart upload key=ZBEB2Q3J9Z0D upload=W1CVUN3GWG20 tag=11NKHDBDE0YN type=write size=2992644 2024-08-08T23:36:07.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.904+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~Q4FU53R0HJ8C.0 size=1048576 2024-08-08T23:36:07.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.908+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~Q4FU53R0HJ8C.1 size=1048576 2024-08-08T23:36:07.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.912+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_YNQU8Z202QCM.2~Q4FU53R0HJ8C.2 size=293320 2024-08-08T23:36:07.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.912+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=YNQU8Z202QCM upload=Q4FU53R0HJ8C tag=IHD4HXD9QB5H type=write size=3439048 2024-08-08T23:36:07.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.912+0000 7fdbd6e2c8c0 1 < completed delete operation key=GMVEOO97I8YH tag=5WLRDCWU25V4 type=del 2024-08-08T23:36:07.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.916+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=1NLARURYRL2E type=write size=634927 2024-08-08T23:36:07.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.924+0000 7fdbd6e2c8c0 1 < suggested remove operation key=QJB9DETMSY4X tag=P2H5TYP66QCU type=del 2024-08-08T23:36:07.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.928+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~NFJIVHSROXRT.0 size=1048576 2024-08-08T23:36:07.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.932+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_QHN8QYEEOHYO.2~NFJIVHSROXRT.1 size=715012 2024-08-08T23:36:07.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.932+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=QHN8QYEEOHYO upload=NFJIVHSROXRT tag=VQLAUDZ1HRXY type=write size=2812164 2024-08-08T23:36:07.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.936+0000 7fdbd6e2c8c0 1 < completed delete operation key=D81PQ0FJVNEE tag=N70Z3NAKVH56 type=del 2024-08-08T23:36:07.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.936+0000 7fdbd6e2c8c0 1 > prepared operation key=MNV404EWJHC1 tag=NNX1MEQXVTDK type=del size=2707987 2024-08-08T23:36:07.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.940+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_JWTLJG79MYI5.2~S40LR958FH9G.0 size=380311 2024-08-08T23:36:07.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.944+0000 7fdbd6e2c8c0 1 < completed multipart upload key=JWTLJG79MYI5 upload=S40LR958FH9G tag=9ZS28GWGL98Y type=write size=1428887 2024-08-08T23:36:07.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.952+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~0UOHD36GLLRC.0 size=1048576 2024-08-08T23:36:07.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~0UOHD36GLLRC.1 size=1048576 2024-08-08T23:36:07.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.956+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_2SO6IPMXZUUI.2~0UOHD36GLLRC.2 size=334571 2024-08-08T23:36:07.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.956+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=2SO6IPMXZUUI upload=0UOHD36GLLRC tag=UQL2QEVS5SBO type=write size=3480299 2024-08-08T23:36:07.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.960+0000 7fdbd6e2c8c0 -1 < failed to complete operation key=63GVT7KRKCSS tag=ARZ013D9K6JY type=write size=589569: (22) Invalid argument 2024-08-08T23:36:07.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.964+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0XF26POOKR3V.2~WKJ42Z3VQP62.0 size=271769 2024-08-08T23:36:07.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.964+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0XF26POOKR3V upload=WKJ42Z3VQP62 tag=F1D47IC8C2KE type=write size=1320345 2024-08-08T23:36:07.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.968+0000 7fdbd6e2c8c0 1 < completed delete operation key=FBCEC998C8EJ tag=4PJ61Y6827V4 type=del 2024-08-08T23:36:07.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.972+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_0MT9FJO58ELX.2~T5WAYVKB660V.0 size=477239 2024-08-08T23:36:07.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.972+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=0MT9FJO58ELX upload=T5WAYVKB660V tag=7WY5824YM9MB type=write size=1525815 2024-08-08T23:36:07.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.984+0000 7fdbd6e2c8c0 1 < suggested update operation key=QHN8QYEEOHYO tag=408UIF6L7Y42 type=write size=1010698 2024-08-08T23:36:07.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.988+0000 7fdbd6e2c8c0 1 > prepared operation key=W5OVPO7BGE4S tag=TAT6166SFKI0 type=del size=2289006 2024-08-08T23:36:07.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.988+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_YNQU8Z202QCM.2~ZC6HR3YGU1SQ.0 size=967612 2024-08-08T23:36:07.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:07.996+0000 7fdbd6e2c8c0 1 < completed multipart upload key=YNQU8Z202QCM upload=ZC6HR3YGU1SQ tag=AI15GMY7O0ZZ type=write size=2016188 2024-08-08T23:36:08.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.000+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~HJ5D781VPJOV.0 size=1048576 2024-08-08T23:36:08.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~HJ5D781VPJOV.1 size=1048576 2024-08-08T23:36:08.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.004+0000 7fdbd6e2c8c0 1 > prepared part key=_multipart_P3H05VKM0ZGJ.2~HJ5D781VPJOV.2 size=448179 2024-08-08T23:36:08.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.004+0000 7fdbd6e2c8c0 1 > prepared multipart upload key=P3H05VKM0ZGJ upload=HJ5D781VPJOV tag=PA33JO82YKWX type=write size=3593907 2024-08-08T23:36:08.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.008+0000 7fdbd6e2c8c0 1 < canceled operation key=FBCEC998C8EJ tag=5LTU1ZIFDR0L type=del size=1683141 2024-08-08T23:36:08.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.012+0000 7fdbd6e2c8c0 1 > prepared operation key=GZJ8GWYBB01F tag=QK3Q3A17IYXL type=del size=3428236 2024-08-08T23:36:08.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.016+0000 7fdbd6e2c8c0 1 < completed delete operation key=P3H05VKM0ZGJ tag=47CLSKL34EO7 type=del 2024-08-08T23:36:08.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.016+0000 7fdbd6e2c8c0 1 > prepared operation key=V3TA5KZ95NXT tag=TDFNH8X8QM4A type=del size=2309527 2024-08-08T23:36:08.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.020+0000 7fdbd6e2c8c0 1 < completed delete operation key=ZBEB2Q3J9Z0D tag=2LI431DKWMRO type=del 2024-08-08T23:36:08.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.024+0000 7fdbd6e2c8c0 1 > prepared operation key=0XF26POOKR3V tag=794BM4P9IIZW type=del size=50772 2024-08-08T23:36:08.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.024+0000 7fdbd6e2c8c0 1 < canceled part key=_multipart_464D0ROM6MHO.2~EWDRSHBDTWU5.0 size=425514 2024-08-08T23:36:08.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.032+0000 7fdbd6e2c8c0 1 < canceled multipart upload key=464D0ROM6MHO upload=EWDRSHBDTWU5 tag=RSE57N4Z061M type=write size=1474090 2024-08-08T23:36:08.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.032+0000 7fdbd6e2c8c0 1 > prepared operation key=903K2EO77YTJ tag=CX6EPD398PA0 type=del size=4177632 2024-08-08T23:36:08.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.036+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~9M8AAAXCGFMN.0 size=1048576 2024-08-08T23:36:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.040+0000 7fdbd6e2c8c0 1 < completed part key=_multipart_VSLBN9AVZK00.2~9M8AAAXCGFMN.1 size=789148 2024-08-08T23:36:08.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.044+0000 7fdbd6e2c8c0 1 < completed multipart upload key=VSLBN9AVZK00 upload=9M8AAAXCGFMN tag=1DVS5T28QLIR type=write size=2886300 2024-08-08T23:36:08.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:36:08.048+0000 7fdbd6e2c8c0 1 > prepared operation key=0MT9FJO58ELX tag=ZKNBTZX21MZK type=write size=530601 2024-08-08T23:36:08.050 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_stats.simulate (21203 ms) 2024-08-08T23:36:08.050 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 1 test from cls_rgw_stats (21203 ms total) 2024-08-08T23:36:08.050 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:36:08.050 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:36:08.771 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 1 test from 1 test suite ran. (23855 ms total) 2024-08-08T23:36:08.771 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 1 test. 2024-08-08T23:36:08.778 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:36:08.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:36:08.836 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-08-08T23:36:08.837 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-08-08T23:36:08.837 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-08-08T23:36:08.902 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:36:08.903 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 31 tests from 1 test suite. 2024-08-08T23:36:08.903 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:36:10.782 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 31 tests from CmpOmap 2024-08-08T23:36:10.782 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-08-08T23:36:10.802 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (21 ms) 2024-08-08T23:36:10.802 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-08-08T23:36:10.827 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (25 ms) 2024-08-08T23:36:10.828 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-08-08T23:36:10.833 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-08-08T23:36:10.833 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-08-08T23:36:10.838 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-08-08T23:36:10.838 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-08-08T23:36:10.851 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_str (13 ms) 2024-08-08T23:36:10.852 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-08-08T23:36:10.863 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64 (12 ms) 2024-08-08T23:36:10.863 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-08-08T23:36:10.871 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-08-08T23:36:10.871 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-08-08T23:36:10.878 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-08-08T23:36:10.878 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-08-08T23:36:11.092 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (213 ms) 2024-08-08T23:36:11.092 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-08-08T23:36:11.103 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (12 ms) 2024-08-08T23:36:11.103 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-08-08T23:36:11.105 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-08-08T23:36:11.105 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-08-08T23:36:11.107 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-08-08T23:36:11.107 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-08-08T23:36:11.125 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-08-08T23:36:11.125 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-08-08T23:36:11.143 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (17 ms) 2024-08-08T23:36:11.143 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-08-08T23:36:11.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-08-08T23:36:11.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-08-08T23:36:11.178 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (19 ms) 2024-08-08T23:36:11.178 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-08-08T23:36:11.199 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-08-08T23:36:11.199 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-08-08T23:36:11.221 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (22 ms) 2024-08-08T23:36:11.221 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-08-08T23:36:11.228 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-08-08T23:36:11.228 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-08-08T23:36:11.235 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-08-08T23:36:11.235 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-08-08T23:36:11.238 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-08-08T23:36:11.238 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-08-08T23:36:11.240 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-08-08T23:36:11.241 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-08-08T23:36:11.258 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-08-08T23:36:11.258 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-08-08T23:36:11.275 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-08-08T23:36:11.275 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-08-08T23:36:11.294 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-08-08T23:36:11.294 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-08-08T23:36:11.315 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (22 ms) 2024-08-08T23:36:11.315 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-08-08T23:36:11.321 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-08-08T23:36:11.321 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-08-08T23:36:11.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-08-08T23:36:11.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-08-08T23:36:11.332 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-08-08T23:36:11.332 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-08-08T23:36:11.334 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (3 ms) 2024-08-08T23:36:11.334 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-08-08T23:36:11.354 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (20 ms) 2024-08-08T23:36:11.354 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 31 tests from CmpOmap (573 ms total) 2024-08-08T23:36:11.354 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:36:11.355 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:36:11.821 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 31 tests from 1 test suite ran. (2918 ms total) 2024-08-08T23:36:11.821 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 31 tests. 2024-08-08T23:36:11.828 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:36:11.828 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:36:11.884 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-08-08T23:36:11.885 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-08-08T23:36:11.886 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-08-08T23:36:11.950 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:36:11.950 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-08T23:36:11.950 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:36:11.950 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from TestCls2PCQueue 2024-08-08T23:36:11.951 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-08-08T23:36:14.846 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2896 ms) 2024-08-08T23:36:14.847 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-08-08T23:36:17.895 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3045 ms) 2024-08-08T23:36:17.895 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-08-08T23:36:20.899 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Reserve (3007 ms) 2024-08-08T23:36:20.899 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-08-08T23:36:23.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3063 ms) 2024-08-08T23:36:23.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-08-08T23:36:28.002 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Commit (4040 ms) 2024-08-08T23:36:28.002 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-08-08T23:36:32.053 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Stats (4052 ms) 2024-08-08T23:36:32.053 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-08-08T23:36:36.108 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4055 ms) 2024-08-08T23:36:36.108 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-08-08T23:36:39.114 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Abort (3006 ms) 2024-08-08T23:36:39.114 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-08-08T23:36:42.167 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveError (3053 ms) 2024-08-08T23:36:42.168 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-08-08T23:36:45.195 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.CommitError (3028 ms) 2024-08-08T23:36:45.195 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-08-08T23:36:48.246 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AbortError (3051 ms) 2024-08-08T23:36:48.246 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-08-08T23:36:51.264 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3017 ms) 2024-08-08T23:36:51.264 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-08-08T23:36:54.321 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3057 ms) 2024-08-08T23:36:54.321 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-08-08T23:36:57.378 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3055 ms) 2024-08-08T23:36:57.379 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-08-08T23:37:00.377 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3001 ms) 2024-08-08T23:37:00.377 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-08-08T23:37:03.445 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3068 ms) 2024-08-08T23:37:03.445 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-08-08T23:37:06.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3050 ms) 2024-08-08T23:37:06.499 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-08-08T23:37:09.524 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Cleanup (3029 ms) 2024-08-08T23:37:09.524 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-08-08T23:37:21.796 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12269 ms) 2024-08-08T23:37:21.796 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-08-08T23:37:26.838 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5046 ms) 2024-08-08T23:37:26.838 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-08-08T23:37:41.812 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14974 ms) 2024-08-08T23:37:41.812 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-08-08T23:37:47.847 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6034 ms) 2024-08-08T23:37:47.847 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-08-08T23:37:57.818 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (9971 ms) 2024-08-08T23:37:57.818 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-08-08T23:38:07.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10072 ms) 2024-08-08T23:38:07.889 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from TestCls2PCQueue (115940 ms total) 2024-08-08T23:38:07.890 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:07.890 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:38:07.890 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (115940 ms total) 2024-08-08T23:38:07.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-08-08T23:38:07.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:38:07.894 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:38:07.951 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-08-08T23:38:07.952 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-08-08T23:38:07.952 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-08-08T23:38:08.026 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:38:08.026 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:38:08.027 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-08T23:38:08.027 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:38:09.894 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from ClsAccount 2024-08-08T23:38:09.894 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.add 2024-08-08T23:38:10.123 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.add (229 ms) 2024-08-08T23:38:10.123 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.get 2024-08-08T23:38:10.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.get (12 ms) 2024-08-08T23:38:10.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.rm 2024-08-08T23:38:10.153 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-08-08T23:38:10.154 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.list 2024-08-08T23:38:10.192 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.list (41 ms) 2024-08-08T23:38:10.192 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from ClsAccount (298 ms total) 2024-08-08T23:38:10.192 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:10.192 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:38:10.899 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (2873 ms total) 2024-08-08T23:38:10.899 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-08-08T23:38:10.903 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:38:10.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:38:10.959 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-08-08T23:38:10.960 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-08-08T23:38:10.960 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-08-08T23:38:11.035 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:38:11.035 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:38:11.035 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 6 tests from 1 test suite. 2024-08-08T23:38:11.035 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:38:12.935 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 6 tests from rgw_gc_log 2024-08-08T23:38:12.936 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-08-08T23:38:12.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.init_existing_queue (26 ms) 2024-08-08T23:38:12.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-08-08T23:38:12.968 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-08-08T23:38:12.968 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-08-08T23:38:12.975 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-08-08T23:38:12.975 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-08-08T23:38:12.977 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-08-08T23:38:12.977 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-08-08T23:38:12.981 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-08-08T23:38:12.981 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-08-08T23:38:12.984 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-08-08T23:38:12.984 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 6 tests from rgw_gc_log (50 ms total) 2024-08-08T23:38:12.984 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:12.984 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:38:13.942 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 6 tests from 1 test suite ran. (2907 ms total) 2024-08-08T23:38:13.942 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 6 tests. 2024-08-08T23:38:13.948 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:38:13.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:38:14.003 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-08-08T23:38:14.004 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-08-08T23:38:14.004 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from TestRGWObj 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.underscore 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.074 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.075 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.076 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.077 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.078 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.079 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.080 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.081 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.082 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.083 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.084 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.085 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.086 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.087 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.088 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.089 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.090 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.091 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.092 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-08-08T23:38:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.094 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.095 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.096 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.097 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.098 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.no_underscore 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.099 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.100 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.101 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.102 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.103 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.104 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.105 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.106 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.107 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.108 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.110 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.111 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.112 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.113 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.114 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.115 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.116 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.117 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.118 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.119 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.120 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.121 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.122 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.123 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.124 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.125 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.126 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.127 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.128 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.129 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.130 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-08-08T23:38:14.131 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.132 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.133 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.134 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.135 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.136 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.137 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.138 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.139 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.140 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.141 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.142 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.143 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.144 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.145 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.146 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.147 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.148 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.149 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.150 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.151 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.152 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.153 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.154 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.155 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.156 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.157 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.158 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.159 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.160 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.161 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.162 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.163 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.164 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.165 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.166 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.167 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-08-08T23:38:14.168 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.169 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.170 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.171 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.172 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.173 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.174 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.175 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.176 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.177 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.178 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.179 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.180 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.181 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.182 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.183 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.184 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.185 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.186 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.187 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.188 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.189 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.190 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.191 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.192 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.193 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.194 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.195 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.196 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.197 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.198 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.199 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.200 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.201 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.202 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.203 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.204 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.205 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.206 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.207 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.208 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.209 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.210 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.211 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.212 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.213 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.214 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.215 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.216 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.217 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.218 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.219 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.220 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.221 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.222 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.223 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.224 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.225 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.226 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.227 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.228 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.229 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.230 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.231 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.232 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.233 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.234 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker_myobj 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.235 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.236 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker_myobj 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-08-08T23:38:14.237 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.238 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.239 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns_myobj 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.242 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.243 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns_myobj 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.244 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.245 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst_myobj 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.246 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.247 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst_myobj 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.248 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.249 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.250 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.251 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.252 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker___myobj 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.253 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.254 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker___myobj 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.256 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns__myobj 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-08-08T23:38:14.257 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.258 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns__myobj 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.259 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.260 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst__myobj 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.261 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.262 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst__myobj 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.263 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.264 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.265 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.266 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.267 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.268 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker___myobj_ 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.269 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.270 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker___myobj_ 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.271 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns__myobj_ 2024-08-08T23:38:14.272 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.273 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-08-08T23:38:14.274 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.275 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.276 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.277 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.278 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.279 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.280 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-08-08T23:38:14.281 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-08-08T23:38:14.282 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-08-08T23:38:14.282 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:38:14.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:38:14.297 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-08-08T23:38:14.298 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-08-08T23:38:14.298 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-08-08T23:38:14.436 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:38:14.436 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:38:14.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 realm 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.495+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:38:14.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:38:14.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.499+0000 7f4964c27980 20 searching for the correct realm 2024-08-08T23:38:14.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.507+0000 7f4961f3a640 0 -- 172.21.15.83:0/1165231861 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f49500022b0 msgr2=0x7f495c08c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:38:14.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.723+0000 7f496273b640 0 -- 172.21.15.83:0/1165231861 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f495402b040 msgr2=0x7f495401da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:38:14.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:38:14.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:38:14.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:38:14.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:38:14.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:38:14.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 zone default found 2024-08-08T23:38:14.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 4 Realm: () 2024-08-08T23:38:14.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:38:14.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:38:14.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:38:14.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 zonegroup default 2024-08-08T23:38:14.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.739+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.743+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.743+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.743+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.743+0000 7f4964c27980 20 started sync module instance, tier type = 2024-08-08T23:38:14.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.743+0000 7f4964c27980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=0 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=1 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=2 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=3 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=4 2024-08-08T23:38:14.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=5 2024-08-08T23:38:14.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.767+0000 7f4964c27980 20 add_watcher() i=6 2024-08-08T23:38:14.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.771+0000 7f4964c27980 20 add_watcher() i=7 2024-08-08T23:38:14.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.771+0000 7f4964c27980 2 all 8 watchers are set, enabling cache 2024-08-08T23:38:14.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4818fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:38:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:38:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:38:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 5 note: GC not initialized 2024-08-08T23:38:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f47937fe640 20 reqs_thread_entry: start 2024-08-08T23:38:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 20 init_complete bucket index max shards: 1 2024-08-08T23:38:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 20 Filter name: none 2024-08-08T23:38:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f47917fa640 20 reqs_thread_entry: start 2024-08-08T23:38:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-08-08T23:38:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.775+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-08-08T23:38:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-08T23:38:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache get: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= : miss 2024-08-08T23:38:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 20 rados->read ofs=0 len=0 2024-08-08T23:38:14.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:38:14.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= info.flags=0x0 2024-08-08T23:38:14.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 adding default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= to cache LRU end 2024-08-08T23:38:14.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache get: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= : hit (negative entry) 2024-08-08T23:38:14.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.779+0000 7f4964c27980 10 cache get: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= : hit (negative entry) 2024-08-08T23:38:14.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-08-08T23:38:14.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4964c27980 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-08T23:38:14.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4964c27980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-08-08T23:38:14.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4845ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693186 cookie 94178063762160 notifier 5481 bl.length()=697 2024-08-08T23:38:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4845ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-08-08T23:38:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.783+0000 7f4845ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-08T23:38:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-08-08T23:38:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4964c27980 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-08T23:38:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4964c27980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-08-08T23:38:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4845ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94178063766128 notifier 5481 bl.length()=194 2024-08-08T23:38:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4845ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-08-08T23:38:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.787+0000 7f4845ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-08T23:38:14.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.791+0000 7f4964c27980 10 cache put: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= info.flags=0x7 2024-08-08T23:38:14.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.791+0000 7f4964c27980 10 moving default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= to cache LRU end 2024-08-08T23:38:14.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.791+0000 7f4964c27980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:q7Ymtir/rkexJCXRvEPvyYcSliA=, ofs0, ns] 2024-08-08T23:38:14.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.795+0000 7f48457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94178063783712 notifier 5481 bl.length()=203 2024-08-08T23:38:14.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.795+0000 7f48457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= info.flags=0x7 2024-08-08T23:38:14.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.795+0000 7f48457fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+q7Ymtir/rkexJCXRvEPvyYcSliA= to cache LRU end 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "ceph-test-librgw-file", 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "librgw test user", 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "librgw@example.com", 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-08-08T23:38:14.795 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "ceph-test-librgw-file", 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "q7Ymtir/rkexJCXRvEPvyYcSliA=", 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "nfZOXfdN1UrMiW9IIZw4yYV2R3uw8Ti1hAmQhOeel7Out0sj7rBGVA==", 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:38:14.785270Z" 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-08-08T23:38:14.796 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:38:14.797 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:38:14.785228Z", 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:14.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.795+0000 7f4818fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:38:14.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.803+0000 7f4964c27980 20 remove_watcher() i=0 2024-08-08T23:38:14.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.803+0000 7f4964c27980 2 removed watcher, disabling cache 2024-08-08T23:38:14.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.803+0000 7f4964c27980 20 remove_watcher() i=1 2024-08-08T23:38:14.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.807+0000 7f4964c27980 20 remove_watcher() i=2 2024-08-08T23:38:14.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.807+0000 7f4964c27980 20 remove_watcher() i=3 2024-08-08T23:38:14.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.811+0000 7f4964c27980 20 remove_watcher() i=4 2024-08-08T23:38:14.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.811+0000 7f4964c27980 20 remove_watcher() i=5 2024-08-08T23:38:14.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.811+0000 7f4964c27980 20 remove_watcher() i=6 2024-08-08T23:38:14.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:14.815+0000 7f4964c27980 20 remove_watcher() i=7 2024-08-08T23:38:14.827 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.1 2024-08-08T23:38:14.848 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-08T23:38:14.848 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:38:14.848 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-08-08T23:38:14.848 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:38:14.861 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:38:14.861 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:38:15.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:15.467+0000 7f88f3feda80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:38:15.829 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (981 ms) 2024-08-08T23:38:15.829 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-08T23:38:15.831 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-08-08T23:38:15.831 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:38:15.831 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-08T23:38:15.831 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-08T23:38:15.849 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/quux 2024-08-08T23:38:15.857 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/f1 2024-08-08T23:38:15.863 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/f2 2024-08-08T23:38:15.869 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/f1 2024-08-08T23:38:15.874 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/d1/ 2024-08-08T23:38:15.880 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-08-08T23:38:15.886 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-08-08T23:38:15.891 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/momma 2024-08-08T23:38:15.896 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-08-08T23:38:15.904 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-08-08T23:38:15.912 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-08-08T23:38:15.919 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-08-08T23:38:15.926 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (96 ms) 2024-08-08T23:38:15.927 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-08T23:38:16.164 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (237 ms) 2024-08-08T23:38:16.164 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-08-08T23:38:16.164 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-08T23:38:16.164 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-08T23:38:16.208 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (44 ms) 2024-08-08T23:38:16.208 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-08T23:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (111 ms) 2024-08-08T23:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-08T23:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-08-08T23:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (18 ms) 2024-08-08T23:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-08T23:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (18 ms) 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_0 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_2 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_0 2024-08-08T23:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_0 2024-08-08T23:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_1 2024-08-08T23:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_1 2024-08-08T23:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_0 2024-08-08T23:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_1 2024-08-08T23:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_2 2024-08-08T23:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_0 2024-08-08T23:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_1 2024-08-08T23:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (23 ms) 2024-08-08T23:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (231 ms) 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:38:16.609 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-08-08T23:38:16.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-08-08T23:38:16.621 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f2 (f2): FILE 2024-08-08T23:38:16.622 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f1 (f1): FILE 2024-08-08T23:38:16.627 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-08-08T23:38:16.630 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-08-08T23:38:16.635 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-08T23:38:16.636 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-08T23:38:16.637 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-08-08T23:38:16.638 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-08-08T23:38:16.639 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-08T23:38:16.640 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-08T23:38:16.642 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-08-08T23:38:16.645 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-08-08T23:38:16.645 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-08-08T23:38:16.645 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar (bar): DIR 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo (foo): DIR 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot (nfsroot): DIR 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (36 ms) 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:38:16.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:38:16.647 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:38:16.647 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:38:16.647 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:38:16.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:16.643+0000 7f88f3feda80 -1 shutting down 2024-08-08T23:38:16.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:16.647+0000 7f87cdd3f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55828, si_uid : 1000, si_addr0x3e80000da14, si_status0 2024-08-08T23:38:45.826 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29181 ms) 2024-08-08T23:38:45.826 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30978 ms total) 2024-08-08T23:38:45.826 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:38:45.826 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:38:45.826 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30978 ms total) 2024-08-08T23:38:45.827 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-08-08T23:38:45.840 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.2 2024-08-08T23:38:45.863 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-08T23:38:45.863 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:38:45.863 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-08-08T23:38:45.863 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:38:45.873 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:38:45.873 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:38:46.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:46.035+0000 7fd6c960ba80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:38:46.156 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (293 ms) 2024-08-08T23:38:46.157 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-08-08T23:38:46.159 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-08T23:38:46.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-08-08T23:38:46.161 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:38:46.162 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:38:46.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:46.159+0000 7fd6c960ba80 -1 shutting down 2024-08-08T23:38:46.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:38:46.159+0000 7fd5a335d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56480, si_uid : 1000, si_addr0x3e80000dca0, si_status0 2024-08-08T23:39:16.321 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30163 ms) 2024-08-08T23:39:16.322 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30458 ms total) 2024-08-08T23:39:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:39:16.322 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:39:16.322 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30458 ms total) 2024-08-08T23:39:16.322 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-08-08T23:39:16.336 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.3 2024-08-08T23:39:16.357 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-08T23:39:16.358 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:39:16.358 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-08-08T23:39:16.358 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:39:16.370 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:39:16.370 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:39:16.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:16.982+0000 7f8e35b88a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:39:17.462 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (1105 ms) 2024-08-08T23:39:17.462 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-08T23:39:17.463 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-08-08T23:39:17.464 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:39:17.464 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-08T23:39:17.464 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-08T23:39:17.473 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-08-08T23:39:17.474 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-08T23:39:17.622 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (148 ms) 2024-08-08T23:39:17.622 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-08-08T23:39:17.622 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_0 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:39:17.623 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.624 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:39:17.624 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_1 2024-08-08T23:39:17.624 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.624 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:39:17.624 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.625 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_2 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_0 2024-08-08T23:39:17.626 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_0 2024-08-08T23:39:17.628 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:39:17.628 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_1 2024-08-08T23:39:17.631 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:39:17.631 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_1 2024-08-08T23:39:17.631 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_0 2024-08-08T23:39:17.636 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:39:17.636 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_1 2024-08-08T23:39:17.638 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:39:17.639 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_2 2024-08-08T23:39:17.639 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_0 2024-08-08T23:39:17.641 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-08T23:39:17.641 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_1 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (23 ms) 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-08T23:39:17.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:39:17.647 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-08-08T23:39:17.648 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-08-08T23:39:17.648 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-08-08T23:39:17.648 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-08-08T23:39:17.648 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-08-08T23:39:17.648 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-08-08T23:39:17.660 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f2 (f2): FILE 2024-08-08T23:39:17.661 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f1 (f1): FILE 2024-08-08T23:39:17.668 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-08-08T23:39:17.672 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-08-08T23:39:17.677 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-08T23:39:17.678 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-08T23:39:17.679 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-08-08T23:39:17.680 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-08-08T23:39:17.682 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-08T23:39:17.684 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-08T23:39:17.685 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-08-08T23:39:17.691 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-08-08T23:39:17.691 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar (bar): DIR 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo (foo): DIR 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot (nfsroot): DIR 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-08T23:39:17.692 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:39:17.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:17.694+0000 7f8e35b88a80 -1 shutting down 2024-08-08T23:39:17.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:17.694+0000 7f8d0f8da640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57126, si_uid : 1000, si_addr0x3e80000df26, si_status0 2024-08-08T23:39:47.141 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29452 ms) 2024-08-08T23:39:47.142 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30784 ms total) 2024-08-08T23:39:47.142 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:39:47.142 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:39:47.142 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30784 ms total) 2024-08-08T23:39:47.143 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-08-08T23:39:47.154 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2.1 2024-08-08T23:39:47.175 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-08T23:39:47.176 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:39:47.176 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW 2024-08-08T23:39:47.176 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:39:47.187 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:39:47.187 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:39:47.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:47.806+0000 7f7de574fa80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:39:47.947 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (772 ms) 2024-08-08T23:39:47.948 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:39:47.949 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:39:47.949 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:39:47.966 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-08-08T23:39:47.966 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:39:47.966 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-08T23:39:47.966 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-08-08T23:39:47.980 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave0 2024-08-08T23:39:47.996 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave1 2024-08-08T23:39:48.012 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave2 2024-08-08T23:39:48.025 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave3 2024-08-08T23:39:48.043 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave4 2024-08-08T23:39:48.060 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave5 2024-08-08T23:39:48.076 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave6 2024-08-08T23:39:48.094 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave7 2024-08-08T23:39:48.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave8 2024-08-08T23:39:48.131 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave9 2024-08-08T23:39:48.131 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (166 ms) 2024-08-08T23:39:48.131 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (464 ms) 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:39:48.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:39:48.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:48.598+0000 7f7de574fa80 -1 shutting down 2024-08-08T23:39:48.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:39:48.602+0000 7f7cbf4a1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57778, si_uid : 1000, si_addr0x3e80000e1b2, si_status0 2024-08-08T23:40:18.256 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29660 ms) 2024-08-08T23:40:18.257 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW (31080 ms total) 2024-08-08T23:40:18.257 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:40:18.257 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:40:18.257 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (31080 ms total) 2024-08-08T23:40:18.257 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-08-08T23:40:18.270 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2.2 2024-08-08T23:40:18.293 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-08T23:40:18.293 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:40:18.294 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW 2024-08-08T23:40:18.294 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:40:18.304 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:40:18.304 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:40:18.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:18.909+0000 7f27c2700a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:40:19.093 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (800 ms) 2024-08-08T23:40:19.093 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:40:19.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:40:19.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:40:19.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-08T23:40:19.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:40:19.136 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (41 ms) 2024-08-08T23:40:19.136 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-08-08T23:40:19.154 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave0 2024-08-08T23:40:19.177 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave1 2024-08-08T23:40:19.200 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave2 2024-08-08T23:40:19.222 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave3 2024-08-08T23:40:19.245 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave4 2024-08-08T23:40:19.266 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave5 2024-08-08T23:40:19.290 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave6 2024-08-08T23:40:19.313 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave7 2024-08-08T23:40:19.334 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave8 2024-08-08T23:40:19.357 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave9 2024-08-08T23:40:19.357 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (222 ms) 2024-08-08T23:40:19.357 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-08-08T23:40:19.840 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (483 ms) 2024-08-08T23:40:19.840 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:40:19.841 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:40:19.841 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:40:19.841 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:40:19.841 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:40:19.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:19.845+0000 7f27c2700a80 -1 shutting down 2024-08-08T23:40:19.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:19.845+0000 7f269c452640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58423, si_uid : 1000, si_addr0x3e80000e437, si_status0 2024-08-08T23:40:49.109 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29269 ms) 2024-08-08T23:40:49.110 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW (30816 ms total) 2024-08-08T23:40:49.110 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:40:49.110 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:40:49.110 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (30816 ms total) 2024-08-08T23:40:49.110 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-08-08T23:40:49.120 INFO:tasks.workunit.client.0.smithi083.stdout:phase 3.1 2024-08-08T23:40:49.462 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 13 tests from 1 test suite. 2024-08-08T23:40:49.462 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:40:49.462 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW 2024-08-08T23:40:49.462 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:40:49.472 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:40:49.472 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:40:49.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:49.885+0000 7f8fee130a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:40:50.025 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (563 ms) 2024-08-08T23:40:50.025 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:40:50.026 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:40:50.027 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:40:50.043 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-08-08T23:40:50.043 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-08T23:40:50.049 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-08-08T23:40:50.049 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-08T23:40:50.052 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-08-08T23:40:50.052 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE1 2024-08-08T23:40:50.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE1 (542 ms) 2024-08-08T23:40:50.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE2 2024-08-08T23:40:50.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE2 (99 ms) 2024-08-08T23:40:50.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-08T23:40:50.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-08T23:40:50.693 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:40:50.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:50.697+0000 7f8fee130a80 -1 shutting down 2024-08-08T23:40:50.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:40:50.701+0000 7f8ec7e82640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59069, si_uid : 1000, si_addr0x3e80000e6bd, si_status0 2024-08-08T23:41:20.181 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29487 ms) 2024-08-08T23:41:20.181 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW (30718 ms total) 2024-08-08T23:41:20.181 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:41:20.181 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:41:20.182 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 13 tests from 1 test suite ran. (30718 ms total) 2024-08-08T23:41:20.182 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 13 tests. 2024-08-08T23:41:20.192 INFO:tasks.workunit.client.0.smithi083.stdout:phase 3.2 2024-08-08T23:41:20.534 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 13 tests from 1 test suite. 2024-08-08T23:41:20.534 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:41:20.534 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW 2024-08-08T23:41:20.534 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:41:20.543 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:41:20.543 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:41:20.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:20.933+0000 7fac51a7da80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:41:21.086 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (553 ms) 2024-08-08T23:41:21.087 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-08T23:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-08T23:41:21.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-08-08T23:41:21.095 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-08T23:41:21.103 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (7 ms) 2024-08-08T23:41:21.103 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE1 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE1 (115 ms) 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE2 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-08T23:41:21.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-08T23:41:21.231 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (13 ms) 2024-08-08T23:41:21.231 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (45 ms) 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:41:21.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:21.281+0000 7fac51a7da80 -1 shutting down 2024-08-08T23:41:21.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:21.281+0000 7fab2b7cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59714, si_uid : 1000, si_addr0x3e80000e942, si_status0 2024-08-08T23:41:51.104 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29828 ms) 2024-08-08T23:41:51.104 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW (30570 ms total) 2024-08-08T23:41:51.104 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:41:51.104 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:41:51.104 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 13 tests from 1 test suite ran. (30570 ms total) 2024-08-08T23:41:51.105 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 13 tests. 2024-08-08T23:41:51.116 INFO:tasks.workunit.client.0.smithi083.stdout:phase 4.1 2024-08-08T23:41:51.138 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TVAR 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:read i1: 64001 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:read s1: blunderbuss 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-08-08T23:41:51.139 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:41:51.154 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:41:51.154 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:41:51.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:51.768+0000 7fe6ac35ba80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:41:51.961 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (823 ms) 2024-08-08T23:41:51.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:41:51.963 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-08T23:41:51.963 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-08T23:41:51.990 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (26 ms) 2024-08-08T23:41:51.990 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-08T23:41:52.871 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_0 2024-08-08T23:41:52.871 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_1 2024-08-08T23:41:52.871 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_2 2024-08-08T23:41:52.871 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_3 2024-08-08T23:41:52.871 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_4 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_5 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_6 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_7 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_8 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_9 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_10 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_11 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_12 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_13 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_14 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_15 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_16 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_17 2024-08-08T23:41:52.872 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_18 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_19 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_20 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_21 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_22 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_23 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_24 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_25 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_26 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_27 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_28 2024-08-08T23:41:52.873 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_29 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_30 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_31 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_32 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_33 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_34 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_35 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_36 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_37 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_38 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_39 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_40 2024-08-08T23:41:52.874 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_41 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_42 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_43 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_44 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_45 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_46 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_47 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_48 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_49 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_50 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_51 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_52 2024-08-08T23:41:52.875 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_53 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_54 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_55 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_56 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_57 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_58 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_59 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_60 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_61 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_62 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_63 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_64 2024-08-08T23:41:52.876 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_65 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_66 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_67 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_68 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_69 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_70 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_71 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_72 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_73 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_74 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_75 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_76 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_77 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_78 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_79 2024-08-08T23:41:52.877 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_80 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_81 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_82 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_83 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_84 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_85 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_86 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_87 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_88 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_89 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_90 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_91 2024-08-08T23:41:52.878 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_92 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_93 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_94 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_95 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_96 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_97 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_98 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_99 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (881 ms) 2024-08-08T23:41:52.879 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-08T23:41:52.880 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-08T23:41:52.881 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-08T23:41:52.882 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-08T23:41:52.883 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-08T23:41:52.884 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-08T23:41:52.885 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-08T23:41:52.886 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-08T23:41:52.887 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (8 ms) 2024-08-08T23:41:52.888 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-08T23:41:52.889 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-08T23:41:52.890 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-08T23:41:52.891 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-08T23:41:52.892 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-08T23:41:52.893 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-08T23:41:52.894 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-08T23:41:52.895 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-08T23:41:52.896 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:41:52.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:41:52.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:52.888+0000 7fe6ac35ba80 -1 shutting down 2024-08-08T23:41:52.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:41:52.888+0000 7fe5860ad640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60359, si_uid : 1000, si_addr0x3e80000ebc7, si_status0 2024-08-08T23:42:22.096 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29212 ms) 2024-08-08T23:42:22.097 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW (30957 ms total) 2024-08-08T23:42:22.097 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:42:22.097 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:42:22.097 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (30958 ms total) 2024-08-08T23:42:22.097 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-08-08T23:42:22.110 INFO:tasks.workunit.client.0.smithi083.stdout:phase 4.2 2024-08-08T23:42:22.132 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-08T23:42:22.132 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:42:22.132 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW 2024-08-08T23:42:22.132 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TVAR 2024-08-08T23:42:22.132 INFO:tasks.workunit.client.0.smithi083.stdout:read i1: 64001 2024-08-08T23:42:22.133 INFO:tasks.workunit.client.0.smithi083.stdout:read s1: blunderbuss 2024-08-08T23:42:22.133 INFO:tasks.workunit.client.0.smithi083.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-08-08T23:42:22.133 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:42:22.142 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:42:22.142 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:42:22.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:22.760+0000 7f1321e2ca80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:42:22.882 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (750 ms) 2024-08-08T23:42:22.882 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:42:22.883 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:42:22.883 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-08T23:42:22.897 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (14 ms) 2024-08-08T23:42:22.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-08T23:42:22.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-08T23:42:22.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-08T23:42:22.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-08T23:42:22.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-08T23:42:22.901 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-08T23:42:22.902 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-08T23:42:22.903 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-08T23:42:22.904 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-08T23:42:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-08T23:42:22.906 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-08T23:42:22.907 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-08T23:42:22.908 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:42:22.909 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:42:22.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:22.904+0000 7f1321e2ca80 -1 shutting down 2024-08-08T23:42:22.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:22.908+0000 7f11fbb7e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61004, si_uid : 1000, si_addr0x3e80000ee4c, si_status0 2024-08-08T23:42:52.907 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30006 ms) 2024-08-08T23:42:52.907 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW (30775 ms total) 2024-08-08T23:42:52.908 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:42:52.908 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:42:52.908 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (30775 ms total) 2024-08-08T23:42:52.908 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-08-08T23:42:52.920 INFO:tasks.workunit.client.0.smithi083.stdout:phase 5.1 2024-08-08T23:42:52.953 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 19 tests from 1 test suite. 2024-08-08T23:42:52.954 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:42:52.954 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW 2024-08-08T23:42:52.954 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:42:52.966 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:42:52.966 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:42:53.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:53.367+0000 7fc90f7a0a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:42:53.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (540 ms) 2024-08-08T23:42:53.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:42:53.495 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:42:53.495 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:42:53.510 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-08-08T23:42:53.510 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-08T23:42:53.515 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-08-08T23:42:53.515 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-08-08T23:42:53.515 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-08-08T23:42:53.515 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-08T23:42:53.517 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-08-08T23:42:53.518 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-08-08T23:42:53.518 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-08-08T23:42:53.518 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-08-08T23:42:53.524 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.PUT_OBJECT (6 ms) 2024-08-08T23:42:53.524 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-08-08T23:42:53.530 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GET_OBJECT (6 ms) 2024-08-08T23:42:53.530 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-08T23:42:53.530 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEV 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-08T23:42:53.531 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:42:53.532 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:42:53.532 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:42:53.532 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:42:53.532 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:42:53.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:53.531+0000 7fc90f7a0a80 -1 shutting down 2024-08-08T23:42:53.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:42:53.535+0000 7fc7e94f2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61649, si_uid : 1000, si_addr0x3e80000f0d1, si_status0 2024-08-08T23:43:23.884 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30354 ms) 2024-08-08T23:43:23.884 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW (30930 ms total) 2024-08-08T23:43:23.884 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:43:23.884 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:43:23.885 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 19 tests from 1 test suite ran. (30930 ms total) 2024-08-08T23:43:23.885 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 19 tests. 2024-08-08T23:43:23.897 INFO:tasks.workunit.client.0.smithi083.stdout:phase 5.2 2024-08-08T23:43:23.931 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 19 tests from 1 test suite. 2024-08-08T23:43:23.931 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:43:23.931 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW 2024-08-08T23:43:23.931 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:43:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:43:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:43:24.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:24.347+0000 7f4b48f15a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:43:24.491 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (559 ms) 2024-08-08T23:43:24.491 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:43:24.492 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-08T23:43:24.493 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-08T23:43:24.493 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-08T23:43:24.493 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-08T23:43:24.501 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-08-08T23:43:24.501 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-08T23:43:24.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEV 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV (0 ms) 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-08-08T23:43:24.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-08T23:43:24.508 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-08-08T23:43:24.508 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-08T23:43:24.540 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:43:24.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:24.543+0000 7f4b48f15a80 -1 shutting down 2024-08-08T23:43:24.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:24.547+0000 7f4a22c67640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62296, si_uid : 1000, si_addr0x3e80000f358, si_status0 2024-08-08T23:43:54.621 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30080 ms) 2024-08-08T23:43:54.621 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW (30689 ms total) 2024-08-08T23:43:54.621 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:43:54.621 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:43:54.621 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 19 tests from 1 test suite ran. (30690 ms total) 2024-08-08T23:43:54.622 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 19 tests. 2024-08-08T23:43:54.634 INFO:tasks.workunit.client.0.smithi083.stdout:phase 6.1 2024-08-08T23:43:54.657 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 10 tests from 1 test suite. 2024-08-08T23:43:54.657 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-08-08T23:43:54.657 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from LibRGW 2024-08-08T23:43:54.657 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-08-08T23:43:54.666 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:43:54.666 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:43:55.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:55.278+0000 7fde560c6a80 -1 LDAP not started since no server URIs were provided in the configuration. 2024-08-08T23:43:55.427 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (770 ms) 2024-08-08T23:43:55.427 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-08-08T23:43:55.428 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-08T23:43:55.428 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-08-08T23:43:55.460 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKETS (32 ms) 2024-08-08T23:43:55.461 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-08-08T23:43:55.472 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (11 ms) 2024-08-08T23:43:55.472 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-08-08T23:43:55.501 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.TOPDIR_RENAME (29 ms) 2024-08-08T23:43:55.501 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-08-08T23:43:55.537 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SUBDIR_RENAME (36 ms) 2024-08-08T23:43:55.537 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-08-08T23:43:55.582 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (45 ms) 2024-08-08T23:43:55.582 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-08T23:43:55.582 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-08T23:43:55.583 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-08T23:43:55.583 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-08T23:43:55.583 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-08T23:43:55.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:55.590+0000 7fde560c6a80 -1 shutting down 2024-08-08T23:43:55.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:43:55.590+0000 7fdd2fe18640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62941, si_uid : 1000, si_addr0x3e80000f5dd, si_status0 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30004 ms) 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from LibRGW (30929 ms total) 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 10 tests from 1 test suite ran. (30929 ms total) 2024-08-08T23:44:25.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 10 tests. 2024-08-08T23:44:25.601 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:44:25.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:44:25.617 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-08-08T23:44:25.618 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-08-08T23:44:25.618 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-08-08T23:44:25.667 INFO:tasks.workunit.client.0.smithi083.stderr:+ [ -z ] 2024-08-08T23:44:25.667 INFO:tasks.workunit.client.0.smithi083.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-08-08T23:44:25.667 INFO:tasks.workunit.client.0.smithi083.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-08-08T23:44:25.667 INFO:tasks.workunit.client.0.smithi083.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-08-08T23:44:25.707 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:44:25.707 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:44:25.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 realm 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.757+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.761+0000 7fad87ed2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:44:25.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.761+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.761+0000 7fad87ed2980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:44:25.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.761+0000 7fad87ed2980 20 searching for the correct realm 2024-08-08T23:44:25.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.761+0000 7fad859e6640 0 -- 172.21.15.83:0/1274436793 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fad70003be0 msgr2=0x7fad8001f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:44:25.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.769+0000 7fad859e6640 0 -- 172.21.15.83:0/1274436793 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x55f5ce9b6a60 msgr2=0x7fad80065290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:44:25.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 zone default found 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 4 Realm: () 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 zonegroup default 2024-08-08T23:44:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.993+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:25.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:25.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 started sync module instance, tier type = 2024-08-08T23:44:25.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:25.997+0000 7fad87ed2980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:44:26.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=0 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=1 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=2 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=3 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=4 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=5 2024-08-08T23:44:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=6 2024-08-08T23:44:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 20 add_watcher() i=7 2024-08-08T23:44:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.017+0000 7fad87ed2980 2 all 8 watchers are set, enabling cache 2024-08-08T23:44:26.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.021+0000 7fac377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:44:26.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.021+0000 7fad87ed2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:44:26.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.021+0000 7fad87ed2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:44:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.021+0000 7fad87ed2980 5 note: GC not initialized 2024-08-08T23:44:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fac367fc640 20 reqs_thread_entry: start 2024-08-08T23:44:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 init_complete bucket index max shards: 1 2024-08-08T23:44:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 Filter name: none 2024-08-08T23:44:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7faba7fff640 20 reqs_thread_entry: start 2024-08-08T23:44:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-08-08T23:44:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-08-08T23:44:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-08T23:44:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-08-08T23:44:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados->read ofs=0 len=0 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-08-08T23:44:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.025+0000 7fad87ed2980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-08-08T23:44:26.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-08-08T23:44:26.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fad87ed2980 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-08T23:44:26.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fad87ed2980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-08-08T23:44:26.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fac697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693187 cookie 94514223990240 notifier 5492 bl.length()=677 2024-08-08T23:44:26.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fac697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-08-08T23:44:26.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.029+0000 7fac697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fad87ed2980 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fad87ed2980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fac697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693196 cookie 94514223985840 notifier 5492 bl.length()=187 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fac697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-08-08T23:44:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.033+0000 7fac697fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-08T23:44:26.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fad87ed2980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-08-08T23:44:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fad87ed2980 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-08T23:44:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fad87ed2980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-08-08T23:44:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fac697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94514223985840 notifier 5492 bl.length()=197 2024-08-08T23:44:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fac697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-08-08T23:44:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.037+0000 7fac697fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-08T23:44:26.035 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:44:26.035 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "ceph-test-maven", 2024-08-08T23:44:26.035 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "maven test user", 2024-08-08T23:44:26.035 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "sigv4@example.com", 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "ceph-test-maven", 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-08-08T23:44:26.036 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:44:26.029752Z" 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:44:26.037 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-08-08T23:44:26.038 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:44:26.029710Z", 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:44:26.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.041+0000 7fac377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:44:26.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.045+0000 7fad87ed2980 20 remove_watcher() i=0 2024-08-08T23:44:26.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.045+0000 7fad87ed2980 2 removed watcher, disabling cache 2024-08-08T23:44:26.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.049+0000 7fad87ed2980 20 remove_watcher() i=1 2024-08-08T23:44:26.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.049+0000 7fad87ed2980 20 remove_watcher() i=2 2024-08-08T23:44:26.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.053+0000 7fad87ed2980 20 remove_watcher() i=3 2024-08-08T23:44:26.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.053+0000 7fad87ed2980 20 remove_watcher() i=4 2024-08-08T23:44:26.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.057+0000 7fad87ed2980 20 remove_watcher() i=5 2024-08-08T23:44:26.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.057+0000 7fad87ed2980 20 remove_watcher() i=6 2024-08-08T23:44:26.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:44:26.057+0000 7fad87ed2980 20 remove_watcher() i=7 2024-08-08T23:44:26.068 INFO:tasks.workunit.client.0.smithi083.stderr:+ [ -z ] 2024-08-08T23:44:26.068 INFO:tasks.workunit.client.0.smithi083.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-08-08T23:44:26.068 INFO:tasks.workunit.client.0.smithi083.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-08-08T23:44:26.069 INFO:tasks.workunit.client.0.smithi083.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi083.front.sepia.ceph.com:80 2024-08-08T23:44:26.069 INFO:tasks.workunit.client.0.smithi083.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-08-08T23:44:26.069 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-08-08T23:44:26.069 INFO:tasks.workunit.client.0.smithi083.stderr:+ ./mvnw clean package 2024-08-08T23:44:26.075 INFO:tasks.workunit.client.0.smithi083.stdout:Warning: JAVA_HOME environment variable is not set. 2024-08-08T23:44:30.381 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Scanning for projects... 2024-08-08T23:44:30.534 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-08-08T23:44:30.654 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 46 kB/s) 2024-08-08T23:44:30.684 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-08-08T23:44:30.727 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 17/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 28/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 39/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 46/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-08-08T23:44:30.743 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-08-08T23:44:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.5 MB/s) 2024-08-08T23:44:30.804 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:30.804 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-08-08T23:44:30.804 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jcksum 1.0 2024-08-08T23:44:30.805 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] from pom.xml 2024-08-08T23:44:30.805 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-08-08T23:44:30.808 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-08-08T23:44:30.825 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-08-08T23:44:30.832 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-08-08T23:44:30.848 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-08-08T23:44:30.852 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-08-08T23:44:30.869 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-08-08T23:44:30.875 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-08-08T23:44:30.892 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-08-08T23:44:30.906 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-08-08T23:44:30.923 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-08-08T23:44:30.932 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-08-08T23:44:30.949 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-08-08T23:44:30.952 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-08-08T23:44:30.967 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-08-08T23:44:30.970 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-08-08T23:44:30.986 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-08-08T23:44:30.991 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-08-08T23:44:31.007 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-08-08T23:44:31.016 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-08-08T23:44:31.033 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-08-08T23:44:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-08-08T23:44:31.056 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-08-08T23:44:31.064 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-08-08T23:44:31.082 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-08-08T23:44:31.094 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-08-08T23:44:31.110 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-08-08T23:44:31.113 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-08-08T23:44:31.136 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 953 kB/s) 2024-08-08T23:44:31.141 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-08-08T23:44:31.159 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-08-08T23:44:31.164 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-08-08T23:44:31.180 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-08-08T23:44:31.190 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-08-08T23:44:31.206 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-08-08T23:44:31.211 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-08-08T23:44:31.228 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-08-08T23:44:31.240 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-08-08T23:44:31.258 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 356 kB/s) 2024-08-08T23:44:31.262 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-08-08T23:44:31.279 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-08-08T23:44:31.282 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-08-08T23:44:31.300 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-08-08T23:44:31.306 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-08-08T23:44:31.322 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-08-08T23:44:31.330 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-08-08T23:44:31.348 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-08-08T23:44:31.372 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-08-08T23:44:31.388 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-08-08T23:44:31.392 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-08-08T23:44:31.409 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-08-08T23:44:31.417 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-08-08T23:44:31.435 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-08-08T23:44:31.447 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-08-08T23:44:31.465 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-08-08T23:44:31.469 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-08-08T23:44:31.486 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-08-08T23:44:31.489 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-08-08T23:44:31.506 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-08-08T23:44:31.515 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-08-08T23:44:31.532 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 202 kB/s) 2024-08-08T23:44:31.540 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-08-08T23:44:31.559 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-08-08T23:44:31.567 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-08-08T23:44:31.584 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-08-08T23:44:31.592 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-08-08T23:44:31.609 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-08-08T23:44:31.616 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-08-08T23:44:31.633 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-08-08T23:44:31.640 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-08-08T23:44:31.658 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-08-08T23:44:31.665 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-08-08T23:44:31.690 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 48 kB/s) 2024-08-08T23:44:31.694 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-08-08T23:44:31.710 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-08-08T23:44:31.714 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-08-08T23:44:31.731 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-08-08T23:44:31.737 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-08-08T23:44:31.753 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 216 kB/s) 2024-08-08T23:44:31.763 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-08-08T23:44:31.782 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 129 kB/s) 2024-08-08T23:44:31.791 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-08-08T23:44:31.810 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-08-08T23:44:31.820 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-08-08T23:44:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 390 kB/s) 2024-08-08T23:44:31.848 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-08-08T23:44:31.867 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 287 kB/s) 2024-08-08T23:44:31.878 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-08-08T23:44:31.896 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 184 kB/s) 2024-08-08T23:44:31.908 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-08-08T23:44:31.926 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-08-08T23:44:31.931 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-08-08T23:44:31.949 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-08-08T23:44:31.958 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-08-08T23:44:31.977 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 339 kB/s) 2024-08-08T23:44:31.986 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-08-08T23:44:32.004 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-08-08T23:44:32.013 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-08-08T23:44:32.031 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-08-08T23:44:32.040 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-08-08T23:44:32.058 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-08-08T23:44:32.068 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-08-08T23:44:32.087 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 215 kB/s) 2024-08-08T23:44:32.093 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-08-08T23:44:32.112 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 94 kB/s) 2024-08-08T23:44:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-08-08T23:44:32.143 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 348 kB/s) 2024-08-08T23:44:32.150 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-08-08T23:44:32.169 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 819 kB/s) 2024-08-08T23:44:32.177 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-08-08T23:44:32.196 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.7 MB/s) 2024-08-08T23:44:32.208 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-08-08T23:44:32.226 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-08-08T23:44:32.237 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-08-08T23:44:32.255 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-08-08T23:44:32.261 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-08-08T23:44:32.280 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-08-08T23:44:32.293 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-08-08T23:44:32.312 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 735 kB/s) 2024-08-08T23:44:32.318 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-08-08T23:44:32.340 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.1 MB/s) 2024-08-08T23:44:32.430 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-08-08T23:44:32.449 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 825 kB/s) 2024-08-08T23:44:32.464 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-08-08T23:44:32.482 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-08-08T23:44:32.487 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-08-08T23:44:32.510 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.6 MB/s) 2024-08-08T23:44:32.526 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-08-08T23:44:32.545 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 921 kB/s) 2024-08-08T23:44:32.555 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-08-08T23:44:32.573 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-08-08T23:44:32.580 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-08-08T23:44:32.601 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 61/78 kB Progress (1): 77/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.5 MB/s) 2024-08-08T23:44:32.621 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-08-08T23:44:32.639 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-08-08T23:44:32.642 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-08-08T23:44:32.659 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-08-08T23:44:32.665 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-08-08T23:44:32.682 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 178 kB/s) 2024-08-08T23:44:32.689 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-08-08T23:44:32.708 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-08-08T23:44:32.715 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-08-08T23:44:32.733 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 107 kB/s) 2024-08-08T23:44:32.739 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-08-08T23:44:32.757 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-08-08T23:44:32.764 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-08-08T23:44:32.782 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 80 kB/s) 2024-08-08T23:44:32.788 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-08-08T23:44:32.807 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-08-08T23:44:32.814 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-08-08T23:44:32.832 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-08-08T23:44:32.838 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-08-08T23:44:32.855 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 178 kB/s) 2024-08-08T23:44:32.862 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-08-08T23:44:32.879 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-08-08T23:44:32.888 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-08-08T23:44:32.905 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 54 kB/s) 2024-08-08T23:44:32.912 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-08-08T23:44:32.930 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 161 kB/s) 2024-08-08T23:44:32.936 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-08-08T23:44:32.953 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-08-08T23:44:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-08-08T23:44:32.975 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-08-08T23:44:32.980 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-08-08T23:44:32.998 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-08-08T23:44:33.004 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-08-08T23:44:33.022 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-08-08T23:44:33.092 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-08-08T23:44:33.215 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-08-08T23:44:33.217 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-08-08T23:44:33.217 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-08-08T23:44:33.217 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-08-08T23:44:33.218 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-08-08T23:44:33.218 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-08-08T23:44:33.256 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 879 kB/s) 2024-08-08T23:44:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-08-08T23:44:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/71 kB Progress (2): 2.8/16 kB | 1.4/71 kB Progress (2): 2.8/16 kB | 2.8/71 kB Progress (2): 4.1/16 kB | 2.8/71 kB Progress (2): 4.1/16 kB | 4.1/71 kB Progress (2): 5.5/16 kB | 4.1/71 kB Progress (2): 5.5/16 kB | 5.5/71 kB Progress (2): 6.9/16 kB | 5.5/71 kB Progress (2): 6.9/16 kB | 6.9/71 kB Progress (2): 8.3/16 kB | 6.9/71 kB Progress (2): 8.3/16 kB | 8.3/71 kB Progress (2): 9.7/16 kB | 8.3/71 kB Progress (2): 9.7/16 kB | 9.7/71 kB Progress (2): 11/16 kB | 9.7/71 kB Progress (2): 11/16 kB | 11/71 kB Progress (2): 12/16 kB | 11/71 kB Progress (2): 12/16 kB | 12/71 kB Progress (2): 14/16 kB | 12/71 kB Progress (2): 14/16 kB | 14/71 kB Progress (2): 15/16 kB | 14/71 kB Progress (2): 15/16 kB | 15/71 kB Progress (3): 15/16 kB | 15/71 kB | 16 kB Progress (3): 16 kB | 15/71 kB | 16 kB Progress (3): 16 kB | 16/71 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 297 kB/s) 2024-08-08T23:44:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-08-08T23:44:33.273 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 287 kB/s) 2024-08-08T23:44:33.273 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-08-08T23:44:33.286 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-08-08T23:44:33.286 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-08-08T23:44:33.289 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/782 kB Progress (1): 2.8/782 kB Progress (1): 4.1/782 kB Progress (1): 5.5/782 kB Progress (1): 6.9/782 kB Progress (2): 6.9/782 kB | 11 kB Progress (2): 8.3/782 kB | 11 kB Progress (2): 9.7/782 kB | 11 kB Progress (2): 11/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 160 kB/s) 2024-08-08T23:44:33.290 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-08-08T23:44:33.307 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 12/782 kB Progress (1): 14/782 kB Progress (1): 15/782 kB Progress (1): 16/782 kB Progress (1): 33/782 kB Progress (2): 33/782 kB | 1.4/98 kB Progress (2): 33/782 kB | 2.8/98 kB Progress (2): 33/782 kB | 4.1/98 kB Progress (2): 33/782 kB | 5.5/98 kB Progress (3): 33/782 kB | 5.5/98 kB | 1.4/49 kB Progress (3): 33/782 kB | 6.9/98 kB | 1.4/49 kB Progress (3): 33/782 kB | 6.9/98 kB | 2.8/49 kB Progress (3): 33/782 kB | 8.3/98 kB | 2.8/49 kB Progress (3): 33/782 kB | 8.3/98 kB | 4.1/49 kB Progress (3): 33/782 kB | 9.7/98 kB | 4.1/49 kB Progress (3): 33/782 kB | 9.7/98 kB | 5.5/49 kB Progress (3): 33/782 kB | 11/98 kB | 5.5/49 kB Progress (3): 33/782 kB | 11/98 kB | 6.9/49 kB Progress (3): 33/782 kB | 12/98 kB | 6.9/49 kB Progress (3): 33/782 kB | 12/98 kB | 8.3/49 kB Progress (3): 33/782 kB | 14/98 kB | 8.3/49 kB Progress (3): 33/782 kB | 14/98 kB | 9.7/49 kB Progress (3): 33/782 kB | 15/98 kB | 9.7/49 kB Progress (3): 33/782 kB | 15/98 kB | 11/49 kB Progress (3): 33/782 kB | 16/98 kB | 11/49 kB Progress (3): 33/782 kB | 16/98 kB | 12/49 kB Progress (3): 33/782 kB | 18/98 kB | 12/49 kB Progress (3): 49/782 kB | 18/98 kB | 12/49 kB Progress (3): 49/782 kB | 18/98 kB | 14/49 kB Progress (3): 49/782 kB | 19/98 kB | 14/49 kB Progress (3): 49/782 kB | 19/98 kB | 15/49 kB Progress (4): 49/782 kB | 19/98 kB | 15/49 kB | 16/205 kB Progress (4): 49/782 kB | 19/98 kB | 16/49 kB | 16/205 kB Progress (4): 49/782 kB | 21/98 kB | 16/49 kB | 16/205 kB Progress (4): 49/782 kB | 21/98 kB | 17/49 kB | 16/205 kB Progress (4): 49/782 kB | 22/98 kB | 17/49 kB | 16/205 kB Progress (4): 49/782 kB | 22/98 kB | 17/49 kB | 33/205 kB Progress (4): 49/782 kB | 23/98 kB | 17/49 kB | 33/205 kB Progress (4): 49/782 kB | 23/98 kB | 19/49 kB | 33/205 kB Progress (4): 49/782 kB | 25/98 kB | 19/49 kB | 33/205 kB Progress (4): 49/782 kB | 25/98 kB | 20/49 kB | 33/205 kB Progress (4): 66/782 kB | 25/98 kB | 20/49 kB | 33/205 kB Progress (4): 66/782 kB | 26/98 kB | 20/49 kB | 33/205 kB Progress (4): 66/782 kB | 26/98 kB | 20/49 kB | 49/205 kB Progress (4): 66/782 kB | 26/98 kB | 21/49 kB | 49/205 kB Progress (4): 66/782 kB | 27/98 kB | 21/49 kB | 49/205 kB Progress (4): 66/782 kB | 27/98 kB | 23/49 kB | 49/205 kB Progress (4): 66/782 kB | 27/98 kB | 23/49 kB | 66/205 kB Progress (4): 66/782 kB | 29/98 kB | 23/49 kB | 66/205 kB Progress (4): 66/782 kB | 29/98 kB | 24/49 kB | 66/205 kB Progress (4): 66/782 kB | 30/98 kB | 24/49 kB | 66/205 kB Progress (4): 66/782 kB | 30/98 kB | 25/49 kB | 66/205 kB Progress (4): 78/782 kB | 30/98 kB | 25/49 kB | 66/205 kB Progress (4): 78/782 kB | 30/98 kB | 27/49 kB | 66/205 kB Progress (5): 78/782 kB | 30/98 kB | 27/49 kB | 66/205 kB | 16/30 kB Progress (5): 78/782 kB | 32/98 kB | 27/49 kB | 66/205 kB | 16/30 kB Progress (5): 78/782 kB | 32/98 kB | 27/49 kB | 82/205 kB | 16/30 kB Progress (5): 78/782 kB | 32/98 kB | 27/49 kB | 82/205 kB | 30 kB Progress (5): 78/782 kB | 33/98 kB | 27/49 kB | 82/205 kB | 30 kB Progress (5): 78/782 kB | 33/98 kB | 28/49 kB | 82/205 kB | 30 kB Progress (5): 78/782 kB | 34/98 kB | 28/49 kB | 82/205 kB | 30 kB Progress (5): 78/782 kB | 34/98 kB | 28/49 kB | 98/205 kB | 30 kB Progress (5): 78/782 kB | 36/98 kB | 28/49 kB | 98/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 347 kB/s) 2024-08-08T23:44:33.307 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 94/782 kB | 36/98 kB | 28/49 kB | 98/205 kB Progress (4): 94/782 kB | 36/98 kB | 30/49 kB | 98/205 kB Progress (4): 94/782 kB | 37/98 kB | 30/49 kB | 98/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-08-08T23:44:33.316 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 94/782 kB | 37/98 kB | 31/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 31/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 32/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 34/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 35/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 36/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 38/49 kB | 98/205 kB Progress (4): 94/782 kB | 38/98 kB | 39/49 kB | 98/205 kB Progress (4): 94/782 kB | 40/98 kB | 39/49 kB | 98/205 kB Progress (4): 94/782 kB | 41/98 kB | 39/49 kB | 98/205 kB Progress (4): 94/782 kB | 42/98 kB | 39/49 kB | 98/205 kB Progress (4): 94/782 kB | 42/98 kB | 41/49 kB | 98/205 kB Progress (4): 94/782 kB | 44/98 kB | 41/49 kB | 98/205 kB Progress (4): 94/782 kB | 44/98 kB | 42/49 kB | 98/205 kB Progress (4): 94/782 kB | 45/98 kB | 42/49 kB | 98/205 kB Progress (4): 94/782 kB | 45/98 kB | 43/49 kB | 98/205 kB Progress (4): 94/782 kB | 47/98 kB | 43/49 kB | 98/205 kB Progress (4): 94/782 kB | 47/98 kB | 45/49 kB | 98/205 kB Progress (4): 94/782 kB | 48/98 kB | 45/49 kB | 98/205 kB Progress (4): 94/782 kB | 48/98 kB | 46/49 kB | 98/205 kB Progress (4): 94/782 kB | 49/98 kB | 46/49 kB | 98/205 kB Progress (4): 111/782 kB | 49/98 kB | 46/49 kB | 98/205 kB Progress (4): 111/782 kB | 49/98 kB | 48/49 kB | 98/205 kB Progress (4): 111/782 kB | 51/98 kB | 48/49 kB | 98/205 kB Progress (4): 111/782 kB | 51/98 kB | 49/49 kB | 98/205 kB Progress (4): 111/782 kB | 51/98 kB | 49/49 kB | 115/205 kB Progress (4): 111/782 kB | 52/98 kB | 49/49 kB | 115/205 kB Progress (4): 111/782 kB | 52/98 kB | 49 kB | 115/205 kB Progress (4): 111/782 kB | 53/98 kB | 49 kB | 115/205 kB Progress (4): 111/782 kB | 53/98 kB | 49 kB | 131/205 kB Progress (4): 127/782 kB | 53/98 kB | 49 kB | 131/205 kB Progress (4): 127/782 kB | 55/98 kB | 49 kB | 131/205 kB Progress (4): 127/782 kB | 55/98 kB | 49 kB | 147/205 kB Progress (4): 127/782 kB | 56/98 kB | 49 kB | 147/205 kB Progress (4): 144/782 kB | 56/98 kB | 49 kB | 147/205 kB Progress (4): 144/782 kB | 56/98 kB | 49 kB | 164/205 kB Progress (4): 144/782 kB | 57/98 kB | 49 kB | 164/205 kB Progress (4): 144/782 kB | 59/98 kB | 49 kB | 164/205 kB Progress (4): 160/782 kB | 59/98 kB | 49 kB | 164/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 502 kB/s) 2024-08-08T23:44:33.317 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 160/782 kB | 60/98 kB | 164/205 kB Progress (3): 160/782 kB | 60/98 kB | 180/205 kB Progress (3): 160/782 kB | 62/98 kB | 180/205 kB Progress (3): 176/782 kB | 62/98 kB | 180/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-08-08T23:44:33.318 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 176/782 kB | 62/98 kB | 197/205 kB Progress (3): 193/782 kB | 62/98 kB | 197/205 kB Progress (3): 193/782 kB | 62/98 kB | 197/205 kB Progress (3): 193/782 kB | 62/98 kB | 205 kB Progress (3): 193/782 kB | 78/98 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-08-08T23:44:33.318 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-08-08T23:44:33.323 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 209/782 kB | 78/98 kB Progress (2): 225/782 kB | 78/98 kB Progress (3): 225/782 kB | 78/98 kB | 16/81 kB Progress (3): 225/782 kB | 95/98 kB | 16/81 kB Progress (3): 225/782 kB | 98 kB | 16/81 kB Progress (3): 225/782 kB | 98 kB | 33/81 kB Progress (3): 225/782 kB | 98 kB | 49/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 908 kB/s) 2024-08-08T23:44:33.323 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 225/782 kB | 65/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-08-08T23:44:33.324 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 225/782 kB | 81/81 kB Progress (2): 225/782 kB | 81 kB Progress (2): 242/782 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 774 kB/s) 2024-08-08T23:44:33.324 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-08-08T23:44:33.334 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 258/782 kB Progress (1): 275/782 kB Progress (1): 291/782 kB Progress (1): 307/782 kB Progress (1): 324/782 kB Progress (1): 340/782 kB Progress (1): 356/782 kB Progress (1): 373/782 kB Progress (1): 389/782 kB Progress (1): 406/782 kB Progress (1): 422/782 kB Progress (1): 438/782 kB Progress (1): 455/782 kB Progress (2): 455/782 kB | 16/798 kB Progress (2): 471/782 kB | 16/798 kB Progress (2): 488/782 kB | 16/798 kB Progress (2): 488/782 kB | 33/798 kB Progress (3): 488/782 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 116 kB/s) 2024-08-08T23:44:33.334 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 488/782 kB | 49/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-08-08T23:44:33.346 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 488/782 kB | 64/798 kB Progress (2): 504/782 kB | 64/798 kB Progress (2): 520/782 kB | 64/798 kB Progress (2): 537/782 kB | 64/798 kB Progress (2): 553/782 kB | 64/798 kB Progress (2): 569/782 kB | 64/798 kB Progress (3): 569/782 kB | 64/798 kB | 16/182 kB Progress (3): 586/782 kB | 64/798 kB | 16/182 kB Progress (3): 586/782 kB | 64/798 kB | 32/182 kB Progress (3): 602/782 kB | 64/798 kB | 32/182 kB Progress (3): 602/782 kB | 64/798 kB | 49/182 kB Progress (3): 619/782 kB | 64/798 kB | 49/182 kB Progress (3): 635/782 kB | 64/798 kB | 49/182 kB Progress (3): 635/782 kB | 64/798 kB | 65/182 kB Progress (3): 651/782 kB | 64/798 kB | 65/182 kB Progress (3): 651/782 kB | 64/798 kB | 81/182 kB Progress (4): 651/782 kB | 64/798 kB | 81/182 kB | 16/151 kB Progress (4): 668/782 kB | 64/798 kB | 81/182 kB | 16/151 kB Progress (4): 668/782 kB | 64/798 kB | 98/182 kB | 16/151 kB Progress (4): 668/782 kB | 64/798 kB | 98/182 kB | 33/151 kB Progress (4): 684/782 kB | 64/798 kB | 98/182 kB | 33/151 kB Progress (4): 684/782 kB | 64/798 kB | 98/182 kB | 49/151 kB Progress (4): 684/782 kB | 64/798 kB | 114/182 kB | 49/151 kB Progress (4): 701/782 kB | 64/798 kB | 114/182 kB | 49/151 kB Progress (4): 701/782 kB | 64/798 kB | 114/182 kB | 66/151 kB Progress (4): 701/782 kB | 64/798 kB | 114/182 kB | 82/151 kB Progress (4): 701/782 kB | 81/798 kB | 114/182 kB | 82/151 kB Progress (4): 717/782 kB | 81/798 kB | 114/182 kB | 82/151 kB Progress (4): 717/782 kB | 81/798 kB | 130/182 kB | 82/151 kB Progress (4): 717/782 kB | 81/798 kB | 130/182 kB | 98/151 kB Progress (4): 733/782 kB | 81/798 kB | 130/182 kB | 98/151 kB Progress (4): 733/782 kB | 81/798 kB | 130/182 kB | 115/151 kB Progress (4): 733/782 kB | 97/798 kB | 130/182 kB | 115/151 kB Progress (4): 750/782 kB | 97/798 kB | 130/182 kB | 115/151 kB Progress (4): 750/782 kB | 97/798 kB | 130/182 kB | 131/151 kB Progress (4): 766/782 kB | 97/798 kB | 130/182 kB | 131/151 kB Progress (4): 766/782 kB | 97/798 kB | 130/182 kB | 147/151 kB Progress (4): 766/782 kB | 97/798 kB | 130/182 kB | 151 kB Progress (4): 766/782 kB | 114/798 kB | 130/182 kB | 151 kB Progress (4): 782 kB | 114/798 kB | 130/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-08-08T23:44:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 6.2 MB/s) 2024-08-08T23:44:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-08-08T23:44:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 130/798 kB | 130/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-08-08T23:44:33.350 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 146/798 kB | 130/182 kB Progress (2): 163/798 kB | 130/182 kB Progress (2): 179/798 kB | 130/182 kB Progress (2): 195/798 kB | 130/182 kB Progress (2): 212/798 kB | 130/182 kB Progress (3): 212/798 kB | 130/182 kB | 16/27 kB Progress (3): 212/798 kB | 130/182 kB | 27 kB Progress (3): 228/798 kB | 130/182 kB | 27 kB Progress (3): 228/798 kB | 147/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 210 kB/s) 2024-08-08T23:44:33.351 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-08-08T23:44:33.352 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 228/798 kB | 163/182 kB Progress (2): 228/798 kB | 180/182 kB Progress (2): 228/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-08-08T23:44:33.352 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-08-08T23:44:33.363 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 245/798 kB Progress (1): 261/798 kB Progress (1): 277/798 kB Progress (1): 294/798 kB Progress (1): 310/798 kB Progress (1): 327/798 kB Progress (1): 343/798 kB Progress (1): 359/798 kB Progress (1): 376/798 kB Progress (1): 392/798 kB Progress (1): 408/798 kB Progress (1): 425/798 kB Progress (1): 441/798 kB Progress (1): 458/798 kB Progress (1): 474/798 kB Progress (2): 474/798 kB | 2.8/30 kB Progress (2): 490/798 kB | 2.8/30 kB Progress (2): 490/798 kB | 19/30 kB Progress (2): 507/798 kB | 19/30 kB Progress (3): 507/798 kB | 19/30 kB | 15/385 kB Progress (3): 507/798 kB | 30 kB | 15/385 kB Progress (3): 523/798 kB | 30 kB | 15/385 kB Progress (3): 523/798 kB | 30 kB | 31/385 kB Progress (3): 523/798 kB | 30 kB | 48/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 212 kB/s) 2024-08-08T23:44:33.363 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-08-08T23:44:33.366 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 523/798 kB | 64/385 kB Progress (2): 523/798 kB | 78/385 kB Progress (2): 523/798 kB | 94/385 kB Progress (2): 523/798 kB | 111/385 kB Progress (2): 523/798 kB | 127/385 kB Progress (2): 523/798 kB | 143/385 kB Progress (2): 523/798 kB | 160/385 kB Progress (2): 523/798 kB | 176/385 kB Progress (3): 523/798 kB | 176/385 kB | 13 kB Progress (3): 523/798 kB | 193/385 kB | 13 kB Progress (3): 523/798 kB | 209/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 91 kB/s) 2024-08-08T23:44:33.366 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-08-08T23:44:33.369 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 523/798 kB | 225/385 kB Progress (2): 523/798 kB | 242/385 kB Progress (2): 523/798 kB | 258/385 kB Progress (3): 523/798 kB | 258/385 kB | 16/75 kB Progress (3): 523/798 kB | 274/385 kB | 16/75 kB Progress (3): 540/798 kB | 274/385 kB | 16/75 kB Progress (3): 540/798 kB | 274/385 kB | 32/75 kB Progress (3): 556/798 kB | 274/385 kB | 32/75 kB Progress (3): 556/798 kB | 291/385 kB | 32/75 kB Progress (3): 572/798 kB | 291/385 kB | 32/75 kB Progress (3): 572/798 kB | 291/385 kB | 49/75 kB Progress (3): 572/798 kB | 307/385 kB | 49/75 kB Progress (3): 589/798 kB | 307/385 kB | 49/75 kB Progress (3): 589/798 kB | 307/385 kB | 65/75 kB Progress (3): 589/798 kB | 324/385 kB | 65/75 kB Progress (3): 605/798 kB | 324/385 kB | 65/75 kB Progress (3): 605/798 kB | 324/385 kB | 75 kB Progress (3): 605/798 kB | 340/385 kB | 75 kB Progress (3): 621/798 kB | 340/385 kB | 75 kB Progress (3): 621/798 kB | 356/385 kB | 75 kB Progress (3): 638/798 kB | 356/385 kB | 75 kB Progress (3): 638/798 kB | 373/385 kB | 75 kB Progress (3): 654/798 kB | 373/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 500 kB/s) 2024-08-08T23:44:33.370 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-08-08T23:44:33.370 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 654/798 kB | 385 kB Progress (2): 671/798 kB | 385 kB Progress (2): 687/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.6 MB/s) 2024-08-08T23:44:33.371 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-08-08T23:44:33.373 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 703/798 kB Progress (1): 720/798 kB Progress (1): 736/798 kB Progress (1): 753/798 kB Progress (1): 769/798 kB Progress (1): 785/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.2 MB/s) 2024-08-08T23:44:33.373 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-08-08T23:44:33.404 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (1): 98/780 kB Progress (1): 115/780 kB Progress (1): 131/780 kB Progress (1): 147/780 kB Progress (2): 147/780 kB | 16/329 kB Progress (2): 164/780 kB | 16/329 kB Progress (2): 164/780 kB | 32/329 kB Progress (2): 180/780 kB | 32/329 kB Progress (2): 180/780 kB | 49/329 kB Progress (2): 180/780 kB | 65/329 kB Progress (2): 197/780 kB | 65/329 kB Progress (2): 197/780 kB | 81/329 kB Progress (2): 213/780 kB | 81/329 kB Progress (2): 213/780 kB | 98/329 kB Progress (2): 229/780 kB | 98/329 kB Progress (2): 229/780 kB | 114/329 kB Progress (2): 246/780 kB | 114/329 kB Progress (2): 246/780 kB | 130/329 kB Progress (2): 256/780 kB | 130/329 kB Progress (3): 256/780 kB | 130/329 kB | 16/501 kB Progress (3): 272/780 kB | 130/329 kB | 16/501 kB Progress (3): 272/780 kB | 147/329 kB | 16/501 kB Progress (3): 272/780 kB | 147/329 kB | 33/501 kB Progress (3): 289/780 kB | 147/329 kB | 33/501 kB Progress (3): 289/780 kB | 163/329 kB | 33/501 kB Progress (3): 289/780 kB | 163/329 kB | 49/501 kB Progress (3): 305/780 kB | 163/329 kB | 49/501 kB Progress (4): 305/780 kB | 163/329 kB | 49/501 kB | 15/354 kB Progress (4): 305/780 kB | 180/329 kB | 49/501 kB | 15/354 kB Progress (4): 305/780 kB | 180/329 kB | 66/501 kB | 15/354 kB Progress (4): 321/780 kB | 180/329 kB | 66/501 kB | 15/354 kB Progress (4): 321/780 kB | 180/329 kB | 66/501 kB | 31/354 kB Progress (4): 321/780 kB | 180/329 kB | 78/501 kB | 31/354 kB Progress (4): 321/780 kB | 196/329 kB | 78/501 kB | 31/354 kB Progress (4): 338/780 kB | 196/329 kB | 78/501 kB | 31/354 kB Progress (4): 338/780 kB | 196/329 kB | 94/501 kB | 31/354 kB Progress (5): 338/780 kB | 196/329 kB | 94/501 kB | 31/354 kB | 15/41 kB Progress (5): 338/780 kB | 196/329 kB | 94/501 kB | 48/354 kB | 15/41 kB Progress (5): 354/780 kB | 196/329 kB | 94/501 kB | 48/354 kB | 15/41 kB Progress (5): 354/780 kB | 212/329 kB | 94/501 kB | 48/354 kB | 15/41 kB Progress (5): 354/780 kB | 212/329 kB | 111/501 kB | 48/354 kB | 15/41 kB Progress (5): 354/780 kB | 212/329 kB | 111/501 kB | 48/354 kB | 31/41 kB Progress (5): 354/780 kB | 212/329 kB | 111/501 kB | 64/354 kB | 31/41 kB Progress (5): 370/780 kB | 212/329 kB | 111/501 kB | 64/354 kB | 31/41 kB Progress (5): 370/780 kB | 229/329 kB | 111/501 kB | 64/354 kB | 31/41 kB Progress (5): 370/780 kB | 229/329 kB | 127/501 kB | 64/354 kB | 31/41 kB Progress (5): 370/780 kB | 229/329 kB | 127/501 kB | 64/354 kB | 41 kB Progress (5): 370/780 kB | 229/329 kB | 127/501 kB | 81/354 kB | 41 kB Progress (5): 387/780 kB | 229/329 kB | 127/501 kB | 81/354 kB | 41 kB Progress (5): 387/780 kB | 245/329 kB | 127/501 kB | 81/354 kB | 41 kB Progress (5): 387/780 kB | 245/329 kB | 144/501 kB | 81/354 kB | 41 kB Progress (5): 387/780 kB | 245/329 kB | 144/501 kB | 97/354 kB | 41 kB Progress (5): 387/780 kB | 262/329 kB | 144/501 kB | 97/354 kB | 41 kB Progress (5): 403/780 kB | 262/329 kB | 144/501 kB | 97/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 225 kB/s) 2024-08-08T23:44:33.404 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 403/780 kB | 262/329 kB | 160/501 kB | 97/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-08-08T23:44:33.407 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 403/780 kB | 278/329 kB | 160/501 kB | 97/354 kB Progress (4): 403/780 kB | 278/329 kB | 160/501 kB | 113/354 kB Progress (4): 420/780 kB | 278/329 kB | 160/501 kB | 113/354 kB Progress (4): 420/780 kB | 278/329 kB | 176/501 kB | 113/354 kB Progress (4): 420/780 kB | 294/329 kB | 176/501 kB | 113/354 kB Progress (4): 420/780 kB | 294/329 kB | 176/501 kB | 130/354 kB Progress (4): 436/780 kB | 294/329 kB | 176/501 kB | 130/354 kB Progress (4): 436/780 kB | 311/329 kB | 176/501 kB | 130/354 kB Progress (4): 436/780 kB | 311/329 kB | 193/501 kB | 130/354 kB Progress (4): 436/780 kB | 311/329 kB | 193/501 kB | 146/354 kB Progress (4): 452/780 kB | 311/329 kB | 193/501 kB | 146/354 kB Progress (4): 452/780 kB | 311/329 kB | 209/501 kB | 146/354 kB Progress (4): 452/780 kB | 327/329 kB | 209/501 kB | 146/354 kB Progress (4): 452/780 kB | 327/329 kB | 209/501 kB | 162/354 kB Progress (4): 452/780 kB | 329 kB | 209/501 kB | 162/354 kB Progress (4): 452/780 kB | 329 kB | 226/501 kB | 162/354 kB Progress (4): 469/780 kB | 329 kB | 226/501 kB | 162/354 kB Progress (4): 469/780 kB | 329 kB | 226/501 kB | 179/354 kB Progress (4): 469/780 kB | 329 kB | 242/501 kB | 179/354 kB Progress (4): 485/780 kB | 329 kB | 242/501 kB | 179/354 kB Progress (4): 485/780 kB | 329 kB | 242/501 kB | 195/354 kB Progress (4): 485/780 kB | 329 kB | 258/501 kB | 195/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-08-08T23:44:33.407 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-08-08T23:44:33.410 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 502/780 kB | 258/501 kB | 195/354 kB Progress (3): 502/780 kB | 258/501 kB | 212/354 kB Progress (3): 502/780 kB | 275/501 kB | 212/354 kB Progress (3): 518/780 kB | 275/501 kB | 212/354 kB Progress (3): 518/780 kB | 275/501 kB | 228/354 kB Progress (3): 518/780 kB | 291/501 kB | 228/354 kB Progress (3): 534/780 kB | 291/501 kB | 228/354 kB Progress (3): 534/780 kB | 291/501 kB | 244/354 kB Progress (3): 534/780 kB | 307/501 kB | 244/354 kB Progress (3): 551/780 kB | 307/501 kB | 244/354 kB Progress (3): 551/780 kB | 307/501 kB | 261/354 kB Progress (3): 551/780 kB | 324/501 kB | 261/354 kB Progress (3): 567/780 kB | 324/501 kB | 261/354 kB Progress (3): 567/780 kB | 324/501 kB | 277/354 kB Progress (3): 567/780 kB | 340/501 kB | 277/354 kB Progress (3): 583/780 kB | 340/501 kB | 277/354 kB Progress (3): 583/780 kB | 340/501 kB | 294/354 kB Progress (3): 583/780 kB | 357/501 kB | 294/354 kB Progress (3): 600/780 kB | 357/501 kB | 294/354 kB Progress (3): 600/780 kB | 357/501 kB | 310/354 kB Progress (3): 600/780 kB | 373/501 kB | 310/354 kB Progress (3): 600/780 kB | 373/501 kB | 326/354 kB Progress (3): 600/780 kB | 389/501 kB | 326/354 kB Progress (3): 616/780 kB | 389/501 kB | 326/354 kB Progress (3): 616/780 kB | 389/501 kB | 343/354 kB Progress (3): 616/780 kB | 406/501 kB | 343/354 kB Progress (3): 633/780 kB | 406/501 kB | 343/354 kB Progress (3): 633/780 kB | 406/501 kB | 354 kB Progress (3): 633/780 kB | 422/501 kB | 354 kB Progress (3): 649/780 kB | 422/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-08-08T23:44:33.410 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 649/780 kB | 439/501 kB Progress (2): 665/780 kB | 439/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-08-08T23:44:33.413 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 682/780 kB | 439/501 kB Progress (2): 682/780 kB | 455/501 kB Progress (2): 698/780 kB | 455/501 kB Progress (2): 698/780 kB | 471/501 kB Progress (2): 715/780 kB | 471/501 kB Progress (2): 715/780 kB | 488/501 kB Progress (2): 731/780 kB | 488/501 kB Progress (2): 731/780 kB | 501 kB Progress (2): 747/780 kB | 501 kB Progress (2): 764/780 kB | 501 kB Progress (2): 780/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.6 MB/s) 2024-08-08T23:44:33.413 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-08-08T23:44:33.414 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.0 MB/s) 2024-08-08T23:44:33.414 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-08-08T23:44:33.420 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 32 kB/s) 2024-08-08T23:44:33.420 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-08-08T23:44:33.429 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/586 kB Progress (1): 31/586 kB Progress (1): 48/586 kB Progress (1): 64/586 kB Progress (1): 81/586 kB Progress (1): 97/586 kB Progress (1): 113/586 kB Progress (1): 129/586 kB Progress (1): 146/586 kB Progress (1): 162/586 kB Progress (1): 178/586 kB Progress (1): 195/586 kB Progress (1): 211/586 kB Progress (1): 228/586 kB Progress (1): 244/586 kB Progress (2): 244/586 kB | 16/211 kB Progress (2): 260/586 kB | 16/211 kB Progress (2): 277/586 kB | 16/211 kB Progress (2): 277/586 kB | 33/211 kB Progress (2): 293/586 kB | 33/211 kB Progress (2): 293/586 kB | 49/211 kB Progress (2): 310/586 kB | 49/211 kB Progress (2): 310/586 kB | 66/211 kB Progress (2): 326/586 kB | 66/211 kB Progress (2): 342/586 kB | 66/211 kB Progress (2): 342/586 kB | 78/211 kB Progress (2): 359/586 kB | 78/211 kB Progress (2): 359/586 kB | 95/211 kB Progress (3): 359/586 kB | 95/211 kB | 14 kB Progress (3): 375/586 kB | 95/211 kB | 14 kB Progress (3): 375/586 kB | 111/211 kB | 14 kB Progress (4): 375/586 kB | 111/211 kB | 14 kB | 16/106 kB Progress (4): 391/586 kB | 111/211 kB | 14 kB | 16/106 kB Progress (4): 391/586 kB | 128/211 kB | 14 kB | 16/106 kB Progress (4): 391/586 kB | 128/211 kB | 14 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 68 kB/s) 2024-08-08T23:44:33.430 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-08-08T23:44:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 408/586 kB | 128/211 kB | 33/106 kB Progress (3): 408/586 kB | 144/211 kB | 33/106 kB Progress (3): 424/586 kB | 144/211 kB | 33/106 kB Progress (3): 424/586 kB | 144/211 kB | 49/106 kB Progress (3): 424/586 kB | 160/211 kB | 49/106 kB Progress (3): 441/586 kB | 160/211 kB | 49/106 kB Progress (3): 441/586 kB | 160/211 kB | 66/106 kB Progress (3): 441/586 kB | 177/211 kB | 66/106 kB Progress (3): 457/586 kB | 177/211 kB | 66/106 kB Progress (3): 457/586 kB | 177/211 kB | 82/106 kB Progress (3): 457/586 kB | 193/211 kB | 82/106 kB Progress (3): 473/586 kB | 193/211 kB | 82/106 kB Progress (3): 473/586 kB | 193/211 kB | 98/106 kB Progress (3): 473/586 kB | 209/211 kB | 98/106 kB Progress (3): 490/586 kB | 209/211 kB | 98/106 kB Progress (3): 490/586 kB | 211 kB | 98/106 kB Progress (3): 490/586 kB | 211 kB | 106 kB Progress (3): 506/586 kB | 211 kB | 106 kB Progress (3): 522/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 501 kB/s) 2024-08-08T23:44:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 995 kB/s) 2024-08-08T23:44:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-08-08T23:44:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-08-08T23:44:33.434 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 539/586 kB Progress (1): 555/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.7 MB/s) 2024-08-08T23:44:33.434 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-08-08T23:44:33.435 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-08-08T23:44:33.436 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-08-08T23:44:33.449 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (2): 115/245 kB | 16/205 kB Progress (3): 115/245 kB | 16/205 kB | 5.5/15 kB Progress (3): 115/245 kB | 16/205 kB | 8.3/15 kB Progress (3): 115/245 kB | 32/205 kB | 8.3/15 kB Progress (3): 131/245 kB | 32/205 kB | 8.3/15 kB Progress (3): 131/245 kB | 32/205 kB | 15 kB Progress (3): 131/245 kB | 49/205 kB | 15 kB Progress (3): 146/245 kB | 49/205 kB | 15 kB Progress (4): 146/245 kB | 49/205 kB | 15 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 67 kB/s) 2024-08-08T23:44:33.449 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 146/245 kB | 49/205 kB | 16 kB Progress (3): 146/245 kB | 65/205 kB | 16 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-08-08T23:44:33.449 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 162/245 kB | 65/205 kB | 16 kB Progress (3): 162/245 kB | 79/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 72 kB/s) 2024-08-08T23:44:33.450 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-08-08T23:44:33.451 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 179/245 kB | 79/205 kB Progress (2): 179/245 kB | 95/205 kB Progress (2): 195/245 kB | 95/205 kB Progress (2): 195/245 kB | 111/205 kB Progress (2): 195/245 kB | 128/205 kB Progress (2): 195/245 kB | 144/205 kB Progress (3): 195/245 kB | 144/205 kB | 6.4 kB Progress (3): 195/245 kB | 161/205 kB | 6.4 kB Progress (3): 195/245 kB | 177/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 28 kB/s) 2024-08-08T23:44:33.452 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 195/245 kB | 193/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-08-08T23:44:33.452 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 195/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 887 kB/s) 2024-08-08T23:44:33.452 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-08-08T23:44:33.454 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 212/245 kB Progress (1): 228/245 kB Progress (1): 244/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-08-08T23:44:33.465 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 93 kB/s) 2024-08-08T23:44:33.466 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 98 kB/s) 2024-08-08T23:44:33.467 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 71 kB/s) 2024-08-08T23:44:33.478 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/184 kB Progress (1): 31/184 kB Progress (1): 48/184 kB Progress (1): 64/184 kB Progress (1): 80/184 kB Progress (1): 97/184 kB Progress (1): 113/184 kB Progress (1): 130/184 kB Progress (1): 146/184 kB Progress (1): 162/184 kB Progress (1): 179/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 718 kB/s) 2024-08-08T23:44:33.499 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:33.499 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-08-08T23:44:33.506 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-08-08T23:44:33.522 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-08-08T23:44:33.525 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-08-08T23:44:33.541 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-08-08T23:44:33.543 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-08-08T23:44:33.558 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-08-08T23:44:33.563 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-08-08T23:44:33.578 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-08-08T23:44:33.587 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-08-08T23:44:33.607 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 78/153 kB Progress (1): 94/153 kB Progress (1): 111/153 kB Progress (1): 127/153 kB Progress (1): 143/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-08-08T23:44:33.608 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-08-08T23:44:33.628 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 62/215 kB Progress (1): 78/215 kB Progress (1): 95/215 kB Progress (1): 111/215 kB Progress (1): 128/215 kB Progress (1): 144/215 kB Progress (1): 160/215 kB Progress (1): 177/215 kB Progress (1): 193/215 kB Progress (1): 209/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-08-08T23:44:33.724 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:33.725 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-08-08T23:44:33.731 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-08-08T23:44:33.749 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-08-08T23:44:33.752 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-08-08T23:44:33.768 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-08-08T23:44:33.773 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-08-08T23:44:33.788 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-08-08T23:44:33.793 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-08-08T23:44:33.808 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-08-08T23:44:33.813 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-08-08T23:44:33.829 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-08-08T23:44:33.832 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-08-08T23:44:33.848 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-08-08T23:44:33.857 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-08-08T23:44:33.873 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-08-08T23:44:33.878 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-08-08T23:44:33.895 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-08-08T23:44:33.899 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-08-08T23:44:33.916 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-08-08T23:44:33.922 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-08-08T23:44:33.938 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-08-08T23:44:33.942 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-08-08T23:44:33.958 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-08-08T23:44:33.962 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-08-08T23:44:33.978 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-08-08T23:44:33.984 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-08-08T23:44:34.000 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-08-08T23:44:34.006 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-08-08T23:44:34.023 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-08-08T23:44:34.034 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-08-08T23:44:34.050 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-08-08T23:44:34.053 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-08-08T23:44:34.069 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-08-08T23:44:34.075 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-08-08T23:44:34.090 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-08-08T23:44:34.096 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-08-08T23:44:34.113 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-08-08T23:44:34.114 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-08-08T23:44:34.114 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-08-08T23:44:34.114 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-08-08T23:44:34.114 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-08-08T23:44:34.115 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-08-08T23:44:34.130 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-08-08T23:44:34.130 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 8.5 kB | 16/41 kB | 16/269 kB Progress (4): 8.5 kB | 16/41 kB | 16/269 kB | 15/55 kB Progress (4): 8.5 kB | 33/41 kB | 16/269 kB | 15/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-08-08T23:44:34.130 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-08-08T23:44:34.130 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-08-08T23:44:34.131 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 33/41 kB | 32/269 kB | 15/55 kB Progress (3): 41 kB | 32/269 kB | 15/55 kB Progress (3): 41 kB | 32/269 kB | 31/55 kB Progress (3): 41 kB | 49/269 kB | 31/55 kB Progress (3): 41 kB | 65/269 kB | 31/55 kB Progress (3): 41 kB | 65/269 kB | 48/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-08-08T23:44:34.132 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 81/269 kB | 48/55 kB Progress (2): 81/269 kB | 55 kB Progress (2): 98/269 kB | 55 kB Progress (2): 114/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-08-08T23:44:34.136 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 212/269 kB Progress (1): 229/269 kB Progress (1): 245/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-08-08T23:44:34.155 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 66/327 kB Progress (2): 66/327 kB | 16/587 kB Progress (2): 82/327 kB | 16/587 kB Progress (2): 82/327 kB | 32/587 kB Progress (2): 98/327 kB | 32/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 115/327 kB | 49/587 kB Progress (2): 115/327 kB | 65/587 kB Progress (2): 131/327 kB | 65/587 kB Progress (2): 131/327 kB | 81/587 kB Progress (2): 147/327 kB | 81/587 kB Progress (2): 147/327 kB | 98/587 kB Progress (2): 164/327 kB | 98/587 kB Progress (2): 164/327 kB | 114/587 kB Progress (2): 180/327 kB | 114/587 kB Progress (2): 180/327 kB | 130/587 kB Progress (2): 197/327 kB | 130/587 kB Progress (2): 197/327 kB | 147/587 kB Progress (2): 213/327 kB | 147/587 kB Progress (2): 213/327 kB | 163/587 kB Progress (2): 229/327 kB | 163/587 kB Progress (2): 229/327 kB | 180/587 kB Progress (2): 246/327 kB | 180/587 kB Progress (2): 246/327 kB | 196/587 kB Progress (2): 256/327 kB | 196/587 kB Progress (2): 256/327 kB | 212/587 kB Progress (2): 272/327 kB | 212/587 kB Progress (2): 272/327 kB | 229/587 kB Progress (2): 289/327 kB | 229/587 kB Progress (2): 289/327 kB | 245/587 kB Progress (2): 305/327 kB | 245/587 kB Progress (2): 305/327 kB | 262/587 kB Progress (2): 321/327 kB | 262/587 kB Progress (2): 327 kB | 262/587 kB Progress (2): 327 kB | 278/587 kB Progress (2): 327 kB | 294/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.0 MB/s) 2024-08-08T23:44:34.161 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 311/587 kB Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-08-08T23:44:34.215 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-08-08T23:44:34.217 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:34.217 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-08-08T23:44:34.225 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-08-08T23:44:34.240 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-08-08T23:44:34.243 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-08-08T23:44:34.259 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-08-08T23:44:34.262 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-08-08T23:44:34.278 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.9 MB/s) 2024-08-08T23:44:34.280 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-08-08T23:44:34.295 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-08-08T23:44:34.300 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-08-08T23:44:34.316 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-08-08T23:44:34.319 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-08-08T23:44:34.336 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-08-08T23:44:34.339 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-08-08T23:44:34.355 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-08-08T23:44:34.360 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-08-08T23:44:34.375 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-08-08T23:44:34.378 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-08-08T23:44:34.394 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-08-08T23:44:34.398 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-08-08T23:44:34.414 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-08-08T23:44:34.416 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-08-08T23:44:34.433 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-08-08T23:44:34.437 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-08-08T23:44:34.452 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-08-08T23:44:34.456 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-08-08T23:44:34.471 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-08-08T23:44:34.475 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-08-08T23:44:34.490 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-08-08T23:44:34.493 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-08-08T23:44:34.509 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-08-08T23:44:34.512 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-08-08T23:44:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-08-08T23:44:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-08-08T23:44:34.546 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-08-08T23:44:34.550 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-08-08T23:44:34.565 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-08-08T23:44:34.570 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-08-08T23:44:34.585 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-08-08T23:44:34.588 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-08-08T23:44:34.604 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-08-08T23:44:34.606 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-08-08T23:44:34.622 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-08-08T23:44:34.627 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-08-08T23:44:34.643 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-08-08T23:44:34.645 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-08-08T23:44:34.661 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-08-08T23:44:34.669 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-08-08T23:44:34.685 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-08-08T23:44:34.686 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-08-08T23:44:34.686 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-08-08T23:44:34.686 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-08-08T23:44:34.687 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-08-08T23:44:34.687 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/122 kB Progress (1): 33/122 kB Progress (2): 33/122 kB | 4.2 kB Progress (2): 49/122 kB | 4.2 kB Progress (3): 49/122 kB | 4.2 kB | 16/55 kB Progress (4): 49/122 kB | 4.2 kB | 16/55 kB | 16/27 kB Progress (4): 66/122 kB | 4.2 kB | 16/55 kB | 16/27 kB Progress (4): 66/122 kB | 4.2 kB | 32/55 kB | 16/27 kB Progress (4): 66/122 kB | 4.2 kB | 32/55 kB | 27 kB Progress (4): 82/122 kB | 4.2 kB | 32/55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 82/122 kB | 49/55 kB | 27 kB Progress (4): 82/122 kB | 49/55 kB | 27 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 98/122 kB | 49/55 kB | 27 kB | 16/334 kB Progress (4): 98/122 kB | 55 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 98/122 kB | 55 kB | 33/334 kB Progress (3): 115/122 kB | 55 kB | 33/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-08-08T23:44:34.704 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 122 kB | 33/334 kB Progress (2): 122 kB | 49/334 kB Progress (2): 122 kB | 66/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-08-08T23:44:34.711 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 111/334 kB Progress (1): 127/334 kB Progress (1): 144/334 kB Progress (1): 160/334 kB Progress (1): 176/334 kB Progress (1): 193/334 kB Progress (1): 209/334 kB Progress (1): 226/334 kB Progress (1): 242/334 kB Progress (1): 258/334 kB Progress (1): 275/334 kB Progress (1): 291/334 kB Progress (1): 307/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 13 MB/s) 2024-08-08T23:44:34.719 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Progress (3): 33/267 kB | 4.7 kB | 16/23 kB Progress (3): 49/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 146 kB/s) 2024-08-08T23:44:34.719 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 49/267 kB | 23 kB Progress (2): 66/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-08-08T23:44:34.721 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 79/267 kB Progress (1): 95/267 kB Progress (1): 111/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 161/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 210/267 kB Progress (1): 226/267 kB Progress (1): 243/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-08-08T23:44:34.833 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Changes detected - recompiling the module! :source 2024-08-08T23:44:34.835 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-08-08T23:44:35.981 INFO:tasks.workunit.client.0.smithi083.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-08-08T23:44:35.982 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:35.982 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-08-08T23:44:35.986 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-08-08T23:44:35.986 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:35.986 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-08-08T23:44:35.993 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-08-08T23:44:35.993 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-08-08T23:44:36.231 INFO:tasks.workunit.client.0.smithi083.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-08-08T23:44:36.231 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:36.231 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-08-08T23:44:36.235 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-08-08T23:44:36.251 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-08-08T23:44:36.255 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-08-08T23:44:36.270 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-08-08T23:44:36.273 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-08-08T23:44:36.289 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-08-08T23:44:36.292 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-08-08T23:44:36.308 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-08-08T23:44:36.312 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-08-08T23:44:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-08-08T23:44:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-08-08T23:44:36.345 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-08-08T23:44:36.348 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-08-08T23:44:36.363 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-08-08T23:44:36.367 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-08-08T23:44:36.382 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-08-08T23:44:36.383 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-08-08T23:44:36.399 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-08-08T23:44:36.403 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-08-08T23:44:36.418 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-08-08T23:44:36.421 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-08-08T23:44:36.436 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-08-08T23:44:36.441 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-08-08T23:44:36.457 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-08-08T23:44:36.460 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-08-08T23:44:36.476 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-08-08T23:44:36.479 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-08-08T23:44:36.496 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-08-08T23:44:36.499 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-08-08T23:44:36.514 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-08-08T23:44:36.519 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-08-08T23:44:36.535 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-08-08T23:44:36.539 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-08-08T23:44:36.556 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-08-08T23:44:36.563 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-08-08T23:44:36.580 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 448 kB/s) 2024-08-08T23:44:36.586 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-08-08T23:44:36.603 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-08-08T23:44:36.610 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-08-08T23:44:36.627 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-08-08T23:44:36.633 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-08-08T23:44:36.648 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 96 kB/s) 2024-08-08T23:44:36.651 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-08-08T23:44:36.667 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 192 kB/s) 2024-08-08T23:44:36.670 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-08-08T23:44:36.686 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-08-08T23:44:36.690 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-08-08T23:44:36.707 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-08-08T23:44:36.710 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-08-08T23:44:36.726 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 904 kB/s) 2024-08-08T23:44:36.732 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-08-08T23:44:36.749 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 185 kB/s) 2024-08-08T23:44:36.752 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-08-08T23:44:36.769 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 400 kB/s) 2024-08-08T23:44:36.773 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-08-08T23:44:36.790 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 466 kB/s) 2024-08-08T23:44:36.796 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-08-08T23:44:36.813 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-08-08T23:44:36.818 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-08-08T23:44:36.835 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 139 kB/s) 2024-08-08T23:44:36.842 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-08-08T23:44:36.858 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-08-08T23:44:36.865 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-08-08T23:44:36.882 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-08-08T23:44:36.887 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-08-08T23:44:36.904 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 806 kB/s) 2024-08-08T23:44:36.911 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-08-08T23:44:36.928 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 746 kB/s) 2024-08-08T23:44:36.932 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-08-08T23:44:36.949 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-08-08T23:44:36.954 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-08-08T23:44:36.970 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-08-08T23:44:36.974 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-08-08T23:44:36.992 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.8 MB/s) 2024-08-08T23:44:36.998 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-08-08T23:44:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-08-08T23:44:37.020 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-08-08T23:44:37.036 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-08-08T23:44:37.046 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-08-08T23:44:37.066 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-08-08T23:44:37.066 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-08-08T23:44:37.083 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 283 kB/s) 2024-08-08T23:44:37.088 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-08-08T23:44:37.105 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-08-08T23:44:37.110 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-08-08T23:44:37.127 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-08-08T23:44:37.134 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-08-08T23:44:37.151 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-08-08T23:44:37.158 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-08-08T23:44:37.175 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 114 kB/s) 2024-08-08T23:44:37.181 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-08-08T23:44:37.198 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-08-08T23:44:37.205 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-08-08T23:44:37.222 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-08-08T23:44:37.227 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-08-08T23:44:37.246 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 674 kB/s) 2024-08-08T23:44:37.251 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-08-08T23:44:37.270 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.1 MB/s) 2024-08-08T23:44:37.275 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-08-08T23:44:37.291 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-08-08T23:44:37.295 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-08-08T23:44:37.312 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-08-08T23:44:37.316 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-08-08T23:44:37.332 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-08-08T23:44:37.336 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-08-08T23:44:37.351 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-08-08T23:44:37.358 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-08-08T23:44:37.375 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 406 kB/s) 2024-08-08T23:44:37.384 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-08-08T23:44:37.402 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-08-08T23:44:37.407 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-08-08T23:44:37.425 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 62/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-08-08T23:44:37.434 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-08-08T23:44:37.451 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-08-08T23:44:37.457 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-08-08T23:44:37.475 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-08-08T23:44:37.478 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-08-08T23:44:37.495 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-08-08T23:44:37.498 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-08-08T23:44:37.514 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-08-08T23:44:37.517 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-08-08T23:44:37.535 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-08-08T23:44:37.541 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-08-08T23:44:37.557 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-08-08T23:44:37.570 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-08-08T23:44:37.598 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 64/308 kB Progress (1): 81/308 kB Progress (1): 97/308 kB Progress (1): 113/308 kB Progress (1): 130/308 kB Progress (1): 146/308 kB Progress (1): 163/308 kB Progress (1): 179/308 kB Progress (1): 195/308 kB Progress (1): 212/308 kB Progress (1): 228/308 kB Progress (1): 244/308 kB Progress (1): 261/308 kB Progress (1): 277/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-08-08T23:44:37.599 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-08-08T23:44:37.599 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-08-08T23:44:37.600 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-08-08T23:44:37.601 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-08-08T23:44:37.601 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-08-08T23:44:37.618 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/171 kB Progress (1): 31/171 kB Progress (1): 48/171 kB Progress (1): 64/171 kB Progress (1): 80/171 kB Progress (1): 96/171 kB Progress (1): 113/171 kB Progress (2): 113/171 kB | 14 kB Progress (3): 113/171 kB | 14 kB | 16/26 kB Progress (3): 129/171 kB | 14 kB | 16/26 kB Progress (4): 129/171 kB | 14 kB | 16/26 kB | 16/118 kB Progress (4): 129/171 kB | 14 kB | 26 kB | 16/118 kB Progress (4): 145/171 kB | 14 kB | 26 kB | 16/118 kB Progress (4): 145/171 kB | 14 kB | 26 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 715 kB/s) 2024-08-08T23:44:37.618 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 162/171 kB | 26 kB | 33/118 kB Progress (4): 162/171 kB | 26 kB | 33/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-08-08T23:44:37.618 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 171 kB | 26 kB | 33/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-08-08T23:44:37.621 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 171 kB | 49/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-08-08T23:44:37.621 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 171 kB | 64/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.5 MB/s) 2024-08-08T23:44:37.621 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-08-08T23:44:37.621 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 430 kB/s) 2024-08-08T23:44:37.621 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-08-08T23:44:37.622 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 80/118 kB Progress (1): 96/118 kB Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-08-08T23:44:37.622 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-08-08T23:44:37.636 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 63/146 kB Progress (2): 63/146 kB | 15/61 kB Progress (2): 80/146 kB | 15/61 kB Progress (2): 80/146 kB | 31/61 kB Progress (2): 96/146 kB | 31/61 kB Progress (2): 96/146 kB | 48/61 kB Progress (3): 96/146 kB | 48/61 kB | 16/136 kB Progress (4): 96/146 kB | 48/61 kB | 16/136 kB | 16/501 kB Progress (4): 96/146 kB | 61 kB | 16/136 kB | 16/501 kB Progress (4): 113/146 kB | 61 kB | 16/136 kB | 16/501 kB Progress (4): 113/146 kB | 61 kB | 33/136 kB | 16/501 kB Progress (4): 113/146 kB | 61 kB | 33/136 kB | 33/501 kB Progress (4): 129/146 kB | 61 kB | 33/136 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-08-08T23:44:37.636 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 129/146 kB | 33/136 kB | 33/501 kB | 15/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-08-08T23:44:37.636 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 129/146 kB | 49/136 kB | 33/501 kB | 15/58 kB Progress (4): 129/146 kB | 49/136 kB | 49/501 kB | 15/58 kB Progress (4): 145/146 kB | 49/136 kB | 49/501 kB | 15/58 kB Progress (4): 146 kB | 49/136 kB | 49/501 kB | 15/58 kB Progress (4): 146 kB | 49/136 kB | 49/501 kB | 31/58 kB Progress (4): 146 kB | 66/136 kB | 49/501 kB | 31/58 kB Progress (4): 146 kB | 66/136 kB | 64/501 kB | 31/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-08-08T23:44:37.636 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-08-08T23:44:37.637 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 66/136 kB | 64/501 kB | 48/58 kB Progress (3): 82/136 kB | 64/501 kB | 48/58 kB Progress (3): 82/136 kB | 81/501 kB | 48/58 kB Progress (3): 82/136 kB | 81/501 kB | 58 kB Progress (3): 98/136 kB | 81/501 kB | 58 kB Progress (3): 98/136 kB | 97/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-08-08T23:44:37.639 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 114/136 kB | 97/501 kB Progress (2): 114/136 kB | 113/501 kB Progress (2): 130/136 kB | 113/501 kB Progress (2): 130/136 kB | 130/501 kB Progress (2): 136 kB | 130/501 kB Progress (2): 136 kB | 146/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.5 MB/s) 2024-08-08T23:44:37.646 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 195/501 kB Progress (1): 212/501 kB Progress (1): 228/501 kB Progress (1): 244/501 kB Progress (1): 261/501 kB Progress (1): 277/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 326/501 kB Progress (1): 343/501 kB Progress (1): 359/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 408/501 kB Progress (1): 425/501 kB Progress (1): 441/501 kB Progress (1): 457/501 kB Progress (1): 474/501 kB Progress (1): 490/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-08-08T23:44:37.653 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (2): 33/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 78/124 kB | 0/2.4 MB Progress (2): 78/124 kB | 0/2.4 MB Progress (2): 95/124 kB | 0/2.4 MB Progress (2): 95/124 kB | 0.1/2.4 MB Progress (2): 111/124 kB | 0.1/2.4 MB Progress (2): 111/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-08-08T23:44:37.690 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-08-08T23:44:37.824 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:37.825 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-08-08T23:44:37.828 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-08-08T23:44:37.843 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-08-08T23:44:37.846 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-08-08T23:44:37.861 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 306 kB/s) 2024-08-08T23:44:37.863 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-08-08T23:44:37.882 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-08-08T23:44:37.883 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-08-08T23:44:37.898 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-08-08T23:44:37.903 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-08-08T23:44:37.918 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-08-08T23:44:37.921 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-08-08T23:44:37.936 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 245 kB/s) 2024-08-08T23:44:37.940 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-08-08T23:44:37.956 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-08-08T23:44:37.959 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-08-08T23:44:37.974 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-08-08T23:44:37.978 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-08-08T23:44:37.994 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-08-08T23:44:38.000 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-08-08T23:44:38.016 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-08-08T23:44:38.019 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-08-08T23:44:38.035 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-08-08T23:44:38.037 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-08-08T23:44:38.053 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-08-08T23:44:38.055 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-08-08T23:44:38.072 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-08-08T23:44:38.079 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-08-08T23:44:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-08-08T23:44:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-08-08T23:44:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-08-08T23:44:38.107 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-08-08T23:44:38.108 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-08-08T23:44:38.108 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-08-08T23:44:38.143 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/26 kB Progress (2): 15/26 kB | 16/79 kB Progress (3): 15/26 kB | 16/79 kB | 16/211 kB Progress (3): 26 kB | 16/79 kB | 16/211 kB Progress (3): 26 kB | 16/79 kB | 33/211 kB Progress (3): 26 kB | 32/79 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 937 kB/s) 2024-08-08T23:44:38.144 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-08-08T23:44:38.144 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 32/79 kB | 33/211 kB | 16/58 kB Progress (3): 32/79 kB | 49/211 kB | 16/58 kB Progress (3): 49/79 kB | 49/211 kB | 16/58 kB Progress (3): 49/79 kB | 49/211 kB | 33/58 kB Progress (3): 49/79 kB | 49/211 kB | 49/58 kB Progress (3): 49/79 kB | 62/211 kB | 49/58 kB Progress (3): 65/79 kB | 62/211 kB | 49/58 kB Progress (4): 65/79 kB | 62/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 65/79 kB | 62/211 kB | 58 kB | 0/1.0 MB Progress (4): 65/79 kB | 62/211 kB | 58 kB | 0/1.0 MB Progress (4): 79 kB | 62/211 kB | 58 kB | 0/1.0 MB Progress (4): 79 kB | 78/211 kB | 58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.0 MB/s) 2024-08-08T23:44:38.144 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 79 kB | 78/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-08-08T23:44:38.144 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 79 kB | 78/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 2.7 MB/s) 2024-08-08T23:44:38.144 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.2/1.0 MB Progress (2): 144/211 kB | 0.2/1.0 MB Progress (2): 160/211 kB | 0.2/1.0 MB Progress (2): 160/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 193/211 kB | 0.2/1.0 MB Progress (2): 193/211 kB | 0.2/1.0 MB Progress (2): 209/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 6.4 MB/s) 2024-08-08T23:44:38.145 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0 MB | 49/116 kB Progress (2): 1.0 MB | 65/116 kB Progress (2): 1.0 MB | 81/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 23 MB/s) 2024-08-08T23:44:38.145 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 81/116 kB | 16/267 kB Progress (2): 98/116 kB | 16/267 kB Progress (2): 114/116 kB | 16/267 kB Progress (2): 116 kB | 16/267 kB Progress (2): 116 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-08-08T23:44:38.147 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 209/267 kB Progress (1): 225/267 kB Progress (1): 242/267 kB Progress (1): 258/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.9 MB/s) 2024-08-08T23:44:38.286 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-08-08T23:44:38.313 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:44:38.313 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] BUILD SUCCESS 2024-08-08T23:44:38.313 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:44:38.313 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Total time: 7.979 s 2024-08-08T23:44:38.313 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Finished at: 2024-08-08T23:44:38Z 2024-08-08T23:44:38.314 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:44:38.363 INFO:tasks.workunit.client.0.smithi083.stderr:+ ./mvnw test -Dtest=PutObjects 2024-08-08T23:44:38.369 INFO:tasks.workunit.client.0.smithi083.stdout:Warning: JAVA_HOME environment variable is not set. 2024-08-08T23:44:39.486 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Scanning for projects... 2024-08-08T23:44:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-08-08T23:44:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jcksum 1.0 2024-08-08T23:44:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] from pom.xml 2024-08-08T23:44:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-08-08T23:44:39.835 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:39.835 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-08-08T23:44:39.954 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-08-08T23:44:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-08-08T23:44:40.060 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Nothing to compile - all classes are up to date 2024-08-08T23:44:40.060 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:40.061 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-08-08T23:44:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-08-08T23:44:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-08-08T23:44:40.069 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Nothing to compile - all classes are up to date 2024-08-08T23:44:40.069 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:40.069 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-08-08T23:44:40.348 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-08-08T23:44:40.591 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-08-08T23:44:40.794 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-08-08T23:44:40.804 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-08-08T23:44:40.823 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-08-08T23:44:40.831 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-08-08T23:44:40.851 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.7/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 141 kB/s) 2024-08-08T23:44:40.857 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-08-08T23:44:40.875 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-08-08T23:44:40.879 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-08-08T23:44:40.898 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-08-08T23:44:40.901 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-08-08T23:44:40.920 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-08-08T23:44:40.923 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-08-08T23:44:40.941 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-08-08T23:44:40.949 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-08-08T23:44:40.977 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-08-08T23:44:40.979 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-08-08T23:44:40.979 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-08-08T23:44:40.979 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-08-08T23:44:40.980 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-08-08T23:44:40.980 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-08-08T23:44:41.025 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/169 kB Progress (1): 31/169 kB Progress (1): 48/169 kB Progress (1): 64/169 kB Progress (1): 79/169 kB Progress (1): 95/169 kB Progress (1): 111/169 kB Progress (1): 128/169 kB Progress (1): 144/169 kB Progress (1): 161/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.6 MB/s) 2024-08-08T23:44:41.033 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/103 kB Progress (2): 2.8/7.7 kB | 1.4/103 kB Progress (3): 2.8/7.7 kB | 1.4/103 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 1.4/103 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 2.8/103 kB | 1.4/18 kB Progress (3): 5.5/7.7 kB | 2.8/103 kB | 1.4/18 kB Progress (3): 5.5/7.7 kB | 2.8/103 kB | 2.8/18 kB Progress (3): 6.9/7.7 kB | 2.8/103 kB | 2.8/18 kB Progress (3): 6.9/7.7 kB | 4.1/103 kB | 2.8/18 kB Progress (3): 7.7 kB | 4.1/103 kB | 2.8/18 kB Progress (3): 7.7 kB | 4.1/103 kB | 4.1/18 kB Progress (3): 7.7 kB | 5.5/103 kB | 4.1/18 kB Progress (3): 7.7 kB | 5.5/103 kB | 5.5/18 kB Progress (3): 7.7 kB | 6.9/103 kB | 5.5/18 kB Progress (3): 7.7 kB | 6.9/103 kB | 6.9/18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-08-08T23:44:41.039 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 6.9/103 kB | 8.3/18 kB Progress (2): 8.3/103 kB | 8.3/18 kB Progress (2): 8.3/103 kB | 9.7/18 kB Progress (2): 9.7/103 kB | 9.7/18 kB Progress (2): 9.7/103 kB | 11/18 kB Progress (2): 11/103 kB | 11/18 kB Progress (2): 11/103 kB | 12/18 kB Progress (2): 12/103 kB | 12/18 kB Progress (3): 12/103 kB | 12/18 kB | 1.4/189 kB Progress (3): 14/103 kB | 12/18 kB | 1.4/189 kB Progress (3): 14/103 kB | 14/18 kB | 1.4/189 kB Progress (3): 15/103 kB | 14/18 kB | 1.4/189 kB Progress (3): 15/103 kB | 14/18 kB | 2.8/189 kB Progress (3): 16/103 kB | 14/18 kB | 2.8/189 kB Progress (3): 16/103 kB | 15/18 kB | 2.8/189 kB Progress (3): 16/103 kB | 15/18 kB | 4.1/189 kB Progress (3): 16/103 kB | 17/18 kB | 4.1/189 kB Progress (3): 16/103 kB | 17/18 kB | 5.5/189 kB Progress (3): 16/103 kB | 18 kB | 5.5/189 kB Progress (3): 32/103 kB | 18 kB | 5.5/189 kB Progress (3): 32/103 kB | 18 kB | 6.9/189 kB Progress (3): 32/103 kB | 18 kB | 8.3/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 279 kB/s) 2024-08-08T23:44:41.055 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 32/103 kB | 9.7/189 kB Progress (2): 32/103 kB | 11/189 kB Progress (2): 32/103 kB | 12/189 kB Progress (2): 32/103 kB | 14/189 kB Progress (2): 32/103 kB | 15/189 kB Progress (2): 49/103 kB | 15/189 kB Progress (2): 49/103 kB | 16/189 kB Progress (2): 49/103 kB | 18/189 kB Progress (2): 49/103 kB | 19/189 kB Progress (2): 49/103 kB | 21/189 kB Progress (2): 49/103 kB | 22/189 kB Progress (2): 65/103 kB | 22/189 kB Progress (2): 65/103 kB | 23/189 kB Progress (2): 65/103 kB | 25/189 kB Progress (2): 65/103 kB | 26/189 kB Progress (2): 65/103 kB | 27/189 kB Progress (2): 65/103 kB | 29/189 kB Progress (2): 65/103 kB | 30/189 kB Progress (2): 65/103 kB | 32/189 kB Progress (2): 65/103 kB | 33/189 kB Progress (2): 65/103 kB | 34/189 kB Progress (2): 65/103 kB | 36/189 kB Progress (2): 65/103 kB | 37/189 kB Progress (2): 65/103 kB | 38/189 kB Progress (2): 65/103 kB | 40/189 kB Progress (2): 65/103 kB | 41/189 kB Progress (2): 65/103 kB | 43/189 kB Progress (2): 65/103 kB | 44/189 kB Progress (2): 65/103 kB | 45/189 kB Progress (2): 65/103 kB | 47/189 kB Progress (2): 65/103 kB | 48/189 kB Progress (2): 65/103 kB | 49/189 kB Progress (2): 65/103 kB | 51/189 kB Progress (2): 65/103 kB | 52/189 kB Progress (2): 65/103 kB | 54/189 kB Progress (2): 65/103 kB | 55/189 kB Progress (2): 65/103 kB | 56/189 kB Progress (2): 65/103 kB | 58/189 kB Progress (2): 65/103 kB | 59/189 kB Progress (2): 81/103 kB | 59/189 kB Progress (2): 81/103 kB | 61/189 kB Progress (2): 81/103 kB | 61/189 kB Progress (2): 98/103 kB | 61/189 kB Progress (2): 103 kB | 61/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-08-08T23:44:41.067 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 78/189 kB Progress (1): 94/189 kB Progress (1): 111/189 kB Progress (1): 127/189 kB Progress (1): 143/189 kB Progress (1): 160/189 kB Progress (1): 176/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-08-08T23:44:41.086 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:44:41.086 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------- 2024-08-08T23:44:41.086 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] T E S T S 2024-08-08T23:44:41.086 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------- 2024-08-08T23:44:41.662 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-08-08T23:44:41.751 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjects.java: starting test run: 2024-08-08T23:44:41.752 INFO:tasks.workunit.client.0.smithi083.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-08-08T23:44:41.752 INFO:tasks.workunit.client.0.smithi083.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-08-08T23:44:41.752 INFO:tasks.workunit.client.0.smithi083.stdout: EndpointUrl=http://smithi083.front.sepia.ceph.com:80 2024-08-08T23:44:41.752 INFO:tasks.workunit.client.0.smithi083.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-08-08T23:44:41.945 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Environment Variables Read 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: S3 Client Initialized 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.248 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.249 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.249 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-08-08T23:44:42.249 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-08-08T23:44:42.249 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generated Big Files 2024-08-08T23:44:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:HeadBucketResponse() 2024-08-08T23:44:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:sheik is ready 2024-08-08T23:44:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Test Bucket Created 2024-08-08T23:44:42.747 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-0b 2024-08-08T23:44:43.048 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-8b 2024-08-08T23:44:43.349 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-200b 2024-08-08T23:44:43.549 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-21983b 2024-08-08T23:44:43.850 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-5519b 2024-08-08T23:44:44.151 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-204329b 2024-08-08T23:44:44.451 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-256k 2024-08-08T23:44:44.752 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-1m 2024-08-08T23:44:45.353 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-08-08T23:44:46.155 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-08-08T23:44:51.567 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-08-08T23:44:58.081 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-08-08T23:45:40.415 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-0b 2024-08-08T23:45:40.416 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-8b 2024-08-08T23:45:40.418 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-200b 2024-08-08T23:45:40.418 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-21983b 2024-08-08T23:45:40.419 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-5519b 2024-08-08T23:45:40.422 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-204329b 2024-08-08T23:45:40.423 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-256k 2024-08-08T23:45:40.423 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-1m 2024-08-08T23:45:40.425 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-1038757b 2024-08-08T23:45:40.449 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-0b 2024-08-08T23:45:40.649 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:40.750 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-8b 2024-08-08T23:45:40.850 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:41.051 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-200b 2024-08-08T23:45:41.150 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:41.251 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-21983b 2024-08-08T23:45:41.451 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:41.551 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-5519b 2024-08-08T23:45:41.751 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:41.852 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-204329b 2024-08-08T23:45:42.051 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-256k 2024-08-08T23:45:42.352 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:42.452 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-1m 2024-08-08T23:45:42.953 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:43.153 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-1038757b 2024-08-08T23:45:43.554 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-08-08T23:45:43.855 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-5m 2024-08-08T23:45:46.258 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-10m 2024-08-08T23:45:50.664 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-100m 2024-08-08T23:46:29.020 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 107.3 s -- in io.ceph.jcksum.PutObjects 2024-08-08T23:46:29.054 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:46:29.054 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Results: 2024-08-08T23:46:29.054 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:46:29.054 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-08-08T23:46:29.054 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-08-08T23:46:29.056 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:46:29.056 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] BUILD SUCCESS 2024-08-08T23:46:29.056 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:46:29.057 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Total time: 01:49 min 2024-08-08T23:46:29.057 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Finished at: 2024-08-08T23:46:29Z 2024-08-08T23:46:29.057 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-08T23:46:29.095 INFO:tasks.workunit.client.0.smithi083.stderr:+ exit 2024-08-08T23:46:29.095 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:46:29.096 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:46:29.152 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-08-08T23:46:29.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-08T23:46:29.523 DEBUG:teuthology.parallel:result is None 2024-08-08T23:46:29.523 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:46:29.535 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:46:29.536 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:46:29.583 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:46:29.583 INFO:teuthology.run_tasks:Running task workunit... 2024-08-08T23:46:29.593 INFO:tasks.workunit:Pulling workunits from ref 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:46:29.593 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-08T23:46:29.594 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:46:29.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:46:29.632 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-08T23:46:29.632 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:46:29.679 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-08T23:46:29.680 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-08T23:46:29.727 INFO:tasks.workunit:timeout=3h 2024-08-08T23:46:29.727 INFO:tasks.workunit:cleanup=True 2024-08-08T23:46:29.730 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:46:29.777 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-08T23:47:16.118 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '0a88632b45f25ae38493667c7dbd155f6e59b499'. 2024-08-08T23:47:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.118 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-08T23:47:16.118 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-08T23:47:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:47:16.120 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 0a88632b45f Merge branch 'wip-67364-squid' of https://github.com/yuvalif/ceph into wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:47:16.125 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-08T23:47:16.174 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-08T23:47:16.176 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:47:16.176 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-08T23:47:16.237 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-08T23:47:16.296 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-08T23:47:16.341 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:47:16.342 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:47:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-08T23:47:16.389 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:47:16.395 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:47:16.395 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-08T23:47:16.444 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-08-08T23:47:16.445 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-08-08T23:47:16.445 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-08-08T23:47:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:INFO: fully qualified domain name: smithi083.front.sepia.ceph.com 2024-08-08T23:47:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-08-08T23:47:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:== TESTING VERSIONED BUCKET == 2024-08-08T23:47:19.721 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-08T23:47:19.921 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-08-08T23:47:19.927 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-08T23:47:19.961 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-08-08T23:47:19.961 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-08-08T23:47:19.961 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 22.0.2 2024-08-08T23:47:20.217 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-22.0.2: 2024-08-08T23:47:20.223 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-22.0.2 2024-08-08T23:47:20.964 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-08-08T23:47:21.994 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-08-08T23:47:21.995 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached boto3-1.34.157-py3-none-any.whl.metadata (6.6 kB) 2024-08-08T23:47:22.503 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.35.0,>=1.34.157 (from boto3) 2024-08-08T23:47:22.504 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached botocore-1.34.157-py3-none-any.whl.metadata (5.7 kB) 2024-08-08T23:47:22.555 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-08T23:47:22.556 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-08T23:47:22.601 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-08T23:47:22.603 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-08T23:47:22.654 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:47:22.655 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-08T23:47:22.755 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:47:22.756 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-08T23:47:23.010 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:47:23.011 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-08T23:47:23.016 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached boto3-1.34.157-py3-none-any.whl (139 kB) 2024-08-08T23:47:23.017 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached botocore-1.34.157-py3-none-any.whl (12.5 MB) 2024-08-08T23:47:23.029 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-08T23:47:23.031 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-08T23:47:23.033 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-08T23:47:23.034 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-08T23:47:23.036 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-08T23:47:23.115 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-08T23:47:24.224 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.34.157 botocore-1.34.157 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-08T23:47:24.569 INFO:tasks.workunit.client.0.smithi083.stdout:INFO: creating user 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "testid", 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "M. Tester", 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "tester@ceph.com", 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-08-08T23:47:24.928 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "testid", 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "0555b35654ad1656d804", 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:47:24.919106Z" 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-08-08T23:47:24.929 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-08-08T23:47:24.930 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-08-08T23:47:24.919079Z", 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-08-08T23:47:24.931 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-08-08T23:47:25.397 INFO:tasks.workunit.client.0.smithi083.stderr:5+0 records in 2024-08-08T23:47:25.397 INFO:tasks.workunit.client.0.smithi083.stderr:5+0 records out 2024-08-08T23:47:25.397 INFO:tasks.workunit.client.0.smithi083.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0220507 s, 238 MB/s 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:bucket nams is reupload-bkt-124295 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:endpoint is http://smithi083.front.sepia.ceph.com:80 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:start UploadId=2~49RzsAzx2UMmwYSF4v7jB5R9TfYxRa6 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 2} 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.503 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1} 2024-08-08T23:48:05.504 INFO:tasks.workunit.client.0.smithi083.stdout:aborting multipart upload, parts=[{'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 1}, {'ETag': '"aaf4868c86677af68151a44ea4702a5e"', 'PartNumber': 2}] 2024-08-08T23:48:07.144 INFO:tasks.workunit.client.0.smithi083.stdout:radosgw-admin bucket radoslist: 2024-08-08T23:48:07.229 INFO:tasks.workunit.client.0.smithi083.stdout:rados ls: 2024-08-08T23:48:07.248 INFO:tasks.workunit.client.0.smithi083.stdout:== PASSED == 2024-08-08T23:48:07.248 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:48:07.249 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:48:07.302 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-08-08T23:48:07.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-08T23:48:07.734 DEBUG:teuthology.parallel:result is None 2024-08-08T23:48:07.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:48:07.746 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:48:07.746 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:48:07.792 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:48:07.792 INFO:teuthology.run_tasks:Running task ragweed... 2024-08-08T23:48:07.809 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-squid', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-08-08T23:48:07.810 INFO:tasks.ragweed:Downloading ragweed... 2024-08-08T23:48:07.810 INFO:tasks.ragweed:Using branch 'wip-yuri7-testing-2024-08-08-0804-squid' for ragweed 2024-08-08T23:48:07.810 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b wip-yuri7-testing-2024-08-08-0804-squid https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-08-08T23:48:07.840 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-08-08T23:48:07.899 INFO:teuthology.orchestra.run.smithi083.stderr:fatal: Remote branch wip-yuri7-testing-2024-08-08-0804-squid not found in upstream origin 2024-08-08T23:48:07.900 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-08-08T23:48:07.901 INFO:tasks.ragweed:Using branch 'ceph-squid' for ragweed 2024-08-08T23:48:07.901 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b ceph-squid https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-08-08T23:48:07.948 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-08-08T23:48:08.138 INFO:tasks.ragweed:Creating rgw users... 2024-08-08T23:48:08.138 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-08-08T23:48:08.138 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key ZBYVWPQXRRTIANJGVWVI --secret 9/b3GKi2PMs+IDHyuDmQ5oTbbwTumLRjOnMjcF3joCRmJ8Xq3CfiaQ== --email ragweed.client.0+test@test.test --system false 2024-08-08T23:48:08.226 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:48:08.226 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:48:08.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.267+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 realm 2024-08-08T23:48:08.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:48:08.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:48:08.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.271+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.275+0000 7ff794919980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:48:08.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.275+0000 7ff794919980 20 searching for the correct realm 2024-08-08T23:48:08.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.275+0000 7ff792c2e640 0 -- 172.21.15.83:0/1462542412 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff7880ef530 msgr2=0x7ff788104a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:48:08.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.491+0000 7ff791c2c640 0 -- 172.21.15.83:0/1462542412 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff78c07bc00 msgr2=0x7ff78c05d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:48:08.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:48:08.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:48:08.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:48:08.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.707+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:48:08.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 zone default found 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 4 Realm: () 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 zonegroup default 2024-08-08T23:48:08.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 started sync module instance, tier type = 2024-08-08T23:48:08.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.711+0000 7ff794919980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:48:08.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=0 2024-08-08T23:48:08.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=1 2024-08-08T23:48:08.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=2 2024-08-08T23:48:08.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=3 2024-08-08T23:48:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=4 2024-08-08T23:48:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=5 2024-08-08T23:48:08.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.739+0000 7ff794919980 20 add_watcher() i=6 2024-08-08T23:48:08.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.743+0000 7ff794919980 20 add_watcher() i=7 2024-08-08T23:48:08.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.743+0000 7ff794919980 2 all 8 watchers are set, enabling cache 2024-08-08T23:48:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff648fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:48:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:48:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:48:08.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 5 note: GC not initialized 2024-08-08T23:48:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff5c37fe640 20 reqs_thread_entry: start 2024-08-08T23:48:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 init_complete bucket index max shards: 1 2024-08-08T23:48:08.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 Filter name: none 2024-08-08T23:48:08.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff5c17fa640 20 reqs_thread_entry: start 2024-08-08T23:48:08.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-08-08T23:48:08.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.747+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 cache get: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI : miss 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI info.flags=0x0 2024-08-08T23:48:08.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 adding default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI to cache LRU end 2024-08-08T23:48:08.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 cache get: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI : hit (negative entry) 2024-08-08T23:48:08.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.751+0000 7ff794919980 10 cache get: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI : hit (negative entry) 2024-08-08T23:48:08.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-08-08T23:48:08.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff794919980 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-08T23:48:08.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff794919980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-08-08T23:48:08.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff6757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595095 cookie 94761334993408 notifier 5603 bl.length()=675 2024-08-08T23:48:08.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff6757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-08-08T23:48:08.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.755+0000 7ff6757fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-08T23:48:08.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-08-08T23:48:08.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff794919980 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-08T23:48:08.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff794919980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-08-08T23:48:08.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff6757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595087 cookie 94761334989360 notifier 5603 bl.length()=202 2024-08-08T23:48:08.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff6757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-08-08T23:48:08.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.759+0000 7ff6757fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-08T23:48:08.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff794919980 10 cache put: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI info.flags=0x7 2024-08-08T23:48:08.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff794919980 10 moving default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI to cache LRU end 2024-08-08T23:48:08.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff794919980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZBYVWPQXRRTIANJGVWVI, ofs0, ns] 2024-08-08T23:48:08.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff6757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595096 cookie 94761334993408 notifier 5603 bl.length()=190 2024-08-08T23:48:08.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff6757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI info.flags=0x7 2024-08-08T23:48:08.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.767+0000 7ff6757fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZBYVWPQXRRTIANJGVWVI to cache LRU end 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "ragweed.client.0", 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr. ragweed.client.0", 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "ragweed.client.0+test@test.test", 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "ragweed.client.0", 2024-08-08T23:48:08.769 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "ZBYVWPQXRRTIANJGVWVI", 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "9/b3GKi2PMs+IDHyuDmQ5oTbbwTumLRjOnMjcF3joCRmJ8Xq3CfiaQ==", 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:48:08.756126Z" 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-08T23:48:08.770 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:48:08.771 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:48:08.756103Z", 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-08T23:48:08.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:48:08.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.771+0000 7ff648fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:48:08.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.779+0000 7ff794919980 20 remove_watcher() i=0 2024-08-08T23:48:08.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.779+0000 7ff794919980 2 removed watcher, disabling cache 2024-08-08T23:48:08.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.779+0000 7ff794919980 20 remove_watcher() i=1 2024-08-08T23:48:08.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.783+0000 7ff794919980 20 remove_watcher() i=2 2024-08-08T23:48:08.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.783+0000 7ff794919980 20 remove_watcher() i=3 2024-08-08T23:48:08.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.787+0000 7ff794919980 20 remove_watcher() i=4 2024-08-08T23:48:08.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.787+0000 7ff794919980 20 remove_watcher() i=5 2024-08-08T23:48:08.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.791+0000 7ff794919980 20 remove_watcher() i=6 2024-08-08T23:48:08.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.791+0000 7ff794919980 20 remove_watcher() i=7 2024-08-08T23:48:08.813 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-08-08T23:48:08.813 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ECRNZUOUCVMBNSBGXHLA --secret TLgkY4uJj14lzYSst84NiIGL7IK4q/ZUjTLluwgf1GlOapy+Dl6f1Q== --email sysuser.client.0+test@test.test --system true 2024-08-08T23:48:08.860 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:48:08.860 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:48:08.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 realm 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:08.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.903+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.907+0000 7fc80a58e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:48:08.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.907+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:08.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.907+0000 7fc80a58e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:48:08.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.907+0000 7fc80a58e980 20 searching for the correct realm 2024-08-08T23:48:08.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:08.911+0000 7fc8088a3640 0 -- 172.21.15.83:0/3393261531 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc7fc0e7040 msgr2=0x7fc7fc0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:48:09.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.127+0000 7fc8078a1640 0 -- 172.21.15.83:0/3393261531 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc80007cbe0 msgr2=0x7fc80008e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:48:09.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:48:09.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.343+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:48:09.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:48:09.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 zone default found 2024-08-08T23:48:09.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 4 Realm: () 2024-08-08T23:48:09.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:48:09.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:48:09.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:48:09.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 zonegroup default 2024-08-08T23:48:09.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 started sync module instance, tier type = 2024-08-08T23:48:09.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.347+0000 7fc80a58e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:48:09.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=0 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=1 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=2 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=3 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=4 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=5 2024-08-08T23:48:09.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=6 2024-08-08T23:48:09.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 20 add_watcher() i=7 2024-08-08T23:48:09.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.371+0000 7fc80a58e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:48:09.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.375+0000 7fc6befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:48:09.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.375+0000 7fc80a58e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:48:09.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.375+0000 7fc80a58e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:48:09.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.375+0000 7fc80a58e980 5 note: GC not initialized 2024-08-08T23:48:09.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc6bdfdb640 20 reqs_thread_entry: start 2024-08-08T23:48:09.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 init_complete bucket index max shards: 1 2024-08-08T23:48:09.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 Filter name: none 2024-08-08T23:48:09.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc62f7fe640 20 reqs_thread_entry: start 2024-08-08T23:48:09.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-08-08T23:48:09.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-08-08T23:48:09.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-08T23:48:09.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-08-08T23:48:09.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache get: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA : miss 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados->read ofs=0 len=0 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA info.flags=0x0 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 adding default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA to cache LRU end 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache get: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA : hit (negative entry) 2024-08-08T23:48:09.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.379+0000 7fc80a58e980 10 cache get: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA : hit (negative entry) 2024-08-08T23:48:09.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-08-08T23:48:09.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc80a58e980 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-08T23:48:09.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc80a58e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-08-08T23:48:09.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc6df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 93945027027824 notifier 5856 bl.length()=675 2024-08-08T23:48:09.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc6df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-08-08T23:48:09.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.383+0000 7fc6df7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-08T23:48:09.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.387+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-08-08T23:48:09.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.387+0000 7fc80a58e980 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-08T23:48:09.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.387+0000 7fc80a58e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-08-08T23:48:09.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.391+0000 7fc6deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595097 cookie 93945027019792 notifier 5856 bl.length()=202 2024-08-08T23:48:09.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.391+0000 7fc6deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-08-08T23:48:09.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.391+0000 7fc6deffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-08T23:48:09.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc80a58e980 10 cache put: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA info.flags=0x7 2024-08-08T23:48:09.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc80a58e980 10 moving default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA to cache LRU end 2024-08-08T23:48:09.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc80a58e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ECRNZUOUCVMBNSBGXHLA, ofs0, ns] 2024-08-08T23:48:09.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc6deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 93945027019792 notifier 5856 bl.length()=190 2024-08-08T23:48:09.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc6deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA info.flags=0x7 2024-08-08T23:48:09.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.395+0000 7fc6deffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ECRNZUOUCVMBNSBGXHLA to cache LRU end 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "sysuser.client.0", 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr. sysuser.client.0", 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "sysuser.client.0+test@test.test", 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-08T23:48:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "sysuser.client.0", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "ECRNZUOUCVMBNSBGXHLA", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "TLgkY4uJj14lzYSst84NiIGL7IK4q/ZUjTLluwgf1GlOapy+Dl6f1Q==", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:48:09.385920Z" 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "system": true, 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:48:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:48:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:48:09.385893Z", 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-08T23:48:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:48:09.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.399+0000 7fc6befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:48:09.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.403+0000 7fc80a58e980 20 remove_watcher() i=0 2024-08-08T23:48:09.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.403+0000 7fc80a58e980 2 removed watcher, disabling cache 2024-08-08T23:48:09.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.403+0000 7fc80a58e980 20 remove_watcher() i=1 2024-08-08T23:48:09.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.407+0000 7fc80a58e980 20 remove_watcher() i=2 2024-08-08T23:48:09.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.411+0000 7fc80a58e980 20 remove_watcher() i=3 2024-08-08T23:48:09.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.411+0000 7fc80a58e980 20 remove_watcher() i=4 2024-08-08T23:48:09.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.415+0000 7fc80a58e980 20 remove_watcher() i=5 2024-08-08T23:48:09.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.415+0000 7fc80a58e980 20 remove_watcher() i=6 2024-08-08T23:48:09.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:48:09.415+0000 7fc80a58e980 20 remove_watcher() i=7 2024-08-08T23:48:09.431 INFO:tasks.ragweed:Configuring ragweed... 2024-08-08T23:48:09.432 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:48:09.432 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-08-08T23:48:09.480 INFO:tasks.ragweed:Configuring boto... 2024-08-08T23:48:09.481 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:48:09.481 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-08-08T23:48:09.533 DEBUG:teuthology.orchestra.run.smithi083:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-08-08T23:48:09.721 INFO:teuthology.orchestra.run.smithi083.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-08-08T23:48:09.904 INFO:teuthology.orchestra.run.smithi083.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-08-08T23:48:10.454 INFO:teuthology.orchestra.run.smithi083.stdout:py installdeps: -rrequirements.txt 2024-08-08T23:48:13.187 INFO:teuthology.orchestra.run.smithi083.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-08-08T23:48:15.335 INFO:teuthology.orchestra.run.smithi083.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=9b136d81544ee35a5128177b6905102a86407544a84001478c94290207dad150,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-08-08T23:48:15.336 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test-pre: PYTHONHASHSEED='1082418874' 2024-08-08T23:48:15.336 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-08-08T23:48:15.506 INFO:teuthology.orchestra.run.smithi083.stdout:============================= test session starts ============================== 2024-08-08T23:48:15.506 INFO:teuthology.orchestra.run.smithi083.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-08-08T23:48:15.507 INFO:teuthology.orchestra.run.smithi083.stdout:cachedir: .tox/py/.pytest_cache 2024-08-08T23:48:15.507 INFO:teuthology.orchestra.run.smithi083.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-08-08T23:48:15.648 INFO:teuthology.orchestra.run.smithi083.stdout:collecting ... collected 9 items 2024-08-08T23:48:15.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:48:19.996 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-08-08T23:48:23.528 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-08-08T23:48:26.917 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-08-08T23:48:32.470 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-08-08T23:48:36.046 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-08-08T23:48:47.646 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-08-08T23:48:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-08-08T23:49:08.228 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-08-08T23:49:25.864 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout:=============================== warnings summary =============================== 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout: import imp 2024-08-08T23:49:25.865 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:49:25.866 INFO:teuthology.orchestra.run.smithi083.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-08-08T23:49:25.866 INFO:teuthology.orchestra.run.smithi083.stdout:=================== 9 passed, 1 warning in 70.36s (0:01:10) ==================== 2024-08-08T23:49:25.918 INFO:teuthology.orchestra.run.smithi083.stdout:___________________________________ summary ____________________________________ 2024-08-08T23:49:25.918 INFO:teuthology.orchestra.run.smithi083.stdout: py: commands succeeded 2024-08-08T23:49:25.918 INFO:teuthology.orchestra.run.smithi083.stdout: congratulations :) 2024-08-08T23:49:25.947 INFO:tasks.ragweed:Cleaning up boto... 2024-08-08T23:49:25.947 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-08-08T23:49:25.953 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-08-08T23:49:26.034 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:49:26.035 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:49:26.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.081+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 realm 2024-08-08T23:49:26.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:49:26.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:49:26.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:49:26.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.085+0000 7f22115b5980 20 searching for the correct realm 2024-08-08T23:49:26.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.089+0000 7f220f8ca640 0 -- 172.21.15.83:0/4034737713 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f220407b040 msgr2=0x7f2204055ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:49:26.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.305+0000 7f220e8c8640 0 -- 172.21.15.83:0/4034737713 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f2200083ff0 msgr2=0x7f2200074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:49:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:49:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:49:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.521+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 zone default found 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 4 Realm: () 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 zonegroup default 2024-08-08T23:49:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 started sync module instance, tier type = 2024-08-08T23:49:26.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.525+0000 7f22115b5980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:49:26.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=0 2024-08-08T23:49:26.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=1 2024-08-08T23:49:26.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=2 2024-08-08T23:49:26.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=3 2024-08-08T23:49:26.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=4 2024-08-08T23:49:26.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=5 2024-08-08T23:49:26.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.549+0000 7f22115b5980 20 add_watcher() i=6 2024-08-08T23:49:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.553+0000 7f22115b5980 20 add_watcher() i=7 2024-08-08T23:49:26.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.553+0000 7f22115b5980 2 all 8 watchers are set, enabling cache 2024-08-08T23:49:26.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.557+0000 7f20c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:49:26.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.557+0000 7f22115b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:49:26.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.557+0000 7f22115b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:49:26.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f20c57e2640 20 reqs_thread_entry: start 2024-08-08T23:49:26.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 20 init_complete bucket index max shards: 1 2024-08-08T23:49:26.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 20 Filter name: none 2024-08-08T23:49:26.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f20be7fc640 20 reqs_thread_entry: start 2024-08-08T23:49:26.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-08-08T23:49:26.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=486 2024-08-08T23:49:26.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-08-08T23:49:26.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-08T23:49:26.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.653+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 : miss 2024-08-08T23:49:26.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=418 2024-08-08T23:49:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 info.flags=0x17 2024-08-08T23:49:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 to cache LRU end 2024-08-08T23:49:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-08-08T23:49:26.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5564e5d8ede8 s->prefetch_data=0 2024-08-08T23:49:26.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 10 manifest: total_size = 13071 2024-08-08T23:49:26.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2261912897050542801 2024-08-08T23:49:26.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5564e5d8ede8 s->prefetch_data=0 2024-08-08T23:49:26.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8ede8 2024-08-08T23:49:26.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.657+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.661+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5564e5d8ede8 s->prefetch_data=0 2024-08-08T23:49:26.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f22115b5980 10 manifest: total_size = 13085 2024-08-08T23:49:26.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17513110351056713106 2024-08-08T23:49:26.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5564e5d8ede8 s->prefetch_data=0 2024-08-08T23:49:26.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8ede8 2024-08-08T23:49:26.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.665+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-08-08T23:49:26.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 10 manifest: total_size = 5122 2024-08-08T23:49:26.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17109769302755072860 2024-08-08T23:49:26.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.669+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-08-08T23:49:26.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 10 manifest: total_size = 4867 2024-08-08T23:49:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10652474459136479808 2024-08-08T23:49:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.673+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.677+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-08-08T23:49:26.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 10 manifest: total_size = 13549 2024-08-08T23:49:26.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3393266305665816925 2024-08-08T23:49:26.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.681+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-08-08T23:49:26.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 10 manifest: total_size = 5004 2024-08-08T23:49:26.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17458987683121609122 2024-08-08T23:49:26.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.685+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-08-08T23:49:26.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 10 manifest: total_size = 7867 2024-08-08T23:49:26.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10614585810139318613 2024-08-08T23:49:26.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.689+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.693+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-08-08T23:49:26.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.693+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f22115b5980 10 manifest: total_size = 15938 2024-08-08T23:49:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9489750836351948654 2024-08-08T23:49:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200015e80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.697+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-08-08T23:49:26.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d95470 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 10 manifest: total_size = 5343 2024-08-08T23:49:26.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6053923764670634860 2024-08-08T23:49:26.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d95470 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5564e5d8e8d8 s->prefetch_data=0 2024-08-08T23:49:26.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e8d8 2024-08-08T23:49:26.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5.0 2024-08-08T23:49:26.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.701+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-08-08T23:49:26.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.705+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:26.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.705+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:26.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-08-08T23:49:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:26.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-08-08T23:49:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=204 2024-08-08T23:49:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-08-08T23:49:26.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.709+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-08-08T23:49:26.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.713+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-08-08T23:49:26.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.713+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-08-08T23:49:26.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.713+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 93891841077024 notifier 5886 bl.length()=162 2024-08-08T23:49:26.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.721+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 from cache 2024-08-08T23:49:26.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.721+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5, ofs0, ns] 2024-08-08T23:49:26.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.721+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 93891841077024 notifier 5886 bl.length()=219 2024-08-08T23:49:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.725+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 : miss 2024-08-08T23:49:26.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.725+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.725+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.725+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 info.flags=0x0 2024-08-08T23:49:26.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.725+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5 to cache LRU end 2024-08-08T23:49:26.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.729+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 : miss 2024-08-08T23:49:26.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.729+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=449 2024-08-08T23:49:26.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 info.flags=0x17 2024-08-08T23:49:26.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 to cache LRU end 2024-08-08T23:49:26.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 2024-08-08T23:49:26.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo 2024-08-08T23:49:26.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d95470 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5564e5d8a598 s->prefetch_data=0 2024-08-08T23:49:26.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 10 manifest: total_size = 26083 2024-08-08T23:49:26.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15997185950050351804 2024-08-08T23:49:26.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d95470 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5564e5d8a598 s->prefetch_data=0 2024-08-08T23:49:26.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8a598 2024-08-08T23:49:26.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.733+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12.0 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7673 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7669 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=4 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4201977 part_ofs=7673 rule->part_size=7669 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7674 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7674 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-08-08T23:49:26.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4217320 part_ofs=23016 rule->part_size=3067 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15997185950050351804 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.1 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.2 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.3 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.4 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15997185950050351804 2024-08-08T23:49:26.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.737+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo 2024-08-08T23:49:26.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:26.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:26.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:26.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:26.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:26.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:26.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:26.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-08-08T23:49:26.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.741+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.745+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=235 2024-08-08T23:49:26.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.745+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-08-08T23:49:26.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.745+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-08-08T23:49:26.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.745+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-08-08T23:49:26.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.745+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-08-08T23:49:26.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.749+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 93891841074512 notifier 5886 bl.length()=191 2024-08-08T23:49:26.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.753+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 from cache 2024-08-08T23:49:26.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.753+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12, ofs0, ns] 2024-08-08T23:49:26.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.753+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 93891841084992 notifier 5886 bl.length()=249 2024-08-08T23:49:26.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.761+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 : miss 2024-08-08T23:49:26.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.761+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.761+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.761+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 info.flags=0x0 2024-08-08T23:49:26.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.761+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12 to cache LRU end 2024-08-08T23:49:26.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 : miss 2024-08-08T23:49:26.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=456 2024-08-08T23:49:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 info.flags=0x17 2024-08-08T23:49:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 to cache LRU end 2024-08-08T23:49:26.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d91930 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5564e5d8e748 s->prefetch_data=0 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 10 manifest: total_size = 1667 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8806665927140681536 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d91930 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5564e5d8e748 s->prefetch_data=0 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e748 2024-08-08T23:49:26.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.765+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13.0 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8806665927140681536 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.1 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.2 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.3 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.4 2024-08-08T23:49:26.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-08-08T23:49:26.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8806665927140681536 2024-08-08T23:49:26.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:26.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.773+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:26.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo 2024-08-08T23:49:26.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:26.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:26.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:26.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:26.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:26.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-08-08T23:49:26.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.777+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.781+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=242 2024-08-08T23:49:26.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.781+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-08-08T23:49:26.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.781+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-08-08T23:49:26.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.785+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-08-08T23:49:26.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.785+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-08-08T23:49:26.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.785+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333463 cookie 93891841084992 notifier 5886 bl.length()=198 2024-08-08T23:49:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.789+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 from cache 2024-08-08T23:49:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.789+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13, ofs0, ns] 2024-08-08T23:49:26.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.789+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333447 cookie 93891841100656 notifier 5886 bl.length()=256 2024-08-08T23:49:26.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.793+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 : miss 2024-08-08T23:49:26.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.793+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.797+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.797+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 info.flags=0x0 2024-08-08T23:49:26.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.797+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13 to cache LRU end 2024-08-08T23:49:26.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 : miss 2024-08-08T23:49:26.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=451 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 info.flags=0x17 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 to cache LRU end 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 2024-08-08T23:49:26.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo[aEzyeGCjW0HsmRvWQ1oz6jOq5tT0WAC] 2024-08-08T23:49:26.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.801+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.805+0000 7f22115b5980 20 get_obj_state: octx=0x7f220000bef0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.805+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to b6ri1wo0be9jo21lpcpgvp61gh7vjkob 2024-08-08T23:49:26.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.805+0000 7f22115b5980 20 get_obj_state_impl: setting s->olh_tag to ek0v5n5msjtz03ro3kzt46hbq7azun7a 2024-08-08T23:49:26.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.805+0000 7f22115b5980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ek0v5n5msjtz03ro3kzt46hbq7azun7a 2024-08-08T23:49:26.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.805+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.809+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.809+0000 7f22115b5980 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-08-08T23:49:26.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.809+0000 7f22115b5980 20 olh_log_entry: epoch=3 op=3 key=foo[aEzyeGCjW0HsmRvWQ1oz6jOq5tT0WAC] 2024-08-08T23:49:26.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.809+0000 7f22115b5980 20 get_obj_state: octx=0x7f220000bef0 obj=test-client.0-r-test-multipart-index-versioning.1:_:aEzyeGCjW0HsmRvWQ1oz6jOq5tT0WAC_foo state=0x5564e5da0e98 s->prefetch_data=0 2024-08-08T23:49:26.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.813+0000 7f22115b5980 10 manifest: total_size = 1667 2024-08-08T23:49:26.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.813+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11894868164724224001 2024-08-08T23:49:26.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.813+0000 7f22115b5980 20 get_obj_state: octx=0x7f220000bef0 obj=test-client.0-r-test-multipart-index-versioning.1:_:aEzyeGCjW0HsmRvWQ1oz6jOq5tT0WAC_foo state=0x5564e5da0e98 s->prefetch_data=0 2024-08-08T23:49:26.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.813+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5da0e98 2024-08-08T23:49:26.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.813+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-08-08T23:49:26.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11894868164724224001 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.1 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.2 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.3 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-08-08T23:49:26.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.4 2024-08-08T23:49:26.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-08-08T23:49:26.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11894868164724224001 2024-08-08T23:49:26.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.821+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo[aEzyeGCjW0HsmRvWQ1oz6jOq5tT0WAC] 2024-08-08T23:49:26.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.825+0000 7f22115b5980 20 get_obj_state: octx=0x7f220000bef0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.829+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11.0 2024-08-08T23:49:26.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:26.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:26.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:26.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:26.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:26.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:26.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.833+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:26.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.837+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-08-08T23:49:26.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.837+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.837+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=237 2024-08-08T23:49:26.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.837+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-08-08T23:49:26.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.837+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-08-08T23:49:26.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.841+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-08-08T23:49:26.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.841+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-08-08T23:49:26.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.841+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 93891841084992 notifier 5886 bl.length()=193 2024-08-08T23:49:26.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.845+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 from cache 2024-08-08T23:49:26.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.845+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11, ofs0, ns] 2024-08-08T23:49:26.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.849+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333458 cookie 93891841092672 notifier 5886 bl.length()=251 2024-08-08T23:49:26.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.853+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 : miss 2024-08-08T23:49:26.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.853+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.853+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.853+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 info.flags=0x0 2024-08-08T23:49:26.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.853+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11 to cache LRU end 2024-08-08T23:49:26.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.857+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 : miss 2024-08-08T23:49:26.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.857+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=441 2024-08-08T23:49:26.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 info.flags=0x17 2024-08-08T23:49:26.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 to cache LRU end 2024-08-08T23:49:26.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 2024-08-08T23:49:26.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo 2024-08-08T23:49:26.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d8fc40 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 10 manifest: total_size = 1667 2024-08-08T23:49:26.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7106492504919518263 2024-08-08T23:49:26.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d8fc40 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.861+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10.0 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7106492504919518263 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.1 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.2 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.3 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.4 2024-08-08T23:49:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-08-08T23:49:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.869+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7106492504919518263 2024-08-08T23:49:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo 2024-08-08T23:49:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:26.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.873+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:26.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.877+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-08-08T23:49:26.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.877+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.877+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=227 2024-08-08T23:49:26.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.877+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-08-08T23:49:26.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.877+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-08-08T23:49:26.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.881+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-08-08T23:49:26.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.881+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-08-08T23:49:26.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.881+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 93891841087232 notifier 5886 bl.length()=183 2024-08-08T23:49:26.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.885+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 from cache 2024-08-08T23:49:26.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.885+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10, ofs0, ns] 2024-08-08T23:49:26.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.885+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 93891841089728 notifier 5886 bl.length()=241 2024-08-08T23:49:26.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.893+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 : miss 2024-08-08T23:49:26.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.893+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.893+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:26.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.893+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 info.flags=0x0 2024-08-08T23:49:26.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.893+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10 to cache LRU end 2024-08-08T23:49:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 : miss 2024-08-08T23:49:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=447 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 info.flags=0x17 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 to cache LRU end 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:26.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.897+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 2024-08-08T23:49:26.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-08T23:49:26.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-08-08T23:49:26.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12765809670424004002 2024-08-08T23:49:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.901+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12765809670424004002 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_0 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_1 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.905+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12765809670424004002 2024-08-08T23:49:26.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3475198129503779459 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.909+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3475198129503779459 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_0 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_1 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-08-08T23:49:26.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3475198129503779459 2024-08-08T23:49:26.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-08-08T23:49:26.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.917+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.921+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.921+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _FZUUsXqL5biMUL2YY6KRmhmhp5ge425 2024-08-08T23:49:26.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.921+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.921+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.921+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _FZUUsXqL5biMUL2YY6KRmhmhp5ge425 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.aM7C4EHGX9RvarBaAQTwc3LpRSloHWN_0 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.aM7C4EHGX9RvarBaAQTwc3LpRSloHWN_1 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.925+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _FZUUsXqL5biMUL2YY6KRmhmhp5ge425 2024-08-08T23:49:26.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-08-08T23:49:26.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _5hn4zpoUqn79e7X5PMbGQF4aw3VZRxm 2024-08-08T23:49:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7ed0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.929+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _5hn4zpoUqn79e7X5PMbGQF4aw3VZRxm 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.m_tkaIJjZWcrc1Xkfo2TQf8NZPq60FA_1 2024-08-08T23:49:26.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-08T23:49:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.937+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _5hn4zpoUqn79e7X5PMbGQF4aw3VZRxm 2024-08-08T23:49:26.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-08-08T23:49:26.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5106900696669816458 2024-08-08T23:49:26.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.941+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5106900696669816458 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_0 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_1 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.945+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5106900696669816458 2024-08-08T23:49:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-08T23:49:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _m-_hrP9E0shXTv2DxAcFeae0NGPoExM 2024-08-08T23:49:26.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.949+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _m-_hrP9E0shXTv2DxAcFeae0NGPoExM 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.hRcwEHnEVUxXw0nMDKtbtgb5CXw-F1g_0 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.hRcwEHnEVUxXw0nMDKtbtgb5CXw-F1g_1 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.957+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _m-_hrP9E0shXTv2DxAcFeae0NGPoExM 2024-08-08T23:49:26.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-08-08T23:49:26.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10472271874240480183 2024-08-08T23:49:26.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.961+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10472271874240480183 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_0 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_1 2024-08-08T23:49:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-08-08T23:49:26.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.965+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10472271874240480183 2024-08-08T23:49:26.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-08-08T23:49:26.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 20 get_obj_state: octx=0x7f220403cf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _1juCu-NMPeKI_oiWy28l3PB3CHPmR5T 2024-08-08T23:49:26.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 20 get_obj_state: octx=0x7f220403cf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.969+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _1juCu-NMPeKI_oiWy28l3PB3CHPmR5T 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.HHQHMDmiqNpmFQyKxJpSW0zwZ3TnstM_1 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _1juCu-NMPeKI_oiWy28l3PB3CHPmR5T 2024-08-08T23:49:26.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.977+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-08-08T23:49:26.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 20 get_obj_state: octx=0x7f220403cf00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8740020376603191148 2024-08-08T23:49:26.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 20 get_obj_state: octx=0x7f220403cf00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.981+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8740020376603191148 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.kNYKSnlLZx1hlscgepxB4UyIaM73B61_1 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.985+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8740020376603191148 2024-08-08T23:49:26.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-08T23:49:26.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _aAdOaZqjkdkTxVOFYiYPggd5tArnL-b 2024-08-08T23:49:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.989+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:26.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:26.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _aAdOaZqjkdkTxVOFYiYPggd5tArnL-b 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.8cGr6TMmn6T-ePKHlM5R451miK7TfwY_0 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.8cGr6TMmn6T-ePKHlM5R451miK7TfwY_1 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:26.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:26.997+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _aAdOaZqjkdkTxVOFYiYPggd5tArnL-b 2024-08-08T23:49:26.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.001+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-08-08T23:49:26.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:27.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _Nw_ixemvPBMlql9B2ARhC3ub1kttUxf 2024-08-08T23:49:27.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.005+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _Nw_ixemvPBMlql9B2ARhC3ub1kttUxf 2024-08-08T23:49:27.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.rg0jdvhfwLEK_l_PDwOKxNwwkqyHKWa_0 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.rg0jdvhfwLEK_l_PDwOKxNwwkqyHKWa_1 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.009+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _Nw_ixemvPBMlql9B2ARhC3ub1kttUxf 2024-08-08T23:49:27.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-08-08T23:49:27.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa250 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 10 manifest: total_size = 5242880 2024-08-08T23:49:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3279501397558441388 2024-08-08T23:49:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa250 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.013+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16.0 2024-08-08T23:49:27.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3279501397558441388 2024-08-08T23:49:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.kNYKSnlLZx1hlscgepxB4UyIaM73B61_1 2024-08-08T23:49:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-08-08T23:49:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3279501397558441388 2024-08-08T23:49:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-08-08T23:49:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.021+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-08-08T23:49:27.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.025+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.029+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=233 2024-08-08T23:49:27.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.029+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-08-08T23:49:27.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.029+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-08-08T23:49:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.029+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-08-08T23:49:27.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.029+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-08-08T23:49:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.033+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 93891841084992 notifier 5886 bl.length()=189 2024-08-08T23:49:27.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.037+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 from cache 2024-08-08T23:49:27.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.037+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16, ofs0, ns] 2024-08-08T23:49:27.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.037+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 93891841092672 notifier 5886 bl.length()=247 2024-08-08T23:49:27.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.045+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 : miss 2024-08-08T23:49:27.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.045+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.045+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.045+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 info.flags=0x0 2024-08-08T23:49:27.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.045+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16 to cache LRU end 2024-08-08T23:49:27.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.049+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 : miss 2024-08-08T23:49:27.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.049+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=457 2024-08-08T23:49:27.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 info.flags=0x17 2024-08-08T23:49:27.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 to cache LRU end 2024-08-08T23:49:27.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-08T23:49:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.243224067356300060 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.053+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.243224067356300060 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1_1 2024-08-08T23:49:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2_1 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.3 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-08-08T23:49:27.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.243224067356300060 2024-08-08T23:49:27.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-08T23:49:27.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.061+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da1660 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.065+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.065+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18195015135753957291 2024-08-08T23:49:27.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.065+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da1660 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.065+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.065+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18195015135753957291 2024-08-08T23:49:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1 2024-08-08T23:49:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-08-08T23:49:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1_1 2024-08-08T23:49:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-08-08T23:49:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2 2024-08-08T23:49:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-08-08T23:49:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2_1 2024-08-08T23:49:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-08-08T23:49:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.3 2024-08-08T23:49:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-08-08T23:49:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.069+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18195015135753957291 2024-08-08T23:49:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-08-08T23:49:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da02f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _yVwbKHbWDotBKgD0hWMY-yOjGi45bm_ 2024-08-08T23:49:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da02f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.073+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _yVwbKHbWDotBKgD0hWMY-yOjGi45bm_ 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_0 2024-08-08T23:49:27.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-08T23:49:27.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_1 2024-08-08T23:49:27.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-08-08T23:49:27.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_2 2024-08-08T23:49:27.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-08-08T23:49:27.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _yVwbKHbWDotBKgD0hWMY-yOjGi45bm_ 2024-08-08T23:49:27.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.081+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-08-08T23:49:27.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d8f620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _9qkTfmA-IfL8_6IyRcy3_zNOFMlgc4_ 2024-08-08T23:49:27.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d8f620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.085+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _9qkTfmA-IfL8_6IyRcy3_zNOFMlgc4_ 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.KhHnmnKNTbns4QitybazR6Ms-0qQc9N_1 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.KhHnmnKNTbns4QitybazR6Ms-0qQc9N_2 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.089+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _9qkTfmA-IfL8_6IyRcy3_zNOFMlgc4_ 2024-08-08T23:49:27.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.093+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6043401729715430728 2024-08-08T23:49:27.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.097+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6043401729715430728 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1_1 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-08-08T23:49:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2_1 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.3 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.101+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6043401729715430728 2024-08-08T23:49:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-08T23:49:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7dd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _h-ge7XacCEYX8VGn3ffzExMKihT7WOD 2024-08-08T23:49:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7dd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.105+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _h-ge7XacCEYX8VGn3ffzExMKihT7WOD 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_0 2024-08-08T23:49:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_1 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_2 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.113+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _h-ge7XacCEYX8VGn3ffzExMKihT7WOD 2024-08-08T23:49:27.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-08-08T23:49:27.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da1130 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12173854997364093900 2024-08-08T23:49:27.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da1130 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.117+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12173854997364093900 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-08-08T23:49:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1_1 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2_1 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.3 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.125+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12173854997364093900 2024-08-08T23:49:27.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-08-08T23:49:27.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d9bc50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _7nxR25cBIV1RCftUcvvw41QTgJDXyxU 2024-08-08T23:49:27.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d9bc50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.129+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _7nxR25cBIV1RCftUcvvw41QTgJDXyxU 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.sh-cBEorFMdHuzkJ3ITVvH0HoYa45pZ_1 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.sh-cBEorFMdHuzkJ3ITVvH0HoYa45pZ_2 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.137+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _7nxR25cBIV1RCftUcvvw41QTgJDXyxU 2024-08-08T23:49:27.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-08-08T23:49:27.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da0cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 10 manifest: total_size = 16375 2024-08-08T23:49:27.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10877469105968786809 2024-08-08T23:49:27.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da0cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.141+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-08-08T23:49:27.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2024-08-08T23:49:27.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7670 2024-08-08T23:49:27.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7670 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=1035 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4209644 part_ofs=15340 rule->part_size=1035 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=16375 stripe_ofs=16375 part_ofs=16375 rule->part_size=1035 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10877469105968786809 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.1 2024-08-08T23:49:27.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.2 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.3 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.149+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10877469105968786809 2024-08-08T23:49:27.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-08T23:49:27.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 10 manifest: total_size = 16375 2024-08-08T23:49:27.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _j643ZazwBmQh0xBhcjU9MuvrYB4572Z 2024-08-08T23:49:27.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.153+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=16375 stripe_ofs=16375 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _j643ZazwBmQh0xBhcjU9MuvrYB4572Z 2024-08-08T23:49:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.OfEVwON5y0_7MAsVGcUdNYW2NwcOjqh_0 2024-08-08T23:49:27.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-08T23:49:27.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.157+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _j643ZazwBmQh0xBhcjU9MuvrYB4572Z 2024-08-08T23:49:27.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.161+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-08-08T23:49:27.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.161+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d5f060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.165+0000 7f22115b5980 10 manifest: total_size = 16375 2024-08-08T23:49:27.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.165+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to _U7TbV8w6VNfw3OLfbzDXTsf6abH-Yjn 2024-08-08T23:49:27.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.165+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d5f060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.165+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.165+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=16375 stripe_ofs=16375 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: _U7TbV8w6VNfw3OLfbzDXTsf6abH-Yjn 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.23T3XERP-X5W_DpEa6uaNTuJB6ScMBJ_0 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.169+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _U7TbV8w6VNfw3OLfbzDXTsf6abH-Yjn 2024-08-08T23:49:27.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-08-08T23:49:27.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 10 manifest: total_size = 16375 2024-08-08T23:49:27.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9427506456995623029 2024-08-08T23:49:27.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080aade0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.173+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17.0 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7670 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7670 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=1035 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4209644 part_ofs=15340 rule->part_size=1035 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=16375 stripe_ofs=16375 part_ofs=16375 rule->part_size=1035 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9427506456995623029 2024-08-08T23:49:27.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.1 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.2 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.3 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.181+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9427506456995623029 2024-08-08T23:49:27.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-08-08T23:49:27.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.185+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.189+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-08-08T23:49:27.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.189+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.189+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=243 2024-08-08T23:49:27.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.189+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-08-08T23:49:27.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.189+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-08-08T23:49:27.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.193+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-08-08T23:49:27.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.193+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-08-08T23:49:27.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.193+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 93891841089728 notifier 5886 bl.length()=199 2024-08-08T23:49:27.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.201+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 from cache 2024-08-08T23:49:27.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.201+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17, ofs0, ns] 2024-08-08T23:49:27.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.201+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 93891841077024 notifier 5886 bl.length()=257 2024-08-08T23:49:27.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.209+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 : miss 2024-08-08T23:49:27.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.209+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.209+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.209+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 info.flags=0x0 2024-08-08T23:49:27.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.209+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17 to cache LRU end 2024-08-08T23:49:27.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.213+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 : miss 2024-08-08T23:49:27.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.213+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=452 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 info.flags=0x17 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 to cache LRU end 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 2024-08-08T23:49:27.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-08T23:49:27.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-08T23:49:27.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-08T23:49:27.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17296439175460687549 2024-08-08T23:49:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.217+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15.0 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17296439175460687549 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.1 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-08-08T23:49:27.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.1_1 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.2 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.2_1 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.3 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.225+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17296439175460687549 2024-08-08T23:49:27.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-08T23:49:27.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200058260 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 10 manifest: total_size = 11534336 2024-08-08T23:49:27.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11146297945782778295 2024-08-08T23:49:27.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200058260 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.229+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15.0 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-08T23:49:27.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11146297945782778295 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.1 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.1_1 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.2 2024-08-08T23:49:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.2_1 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.3 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.237+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11146297945782778295 2024-08-08T23:49:27.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-08T23:49:27.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 10 manifest: total_size = 541681 2024-08-08T23:49:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14240023846591834488 2024-08-08T23:49:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.241+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15.0 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-08-08T23:49:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14240023846591834488 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.1 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.2 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.3 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14240023846591834488 2024-08-08T23:49:27.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.249+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-08T23:49:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.253+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.257+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-08-08T23:49:27.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.257+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.257+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=238 2024-08-08T23:49:27.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.257+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-08-08T23:49:27.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.257+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-08-08T23:49:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.261+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-08-08T23:49:27.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.261+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-08-08T23:49:27.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.261+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 93891841092672 notifier 5886 bl.length()=194 2024-08-08T23:49:27.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.269+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 from cache 2024-08-08T23:49:27.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.269+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15, ofs0, ns] 2024-08-08T23:49:27.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.269+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 93891841077024 notifier 5886 bl.length()=252 2024-08-08T23:49:27.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.277+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 : miss 2024-08-08T23:49:27.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.277+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.277+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.277+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 info.flags=0x0 2024-08-08T23:49:27.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.277+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15 to cache LRU end 2024-08-08T23:49:27.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.281+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 : miss 2024-08-08T23:49:27.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.281+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=442 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 info.flags=0x17 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 to cache LRU end 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 2024-08-08T23:49:27.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-08T23:49:27.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-08T23:49:27.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-08T23:49:27.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d985d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 10 manifest: total_size = 10485760 2024-08-08T23:49:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1513323009152464874 2024-08-08T23:49:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d985d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.285+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14.0 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1513323009152464874 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_0 2024-08-08T23:49:27.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_1 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_2 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.293+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1513323009152464874 2024-08-08T23:49:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-08T23:49:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa980 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 10 manifest: total_size = 10485760 2024-08-08T23:49:27.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3463980139044234834 2024-08-08T23:49:27.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5daa980 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.297+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14.0 2024-08-08T23:49:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3463980139044234834 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_0 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_1 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_2 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-08T23:49:27.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f22115b5980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3463980139044234834 2024-08-08T23:49:27.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.305+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-08T23:49:27.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d91830 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 10 manifest: total_size = 3300 2024-08-08T23:49:27.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5825902924624788983 2024-08-08T23:49:27.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d91830 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.309+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14.0 2024-08-08T23:49:27.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.313+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.313+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-08T23:49:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.317+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.321+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-08-08T23:49:27.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.321+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.321+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=228 2024-08-08T23:49:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.321+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-08-08T23:49:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.321+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-08-08T23:49:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.325+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-08-08T23:49:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.325+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-08-08T23:49:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.325+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 93891841084992 notifier 5886 bl.length()=184 2024-08-08T23:49:27.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.333+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 from cache 2024-08-08T23:49:27.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.333+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14, ofs0, ns] 2024-08-08T23:49:27.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.333+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333448 cookie 93891841100656 notifier 5886 bl.length()=242 2024-08-08T23:49:27.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.337+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 : miss 2024-08-08T23:49:27.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.337+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.337+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.337+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 info.flags=0x0 2024-08-08T23:49:27.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.337+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14 to cache LRU end 2024-08-08T23:49:27.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 : miss 2024-08-08T23:49:27.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=437 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 info.flags=0x17 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 to cache LRU end 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 2024-08-08T23:49:27.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ 2024-08-08T23:49:27.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ _ 2024-08-08T23:49:27.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cls_bucket_list_unordered: got ___ 2024-08-08T23:49:27.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.345+0000 7f22115b5980 10 cls_bucket_list_unordered: got obj 2024-08-08T23:49:27.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 10 manifest: total_size = 0 2024-08-08T23:49:27.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4214129507411374949 2024-08-08T23:49:27.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.349+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7.0 2024-08-08T23:49:27.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.353+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f22115b5980 10 manifest: total_size = 0 2024-08-08T23:49:27.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10833485930143141837 2024-08-08T23:49:27.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080b7a50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7.0 2024-08-08T23:49:27.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.357+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=__ 2024-08-08T23:49:27.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.361+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7750 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.365+0000 7f22115b5980 10 manifest: total_size = 0 2024-08-08T23:49:27.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.365+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7843045614122783572 2024-08-08T23:49:27.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.365+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5da7750 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.365+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.365+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7.0 2024-08-08T23:49:27.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.369+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=__ _ 2024-08-08T23:49:27.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200058260 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 10 manifest: total_size = 0 2024-08-08T23:49:27.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8694507284947237245 2024-08-08T23:49:27.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 20 get_obj_state: octx=0x7f2200058260 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.373+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7.0 2024-08-08T23:49:27.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.377+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=___ 2024-08-08T23:49:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.381+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.381+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=obj 2024-08-08T23:49:27.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.385+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.389+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-08-08T23:49:27.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.389+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.389+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=223 2024-08-08T23:49:27.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.389+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-08-08T23:49:27.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.389+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-08-08T23:49:27.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.393+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-08-08T23:49:27.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.393+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-08-08T23:49:27.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.393+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 93891841074512 notifier 5886 bl.length()=181 2024-08-08T23:49:27.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.401+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 from cache 2024-08-08T23:49:27.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.401+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7, ofs0, ns] 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.401+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 93891841089728 notifier 5886 bl.length()=238 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.405+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 : miss 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.405+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.405+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.405+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 info.flags=0x0 2024-08-08T23:49:27.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.405+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7 to cache LRU end 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 : miss 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=437 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 info.flags=0x17 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 to cache LRU end 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ _ 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cls_bucket_list_unordered: got ___ 2024-08-08T23:49:27.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 10 cls_bucket_list_unordered: got obj 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.413+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.417+0000 7f22115b5980 10 manifest: total_size = 24595 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.417+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8317332052186686905 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.417+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.417+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.417+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8.0 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 10 manifest: total_size = 524288 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12914616127262780246 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.425+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8.0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.429+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=__ 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 10 manifest: total_size = 38 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5588549444897217507 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 20 get_obj_state: octx=0x7f22080c7fc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.433+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8.0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.437+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 20 get_obj_state: octx=0x7f220001e610 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 10 manifest: total_size = 527 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7622091504425551332 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 20 get_obj_state: octx=0x7f220001e610 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.441+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8.0 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.445+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=___ 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.449+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.449+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=obj 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.453+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.457+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.457+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.457+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=223 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.457+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-08-08T23:49:27.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.457+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.461+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.461+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.461+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333540 cookie 93891841074512 notifier 5886 bl.length()=181 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.469+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 from cache 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.469+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8, ofs0, ns] 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.469+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 93891841089728 notifier 5886 bl.length()=238 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.473+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 : miss 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.473+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.477+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.477+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 info.flags=0x0 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.477+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8 to cache LRU end 2024-08-08T23:49:27.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 : miss 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=437 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 info.flags=0x17 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 to cache LRU end 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.481+0000 7f22115b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 10 cls_bucket_list_unordered: got __ _ 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 10 cls_bucket_list_unordered: got ___ 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 10 cls_bucket_list_unordered: got obj 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 10 manifest: total_size = 55 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2537490989336161410 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.485+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9.0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.489+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f22115b5980 10 manifest: total_size = 1035 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17038951500304832 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9.0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.493+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=__ 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 10 manifest: total_size = 4134 2024-08-08T23:49:27.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5134464459843394345 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.501+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9.0 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.505+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 10 manifest: total_size = 1035 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16511061230400177698 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 20 get_obj_state: octx=0x5564e5d3e160 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5564e5d8e728 s->prefetch_data=0 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 20 prepare_atomic_modification: state is not atomic. state=0x5564e5d8e728 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f22115b5980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9.0 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.509+0000 7f20f27fc640 20 handle_completion(): completion ok for obj=___ 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.513+0000 7f22115b5980 20 list_objects_ordered: starting attempt 1 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.513+0000 7f22115b5980 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-08-08T23:49:27.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f20f2ffd640 20 handle_completion(): completion ok for obj=obj 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f22115b5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f22115b5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f22115b5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.517+0000 7f22115b5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9])"; uploads.size()=0; is_truncated=0 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.521+0000 7f22115b5980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.521+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f22115b5980 20 rados_obj.operate() r=0 bl.length=223 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f22115b5980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-08-08T23:49:27.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f22115b5980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f22115b5980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.525+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 93891841074512 notifier 5886 bl.length()=181 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.533+0000 7f22115b5980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 from cache 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.533+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9, ofs0, ns] 2024-08-08T23:49:27.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.533+0000 7f20f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333463 cookie 93891841089728 notifier 5886 bl.length()=238 2024-08-08T23:49:27.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.541+0000 7f22115b5980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 : miss 2024-08-08T23:49:27.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.541+0000 7f22115b5980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.541+0000 7f22115b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.541+0000 7f22115b5980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 info.flags=0x0 2024-08-08T23:49:27.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.541+0000 7f22115b5980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9 to cache LRU end 2024-08-08T23:49:27.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.545+0000 7f22115b5980 10 removing key index: ZBYVWPQXRRTIANJGVWVI 2024-08-08T23:49:27.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.549+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:ZBYVWPQXRRTIANJGVWVI, ofs0, ns] 2024-08-08T23:49:27.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.549+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 93891841087232 notifier 5886 bl.length()=170 2024-08-08T23:49:27.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.553+0000 7f22115b5980 10 removing email index: ragweed.client.0+test@test.test 2024-08-08T23:49:27.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.557+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-08-08T23:49:27.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.557+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 93891841084992 notifier 5886 bl.length()=182 2024-08-08T23:49:27.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.561+0000 7f22115b5980 10 removing user buckets index 2024-08-08T23:49:27.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.565+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-08-08T23:49:27.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.565+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 93891841092672 notifier 5886 bl.length()=173 2024-08-08T23:49:27.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.569+0000 7f22115b5980 10 removing user index: ragweed.client.0 2024-08-08T23:49:27.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.569+0000 7f22115b5980 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-08-08T23:49:27.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.569+0000 7f22115b5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-08-08T23:49:27.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.573+0000 7f20f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 93891841087232 notifier 5886 bl.length()=165 2024-08-08T23:49:27.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.581+0000 7f20c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:49:27.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.585+0000 7f22115b5980 20 remove_watcher() i=0 2024-08-08T23:49:27.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.585+0000 7f22115b5980 2 removed watcher, disabling cache 2024-08-08T23:49:27.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.589+0000 7f22115b5980 20 remove_watcher() i=1 2024-08-08T23:49:27.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.593+0000 7f22115b5980 20 remove_watcher() i=2 2024-08-08T23:49:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.593+0000 7f22115b5980 20 remove_watcher() i=3 2024-08-08T23:49:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.597+0000 7f22115b5980 20 remove_watcher() i=4 2024-08-08T23:49:27.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.601+0000 7f22115b5980 20 remove_watcher() i=5 2024-08-08T23:49:27.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.601+0000 7f22115b5980 20 remove_watcher() i=6 2024-08-08T23:49:27.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.605+0000 7f22115b5980 20 remove_watcher() i=7 2024-08-08T23:49:27.620 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-08-08T23:49:27.699 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:49:27.699 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:49:27.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 realm 2024-08-08T23:49:27.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:49:27.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:27.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.745+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.749+0000 7fc3f399a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:49:27.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.749+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:27.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.749+0000 7fc3f399a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:49:27.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.749+0000 7fc3f399a980 20 searching for the correct realm 2024-08-08T23:49:27.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.753+0000 7fc3f1caf640 0 -- 172.21.15.83:0/2296882517 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc3dc017070 msgr2=0x7fc3dc053790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:49:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:27.969+0000 7fc3f0cad640 0 -- 172.21.15.83:0/2296882517 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc3e4002b70 msgr2=0x7fc3e410e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:49:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.185+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:49:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 zone default found 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 4 Realm: () 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 zonegroup default 2024-08-08T23:49:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.189+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.193+0000 7fc3f399a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:49:28.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.193+0000 7fc3f399a980 20 started sync module instance, tier type = 2024-08-08T23:49:28.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.193+0000 7fc3f399a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=0 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=1 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=2 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=3 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=4 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=5 2024-08-08T23:49:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.213+0000 7fc3f399a980 20 add_watcher() i=6 2024-08-08T23:49:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.217+0000 7fc3f399a980 20 add_watcher() i=7 2024-08-08T23:49:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.217+0000 7fc3f399a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:49:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.217+0000 7fc2a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:49:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.217+0000 7fc3f399a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:49:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.217+0000 7fc3f399a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:49:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.305+0000 7fc2a67e4640 20 reqs_thread_entry: start 2024-08-08T23:49:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 20 init_complete bucket index max shards: 1 2024-08-08T23:49:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 20 Filter name: none 2024-08-08T23:49:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc217fff640 20 reqs_thread_entry: start 2024-08-08T23:49:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-08-08T23:49:28.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 20 rados->read ofs=0 len=0 2024-08-08T23:49:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 20 rados_obj.operate() r=0 bl.length=486 2024-08-08T23:49:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-08-08T23:49:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-08T23:49:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:49:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.309+0000 7fc3f399a980 10 removing key index: ECRNZUOUCVMBNSBGXHLA 2024-08-08T23:49:28.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.313+0000 7fc3f399a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:ECRNZUOUCVMBNSBGXHLA, ofs0, ns] 2024-08-08T23:49:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.313+0000 7fc2d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 94009013888608 notifier 5663 bl.length()=170 2024-08-08T23:49:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.317+0000 7fc3f399a980 10 removing email index: sysuser.client.0+test@test.test 2024-08-08T23:49:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.317+0000 7fc3f399a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-08-08T23:49:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.317+0000 7fc2c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94009013888608 notifier 5663 bl.length()=182 2024-08-08T23:49:28.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.321+0000 7fc3f399a980 10 removing user buckets index 2024-08-08T23:49:28.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.325+0000 7fc3f399a980 10 removing user index: sysuser.client.0 2024-08-08T23:49:28.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.325+0000 7fc3f399a980 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-08-08T23:49:28.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.325+0000 7fc3f399a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-08-08T23:49:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.329+0000 7fc2c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94009013880256 notifier 5663 bl.length()=165 2024-08-08T23:49:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.329+0000 7fc2a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:49:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.337+0000 7fc3f399a980 20 remove_watcher() i=0 2024-08-08T23:49:28.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.337+0000 7fc3f399a980 2 removed watcher, disabling cache 2024-08-08T23:49:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.337+0000 7fc3f399a980 20 remove_watcher() i=1 2024-08-08T23:49:28.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.341+0000 7fc3f399a980 20 remove_watcher() i=2 2024-08-08T23:49:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.341+0000 7fc3f399a980 20 remove_watcher() i=3 2024-08-08T23:49:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.345+0000 7fc3f399a980 20 remove_watcher() i=4 2024-08-08T23:49:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.345+0000 7fc3f399a980 20 remove_watcher() i=5 2024-08-08T23:49:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.349+0000 7fc3f399a980 20 remove_watcher() i=6 2024-08-08T23:49:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:49:28.349+0000 7fc3f399a980 20 remove_watcher() i=7 2024-08-08T23:49:28.362 INFO:tasks.ragweed:Removing ragweed... 2024-08-08T23:49:28.362 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-08-08T23:49:28.452 INFO:teuthology.run_tasks:Running task workunit... 2024-08-08T23:49:28.462 INFO:tasks.workunit:Pulling workunits from ref 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:49:28.462 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-08T23:49:28.463 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:49:28.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-08T23:49:28.470 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-08T23:49:28.470 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:49:28.516 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-08T23:49:28.516 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-08T23:49:28.568 INFO:tasks.workunit:timeout=3h 2024-08-08T23:49:28.568 INFO:tasks.workunit:cleanup=True 2024-08-08T23:49:28.569 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a88632b45f25ae38493667c7dbd155f6e59b499 2024-08-08T23:49:28.618 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-08T23:50:15.461 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '0a88632b45f25ae38493667c7dbd155f6e59b499'. 2024-08-08T23:50:15.461 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.461 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-08T23:50:15.462 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-08T23:50:15.462 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-08-08T23:50:15.462 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.462 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-08T23:50:15.462 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.463 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-08-08T23:50:15.464 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.464 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-08T23:50:15.464 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:15.464 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 0a88632b45f Merge branch 'wip-67364-squid' of https://github.com/yuvalif/ceph into wip-yuri7-testing-2024-08-08-0804-squid 2024-08-08T23:50:15.468 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-08T23:50:15.517 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-08T23:50:15.521 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:50:15.521 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-08T23:50:15.574 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-08T23:50:15.628 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-08T23:50:15.673 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-08T23:50:15.674 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:50:15.674 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-08T23:50:15.715 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-08T23:50:15.719 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:50:15.720 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-08T23:50:15.769 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-08-08T23:50:15.771 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-08-08T23:50:15.771 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a88632b45f25ae38493667c7dbd155f6e59b499 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-08-08T23:50:15.820 INFO:tasks.workunit.client.0.smithi083.stderr:+ ulimit -c 0 2024-08-08T23:50:15.821 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-08-08T23:50:15.821 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:50:15.821 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:50:18.738 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:50:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-08-08T23:50:18.740 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-08-08T23:50:19.099 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-08T23:50:19.308 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-08-08T23:50:19.314 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-08T23:50:19.348 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-08-08T23:50:19.349 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-08-08T23:50:19.349 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 22.0.2 2024-08-08T23:50:19.605 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-22.0.2: 2024-08-08T23:50:19.610 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-22.0.2 2024-08-08T23:50:20.389 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-08-08T23:50:20.448 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install boto3 2024-08-08T23:50:21.422 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-08-08T23:50:21.423 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached boto3-1.34.157-py3-none-any.whl.metadata (6.6 kB) 2024-08-08T23:50:21.971 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.35.0,>=1.34.157 (from boto3) 2024-08-08T23:50:21.972 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached botocore-1.34.157-py3-none-any.whl.metadata (5.7 kB) 2024-08-08T23:50:22.035 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-08T23:50:22.036 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-08T23:50:22.078 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-08T23:50:22.079 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-08T23:50:22.129 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:50:22.130 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-08T23:50:22.214 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:50:22.215 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-08T23:50:22.367 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.157->boto3) 2024-08-08T23:50:22.368 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-08T23:50:22.372 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached boto3-1.34.157-py3-none-any.whl (139 kB) 2024-08-08T23:50:22.373 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached botocore-1.34.157-py3-none-any.whl (12.5 MB) 2024-08-08T23:50:22.383 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-08T23:50:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-08T23:50:22.385 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-08T23:50:22.386 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-08T23:50:22.387 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-08T23:50:22.456 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-08T23:50:23.540 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.34.157 botocore-1.34.157 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-08T23:50:23.746 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-08-08T23:50:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-08-08T23:50:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:23.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.964+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:23.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:23.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 realm 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:23.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:23.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:23.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:23.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.968+0000 7f6f6511b980 20 searching for the correct realm 2024-08-08T23:50:23.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.972+0000 7f6f63430640 0 -- 172.21.15.83:0/2218762645 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6f580f6410 msgr2=0x7f6f580f6830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:23.980+0000 7f6f6242e640 0 -- 172.21.15.83:0/2218762645 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6f5c064330 msgr2=0x7f6f5c065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:24.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.196+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 zone default found 2024-08-08T23:50:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 4 Realm: () 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 zonegroup default 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 started sync module instance, tier type = 2024-08-08T23:50:24.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.200+0000 7f6f6511b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=0 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=1 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=2 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=3 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=4 2024-08-08T23:50:24.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=5 2024-08-08T23:50:24.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=6 2024-08-08T23:50:24.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 20 add_watcher() i=7 2024-08-08T23:50:24.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.224+0000 7f6f6511b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:24.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.228+0000 7f6e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 5 note: GC not initialized 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6d93fff640 20 reqs_thread_entry: start 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 Filter name: none 2024-08-08T23:50:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6d91ffb640 20 reqs_thread_entry: start 2024-08-08T23:50:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-08-08T23:50:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=22 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-08-08T23:50:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-08-08T23:50:24.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-08-08T23:50:24.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.232+0000 7f6f6511b980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 20 rados_obj.operate() r=0 bl.length=420 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6f6511b980 20 get_user_info_from_index found 0 xattrs 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-08-08T23:50:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.236+0000 7f6e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:24.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.244+0000 7f6f6511b980 20 remove_watcher() i=0 2024-08-08T23:50:24.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.244+0000 7f6f6511b980 2 removed watcher, disabling cache 2024-08-08T23:50:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.244+0000 7f6f6511b980 20 remove_watcher() i=1 2024-08-08T23:50:24.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.248+0000 7f6f6511b980 20 remove_watcher() i=2 2024-08-08T23:50:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.248+0000 7f6f6511b980 20 remove_watcher() i=3 2024-08-08T23:50:24.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.252+0000 7f6f6511b980 20 remove_watcher() i=4 2024-08-08T23:50:24.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.252+0000 7f6f6511b980 20 remove_watcher() i=5 2024-08-08T23:50:24.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.256+0000 7f6f6511b980 20 remove_watcher() i=6 2024-08-08T23:50:24.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.256+0000 7f6f6511b980 20 remove_watcher() i=7 2024-08-08T23:50:24.912 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard add 2024-08-08T23:50:24.912 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:24.912 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-08T23:50:24.945 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:24.945 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:24.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.992+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.992+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.992+0000 7f0270095980 20 realm 2024-08-08T23:50:24.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.992+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:24.996+0000 7f0270095980 20 searching for the correct realm 2024-08-08T23:50:24.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.000+0000 7f026e3aa640 0 -- 172.21.15.83:0/852480068 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f026401abc0 msgr2=0x7f0264069050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.008+0000 7f026d3a8640 0 -- 172.21.15.83:0/852480068 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f02680fe3d0 msgr2=0x7f02680fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:25.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:25.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.224+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 zone default found 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 4 Realm: () 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 zonegroup default 2024-08-08T23:50:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.228+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.232+0000 7f0270095980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.232+0000 7f0270095980 20 started sync module instance, tier type = 2024-08-08T23:50:25.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.232+0000 7f0270095980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=0 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=1 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=2 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=3 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=4 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=5 2024-08-08T23:50:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.252+0000 7f0270095980 20 add_watcher() i=6 2024-08-08T23:50:25.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.256+0000 7f0270095980 20 add_watcher() i=7 2024-08-08T23:50:25.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.256+0000 7f0270095980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:25.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.260+0000 7f011f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.260+0000 7f0270095980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:25.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.260+0000 7f0270095980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:25.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.260+0000 7f0270095980 5 note: GC not initialized 2024-08-08T23:50:25.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f011e7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f0270095980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f0270095980 20 Filter name: none 2024-08-08T23:50:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f008ffff640 20 reqs_thread_entry: start 2024-08-08T23:50:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:25.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.264+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:25.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:25.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:25.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:25.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.268+0000 7f0270095980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:25.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.272+0000 7f011f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.276+0000 7f0270095980 20 remove_watcher() i=0 2024-08-08T23:50:25.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.276+0000 7f0270095980 2 removed watcher, disabling cache 2024-08-08T23:50:25.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.280+0000 7f0270095980 20 remove_watcher() i=1 2024-08-08T23:50:25.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.280+0000 7f0270095980 20 remove_watcher() i=2 2024-08-08T23:50:25.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.284+0000 7f0270095980 20 remove_watcher() i=3 2024-08-08T23:50:25.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.284+0000 7f0270095980 20 remove_watcher() i=4 2024-08-08T23:50:25.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.288+0000 7f0270095980 20 remove_watcher() i=5 2024-08-08T23:50:25.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.288+0000 7f0270095980 20 remove_watcher() i=6 2024-08-08T23:50:25.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.288+0000 7f0270095980 20 remove_watcher() i=7 2024-08-08T23:50:25.302 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:25.302 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:25.303 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-08-08T23:50:25.303 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:25.303 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-08-08T23:50:25.335 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:25.335 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:25.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.380+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 realm 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:25.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.384+0000 7f2bfa51f980 20 searching for the correct realm 2024-08-08T23:50:25.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.392+0000 7f2bf8834640 0 -- 172.21.15.83:0/1504054003 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x55a43a8e70a0 msgr2=0x55a43a8e9490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.396+0000 7f2bf7832640 0 -- 172.21.15.83:0/1504054003 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f2bf0053920 msgr2=0x7f2bf001c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.404+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 zone default found 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 4 Realm: () 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 zonegroup default 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 started sync module instance, tier type = 2024-08-08T23:50:25.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.408+0000 7f2bfa51f980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:25.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=0 2024-08-08T23:50:25.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=1 2024-08-08T23:50:25.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=2 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=3 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=4 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=5 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=6 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 20 add_watcher() i=7 2024-08-08T23:50:25.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.424+0000 7f2bfa51f980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:25.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2aaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 5 note: GC not initialized 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2aadfdb640 20 reqs_thread_entry: start 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 20 Filter name: none 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2a1f7fe640 20 reqs_thread_entry: start 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.428+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : miss 2024-08-08T23:50:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.432+0000 7f2bfa51f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:25.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.436+0000 7f2aaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.440+0000 7f2bfa51f980 20 remove_watcher() i=0 2024-08-08T23:50:25.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.440+0000 7f2bfa51f980 2 removed watcher, disabling cache 2024-08-08T23:50:25.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.440+0000 7f2bfa51f980 20 remove_watcher() i=1 2024-08-08T23:50:25.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.444+0000 7f2bfa51f980 20 remove_watcher() i=2 2024-08-08T23:50:25.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.448+0000 7f2bfa51f980 20 remove_watcher() i=3 2024-08-08T23:50:25.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.448+0000 7f2bfa51f980 20 remove_watcher() i=4 2024-08-08T23:50:25.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.448+0000 7f2bfa51f980 20 remove_watcher() i=5 2024-08-08T23:50:25.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.452+0000 7f2bfa51f980 20 remove_watcher() i=6 2024-08-08T23:50:25.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.452+0000 7f2bfa51f980 20 remove_watcher() i=7 2024-08-08T23:50:25.462 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard list 2024-08-08T23:50:25.486 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:25.486 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:25.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 realm 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.532+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.536+0000 7f06ede42980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.536+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.536+0000 7f06ede42980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:25.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.536+0000 7f06ede42980 20 searching for the correct realm 2024-08-08T23:50:25.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.540+0000 7f06ec157640 0 -- 172.21.15.83:0/1154275185 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x5583205afdb0 msgr2=0x5583205b21a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.548+0000 7f06eb155640 0 -- 172.21.15.83:0/1154275185 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f06e405e160 msgr2=0x7f06e407c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:25.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:25.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.552+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 zone default found 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 4 Realm: () 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 zonegroup default 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 started sync module instance, tier type = 2024-08-08T23:50:25.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.556+0000 7f06ede42980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:25.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=0 2024-08-08T23:50:25.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=1 2024-08-08T23:50:25.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=2 2024-08-08T23:50:25.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=3 2024-08-08T23:50:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=4 2024-08-08T23:50:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=5 2024-08-08T23:50:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=6 2024-08-08T23:50:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 20 add_watcher() i=7 2024-08-08T23:50:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.572+0000 7f06ede42980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:25.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f06ede42980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f06ede42980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f06ede42980 5 note: GC not initialized 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f05a0fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f06ede42980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f06ede42980 20 Filter name: none 2024-08-08T23:50:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.576+0000 7f051a7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:25.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.584+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:25.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.592+0000 7f06ede42980 20 remove_watcher() i=0 2024-08-08T23:50:25.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.592+0000 7f06ede42980 2 removed watcher, disabling cache 2024-08-08T23:50:25.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.592+0000 7f06ede42980 20 remove_watcher() i=1 2024-08-08T23:50:25.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.596+0000 7f06ede42980 20 remove_watcher() i=2 2024-08-08T23:50:25.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.596+0000 7f06ede42980 20 remove_watcher() i=3 2024-08-08T23:50:25.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.600+0000 7f06ede42980 20 remove_watcher() i=4 2024-08-08T23:50:25.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.600+0000 7f06ede42980 20 remove_watcher() i=5 2024-08-08T23:50:25.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.600+0000 7f06ede42980 20 remove_watcher() i=6 2024-08-08T23:50:25.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.600+0000 7f06ede42980 20 remove_watcher() i=7 2024-08-08T23:50:25.613 INFO:tasks.workunit.client.0.smithi083.stderr:bucket name a-bucket 2024-08-08T23:50:25.613 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard process 2024-08-08T23:50:25.613 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:25.614 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard process 2024-08-08T23:50:25.637 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:25.637 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:25.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 realm 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:25.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.684+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.688+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:25.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.688+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:25.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.688+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:25.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.688+0000 7f64b9b36980 20 searching for the correct realm 2024-08-08T23:50:25.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.692+0000 7f64b7e4b640 0 -- 172.21.15.83:0/1090789397 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f64ac008040 msgr2=0x7f64ac065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:25.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:25.908+0000 7f64b6e49640 0 -- 172.21.15.83:0/1090789397 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f64b00cf410 msgr2=0x7f64b00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:26.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:26.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:26.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:26.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:26.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.124+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 zone default found 2024-08-08T23:50:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 4 Realm: () 2024-08-08T23:50:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 zonegroup default 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:26.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.128+0000 7f64b9b36980 20 started sync module instance, tier type = 2024-08-08T23:50:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.132+0000 7f64b9b36980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=0 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=1 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=2 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=3 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=4 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=5 2024-08-08T23:50:26.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=6 2024-08-08T23:50:26.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 20 add_watcher() i=7 2024-08-08T23:50:26.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.156+0000 7f64b9b36980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:26.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.160+0000 7f636dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:26.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:26.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:26.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 5 note: GC not initialized 2024-08-08T23:50:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f636cfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 20 Filter name: none 2024-08-08T23:50:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f62e67fc640 20 reqs_thread_entry: start 2024-08-08T23:50:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.164+0000 7f64b9b36980 20 processing logshard = reshard.0000000000 2024-08-08T23:50:26.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.172+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-08-08T23:50:26.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.172+0000 7f64b9b36980 20 processing logshard = reshard.0000000001 2024-08-08T23:50:26.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.176+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-08-08T23:50:26.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.176+0000 7f64b9b36980 20 processing logshard = reshard.0000000002 2024-08-08T23:50:26.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.180+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-08-08T23:50:26.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.180+0000 7f64b9b36980 20 processing logshard = reshard.0000000003 2024-08-08T23:50:26.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.188+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-08-08T23:50:26.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.188+0000 7f64b9b36980 20 processing logshard = reshard.0000000004 2024-08-08T23:50:26.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.192+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-08-08T23:50:26.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.192+0000 7f64b9b36980 20 processing logshard = reshard.0000000005 2024-08-08T23:50:26.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.200+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-08-08T23:50:26.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.200+0000 7f64b9b36980 20 processing logshard = reshard.0000000006 2024-08-08T23:50:26.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.200+0000 7f64b9b36980 20 process_entry resharding a-bucket 2024-08-08T23:50:26.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.200+0000 7f64b9b36980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-08T23:50:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.200+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-08-08T23:50:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-08T23:50:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : miss 2024-08-08T23:50:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 20 rados->read ofs=0 len=0 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.204+0000 7f64b9b36980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:26.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f64b9b36980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:26.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f64b9b36980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:26.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f64b9b36980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:26.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f64b9b36980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:50:26.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f639affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94418653321712 notifier 5994 bl.length()=903 2024-08-08T23:50:26.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f639affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:26.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f639affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:26.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.216+0000 7f639affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:26.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.220+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:50:26.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.220+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:50:26.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.220+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:50:26.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.220+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:50:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.0 2024-08-08T23:50:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.0 2024-08-08T23:50:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.1 2024-08-08T23:50:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.1 2024-08-08T23:50:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.0 2024-08-08T23:50:26.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : hit (requested=0x17, cached=0x17) 2024-08-08T23:50:26.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.224+0000 7f64b9b36980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:26.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f64b9b36980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:26.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f64b9b36980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:26.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f64b9b36980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:26.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f64b9b36980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:50:26.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f639a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94418653321712 notifier 5994 bl.length()=871 2024-08-08T23:50:26.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f639a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:26.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f639a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:26.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.228+0000 7f639a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:26.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.232+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:50:26.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.232+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:50:26.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.232+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:50:26.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.232+0000 7f64b9b36980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:50:26.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.232+0000 7f64b9b36980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-08-08T23:50:26.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.236+0000 7f64b9b36980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-08-08T23:50:26.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.240+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-08-08T23:50:26.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.240+0000 7f64b9b36980 20 processing logshard = reshard.0000000007 2024-08-08T23:50:26.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.248+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-08-08T23:50:26.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.248+0000 7f64b9b36980 20 processing logshard = reshard.0000000008 2024-08-08T23:50:26.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.252+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-08-08T23:50:26.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.252+0000 7f64b9b36980 20 processing logshard = reshard.0000000009 2024-08-08T23:50:26.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.260+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-08-08T23:50:26.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.260+0000 7f64b9b36980 20 processing logshard = reshard.0000000010 2024-08-08T23:50:26.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.264+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-08-08T23:50:26.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.264+0000 7f64b9b36980 20 processing logshard = reshard.0000000011 2024-08-08T23:50:26.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.272+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-08-08T23:50:26.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.272+0000 7f64b9b36980 20 processing logshard = reshard.0000000012 2024-08-08T23:50:26.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.276+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-08-08T23:50:26.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.276+0000 7f64b9b36980 20 processing logshard = reshard.0000000013 2024-08-08T23:50:26.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.284+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-08-08T23:50:26.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.284+0000 7f64b9b36980 20 processing logshard = reshard.0000000014 2024-08-08T23:50:26.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.292+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-08-08T23:50:26.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.292+0000 7f64b9b36980 20 processing logshard = reshard.0000000015 2024-08-08T23:50:26.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.296+0000 7f64b9b36980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-08-08T23:50:26.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.300+0000 7f636dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:26.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.304+0000 7f64b9b36980 20 remove_watcher() i=0 2024-08-08T23:50:26.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.304+0000 7f64b9b36980 2 removed watcher, disabling cache 2024-08-08T23:50:26.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.308+0000 7f64b9b36980 20 remove_watcher() i=1 2024-08-08T23:50:26.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.308+0000 7f64b9b36980 20 remove_watcher() i=2 2024-08-08T23:50:26.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.312+0000 7f64b9b36980 20 remove_watcher() i=3 2024-08-08T23:50:26.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.316+0000 7f64b9b36980 20 remove_watcher() i=4 2024-08-08T23:50:26.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.316+0000 7f64b9b36980 20 remove_watcher() i=5 2024-08-08T23:50:26.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.316+0000 7f64b9b36980 20 remove_watcher() i=6 2024-08-08T23:50:26.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:26.320+0000 7f64b9b36980 20 remove_watcher() i=7 2024-08-08T23:50:31.341 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-08T23:50:31.374 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:31.375 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:31.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 realm 2024-08-08T23:50:31.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:31.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.424+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.428+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:31.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.428+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.428+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:31.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.428+0000 7fa71a32e980 20 searching for the correct realm 2024-08-08T23:50:31.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.432+0000 7fa718643640 0 -- 172.21.15.83:0/1217032322 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fa70c0739b0 msgr2=0x7fa70c07c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:31.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.648+0000 7fa717641640 0 -- 172.21.15.83:0/1217032322 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fa710008430 msgr2=0x7fa7100088b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:31.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.864+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:31.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 zone default found 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 4 Realm: () 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:31.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 zonegroup default 2024-08-08T23:50:31.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:31.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 started sync module instance, tier type = 2024-08-08T23:50:31.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.868+0000 7fa71a32e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=0 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=1 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=2 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=3 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=4 2024-08-08T23:50:31.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=5 2024-08-08T23:50:31.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.892+0000 7fa71a32e980 20 add_watcher() i=6 2024-08-08T23:50:31.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.896+0000 7fa71a32e980 20 add_watcher() i=7 2024-08-08T23:50:31.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.896+0000 7fa71a32e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:31.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:31.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:31.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:31.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 5 note: GC not initialized 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa5ccfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 20 Filter name: none 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa5467fc640 20 reqs_thread_entry: start 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.900+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:31.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:31.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:31.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.904+0000 7fa71a32e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:31.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.908+0000 7fa71a32e980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:31.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.908+0000 7fa71a32e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:31.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.908+0000 7fa5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:31.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.912+0000 7fa71a32e980 20 remove_watcher() i=0 2024-08-08T23:50:31.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.912+0000 7fa71a32e980 2 removed watcher, disabling cache 2024-08-08T23:50:31.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.916+0000 7fa71a32e980 20 remove_watcher() i=1 2024-08-08T23:50:31.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.916+0000 7fa71a32e980 20 remove_watcher() i=2 2024-08-08T23:50:31.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.920+0000 7fa71a32e980 20 remove_watcher() i=3 2024-08-08T23:50:31.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.920+0000 7fa71a32e980 20 remove_watcher() i=4 2024-08-08T23:50:31.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.924+0000 7fa71a32e980 20 remove_watcher() i=5 2024-08-08T23:50:31.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.924+0000 7fa71a32e980 20 remove_watcher() i=6 2024-08-08T23:50:31.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:31.928+0000 7fa71a32e980 20 remove_watcher() i=7 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard add non empty bucket 2024-08-08T23:50:31.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:32.630 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-08T23:50:32.662 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:32.662 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:32.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.708+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 realm 2024-08-08T23:50:32.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:32.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:32.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:32.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.712+0000 7f45bba51980 20 searching for the correct realm 2024-08-08T23:50:32.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.716+0000 7f45b9d66640 0 -- 172.21.15.83:0/1567691834 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f45b00ce040 msgr2=0x7f45b00ec400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:32.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.724+0000 7f45b8d64640 0 -- 172.21.15.83:0/1567691834 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f45b40623f0 msgr2=0x7f45b4062850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:32.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:32.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.940+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 zone default found 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 4 Realm: () 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 zonegroup default 2024-08-08T23:50:32.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:32.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 started sync module instance, tier type = 2024-08-08T23:50:32.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.944+0000 7f45bba51980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:32.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=0 2024-08-08T23:50:32.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=1 2024-08-08T23:50:32.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=2 2024-08-08T23:50:32.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=3 2024-08-08T23:50:32.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=4 2024-08-08T23:50:32.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=5 2024-08-08T23:50:32.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.968+0000 7f45bba51980 20 add_watcher() i=6 2024-08-08T23:50:32.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.972+0000 7f45bba51980 20 add_watcher() i=7 2024-08-08T23:50:32.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.972+0000 7f45bba51980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:32.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f446ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:32.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:32.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:32.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 5 note: GC not initialized 2024-08-08T23:50:32.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f446efe5640 20 reqs_thread_entry: start 2024-08-08T23:50:32.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:32.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 20 Filter name: none 2024-08-08T23:50:32.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f446cfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:32.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.976+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:32.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:32.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:32.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:32.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.980+0000 7f45bba51980 20 rados->read ofs=0 len=0 2024-08-08T23:50:32.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.984+0000 7f45bba51980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:32.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.984+0000 7f45bba51980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:32.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.984+0000 7f446ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:32.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.988+0000 7f45bba51980 20 remove_watcher() i=0 2024-08-08T23:50:32.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.988+0000 7f45bba51980 2 removed watcher, disabling cache 2024-08-08T23:50:32.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.992+0000 7f45bba51980 20 remove_watcher() i=1 2024-08-08T23:50:32.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.996+0000 7f45bba51980 20 remove_watcher() i=2 2024-08-08T23:50:32.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:32.996+0000 7f45bba51980 20 remove_watcher() i=3 2024-08-08T23:50:32.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.000+0000 7f45bba51980 20 remove_watcher() i=4 2024-08-08T23:50:32.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.000+0000 7f45bba51980 20 remove_watcher() i=5 2024-08-08T23:50:32.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.004+0000 7f45bba51980 20 remove_watcher() i=6 2024-08-08T23:50:33.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.004+0000 7f45bba51980 20 remove_watcher() i=7 2024-08-08T23:50:33.018 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:33.018 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:33.018 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-08-08T23:50:33.018 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:33.018 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-08-08T23:50:33.048 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:33.049 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:33.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 realm 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.096+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:33.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:33.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.100+0000 7fe8e1d41980 20 searching for the correct realm 2024-08-08T23:50:33.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.104+0000 7fe8df855640 0 -- 172.21.15.83:0/1788700306 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fe8d802d040 msgr2=0x7fe8d8042a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:33.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.112+0000 7fe8df054640 0 -- 172.21.15.83:0/1788700306 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fe8d8061950 msgr2=0x7fe8d802d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:33.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.328+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:33.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 zone default found 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 4 Realm: () 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:33.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:33.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 zonegroup default 2024-08-08T23:50:33.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 started sync module instance, tier type = 2024-08-08T23:50:33.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.332+0000 7fe8e1d41980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=0 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=1 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=2 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=3 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=4 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=5 2024-08-08T23:50:33.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=6 2024-08-08T23:50:33.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 20 add_watcher() i=7 2024-08-08T23:50:33.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.360+0000 7fe8e1d41980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:33.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.364+0000 7fe795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:33.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:33.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:33.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 5 note: GC not initialized 2024-08-08T23:50:33.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe794fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:33.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:33.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 Filter name: none 2024-08-08T23:50:33.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe70e7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:33.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-08T23:50:33.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:33.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-08T23:50:33.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-08T23:50:33.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : miss 2024-08-08T23:50:33.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.368+0000 7fe8e1d41980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:33.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe8e1d41980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:33.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.372+0000 7fe795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:33.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.380+0000 7fe8e1d41980 20 remove_watcher() i=0 2024-08-08T23:50:33.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.380+0000 7fe8e1d41980 2 removed watcher, disabling cache 2024-08-08T23:50:33.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.384+0000 7fe8e1d41980 20 remove_watcher() i=1 2024-08-08T23:50:33.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.384+0000 7fe8e1d41980 20 remove_watcher() i=2 2024-08-08T23:50:33.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.388+0000 7fe8e1d41980 20 remove_watcher() i=3 2024-08-08T23:50:33.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.388+0000 7fe8e1d41980 20 remove_watcher() i=4 2024-08-08T23:50:33.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.392+0000 7fe8e1d41980 20 remove_watcher() i=5 2024-08-08T23:50:33.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.392+0000 7fe8e1d41980 20 remove_watcher() i=6 2024-08-08T23:50:33.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.392+0000 7fe8e1d41980 20 remove_watcher() i=7 2024-08-08T23:50:33.407 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard list 2024-08-08T23:50:33.431 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:33.431 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:33.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.476+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 realm 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:33.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:33.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.480+0000 7fdd9e506980 20 searching for the correct realm 2024-08-08T23:50:33.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.488+0000 7fdd9c01a640 0 -- 172.21.15.83:0/1417866932 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fdd94017070 msgr2=0x7fdd94069850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:33.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.492+0000 7fdd9b819640 0 -- 172.21.15.83:0/1417866932 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fdd94025120 msgr2=0x7fdd94002d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:33.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:33.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:33.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.708+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 zone default found 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 4 Realm: () 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 zonegroup default 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 started sync module instance, tier type = 2024-08-08T23:50:33.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.712+0000 7fdd9e506980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=0 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=1 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=2 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=3 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=4 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=5 2024-08-08T23:50:33.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.736+0000 7fdd9e506980 20 add_watcher() i=6 2024-08-08T23:50:33.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.740+0000 7fdd9e506980 20 add_watcher() i=7 2024-08-08T23:50:33.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.740+0000 7fdd9e506980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:33.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdc52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:33.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdd9e506980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:33.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdd9e506980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:33.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdd9e506980 5 note: GC not initialized 2024-08-08T23:50:33.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdc51fdb640 20 reqs_thread_entry: start 2024-08-08T23:50:33.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdd9e506980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:33.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdd9e506980 20 Filter name: none 2024-08-08T23:50:33.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.744+0000 7fdbc37fe640 20 reqs_thread_entry: start 2024-08-08T23:50:33.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.760+0000 7fdc52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:33.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.764+0000 7fdd9e506980 20 remove_watcher() i=0 2024-08-08T23:50:33.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.764+0000 7fdd9e506980 2 removed watcher, disabling cache 2024-08-08T23:50:33.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.764+0000 7fdd9e506980 20 remove_watcher() i=1 2024-08-08T23:50:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.768+0000 7fdd9e506980 20 remove_watcher() i=2 2024-08-08T23:50:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.772+0000 7fdd9e506980 20 remove_watcher() i=3 2024-08-08T23:50:33.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.776+0000 7fdd9e506980 20 remove_watcher() i=4 2024-08-08T23:50:33.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.776+0000 7fdd9e506980 20 remove_watcher() i=5 2024-08-08T23:50:33.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.776+0000 7fdd9e506980 20 remove_watcher() i=6 2024-08-08T23:50:33.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.780+0000 7fdd9e506980 20 remove_watcher() i=7 2024-08-08T23:50:33.792 INFO:tasks.workunit.client.0.smithi083.stderr:bucket name a-bucket 2024-08-08T23:50:33.792 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard process non empty bucket 2024-08-08T23:50:33.792 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:33.792 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard process 2024-08-08T23:50:33.816 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:33.816 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:33.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 realm 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:33.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:33.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.864+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:33.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.868+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:33.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.868+0000 7f46338d9980 20 searching for the correct realm 2024-08-08T23:50:33.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.872+0000 7f46313ed640 0 -- 172.21.15.83:0/4124848576 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f462c026040 msgr2=0x7f462c030420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:33.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:33.876+0000 7f4630bec640 0 -- 172.21.15.83:0/4124848576 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f462c05e950 msgr2=0x7f462c03a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:34.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:34.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:34.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:34.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:34.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:34.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:34.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.092+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 zone default found 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 4 Realm: () 2024-08-08T23:50:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 zonegroup default 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 started sync module instance, tier type = 2024-08-08T23:50:34.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.096+0000 7f46338d9980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=0 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=1 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=2 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=3 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=4 2024-08-08T23:50:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=5 2024-08-08T23:50:34.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=6 2024-08-08T23:50:34.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 20 add_watcher() i=7 2024-08-08T23:50:34.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.120+0000 7f46338d9980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:34.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f44e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:34.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:34.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:34.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 5 note: GC not initialized 2024-08-08T23:50:34.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f44e67e4640 20 reqs_thread_entry: start 2024-08-08T23:50:34.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:34.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 20 Filter name: none 2024-08-08T23:50:34.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f4457fff640 20 reqs_thread_entry: start 2024-08-08T23:50:34.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.128+0000 7f46338d9980 20 processing logshard = reshard.0000000000 2024-08-08T23:50:34.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.136+0000 7f46338d9980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-08-08T23:50:34.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.136+0000 7f46338d9980 20 processing logshard = reshard.0000000001 2024-08-08T23:50:34.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.140+0000 7f46338d9980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-08-08T23:50:34.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.140+0000 7f46338d9980 20 processing logshard = reshard.0000000002 2024-08-08T23:50:34.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.144+0000 7f46338d9980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-08-08T23:50:34.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.144+0000 7f46338d9980 20 processing logshard = reshard.0000000003 2024-08-08T23:50:34.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.152+0000 7f46338d9980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-08-08T23:50:34.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.152+0000 7f46338d9980 20 processing logshard = reshard.0000000004 2024-08-08T23:50:34.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.160+0000 7f46338d9980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-08-08T23:50:34.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.160+0000 7f46338d9980 20 processing logshard = reshard.0000000005 2024-08-08T23:50:34.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.164+0000 7f46338d9980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-08-08T23:50:34.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.164+0000 7f46338d9980 20 processing logshard = reshard.0000000006 2024-08-08T23:50:34.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 20 process_entry resharding a-bucket 2024-08-08T23:50:34.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-08T23:50:34.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:34.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-08-08T23:50:34.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-08T23:50:34.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : miss 2024-08-08T23:50:34.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.168+0000 7f46338d9980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.172+0000 7f46338d9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.172+0000 7f46338d9980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.172+0000 7f46338d9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.172+0000 7f46338d9980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:34.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.172+0000 7f46338d9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:34.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f46338d9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:34.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f46338d9980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:34.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f46338d9980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:34.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f46338d9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:50:34.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f4503fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94516864359232 notifier 5837 bl.length()=903 2024-08-08T23:50:34.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f4503fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:34.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f4503fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:34.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.184+0000 7f4503fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:34.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:50:34.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:50:34.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:50:34.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:50:34.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.0 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.188+0000 7f46338d9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.0 2024-08-08T23:50:34.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.192+0000 7f46338d9980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.1 2024-08-08T23:50:34.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.192+0000 7f46338d9980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.1.1 2024-08-08T23:50:34.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : hit (requested=0x17, cached=0x17) 2024-08-08T23:50:34.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:50:34.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:34.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:34.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:34.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f46338d9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:50:34.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f4503fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94516864359232 notifier 5837 bl.length()=871 2024-08-08T23:50:34.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f4503fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:50:34.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f4503fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:50:34.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.196+0000 7f4503fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:50:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.200+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:50:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.200+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:50:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.200+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:50:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.200+0000 7f46338d9980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:50:34.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.204+0000 7f46338d9980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-08-08T23:50:34.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.208+0000 7f46338d9980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-08-08T23:50:34.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.212+0000 7f46338d9980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-08-08T23:50:34.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.212+0000 7f46338d9980 20 processing logshard = reshard.0000000007 2024-08-08T23:50:34.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.216+0000 7f46338d9980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-08-08T23:50:34.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.216+0000 7f46338d9980 20 processing logshard = reshard.0000000008 2024-08-08T23:50:34.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.224+0000 7f46338d9980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-08-08T23:50:34.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.224+0000 7f46338d9980 20 processing logshard = reshard.0000000009 2024-08-08T23:50:34.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.232+0000 7f46338d9980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-08-08T23:50:34.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.232+0000 7f46338d9980 20 processing logshard = reshard.0000000010 2024-08-08T23:50:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.236+0000 7f46338d9980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-08-08T23:50:34.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.236+0000 7f46338d9980 20 processing logshard = reshard.0000000011 2024-08-08T23:50:34.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.240+0000 7f46338d9980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-08-08T23:50:34.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.240+0000 7f46338d9980 20 processing logshard = reshard.0000000012 2024-08-08T23:50:34.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.252+0000 7f46338d9980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-08-08T23:50:34.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.252+0000 7f46338d9980 20 processing logshard = reshard.0000000013 2024-08-08T23:50:34.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.256+0000 7f46338d9980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-08-08T23:50:34.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.256+0000 7f46338d9980 20 processing logshard = reshard.0000000014 2024-08-08T23:50:34.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.264+0000 7f46338d9980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-08-08T23:50:34.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.264+0000 7f46338d9980 20 processing logshard = reshard.0000000015 2024-08-08T23:50:34.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.268+0000 7f46338d9980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-08-08T23:50:34.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.272+0000 7f44e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:34.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.276+0000 7f46338d9980 20 remove_watcher() i=0 2024-08-08T23:50:34.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.276+0000 7f46338d9980 2 removed watcher, disabling cache 2024-08-08T23:50:34.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.280+0000 7f46338d9980 20 remove_watcher() i=1 2024-08-08T23:50:34.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.284+0000 7f46338d9980 20 remove_watcher() i=2 2024-08-08T23:50:34.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.284+0000 7f46338d9980 20 remove_watcher() i=3 2024-08-08T23:50:34.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.288+0000 7f46338d9980 20 remove_watcher() i=4 2024-08-08T23:50:34.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.288+0000 7f46338d9980 20 remove_watcher() i=5 2024-08-08T23:50:34.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.292+0000 7f46338d9980 20 remove_watcher() i=6 2024-08-08T23:50:34.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.296+0000 7f46338d9980 20 remove_watcher() i=7 2024-08-08T23:50:34.309 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-08T23:50:34.339 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:34.339 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:34.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.384+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 realm 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:34.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:34.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.388+0000 7f57caa6a980 20 searching for the correct realm 2024-08-08T23:50:34.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.396+0000 7f57c857e640 0 -- 172.21.15.83:0/792874318 >> [v2:172.21.15.83:6816/3379310080,v1:172.21.15.83:6817/3379310080] conn(0x5563ff992600 msgr2=0x5563ff9949f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:34.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.404+0000 7f57c7d7d640 0 -- 172.21.15.83:0/792874318 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f57c006b040 msgr2=0x7f57c00437f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:34.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:34.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:34.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 zone default found 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 4 Realm: () 2024-08-08T23:50:34.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 zonegroup default 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:34.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 started sync module instance, tier type = 2024-08-08T23:50:34.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.412+0000 7f57caa6a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=0 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=1 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=2 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=3 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=4 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=5 2024-08-08T23:50:34.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.428+0000 7f57caa6a980 20 add_watcher() i=6 2024-08-08T23:50:34.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f57caa6a980 20 add_watcher() i=7 2024-08-08T23:50:34.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f57caa6a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:34.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f567efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:34.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f57caa6a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:34.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f57caa6a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:34.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.432+0000 7f57caa6a980 5 note: GC not initialized 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f567dfdb640 20 reqs_thread_entry: start 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 Filter name: none 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f55ef7fe640 20 reqs_thread_entry: start 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:34.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:34.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:34.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:50:34.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.436+0000 7f57caa6a980 20 rados->read ofs=0 len=0 2024-08-08T23:50:34.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.440+0000 7f57caa6a980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:50:34.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.440+0000 7f57caa6a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:34.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.440+0000 7f567efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:34.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.444+0000 7f57caa6a980 20 remove_watcher() i=0 2024-08-08T23:50:34.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.444+0000 7f57caa6a980 2 removed watcher, disabling cache 2024-08-08T23:50:34.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.448+0000 7f57caa6a980 20 remove_watcher() i=1 2024-08-08T23:50:34.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.448+0000 7f57caa6a980 20 remove_watcher() i=2 2024-08-08T23:50:34.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.452+0000 7f57caa6a980 20 remove_watcher() i=3 2024-08-08T23:50:34.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.452+0000 7f57caa6a980 20 remove_watcher() i=4 2024-08-08T23:50:34.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.456+0000 7f57caa6a980 20 remove_watcher() i=5 2024-08-08T23:50:34.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.456+0000 7f57caa6a980 20 remove_watcher() i=6 2024-08-08T23:50:34.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:34.456+0000 7f57caa6a980 20 remove_watcher() i=7 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-08-08T23:50:34.468 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:36.400 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-08T23:50:36.432 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:36.432 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:36.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.480+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 realm 2024-08-08T23:50:36.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:36.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:36.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:36.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.484+0000 7f94516b1980 20 searching for the correct realm 2024-08-08T23:50:36.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.488+0000 7f944f9c6640 0 -- 172.21.15.83:0/1227685693 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f94440d3420 msgr2=0x7f94440d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:36.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.704+0000 7f944e9c4640 0 -- 172.21.15.83:0/1227685693 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f944804b040 msgr2=0x7f944804b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:36.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.920+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:36.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 zone default found 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 4 Realm: () 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 zonegroup default 2024-08-08T23:50:36.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:36.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 started sync module instance, tier type = 2024-08-08T23:50:36.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.924+0000 7f94516b1980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=0 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=1 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=2 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=3 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=4 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=5 2024-08-08T23:50:36.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.948+0000 7f94516b1980 20 add_watcher() i=6 2024-08-08T23:50:36.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.952+0000 7f94516b1980 20 add_watcher() i=7 2024-08-08T23:50:36.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.952+0000 7f94516b1980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:36.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.956+0000 7f9305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:36.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.956+0000 7f94516b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:36.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.956+0000 7f94516b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:36.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.956+0000 7f94516b1980 5 note: GC not initialized 2024-08-08T23:50:36.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f9304fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:36.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:36.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 Filter name: none 2024-08-08T23:50:36.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f927e7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:36.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:36.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:36.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:36.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:36.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.960+0000 7f94516b1980 20 rados->read ofs=0 len=0 2024-08-08T23:50:36.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.964+0000 7f94516b1980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:36.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.964+0000 7f94516b1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:36.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.964+0000 7f9305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:36.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.972+0000 7f94516b1980 20 remove_watcher() i=0 2024-08-08T23:50:36.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.972+0000 7f94516b1980 2 removed watcher, disabling cache 2024-08-08T23:50:36.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.972+0000 7f94516b1980 20 remove_watcher() i=1 2024-08-08T23:50:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.976+0000 7f94516b1980 20 remove_watcher() i=2 2024-08-08T23:50:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.976+0000 7f94516b1980 20 remove_watcher() i=3 2024-08-08T23:50:36.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.980+0000 7f94516b1980 20 remove_watcher() i=4 2024-08-08T23:50:36.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.980+0000 7f94516b1980 20 remove_watcher() i=5 2024-08-08T23:50:36.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.984+0000 7f94516b1980 20 remove_watcher() i=6 2024-08-08T23:50:36.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:36.984+0000 7f94516b1980 20 remove_watcher() i=7 2024-08-08T23:50:36.998 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:36.998 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:36.998 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:50:36.998 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:36.998 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-08-08T23:50:37.031 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:37.031 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:37.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.076+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.076+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.076+0000 7ff558f53980 20 realm 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:37.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:37.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:37.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.080+0000 7ff558f53980 20 searching for the correct realm 2024-08-08T23:50:37.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.084+0000 7ff557268640 0 -- 172.21.15.83:0/3816994730 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff54c123be0 msgr2=0x7ff54c10da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:37.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.300+0000 7ff556266640 0 -- 172.21.15.83:0/3816994730 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff5500367a0 msgr2=0x7ff5500401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:37.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.516+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:37.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 zone default found 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 4 Realm: () 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 zonegroup default 2024-08-08T23:50:37.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 started sync module instance, tier type = 2024-08-08T23:50:37.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.520+0000 7ff558f53980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=0 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=1 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=2 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=3 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=4 2024-08-08T23:50:37.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.544+0000 7ff558f53980 20 add_watcher() i=5 2024-08-08T23:50:37.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.548+0000 7ff558f53980 20 add_watcher() i=6 2024-08-08T23:50:37.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.548+0000 7ff558f53980 20 add_watcher() i=7 2024-08-08T23:50:37.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.548+0000 7ff558f53980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:37.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff40dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:37.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:37.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:37.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 5 note: GC not initialized 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff40cfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 20 Filter name: none 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff405ffb640 20 reqs_thread_entry: start 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-08T23:50:37.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.552+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 : miss 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:37.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:37.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:37.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:37.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:37.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.556+0000 7ff558f53980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 2024-08-08T23:50:37.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.560+0000 7ff558f53980 -1 Injecting error=-5 at location=set_target_layout 2024-08-08T23:50:37.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.560+0000 7ff558f53980 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-08-08T23:50:37.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.568+0000 7ff40dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:37.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.572+0000 7ff558f53980 20 remove_watcher() i=0 2024-08-08T23:50:37.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.572+0000 7ff558f53980 2 removed watcher, disabling cache 2024-08-08T23:50:37.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.572+0000 7ff558f53980 20 remove_watcher() i=1 2024-08-08T23:50:37.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.576+0000 7ff558f53980 20 remove_watcher() i=2 2024-08-08T23:50:37.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.580+0000 7ff558f53980 20 remove_watcher() i=3 2024-08-08T23:50:37.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.580+0000 7ff558f53980 20 remove_watcher() i=4 2024-08-08T23:50:37.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.584+0000 7ff558f53980 20 remove_watcher() i=5 2024-08-08T23:50:37.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.584+0000 7ff558f53980 20 remove_watcher() i=6 2024-08-08T23:50:37.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.584+0000 7ff558f53980 20 remove_watcher() i=7 2024-08-08T23:50:37.601 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-08T23:50:37.633 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:37.633 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:37.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.680+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 realm 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:37.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:37.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.684+0000 7f4efa248980 20 searching for the correct realm 2024-08-08T23:50:37.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.688+0000 7f4ef755b640 0 -- 172.21.15.83:0/2629324931 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f4ee80c32a0 msgr2=0x7f4ee80ef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:37.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.900+0000 7f4ef7d5c640 0 -- 172.21.15.83:0/2629324931 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f4ef0032070 msgr2=0x7f4ef005d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:37.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:37.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:37.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 zone default found 2024-08-08T23:50:37.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 4 Realm: () 2024-08-08T23:50:37.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 zonegroup default 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.920+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.924+0000 7f4efa248980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:37.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.924+0000 7f4efa248980 20 started sync module instance, tier type = 2024-08-08T23:50:37.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.924+0000 7f4efa248980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:37.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=0 2024-08-08T23:50:37.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=1 2024-08-08T23:50:37.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=2 2024-08-08T23:50:37.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=3 2024-08-08T23:50:37.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=4 2024-08-08T23:50:37.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=5 2024-08-08T23:50:37.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.944+0000 7f4efa248980 20 add_watcher() i=6 2024-08-08T23:50:37.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.948+0000 7f4efa248980 20 add_watcher() i=7 2024-08-08T23:50:37.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.948+0000 7f4efa248980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:37.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:37.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:37.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:37.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 5 note: GC not initialized 2024-08-08T23:50:37.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4dacfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:37.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:37.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 20 Filter name: none 2024-08-08T23:50:37.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4d267fc640 20 reqs_thread_entry: start 2024-08-08T23:50:37.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.952+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:37.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:37.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:37.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:37.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados->read ofs=0 len=0 2024-08-08T23:50:37.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:37.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.956+0000 7f4efa248980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:37.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.960+0000 7f4dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:37.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.964+0000 7f4efa248980 20 remove_watcher() i=0 2024-08-08T23:50:37.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.964+0000 7f4efa248980 2 removed watcher, disabling cache 2024-08-08T23:50:37.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.968+0000 7f4efa248980 20 remove_watcher() i=1 2024-08-08T23:50:37.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.968+0000 7f4efa248980 20 remove_watcher() i=2 2024-08-08T23:50:37.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.972+0000 7f4efa248980 20 remove_watcher() i=3 2024-08-08T23:50:37.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.976+0000 7f4efa248980 20 remove_watcher() i=4 2024-08-08T23:50:37.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.976+0000 7f4efa248980 20 remove_watcher() i=5 2024-08-08T23:50:37.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.976+0000 7f4efa248980 20 remove_watcher() i=6 2024-08-08T23:50:37.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:37.980+0000 7f4efa248980 20 remove_watcher() i=7 2024-08-08T23:50:37.992 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:37.992 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:37.992 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:50:37.992 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:38.113 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:50:38.148 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:38.148 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:38.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 realm 2024-08-08T23:50:38.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:38.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.200+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.204+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:38.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.204+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.204+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:38.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.204+0000 7f3b09483980 20 searching for the correct realm 2024-08-08T23:50:38.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.204+0000 7f3b06f97640 0 -- 172.21.15.83:0/4239202784 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f3b00020040 msgr2=0x7f3b0005eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:38.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.208+0000 7f3b06f97640 0 -- 172.21.15.83:0/4239202784 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x7f3af4003980 msgr2=0x7f3b00068a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:38.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:38.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:38.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 zone default found 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 4 Realm: () 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 zonegroup default 2024-08-08T23:50:38.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.432+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 started sync module instance, tier type = 2024-08-08T23:50:38.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.436+0000 7f3b09483980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=0 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=1 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=2 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=3 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=4 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=5 2024-08-08T23:50:38.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.460+0000 7f3b09483980 20 add_watcher() i=6 2024-08-08T23:50:38.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.464+0000 7f3b09483980 20 add_watcher() i=7 2024-08-08T23:50:38.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.464+0000 7f3b09483980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:38.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f39bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:38.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:38.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:38.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 5 note: GC not initialized 2024-08-08T23:50:38.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f39bcfe1640 20 reqs_thread_entry: start 2024-08-08T23:50:38.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:38.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 20 Filter name: none 2024-08-08T23:50:38.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f39b5ffb640 20 reqs_thread_entry: start 2024-08-08T23:50:38.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-08T23:50:38.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.468+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 : miss 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:38.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:38.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:38.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:38.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:38.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.472+0000 7f3b09483980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 2024-08-08T23:50:38.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f3b09483980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f3b09483980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f3b09483980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f3b09483980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20, ofs0, ns] 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f39ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 94110486694160 notifier 6180 bl.length()=1001 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f39ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f39ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:38.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.484+0000 7f39ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:38.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.488+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): orig_sources= new_sources= 2024-08-08T23:50:38.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.488+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): potential sources added=[] removed=[] 2024-08-08T23:50:38.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.488+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): orig_dests= new_dests= 2024-08-08T23:50:38.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.488+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): potential dests added=[] removed=[] 2024-08-08T23:50:38.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.492+0000 7f3b09483980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20.1.0 2024-08-08T23:50:38.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.492+0000 7f3b09483980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20.1.0 2024-08-08T23:50:38.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.492+0000 7f3b09483980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20.1.1 2024-08-08T23:50:38.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.492+0000 7f3b09483980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20.1.1 2024-08-08T23:50:38.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.492+0000 7f3b09483980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20.0 2024-08-08T23:50:38.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 : hit (requested=0x17, cached=0x17) 2024-08-08T23:50:38.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 2024-08-08T23:50:38.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:38.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:38.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:38.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.496+0000 7f3b09483980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20, ofs0, ns] 2024-08-08T23:50:38.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f39ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94110486694160 notifier 6180 bl.length()=969 2024-08-08T23:50:38.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f39ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 info.flags=0x17 2024-08-08T23:50:38.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f39ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 to cache LRU end 2024-08-08T23:50:38.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f39ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:38.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): orig_sources= new_sources= 2024-08-08T23:50:38.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): potential sources added=[] removed=[] 2024-08-08T23:50:38.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): orig_dests= new_dests= 2024-08-08T23:50:38.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.500+0000 7f3b09483980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20]): potential dests added=[] removed=[] 2024-08-08T23:50:38.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.504+0000 7f3b09483980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-08-08T23:50:38.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.508+0000 7f39bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:38.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.512+0000 7f3b09483980 20 remove_watcher() i=0 2024-08-08T23:50:38.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.512+0000 7f3b09483980 2 removed watcher, disabling cache 2024-08-08T23:50:38.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.516+0000 7f3b09483980 20 remove_watcher() i=1 2024-08-08T23:50:38.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.516+0000 7f3b09483980 20 remove_watcher() i=2 2024-08-08T23:50:38.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.520+0000 7f3b09483980 20 remove_watcher() i=3 2024-08-08T23:50:38.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.520+0000 7f3b09483980 20 remove_watcher() i=4 2024-08-08T23:50:38.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.524+0000 7f3b09483980 20 remove_watcher() i=5 2024-08-08T23:50:38.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.524+0000 7f3b09483980 20 remove_watcher() i=6 2024-08-08T23:50:38.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.528+0000 7f3b09483980 20 remove_watcher() i=7 2024-08-08T23:50:38.545 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-08T23:50:38.576 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:38.576 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:38.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 realm 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:38.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.624+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.628+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:38.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.628+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.628+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:38.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.628+0000 7fb791d93980 20 searching for the correct realm 2024-08-08T23:50:38.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.632+0000 7fb78f8a7640 0 -- 172.21.15.83:0/3269568409 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fb78810bc40 msgr2=0x7fb7880f07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:38.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.640+0000 7fb78f0a6640 0 -- 172.21.15.83:0/3269568409 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fb7880d9bd0 msgr2=0x7fb7880bb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:38.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:38.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:38.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:38.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:38.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:38.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:38.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:38.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.856+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 zone default found 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 4 Realm: () 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 zonegroup default 2024-08-08T23:50:38.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:38.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 started sync module instance, tier type = 2024-08-08T23:50:38.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.860+0000 7fb791d93980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=0 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=1 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=2 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=3 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=4 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=5 2024-08-08T23:50:38.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.892+0000 7fb791d93980 20 add_watcher() i=6 2024-08-08T23:50:38.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.896+0000 7fb791d93980 20 add_watcher() i=7 2024-08-08T23:50:38.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.896+0000 7fb791d93980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:38.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:38.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb791d93980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:38.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb791d93980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:38.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb791d93980 5 note: GC not initialized 2024-08-08T23:50:38.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb644fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:38.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb791d93980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:38.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb791d93980 20 Filter name: none 2024-08-08T23:50:38.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.900+0000 7fb5be7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:38.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:38.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados->read ofs=0 len=0 2024-08-08T23:50:38.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:38.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.904+0000 7fb791d93980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:38.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.908+0000 7fb645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:38.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.912+0000 7fb791d93980 20 remove_watcher() i=0 2024-08-08T23:50:38.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.912+0000 7fb791d93980 2 removed watcher, disabling cache 2024-08-08T23:50:38.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.916+0000 7fb791d93980 20 remove_watcher() i=1 2024-08-08T23:50:38.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.920+0000 7fb791d93980 20 remove_watcher() i=2 2024-08-08T23:50:38.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.920+0000 7fb791d93980 20 remove_watcher() i=3 2024-08-08T23:50:38.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.924+0000 7fb791d93980 20 remove_watcher() i=4 2024-08-08T23:50:38.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.924+0000 7fb791d93980 20 remove_watcher() i=5 2024-08-08T23:50:38.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.928+0000 7fb791d93980 20 remove_watcher() i=6 2024-08-08T23:50:38.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:38.928+0000 7fb791d93980 20 remove_watcher() i=7 2024-08-08T23:50:38.941 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:38.941 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:38.941 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:50:38.941 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:39.724 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-08-08T23:50:39.725 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:41.731 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-08T23:50:41.764 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:41.764 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:41.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:41.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:41.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 realm 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:41.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.811+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:41.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.815+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:41.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.815+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:41.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.815+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:41.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.815+0000 7f8d2b3c2980 20 searching for the correct realm 2024-08-08T23:50:41.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:41.819+0000 7f8d296d7640 0 -- 172.21.15.83:0/3155397725 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f8d1c029070 msgr2=0x7f8d1c037770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:42.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.035+0000 7f8d286d5640 0 -- 172.21.15.83:0/3155397725 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f8d2010c220 msgr2=0x7f8d200f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:42.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.251+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:42.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 zone default found 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 4 Realm: () 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:42.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 zonegroup default 2024-08-08T23:50:42.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 started sync module instance, tier type = 2024-08-08T23:50:42.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.255+0000 7f8d2b3c2980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=0 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=1 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=2 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=3 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=4 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=5 2024-08-08T23:50:42.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.279+0000 7f8d2b3c2980 20 add_watcher() i=6 2024-08-08T23:50:42.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.283+0000 7f8d2b3c2980 20 add_watcher() i=7 2024-08-08T23:50:42.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.283+0000 7f8d2b3c2980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:42.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.287+0000 7f8bdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:42.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.287+0000 7f8d2b3c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:42.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.287+0000 7f8d2b3c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:42.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.287+0000 7f8d2b3c2980 5 note: GC not initialized 2024-08-08T23:50:42.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8bddfe3640 20 reqs_thread_entry: start 2024-08-08T23:50:42.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:42.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 Filter name: none 2024-08-08T23:50:42.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8b4f7fe640 20 reqs_thread_entry: start 2024-08-08T23:50:42.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:42.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:42.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:42.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.291+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.295+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:42.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.295+0000 7f8d2b3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.295+0000 7f8d2b3c2980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:42.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.295+0000 7f8d2b3c2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:42.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.299+0000 7f8bdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:42.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.303+0000 7f8d2b3c2980 20 remove_watcher() i=0 2024-08-08T23:50:42.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.303+0000 7f8d2b3c2980 2 removed watcher, disabling cache 2024-08-08T23:50:42.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.307+0000 7f8d2b3c2980 20 remove_watcher() i=1 2024-08-08T23:50:42.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.311+0000 7f8d2b3c2980 20 remove_watcher() i=2 2024-08-08T23:50:42.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.311+0000 7f8d2b3c2980 20 remove_watcher() i=3 2024-08-08T23:50:42.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.315+0000 7f8d2b3c2980 20 remove_watcher() i=4 2024-08-08T23:50:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.319+0000 7f8d2b3c2980 20 remove_watcher() i=5 2024-08-08T23:50:42.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.319+0000 7f8d2b3c2980 20 remove_watcher() i=6 2024-08-08T23:50:42.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.319+0000 7f8d2b3c2980 20 remove_watcher() i=7 2024-08-08T23:50:42.333 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:42.333 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:42.333 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:50:42.333 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:42.333 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-08-08T23:50:42.371 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:42.371 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:42.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.415+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 realm 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:42.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:42.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.419+0000 7fd45af13980 20 searching for the correct realm 2024-08-08T23:50:42.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.423+0000 7fd459228640 0 -- 172.21.15.83:0/3360170527 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fd440030060 msgr2=0x7fd44005a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:42.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.639+0000 7fd458226640 0 -- 172.21.15.83:0/3360170527 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fd4480c0700 msgr2=0x7fd4480f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:42.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:42.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:42.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:42.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:42.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.855+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 zone default found 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 4 Realm: () 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:42.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:42.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 zonegroup default 2024-08-08T23:50:42.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:42.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 started sync module instance, tier type = 2024-08-08T23:50:42.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.859+0000 7fd45af13980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=0 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=1 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=2 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=3 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=4 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=5 2024-08-08T23:50:42.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.879+0000 7fd45af13980 20 add_watcher() i=6 2024-08-08T23:50:42.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.883+0000 7fd45af13980 20 add_watcher() i=7 2024-08-08T23:50:42.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.883+0000 7fd45af13980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:42.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd30f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:42.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:42.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:42.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 5 note: GC not initialized 2024-08-08T23:50:42.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd30e7e4640 20 reqs_thread_entry: start 2024-08-08T23:50:42.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:42.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 Filter name: none 2024-08-08T23:50:42.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd3077fe640 20 reqs_thread_entry: start 2024-08-08T23:50:42.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-08T23:50:42.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-08T23:50:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-08T23:50:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 : miss 2024-08-08T23:50:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rados->read ofs=0 len=0 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 info.flags=0x17 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 to cache LRU end 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:42.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.887+0000 7fd45af13980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 2024-08-08T23:50:42.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.895+0000 7fd45af13980 -1 Injecting error=-125 at location=set_target_layout 2024-08-08T23:50:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd45af13980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 info.flags=0x17 2024-08-08T23:50:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd45af13980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 to cache LRU end 2024-08-08T23:50:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd45af13980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd45af13980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21, ofs0, ns] 2024-08-08T23:50:42.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd32ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94728472139472 notifier 6237 bl.length()=1001 2024-08-08T23:50:42.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd32ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 info.flags=0x17 2024-08-08T23:50:42.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd32ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 to cache LRU end 2024-08-08T23:50:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.899+0000 7fd32ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:42.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.907+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): orig_sources= new_sources= 2024-08-08T23:50:42.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.907+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): potential sources added=[] removed=[] 2024-08-08T23:50:42.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.907+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): orig_dests= new_dests= 2024-08-08T23:50:42.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.907+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): potential dests added=[] removed=[] 2024-08-08T23:50:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.911+0000 7fd45af13980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21.1.0 2024-08-08T23:50:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.911+0000 7fd45af13980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21.1.0 2024-08-08T23:50:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.911+0000 7fd45af13980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21.1.1 2024-08-08T23:50:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.911+0000 7fd45af13980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21.1.1 2024-08-08T23:50:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.911+0000 7fd45af13980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21.0 2024-08-08T23:50:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.915+0000 7fd45af13980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 : hit (requested=0x17, cached=0x17) 2024-08-08T23:50:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.915+0000 7fd45af13980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 2024-08-08T23:50:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd45af13980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 info.flags=0x17 2024-08-08T23:50:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd45af13980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 to cache LRU end 2024-08-08T23:50:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd45af13980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd45af13980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21, ofs0, ns] 2024-08-08T23:50:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd32f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 94728472139472 notifier 6237 bl.length()=969 2024-08-08T23:50:42.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd32f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 info.flags=0x17 2024-08-08T23:50:42.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd32f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 to cache LRU end 2024-08-08T23:50:42.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.919+0000 7fd32f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:42.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.923+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): orig_sources= new_sources= 2024-08-08T23:50:42.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.923+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): potential sources added=[] removed=[] 2024-08-08T23:50:42.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.923+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): orig_dests= new_dests= 2024-08-08T23:50:42.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.923+0000 7fd45af13980 20 handle_bi_update(): bucket=:error-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21]): potential dests added=[] removed=[] 2024-08-08T23:50:42.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.923+0000 7fd45af13980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-08-08T23:50:42.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.927+0000 7fd30f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:42.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.935+0000 7fd45af13980 20 remove_watcher() i=0 2024-08-08T23:50:42.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.935+0000 7fd45af13980 2 removed watcher, disabling cache 2024-08-08T23:50:42.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.935+0000 7fd45af13980 20 remove_watcher() i=1 2024-08-08T23:50:42.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.939+0000 7fd45af13980 20 remove_watcher() i=2 2024-08-08T23:50:42.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.943+0000 7fd45af13980 20 remove_watcher() i=3 2024-08-08T23:50:42.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.943+0000 7fd45af13980 20 remove_watcher() i=4 2024-08-08T23:50:42.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.947+0000 7fd45af13980 20 remove_watcher() i=5 2024-08-08T23:50:42.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.947+0000 7fd45af13980 20 remove_watcher() i=6 2024-08-08T23:50:42.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:42.951+0000 7fd45af13980 20 remove_watcher() i=7 2024-08-08T23:50:42.962 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-08T23:50:42.993 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:42.993 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:43.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 realm 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.039+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.043+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:43.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.043+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.043+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:43.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.043+0000 7ff436961980 20 searching for the correct realm 2024-08-08T23:50:43.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.047+0000 7ff434c76640 0 -- 172.21.15.83:0/2137030119 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff428037a50 msgr2=0x7ff428083a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:43.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.055+0000 7ff433c74640 0 -- 172.21.15.83:0/2137030119 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff42c0661a0 msgr2=0x7ff42c07a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:43.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:43.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.271+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:43.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 zone default found 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 4 Realm: () 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 zonegroup default 2024-08-08T23:50:43.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.275+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.279+0000 7ff436961980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:43.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.279+0000 7ff436961980 20 started sync module instance, tier type = 2024-08-08T23:50:43.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.279+0000 7ff436961980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=0 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=1 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=2 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=3 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=4 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=5 2024-08-08T23:50:43.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=6 2024-08-08T23:50:43.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 20 add_watcher() i=7 2024-08-08T23:50:43.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.299+0000 7ff436961980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:43.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.303+0000 7ff2eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:43.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:43.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:43.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 5 note: GC not initialized 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff2e9fdb640 20 reqs_thread_entry: start 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 Filter name: none 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff25b7fe640 20 reqs_thread_entry: start 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:43.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.307+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:43.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:43.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:43.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 rados->read ofs=0 len=0 2024-08-08T23:50:43.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:43.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.311+0000 7ff436961980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:43.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.315+0000 7ff2eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:43.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.319+0000 7ff436961980 20 remove_watcher() i=0 2024-08-08T23:50:43.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.319+0000 7ff436961980 2 removed watcher, disabling cache 2024-08-08T23:50:43.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.323+0000 7ff436961980 20 remove_watcher() i=1 2024-08-08T23:50:43.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.323+0000 7ff436961980 20 remove_watcher() i=2 2024-08-08T23:50:43.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.327+0000 7ff436961980 20 remove_watcher() i=3 2024-08-08T23:50:43.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.327+0000 7ff436961980 20 remove_watcher() i=4 2024-08-08T23:50:43.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.331+0000 7ff436961980 20 remove_watcher() i=5 2024-08-08T23:50:43.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.331+0000 7ff436961980 20 remove_watcher() i=6 2024-08-08T23:50:43.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:43.335+0000 7ff436961980 20 remove_watcher() i=7 2024-08-08T23:50:43.347 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:43.347 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:43.348 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-08-08T23:50:43.348 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:44.020 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at set_target_layout 2024-08-08T23:50:44.020 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:46.067 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-08T23:50:46.100 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:46.101 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:46.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 realm 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.147+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.151+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:46.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.151+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.151+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:46.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.151+0000 7f93e46ab980 20 searching for the correct realm 2024-08-08T23:50:46.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.155+0000 7f93e29c0640 0 -- 172.21.15.83:0/1998087165 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f93d8038070 msgr2=0x7f93d8038450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:46.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.163+0000 7f93e19be640 0 -- 172.21.15.83:0/1998087165 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f93dc0ee8e0 msgr2=0x7f93dc0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:50:46.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:46.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.379+0000 7f93e46ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:46.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 zone default found 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 4 Realm: () 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 zonegroup default 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.383+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.387+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.387+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.387+0000 7f93e46ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.387+0000 7f93e46ab980 20 started sync module instance, tier type = 2024-08-08T23:50:46.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.387+0000 7f93e46ab980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:46.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=0 2024-08-08T23:50:46.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=1 2024-08-08T23:50:46.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=2 2024-08-08T23:50:46.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=3 2024-08-08T23:50:46.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=4 2024-08-08T23:50:46.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=5 2024-08-08T23:50:46.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=6 2024-08-08T23:50:46.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 20 add_watcher() i=7 2024-08-08T23:50:46.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.411+0000 7f93e46ab980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:46.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.415+0000 7f9298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:46.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:46.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:46.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 5 note: GC not initialized 2024-08-08T23:50:46.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f92137fe640 20 reqs_thread_entry: start 2024-08-08T23:50:46.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:46.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 Filter name: none 2024-08-08T23:50:46.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f92117fa640 20 reqs_thread_entry: start 2024-08-08T23:50:46.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:46.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.419+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:46.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:46.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:46.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:46.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.423+0000 7f93e46ab980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:46.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.427+0000 7f9298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:46.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.431+0000 7f93e46ab980 20 remove_watcher() i=0 2024-08-08T23:50:46.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.431+0000 7f93e46ab980 2 removed watcher, disabling cache 2024-08-08T23:50:46.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.435+0000 7f93e46ab980 20 remove_watcher() i=1 2024-08-08T23:50:46.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.435+0000 7f93e46ab980 20 remove_watcher() i=2 2024-08-08T23:50:46.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.439+0000 7f93e46ab980 20 remove_watcher() i=3 2024-08-08T23:50:46.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.439+0000 7f93e46ab980 20 remove_watcher() i=4 2024-08-08T23:50:46.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.443+0000 7f93e46ab980 20 remove_watcher() i=5 2024-08-08T23:50:46.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.443+0000 7f93e46ab980 20 remove_watcher() i=6 2024-08-08T23:50:46.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.443+0000 7f93e46ab980 20 remove_watcher() i=7 2024-08-08T23:50:46.466 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:46.466 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:46.466 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:50:46.467 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:46.467 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-08-08T23:50:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:46.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.551+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 realm 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:46.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:46.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.555+0000 7fc76626e980 20 searching for the correct realm 2024-08-08T23:50:46.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.559+0000 7fc764583640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc74c0bf070 msgr2=0x7fc74c0fa940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.775+0000 7fc75bfff640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc75c045900 msgr2=0x7fc75c02b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.991+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:46.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 zone default found 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 4 Realm: () 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 zonegroup default 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:46.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.999+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:46.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.999+0000 7fc76626e980 20 started sync module instance, tier type = 2024-08-08T23:50:46.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:46.999+0000 7fc76626e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=0 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=1 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=2 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=3 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=4 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=5 2024-08-08T23:50:47.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=6 2024-08-08T23:50:47.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.023+0000 7fc76626e980 20 add_watcher() i=7 2024-08-08T23:50:47.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.023+0000 7fc76626e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:47.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:47.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:47.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:47.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 5 note: GC not initialized 2024-08-08T23:50:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc618fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 20 Filter name: none 2024-08-08T23:50:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc5927fc640 20 reqs_thread_entry: start 2024-08-08T23:50:47.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-08T23:50:47.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.027+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:47.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : miss 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:50:47.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:50:47.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:47.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:47.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.031+0000 7fc76626e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:50:47.033 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc76626e980 time 2024-08-08T23:50:47.041414+0000 2024-08-08T23:50:47.033 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:50:47.036 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc769b46cc1] 2024-08-08T23:50:47.036 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.039+0000 7fc76626e980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc76626e980 time 2024-08-08T23:50:47.041414+0000 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc769b46cc1] 2024-08-08T23:50:47.037 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-08-08T23:50:47.038 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc76626e980 thread_name:radosgw-admin 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7689c7520] 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc769b46d1b] 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.040 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.043+0000 7fc76626e980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc76626e980 thread_name:radosgw-admin 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.041 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7689c7520] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc769b46d1b] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-08-08T23:50:47.042 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:50:47.043 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.043 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:50:47.081 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.081 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.136537s 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e1ccc40 auth_method 0 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e25f800 auth_method 0 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.082 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e25edd0 auth_method 0 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_done global_id 6279 payload 274 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.083 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:50:46.531+0000 7fc763d82640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: dump: 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: dump: 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 monclient: authenticate success, global_id 6279 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: get_monmap_and_config success 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:50:46.531+0000 7fc76626e980 4 set_mon_vals no callback set 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: shutdown 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) unregister_commands rotate-key 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: starting msgr at 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: starting objecter 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests hook 0x55955e3106d0 2024-08-08T23:50:47.088 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: setting wanted keys 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: calling monclient init 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.089 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key hook 0x55955e312aa8 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e1ccc40 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e25edd0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e25f800 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.090 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.139608s 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e25edd0 auth_method 0 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e1ccc40 auth_method 0 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.091 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6011 payload 824 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:50:46.531+0000 7fc75bfff640 1 monclient: found mon.noname-c 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:50:46.535+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: dump: 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.092 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:50:46.535+0000 7fc76626e980 5 monclient: authenticate success, global_id 6011 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.093 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: dump: 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.094 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:50:46.535+0000 7fc651e0b640 4 set_mon_vals no callback set 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:50:46.535+0000 7fc76626e980 1 librados: init done 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:50:46.535+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc64c0662d0 auth_method 0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:50:46.535+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e33a5a0 auth_method 0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:50:46.535+0000 7fc763d82640 10 monclient: get_auth_request con 0x55955e35cf20 auth_method 0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:50:46.539+0000 7fc75bfff640 10 monclient: get_auth_request con 0x55955e361280 auth_method 0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:50:46.539+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e360810 auth_method 0 2024-08-08T23:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:50:46.543+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.097 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests cmddesc objecter_requests hook 0x55955e36c9c0 EEXIST 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x55955e368460 EEXIST 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.099 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e372f50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e373880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e373330 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.149195s 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e373880 auth_method 0 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e373330 auth_method 0 2024-08-08T23:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e372f50 auth_method 0 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.101 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_done global_id 6285 payload 824 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:50:46.543+0000 7fc763d82640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: dump: 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: dump: 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:50:46.543+0000 7fc764d84640 4 set_mon_vals no callback set 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 monclient: authenticate success, global_id 6285 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: get_monmap_and_config 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.106 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc63c0661b0 auth_method 0 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x7ffece9ebe18 EEXIST 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e3e08c0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e3b5f50 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e3df600 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.153915s 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e3e08c0 auth_method 0 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e3b5f50 auth_method 0 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6288 payload 274 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:50:46.547+0000 7fc75bfff640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: dump: 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: dump: 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 monclient: authenticate success, global_id 6288 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: get_monmap_and_config success 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:50:46.547+0000 7fc76626e980 4 set_mon_vals no callback set 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: shutdown 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.113 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.114 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: starting msgr at 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: starting objecter 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests cmddesc objecter_requests hook 0x55955e3ddc60 EEXIST 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: setting wanted keys 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: calling monclient init 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.115 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:50:46.551+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:50:46.551+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x55955e3a8af8 EEXIST 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e3b5f50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.116 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e3df600 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e3e08c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.156472s 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e3b5f50 auth_method 0 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e3e08c0 auth_method 0 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.117 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6291 payload 824 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:50:46.551+0000 7fc75bfff640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:50:46.551+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e3df600 auth_method 0 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.118 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: dump: 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.119 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: dump: 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.120 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 monclient: authenticate success, global_id 6291 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:50:46.551+0000 7fc642ffd640 4 set_mon_vals no callback set 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:50:46.551+0000 7fc76626e980 1 librados: init done 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 asok(0x55955e108520) register_command cr dump hook 0x55955e3e7d38 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:50:46.551+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:50:46.551+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc62c0662a0 auth_method 0 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient: get_auth_request con 0x55955e3fe790 auth_method 0 2024-08-08T23:50:47.121 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 realm 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:50:46.555+0000 7fc76626e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:50:46.555+0000 7fc75bfff640 10 monclient: get_auth_request con 0x55955e402a00 auth_method 0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:50:46.555+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e406260 auth_method 0 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 searching for the correct realm 2024-08-08T23:50:47.122 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:50:46.559+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc75c036650 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:50:46.559+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc754008050 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:50:46.559+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc74c0bf070 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:50:46.559+0000 7fc764583640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc74c0bf070 msgr2=0x7fc74c0fa940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:50:46.763+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc74c0bf070 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:50:46.767+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc75c02c430 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:50:46.775+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc75c045900 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:50:46.775+0000 7fc75bfff640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc75c045900 msgr2=0x7fc75c02b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:50:46.979+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc75c045900 auth_method 0 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 zone default found 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 Realm: () 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:50:46.995+0000 7fc76626e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 zonegroup default 2024-08-08T23:50:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 started sync module instance, tier type = 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=0 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=1 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=2 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=3 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=4 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=5 2024-08-08T23:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=6 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:50:47.023+0000 7fc76626e980 20 add_watcher() i=7 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:50:47.023+0000 7fc76626e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:50:47.027+0000 7fc619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.126 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:50:47.027+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache list hook 0x55955e3e8560 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache inspect hook 0x55955e3e8560 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache erase hook 0x55955e3e8560 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache zap hook 0x55955e3e8560 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 note: GC not initialized 2024-08-08T23:50:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:50:47.027+0000 7fc618fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace show hook 0x7fc74c004470 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace history hook 0x7fc74c004470 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace active hook 0x7fc74c004470 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace active_short hook 0x7fc74c004470 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 Filter name: none 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:50:47.027+0000 7fc5927fc640 20 reqs_thread_entry: start 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:50:47.027+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : miss 2024-08-08T23:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:50:47.039+0000 7fc76626e980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc76626e980 time 2024-08-08T23:50:47.041414+0000 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc769b46cc1] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:50:47.043+0000 7fc76626e980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:50:47.130 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc76626e980 thread_name:radosgw-admin 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7689c7520] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc769b46d1b] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-08-08T23:50:47.131 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:50:47.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:50:47.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:50:47.134 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:50:47.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:50:47.136 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:50:47.137 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:50:47.138 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc5927fc640 / http_manager 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc618fe1640 / http_manager 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc619fe3640 / rgw_dt_lg_renew 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc6417fa640 / ms_dispatch 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc642ffd640 / io_context_pool 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc6497fa640 / ms_dispatch 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc64bfff640 / ms_dispatch 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc651e0b640 / io_context_pool 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc75bfff640 / msgr-worker-2 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc763d82640 / msgr-worker-1 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc764583640 / msgr-worker-0 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc764d84640 / io_context_pool 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc76626e980 / radosgw-admin 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:50:47.139 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.81934.log 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.136537s 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e1ccc40 auth_method 0 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e25f800 auth_method 0 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.140 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:50:46.531+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e25edd0 auth_method 0 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_done global_id 6279 payload 274 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:50:46.531+0000 7fc763d82640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.141 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: dump: 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.142 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:50:46.531+0000 7fc651e0b640 10 monclient: dump: 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.143 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 monclient: authenticate success, global_id 6279 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: get_monmap_and_config success 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:50:46.531+0000 7fc76626e980 4 set_mon_vals no callback set 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: shutdown 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) unregister_commands rotate-key 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.144 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding auth protocol: cephx 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.145 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: crc 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e318320) adding con mode: secure 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: starting msgr at 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: starting objecter 2024-08-08T23:50:47.146 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests hook 0x55955e3106d0 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: setting wanted keys 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:50:46.531+0000 7fc76626e980 1 librados: calling monclient init 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding auth protocol: cephx 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.147 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: crc 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 AuthRegistry(0x55955e312960) adding con mode: secure 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:50:46.531+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:50:46.531+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key hook 0x55955e312aa8 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e1ccc40 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e25edd0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e25f800 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.148 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:50:46.531+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.139608s 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e25edd0 auth_method 0 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e1ccc40 auth_method 0 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.149 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:50:46.531+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6011 payload 824 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:50:46.531+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:50:46.531+0000 7fc75bfff640 1 monclient: found mon.noname-c 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:50:46.535+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: dump: 2024-08-08T23:50:47.150 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:50:46.535+0000 7fc76626e980 5 monclient: authenticate success, global_id 6011 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.151 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:50:46.535+0000 7fc64bfff640 10 monclient: dump: 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.152 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:50:46.535+0000 7fc651e0b640 4 set_mon_vals no callback set 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:50:46.535+0000 7fc76626e980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:50:46.535+0000 7fc76626e980 1 librados: init done 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:50:46.535+0000 7fc64bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:50:46.535+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc64c0662d0 auth_method 0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:50:46.535+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e33a5a0 auth_method 0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:50:46.535+0000 7fc763d82640 10 monclient: get_auth_request con 0x55955e35cf20 auth_method 0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:50:46.539+0000 7fc75bfff640 10 monclient: get_auth_request con 0x55955e361280 auth_method 0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:50:46.539+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e360810 auth_method 0 2024-08-08T23:50:47.153 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:50:46.543+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.154 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding auth protocol: cephx 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.155 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: crc 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e369420) adding con mode: secure 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests cmddesc objecter_requests hook 0x55955e36c9c0 EEXIST 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding auth protocol: cephx 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.156 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: crc 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 AuthRegistry(0x55955e368318) adding con mode: secure 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:50:46.543+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x55955e368460 EEXIST 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e372f50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e373880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.157 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e373330 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.149195s 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e373880 auth_method 0 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e373330 auth_method 0 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.158 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:50:46.543+0000 7fc764583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e372f50 auth_method 0 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:50:46.543+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient(hunting): handle_auth_done global_id 6285 payload 824 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:50:46.543+0000 7fc763d82640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.159 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:50:46.543+0000 7fc763d82640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: dump: 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.160 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:50:46.543+0000 7fc6497fa640 10 monclient: dump: 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.161 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:50:46.543+0000 7fc764d84640 4 set_mon_vals no callback set 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:50:46.543+0000 7fc76626e980 5 monclient: authenticate success, global_id 6285 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:50:46.543+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:50:46.547+0000 7fc6497fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: get_monmap_and_config 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.162 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.163 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding auth protocol: cephx 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: crc 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3b0840) adding con mode: secure 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc63c0661b0 auth_method 0 2024-08-08T23:50:47.164 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding auth protocol: cephx 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.165 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: crc 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ebcd0) adding con mode: secure 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x7ffece9ebe18 EEXIST 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e3e08c0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e3b5f50 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e3df600 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.166 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.153915s 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e3e08c0 auth_method 0 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): get_auth_request con 0x55955e3b5f50 auth_method 0 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:50:46.547+0000 7fc764583640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.167 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6288 payload 274 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:50:46.547+0000 7fc75bfff640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:50:46.547+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: dump: 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.168 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:50:46.547+0000 7fc642ffd640 10 monclient: dump: 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.169 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 monclient: authenticate success, global_id 6288 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: get_monmap_and_config success 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:50:46.547+0000 7fc76626e980 4 set_mon_vals no callback set 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: shutdown 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: build_initial_monmap 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 build_initial for_mkfs: 0 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: monmap: 2024-08-08T23:50:47.170 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding auth protocol: cephx 2024-08-08T23:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: crc 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3dc520) adding con mode: secure 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:50:46.547+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: starting msgr at 2024-08-08T23:50:47.172 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: starting objecter 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 asok(0x55955e108520) register_command objecter_requests cmddesc objecter_requests hook 0x55955e3ddc60 EEXIST 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: setting wanted keys 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:50:46.547+0000 7fc76626e980 1 librados: calling monclient init 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:50:46.547+0000 7fc76626e980 10 monclient: init 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding auth protocol: cephx 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.173 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: crc 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:50:46.547+0000 7fc76626e980 5 AuthRegistry(0x55955e3a89b0) adding con mode: secure 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:50:46.551+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:50:46.551+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 asok(0x55955e108520) register_command rotate-key cmddesc rotate-key hook 0x55955e3a8af8 EEXIST 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _reopen_session rank -1 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-a con 0x55955e3b5f50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-b con 0x55955e3df600 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:50:47.174 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): picked mon.noname-c con 0x55955e3e08c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): start opening mon connection 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): _renew_subs 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient(hunting): authenticate will time out at 2317.156472s 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): get_auth_request con 0x55955e3b5f50 auth_method 0 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): get_auth_request con 0x55955e3e08c0 auth_method 0 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:50:47.175 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient(hunting): handle_auth_done global_id 6291 payload 824 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient: _finish_hunting 0 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:50:46.551+0000 7fc75bfff640 1 monclient: found mon.noname-a 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:50:46.551+0000 7fc75bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:50:46.551+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e3df600 auth_method 0 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: dump: 2024-08-08T23:50:47.176 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: _finish_auth 0 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: _check_auth_tickets 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_config config(0 keys) 2024-08-08T23:50:47.177 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:50:46.551+0000 7fc6417fa640 10 monclient: dump: 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.178 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 monclient: authenticate success, global_id 6291 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:50:46.551+0000 7fc642ffd640 4 set_mon_vals no callback set 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _renew_subs 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:50:46.551+0000 7fc76626e980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:50:46.551+0000 7fc76626e980 1 librados: init done 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:50:46.551+0000 7fc76626e980 5 asok(0x55955e108520) register_command cr dump hook 0x55955e3e7d38 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:50:46.551+0000 7fc6417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:50:46.551+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:50:46.551+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc62c0662a0 auth_method 0 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:50:46.551+0000 7fc763d82640 10 monclient: get_auth_request con 0x55955e3fe790 auth_method 0 2024-08-08T23:50:47.179 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 realm 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:50:46.555+0000 7fc76626e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:50:46.555+0000 7fc75bfff640 10 monclient: get_auth_request con 0x55955e402a00 auth_method 0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:50:46.555+0000 7fc764583640 10 monclient: get_auth_request con 0x55955e406260 auth_method 0 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:47.180 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:50:46.555+0000 7fc76626e980 20 searching for the correct realm 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:50:46.559+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc75c036650 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:50:46.559+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc754008050 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:50:46.559+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc74c0bf070 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:50:46.559+0000 7fc764583640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc74c0bf070 msgr2=0x7fc74c0fa940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:50:46.763+0000 7fc764583640 10 monclient: get_auth_request con 0x7fc74c0bf070 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:50:46.767+0000 7fc763d82640 10 monclient: get_auth_request con 0x7fc75c02c430 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:50:46.775+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc75c045900 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:50:46.775+0000 7fc75bfff640 0 -- 172.21.15.83:0/3286087223 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc75c045900 msgr2=0x7fc75c02b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:50:46.979+0000 7fc75bfff640 10 monclient: get_auth_request con 0x7fc75c045900 auth_method 0 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:47.181 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:50:46.991+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 zone default found 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 Realm: () 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:50:46.995+0000 7fc76626e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:50:46.995+0000 7fc76626e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 zonegroup default 2024-08-08T23:50:47.182 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:50:46.995+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 started sync module instance, tier type = 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:50:46.999+0000 7fc76626e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=0 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=1 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=2 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=3 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=4 2024-08-08T23:50:47.183 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=5 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:50:47.019+0000 7fc76626e980 20 add_watcher() i=6 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:50:47.023+0000 7fc76626e980 20 add_watcher() i=7 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:50:47.023+0000 7fc76626e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding auth protocol: cephx 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:50:47.027+0000 7fc619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.184 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: crc 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 AuthRegistry(0x7ffece9ec160) adding con mode: secure 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:50:47.027+0000 7fc76626e980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache list hook 0x55955e3e8560 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache inspect hook 0x55955e3e8560 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache erase hook 0x55955e3e8560 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command cache zap hook 0x55955e3e8560 2024-08-08T23:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 note: GC not initialized 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:50:47.027+0000 7fc618fe1640 20 reqs_thread_entry: start 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace show hook 0x7fc74c004470 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace history hook 0x7fc74c004470 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace active hook 0x7fc74c004470 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:50:47.027+0000 7fc76626e980 5 asok(0x55955e108520) register_command sync trace active_short hook 0x7fc74c004470 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 Filter name: none 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:50:47.027+0000 7fc5927fc640 20 reqs_thread_entry: start 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:50:47.027+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:50:47.027+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : miss 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:50:47.031+0000 7fc76626e980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:50:47.031+0000 7fc76626e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:50:47.039+0000 7fc76626e980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc76626e980 time 2024-08-08T23:50:47.041414+0000 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.187 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc769b46cc1] 2024-08-08T23:50:47.188 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.188 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.189 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.189 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.189 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:50:47.043+0000 7fc76626e980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc76626e980 thread_name:radosgw-admin 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7689c7520] 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:50:47.190 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc769b46d1b] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc769b46e75] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55955be846e1] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0x929c5a) [0x55955be8dc5a] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55955be92ce3] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7689aed90] 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:50:47.191 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:50:47.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:50:47.193 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:50:47.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:50:47.195 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:50:47.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc5927fc640 / http_manager 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc618fe1640 / http_manager 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc619fe3640 / rgw_dt_lg_renew 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc6417fa640 / ms_dispatch 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc642ffd640 / io_context_pool 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc6497fa640 / ms_dispatch 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc64bfff640 / ms_dispatch 2024-08-08T23:50:47.198 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc651e0b640 / io_context_pool 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc75bfff640 / msgr-worker-2 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc763d82640 / msgr-worker-1 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc764583640 / msgr-worker-0 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc764d84640 / io_context_pool 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc76626e980 / radosgw-admin 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-08-08T23:50:47.047786Z_5c6bc0a2-1646-4d0e-8e5d-10392031d5f3/log 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr:Aborted 2024-08-08T23:50:47.199 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 realm 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.131+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.135+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.135+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.135+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.135+0000 7f8d1bd94980 20 searching for the correct realm 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.139+0000 7f8d198a8640 0 -- 172.21.15.83:0/3006805672 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f8d140ac030 msgr2=0x7f8d14107ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.147+0000 7f8d190a7640 0 -- 172.21.15.83:0/3006805672 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f8d14108600 msgr2=0x7f8d14002d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:47.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:47.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:47.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:47.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.363+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:47.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 zone default found 2024-08-08T23:50:47.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 4 Realm: () 2024-08-08T23:50:47.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 zonegroup default 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 started sync module instance, tier type = 2024-08-08T23:50:47.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.367+0000 7f8d1bd94980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=0 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=1 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=2 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=3 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=4 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=5 2024-08-08T23:50:47.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=6 2024-08-08T23:50:47.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 20 add_watcher() i=7 2024-08-08T23:50:47.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.391+0000 7f8d1bd94980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:47.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.395+0000 7f8bcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:47.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:47.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:47.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 5 note: GC not initialized 2024-08-08T23:50:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8bca7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 Filter name: none 2024-08-08T23:50:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8b3bfff640 20 reqs_thread_entry: start 2024-08-08T23:50:47.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:47.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:47.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:47.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.399+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.403+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:47.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.403+0000 7f8d1bd94980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.403+0000 7f8d1bd94980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:47.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.403+0000 7f8d1bd94980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:50:47.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.407+0000 7f8bcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:47.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.411+0000 7f8d1bd94980 20 remove_watcher() i=0 2024-08-08T23:50:47.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.411+0000 7f8d1bd94980 2 removed watcher, disabling cache 2024-08-08T23:50:47.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.411+0000 7f8d1bd94980 20 remove_watcher() i=1 2024-08-08T23:50:47.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.415+0000 7f8d1bd94980 20 remove_watcher() i=2 2024-08-08T23:50:47.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.419+0000 7f8d1bd94980 20 remove_watcher() i=3 2024-08-08T23:50:47.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.419+0000 7f8d1bd94980 20 remove_watcher() i=4 2024-08-08T23:50:47.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.419+0000 7f8d1bd94980 20 remove_watcher() i=5 2024-08-08T23:50:47.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.423+0000 7f8d1bd94980 20 remove_watcher() i=6 2024-08-08T23:50:47.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.423+0000 7f8d1bd94980 20 remove_watcher() i=7 2024-08-08T23:50:47.436 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.436 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:50:47.436 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:50:47.436 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:50:47.541 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:50:47.576 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:50:47.576 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:50:47.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 realm 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:50:47.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:47.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.623+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.627+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:47.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.627+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:47.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.627+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:50:47.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.627+0000 7fda7c261980 20 searching for the correct realm 2024-08-08T23:50:47.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.631+0000 7fda7a576640 0 -- 172.21.15.83:0/2606062237 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x55f7e65d5690 msgr2=0x7fda701160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:47.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:47.847+0000 7fda79574640 0 -- 172.21.15.83:0/2606062237 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fda740667c0 msgr2=0x7fda7406aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:50:48.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.063+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:50:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:50:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 zone default found 2024-08-08T23:50:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 4 Realm: () 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 zonegroup default 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:48.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:50:48.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 started sync module instance, tier type = 2024-08-08T23:50:48.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.067+0000 7fda7c261980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=0 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=1 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=2 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=3 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=4 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=5 2024-08-08T23:50:48.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.087+0000 7fda7c261980 20 add_watcher() i=6 2024-08-08T23:50:48.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.091+0000 7fda7c261980 20 add_watcher() i=7 2024-08-08T23:50:48.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.091+0000 7fda7c261980 2 all 8 watchers are set, enabling cache 2024-08-08T23:50:48.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fd92b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:48.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fda7c261980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:50:48.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fda7c261980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:50:48.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fda7c261980 5 note: GC not initialized 2024-08-08T23:50:48.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fd92a7fc640 20 reqs_thread_entry: start 2024-08-08T23:50:48.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fda7c261980 20 init_complete bucket index max shards: 1 2024-08-08T23:50:48.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.095+0000 7fda7c261980 20 Filter name: none 2024-08-08T23:50:48.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fd89bfff640 20 reqs_thread_entry: start 2024-08-08T23:50:48.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-08T23:50:48.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:50:48.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-08T23:50:48.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-08T23:50:48.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : miss 2024-08-08T23:50:48.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 20 rados->read ofs=0 len=0 2024-08-08T23:50:48.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:50:48.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:50:48.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:50:48.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:50:48.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:50:48.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.099+0000 7fda7c261980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:50:48.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.103+0000 7fda7c261980 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to be held by another RGW process; skipping for now 2024-08-08T23:50:48.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.103+0000 7fd92b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:50:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.107+0000 7fda7c261980 20 remove_watcher() i=0 2024-08-08T23:50:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.107+0000 7fda7c261980 2 removed watcher, disabling cache 2024-08-08T23:50:48.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.111+0000 7fda7c261980 20 remove_watcher() i=1 2024-08-08T23:50:48.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.111+0000 7fda7c261980 20 remove_watcher() i=2 2024-08-08T23:50:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.115+0000 7fda7c261980 20 remove_watcher() i=3 2024-08-08T23:50:48.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.119+0000 7fda7c261980 20 remove_watcher() i=4 2024-08-08T23:50:48.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.119+0000 7fda7c261980 20 remove_watcher() i=5 2024-08-08T23:50:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.119+0000 7fda7c261980 20 remove_watcher() i=6 2024-08-08T23:50:48.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:50:48.123+0000 7fda7c261980 20 remove_watcher() i=7 2024-08-08T23:50:48.141 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-08T23:51:18.148 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:51:18.185 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:18.185 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:18.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.231+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 realm 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:18.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:18.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.235+0000 7fc085e9d980 20 searching for the correct realm 2024-08-08T23:51:18.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.239+0000 7fc0841b2640 0 -- 172.21.15.83:0/2186776753 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc06c05b400 msgr2=0x7fc06c05b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:18.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.247+0000 7fc07b1b0640 0 -- 172.21.15.83:0/2186776753 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc07c11fb10 msgr2=0x7fc07c128550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:18.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:18.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.463+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 zone default found 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 4 Realm: () 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 zonegroup default 2024-08-08T23:51:18.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 started sync module instance, tier type = 2024-08-08T23:51:18.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.467+0000 7fc085e9d980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:18.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=0 2024-08-08T23:51:18.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=1 2024-08-08T23:51:18.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=2 2024-08-08T23:51:18.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=3 2024-08-08T23:51:18.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=4 2024-08-08T23:51:18.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=5 2024-08-08T23:51:18.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.491+0000 7fc085e9d980 20 add_watcher() i=6 2024-08-08T23:51:18.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.495+0000 7fc085e9d980 20 add_watcher() i=7 2024-08-08T23:51:18.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.495+0000 7fc085e9d980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:18.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fbf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:18.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:18.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:18.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 5 note: GC not initialized 2024-08-08T23:51:18.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fbf38fe1640 20 reqs_thread_entry: start 2024-08-08T23:51:18.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:18.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 20 Filter name: none 2024-08-08T23:51:18.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fbeb27fc640 20 reqs_thread_entry: start 2024-08-08T23:51:18.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-08T23:51:18.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.499+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:51:18.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-08T23:51:18.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-08T23:51:18.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : miss 2024-08-08T23:51:18.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:51:18.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:51:18.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:51:18.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:18.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:18.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.503+0000 7fc085e9d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:51:18.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.507+0000 7fc085e9d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.507+0000 7fc085e9d980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.507+0000 7fc085e9d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.507+0000 7fc085e9d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22, ofs0, ns] 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fbf62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333450 cookie 94405508035216 notifier 6068 bl.length()=1001 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fbf62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fbf62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:51:18.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fbf62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:18.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): orig_sources= new_sources= 2024-08-08T23:51:18.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): potential sources added=[] removed=[] 2024-08-08T23:51:18.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): orig_dests= new_dests= 2024-08-08T23:51:18.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.511+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): potential dests added=[] removed=[] 2024-08-08T23:51:18.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.515+0000 7fc085e9d980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22.1.0 2024-08-08T23:51:18.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.515+0000 7fc085e9d980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22.1.0 2024-08-08T23:51:18.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.515+0000 7fc085e9d980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22.1.1 2024-08-08T23:51:18.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.515+0000 7fc085e9d980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22.1.1 2024-08-08T23:51:18.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.515+0000 7fc085e9d980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22.0 2024-08-08T23:51:18.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.519+0000 7fc085e9d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 : hit (requested=0x17, cached=0x17) 2024-08-08T23:51:18.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.519+0000 7fc085e9d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22, ofs0, ns] 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fbf62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333451 cookie 94405508035216 notifier 6068 bl.length()=969 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fbf62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 info.flags=0x17 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fbf62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 to cache LRU end 2024-08-08T23:51:18.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fbf62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:18.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): orig_sources= new_sources= 2024-08-08T23:51:18.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): potential sources added=[] removed=[] 2024-08-08T23:51:18.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): orig_dests= new_dests= 2024-08-08T23:51:18.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.523+0000 7fc085e9d980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22]): potential dests added=[] removed=[] 2024-08-08T23:51:18.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.527+0000 7fc085e9d980 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-08-08T23:51:18.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.531+0000 7fbf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:18.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.535+0000 7fc085e9d980 20 remove_watcher() i=0 2024-08-08T23:51:18.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.535+0000 7fc085e9d980 2 removed watcher, disabling cache 2024-08-08T23:51:18.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.539+0000 7fc085e9d980 20 remove_watcher() i=1 2024-08-08T23:51:18.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.539+0000 7fc085e9d980 20 remove_watcher() i=2 2024-08-08T23:51:18.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.543+0000 7fc085e9d980 20 remove_watcher() i=3 2024-08-08T23:51:18.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.547+0000 7fc085e9d980 20 remove_watcher() i=4 2024-08-08T23:51:18.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.547+0000 7fc085e9d980 20 remove_watcher() i=5 2024-08-08T23:51:18.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.547+0000 7fc085e9d980 20 remove_watcher() i=6 2024-08-08T23:51:18.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.551+0000 7fc085e9d980 20 remove_watcher() i=7 2024-08-08T23:51:18.565 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-08T23:51:18.593 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:18.593 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:18.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 realm 2024-08-08T23:51:18.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.639+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.643+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:18.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.643+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:18.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.643+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:18.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.643+0000 7f811ddea980 20 searching for the correct realm 2024-08-08T23:51:18.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.647+0000 7f811c0ff640 0 -- 172.21.15.83:0/2739141266 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f8110008040 msgr2=0x7f811005ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:51:18.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:18.863+0000 7f811b0fd640 0 -- 172.21.15.83:0/2739141266 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f8114094200 msgr2=0x7f81140867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:19.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:19.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.079+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 zone default found 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 4 Realm: () 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:19.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:19.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:19.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 zonegroup default 2024-08-08T23:51:19.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:19.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:19.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:19.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 started sync module instance, tier type = 2024-08-08T23:51:19.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.083+0000 7f811ddea980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:19.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=0 2024-08-08T23:51:19.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=1 2024-08-08T23:51:19.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=2 2024-08-08T23:51:19.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=3 2024-08-08T23:51:19.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=4 2024-08-08T23:51:19.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=5 2024-08-08T23:51:19.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.107+0000 7f811ddea980 20 add_watcher() i=6 2024-08-08T23:51:19.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.111+0000 7f811ddea980 20 add_watcher() i=7 2024-08-08T23:51:19.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.111+0000 7f811ddea980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:19.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f7fd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:19.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:19.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:19.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 5 note: GC not initialized 2024-08-08T23:51:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f7fd17e2640 20 reqs_thread_entry: start 2024-08-08T23:51:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 20 Filter name: none 2024-08-08T23:51:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f7fca7fc640 20 reqs_thread_entry: start 2024-08-08T23:51:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.115+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:51:19.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:51:19.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:19.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=218 2024-08-08T23:51:19.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados->read ofs=0 len=0 2024-08-08T23:51:19.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 rados_obj.operate() r=0 bl.length=432 2024-08-08T23:51:19.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.119+0000 7f811ddea980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:19.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.123+0000 7f7fd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:19.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.127+0000 7f811ddea980 20 remove_watcher() i=0 2024-08-08T23:51:19.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.127+0000 7f811ddea980 2 removed watcher, disabling cache 2024-08-08T23:51:19.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.131+0000 7f811ddea980 20 remove_watcher() i=1 2024-08-08T23:51:19.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.131+0000 7f811ddea980 20 remove_watcher() i=2 2024-08-08T23:51:19.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.135+0000 7f811ddea980 20 remove_watcher() i=3 2024-08-08T23:51:19.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.135+0000 7f811ddea980 20 remove_watcher() i=4 2024-08-08T23:51:19.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.139+0000 7f811ddea980 20 remove_watcher() i=5 2024-08-08T23:51:19.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.139+0000 7f811ddea980 20 remove_watcher() i=6 2024-08-08T23:51:19.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:19.139+0000 7f811ddea980 20 remove_watcher() i=7 2024-08-08T23:51:19.153 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:19.153 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:19.154 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:51:19.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:19.843 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-08-08T23:51:19.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-08T23:51:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:21.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.943+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 realm 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:21.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:21.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:21.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:21.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:21.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.947+0000 7ff4530a7980 20 searching for the correct realm 2024-08-08T23:51:21.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:21.951+0000 7ff4513bc640 0 -- 172.21.15.83:0/1331091114 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff4440ac000 msgr2=0x7ff44410c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:22.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.367+0000 7ff4503ba640 0 -- 172.21.15.83:0/1331091114 >> [v2:172.21.15.196:6801/988086196,v1:172.21.15.196:6802/988086196] conn(0x555d54e13000 msgr2=0x555d54e153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:22.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.383+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:22.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:22.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 zone default found 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 4 Realm: () 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 zonegroup default 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 started sync module instance, tier type = 2024-08-08T23:51:22.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.387+0000 7ff4530a7980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=0 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=1 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=2 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=3 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=4 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=5 2024-08-08T23:51:22.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.411+0000 7ff4530a7980 20 add_watcher() i=6 2024-08-08T23:51:22.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.415+0000 7ff4530a7980 20 add_watcher() i=7 2024-08-08T23:51:22.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.415+0000 7ff4530a7980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:22.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff306fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:22.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:22.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:22.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 5 note: GC not initialized 2024-08-08T23:51:22.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff305fe3640 20 reqs_thread_entry: start 2024-08-08T23:51:22.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:22.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 20 Filter name: none 2024-08-08T23:51:22.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff2777fe640 20 reqs_thread_entry: start 2024-08-08T23:51:22.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.419+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:22.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:22.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:22.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:22.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:22.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.423+0000 7ff4530a7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:22.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.427+0000 7ff306fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:22.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.431+0000 7ff4530a7980 20 remove_watcher() i=0 2024-08-08T23:51:22.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.431+0000 7ff4530a7980 2 removed watcher, disabling cache 2024-08-08T23:51:22.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.435+0000 7ff4530a7980 20 remove_watcher() i=1 2024-08-08T23:51:22.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.435+0000 7ff4530a7980 20 remove_watcher() i=2 2024-08-08T23:51:22.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.439+0000 7ff4530a7980 20 remove_watcher() i=3 2024-08-08T23:51:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.439+0000 7ff4530a7980 20 remove_watcher() i=4 2024-08-08T23:51:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.443+0000 7ff4530a7980 20 remove_watcher() i=5 2024-08-08T23:51:22.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.443+0000 7ff4530a7980 20 remove_watcher() i=6 2024-08-08T23:51:22.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.447+0000 7ff4530a7980 20 remove_watcher() i=7 2024-08-08T23:51:22.457 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:22.457 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:22.457 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:51:22.457 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:22.458 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-08-08T23:51:22.494 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:22.494 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:22.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 realm 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.539+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.543+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:22.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.543+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.543+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:22.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.543+0000 7fc23f5ed980 20 searching for the correct realm 2024-08-08T23:51:22.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.547+0000 7fc23d101640 0 -- 172.21.15.83:0/2377001469 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fc23807c020 msgr2=0x7fc23800ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:22.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.555+0000 7fc23c900640 0 -- 172.21.15.83:0/2377001469 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc23800e070 msgr2=0x7fc23807e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:51:22.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.771+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:22.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 zone default found 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 4 Realm: () 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 zonegroup default 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 started sync module instance, tier type = 2024-08-08T23:51:22.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.775+0000 7fc23f5ed980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=0 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=1 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=2 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=3 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=4 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=5 2024-08-08T23:51:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=6 2024-08-08T23:51:22.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 20 add_watcher() i=7 2024-08-08T23:51:22.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.799+0000 7fc23f5ed980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:22.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc0f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 5 note: GC not initialized 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc0f27e4640 20 reqs_thread_entry: start 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 20 Filter name: none 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc063fff640 20 reqs_thread_entry: start 2024-08-08T23:51:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.803+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 : miss 2024-08-08T23:51:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.807+0000 7fc23f5ed980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 2024-08-08T23:51:22.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.815+0000 7fc23f5ed980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:22.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.815+0000 7fc23f5ed980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:22.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.815+0000 7fc23f5ed980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:22.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.815+0000 7fc23f5ed980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23, ofs0, ns] 2024-08-08T23:51:22.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc120ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 93926354938896 notifier 6116 bl.length()=991 2024-08-08T23:51:22.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc120ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:22.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc120ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:22.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc120ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:22.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_sources= new_sources= 2024-08-08T23:51:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential sources added=[] removed=[] 2024-08-08T23:51:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_dests= new_dests= 2024-08-08T23:51:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential dests added=[] removed=[] 2024-08-08T23:51:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 -1 Injecting error=-5 at location=block_writes 2024-08-08T23:51:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.819+0000 7fc23f5ed980 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-08-08T23:51:22.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 : hit (requested=0x17, cached=0x17) 2024-08-08T23:51:22.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 2024-08-08T23:51:22.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:22.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:22.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:22.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.823+0000 7fc23f5ed980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23, ofs0, ns] 2024-08-08T23:51:22.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc120ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 93926354938896 notifier 6116 bl.length()=959 2024-08-08T23:51:22.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc120ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc120ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc120ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_sources= new_sources= 2024-08-08T23:51:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential sources added=[] removed=[] 2024-08-08T23:51:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_dests= new_dests= 2024-08-08T23:51:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.827+0000 7fc23f5ed980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential dests added=[] removed=[] 2024-08-08T23:51:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.831+0000 7fc0f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:22.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.835+0000 7fc23f5ed980 20 remove_watcher() i=0 2024-08-08T23:51:22.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.835+0000 7fc23f5ed980 2 removed watcher, disabling cache 2024-08-08T23:51:22.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.839+0000 7fc23f5ed980 20 remove_watcher() i=1 2024-08-08T23:51:22.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.839+0000 7fc23f5ed980 20 remove_watcher() i=2 2024-08-08T23:51:22.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.843+0000 7fc23f5ed980 20 remove_watcher() i=3 2024-08-08T23:51:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.843+0000 7fc23f5ed980 20 remove_watcher() i=4 2024-08-08T23:51:22.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.847+0000 7fc23f5ed980 20 remove_watcher() i=5 2024-08-08T23:51:22.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.847+0000 7fc23f5ed980 20 remove_watcher() i=6 2024-08-08T23:51:22.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.847+0000 7fc23f5ed980 20 remove_watcher() i=7 2024-08-08T23:51:22.861 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-08T23:51:22.887 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:22.888 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:22.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.931+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 realm 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:22.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:22.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:22.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.935+0000 7fd5eca54980 20 searching for the correct realm 2024-08-08T23:51:22.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:22.939+0000 7fd5ead69640 0 -- 172.21.15.83:0/831503871 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fd5e005ed60 msgr2=0x7fd5e00554d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:23.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.155+0000 7fd5e9d67640 0 -- 172.21.15.83:0/831503871 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fd5e4023bb0 msgr2=0x7fd5e4023040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:23.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:23.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:23.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.371+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:23.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:23.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 zone default found 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 4 Realm: () 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 zonegroup default 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 started sync module instance, tier type = 2024-08-08T23:51:23.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.375+0000 7fd5eca54980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:23.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=0 2024-08-08T23:51:23.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=1 2024-08-08T23:51:23.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=2 2024-08-08T23:51:23.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=3 2024-08-08T23:51:23.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=4 2024-08-08T23:51:23.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=5 2024-08-08T23:51:23.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=6 2024-08-08T23:51:23.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 20 add_watcher() i=7 2024-08-08T23:51:23.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.399+0000 7fd5eca54980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:23.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd4a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:23.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:23.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:23.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 5 note: GC not initialized 2024-08-08T23:51:23.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd41b7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:23.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:23.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 20 Filter name: none 2024-08-08T23:51:23.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd4197fa640 20 reqs_thread_entry: start 2024-08-08T23:51:23.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.403+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:23.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:23.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:23.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:23.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:23.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.407+0000 7fd5eca54980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:23.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.411+0000 7fd4a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:23.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.415+0000 7fd5eca54980 20 remove_watcher() i=0 2024-08-08T23:51:23.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.415+0000 7fd5eca54980 2 removed watcher, disabling cache 2024-08-08T23:51:23.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.419+0000 7fd5eca54980 20 remove_watcher() i=1 2024-08-08T23:51:23.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.423+0000 7fd5eca54980 20 remove_watcher() i=2 2024-08-08T23:51:23.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.423+0000 7fd5eca54980 20 remove_watcher() i=3 2024-08-08T23:51:23.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.427+0000 7fd5eca54980 20 remove_watcher() i=4 2024-08-08T23:51:23.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.427+0000 7fd5eca54980 20 remove_watcher() i=5 2024-08-08T23:51:23.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.427+0000 7fd5eca54980 20 remove_watcher() i=6 2024-08-08T23:51:23.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.431+0000 7fd5eca54980 20 remove_watcher() i=7 2024-08-08T23:51:23.441 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:23.441 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:23.442 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:51:23.442 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:23.540 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:51:23.577 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:23.577 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:23.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.623+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 realm 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:23.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.627+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.631+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:23.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.631+0000 7f6c31b6b980 20 searching for the correct realm 2024-08-08T23:51:23.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.631+0000 7f6c2ee7e640 0 -- 172.21.15.83:0/1036732537 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f6c200f06c0 msgr2=0x7f6c200ef320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:23.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.843+0000 7f6c2f67f640 0 -- 172.21.15.83:0/1036732537 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f6c28035020 msgr2=0x7f6c28035510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 zone default found 2024-08-08T23:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 4 Realm: () 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 zonegroup default 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.863+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.867+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.867+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.867+0000 7f6c31b6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.867+0000 7f6c31b6b980 20 started sync module instance, tier type = 2024-08-08T23:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.867+0000 7f6c31b6b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=0 2024-08-08T23:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=1 2024-08-08T23:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=2 2024-08-08T23:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=3 2024-08-08T23:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=4 2024-08-08T23:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=5 2024-08-08T23:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=6 2024-08-08T23:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 20 add_watcher() i=7 2024-08-08T23:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.891+0000 7f6c31b6b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 5 note: GC not initialized 2024-08-08T23:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6ae4fe1640 20 reqs_thread_entry: start 2024-08-08T23:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 Filter name: none 2024-08-08T23:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6a5e7fc640 20 reqs_thread_entry: start 2024-08-08T23:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-08-08T23:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-08-08T23:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-08-08T23:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 : miss 2024-08-08T23:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.899+0000 7f6c31b6b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.903+0000 7f6c31b6b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 2024-08-08T23:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23, ofs0, ns] 2024-08-08T23:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6b12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94164358018016 notifier 6441 bl.length()=991 2024-08-08T23:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6b12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6b12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6b12ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_sources= new_sources= 2024-08-08T23:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.911+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential sources added=[] removed=[] 2024-08-08T23:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_dests= new_dests= 2024-08-08T23:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential dests added=[] removed=[] 2024-08-08T23:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23.1.0 2024-08-08T23:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23.1.0 2024-08-08T23:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23.1.1 2024-08-08T23:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23.1.1 2024-08-08T23:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.915+0000 7f6c31b6b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23.0 2024-08-08T23:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.919+0000 7f6c31b6b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 : hit (requested=0x17, cached=0x17) 2024-08-08T23:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.919+0000 7f6c31b6b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 2024-08-08T23:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6c31b6b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6c31b6b980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6c31b6b980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6c31b6b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23, ofs0, ns] 2024-08-08T23:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6b12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 94164358018016 notifier 6441 bl.length()=959 2024-08-08T23:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6b12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 info.flags=0x17 2024-08-08T23:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6b12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 to cache LRU end 2024-08-08T23:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.923+0000 7f6b12ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.927+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_sources= new_sources= 2024-08-08T23:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.927+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential sources added=[] removed=[] 2024-08-08T23:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.927+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): orig_dests= new_dests= 2024-08-08T23:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.927+0000 7f6c31b6b980 20 handle_bi_update(): bucket=:error-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23]): potential dests added=[] removed=[] 2024-08-08T23:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.927+0000 7f6c31b6b980 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-08-08T23:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.935+0000 7f6ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.939+0000 7f6c31b6b980 20 remove_watcher() i=0 2024-08-08T23:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.939+0000 7f6c31b6b980 2 removed watcher, disabling cache 2024-08-08T23:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.943+0000 7f6c31b6b980 20 remove_watcher() i=1 2024-08-08T23:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.943+0000 7f6c31b6b980 20 remove_watcher() i=2 2024-08-08T23:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.947+0000 7f6c31b6b980 20 remove_watcher() i=3 2024-08-08T23:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.947+0000 7f6c31b6b980 20 remove_watcher() i=4 2024-08-08T23:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.951+0000 7f6c31b6b980 20 remove_watcher() i=5 2024-08-08T23:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.951+0000 7f6c31b6b980 20 remove_watcher() i=6 2024-08-08T23:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:23.951+0000 7f6c31b6b980 20 remove_watcher() i=7 2024-08-08T23:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-08T23:51:23.995 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:23.995 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:24.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.039+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 realm 2024-08-08T23:51:24.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:24.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:24.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.043+0000 7f7594c1b980 20 searching for the correct realm 2024-08-08T23:51:24.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.047+0000 7f7592f30640 0 -- 172.21.15.83:0/2567260395 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f757c109040 msgr2=0x7f757c10ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:24.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.055+0000 7f7591f2e640 0 -- 172.21.15.83:0/2567260395 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f758400e070 msgr2=0x7f758405c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:51:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.271+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:24.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 zone default found 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 4 Realm: () 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 zonegroup default 2024-08-08T23:51:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:24.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 started sync module instance, tier type = 2024-08-08T23:51:24.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.275+0000 7f7594c1b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:24.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=0 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=1 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=2 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=3 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=4 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=5 2024-08-08T23:51:24.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.299+0000 7f7594c1b980 20 add_watcher() i=6 2024-08-08T23:51:24.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.303+0000 7f7594c1b980 20 add_watcher() i=7 2024-08-08T23:51:24.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.303+0000 7f7594c1b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:24.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:24.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:24.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:24.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 5 note: GC not initialized 2024-08-08T23:51:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f73c37fe640 20 reqs_thread_entry: start 2024-08-08T23:51:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 20 Filter name: none 2024-08-08T23:51:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f73c17fa640 20 reqs_thread_entry: start 2024-08-08T23:51:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.307+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:24.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:24.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:24.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:24.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados->read ofs=0 len=0 2024-08-08T23:51:24.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:24.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.311+0000 7f7594c1b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:24.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.315+0000 7f7448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:24.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.319+0000 7f7594c1b980 20 remove_watcher() i=0 2024-08-08T23:51:24.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.319+0000 7f7594c1b980 2 removed watcher, disabling cache 2024-08-08T23:51:24.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.323+0000 7f7594c1b980 20 remove_watcher() i=1 2024-08-08T23:51:24.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.327+0000 7f7594c1b980 20 remove_watcher() i=2 2024-08-08T23:51:24.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.327+0000 7f7594c1b980 20 remove_watcher() i=3 2024-08-08T23:51:24.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.331+0000 7f7594c1b980 20 remove_watcher() i=4 2024-08-08T23:51:24.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.331+0000 7f7594c1b980 20 remove_watcher() i=5 2024-08-08T23:51:24.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.335+0000 7f7594c1b980 20 remove_watcher() i=6 2024-08-08T23:51:24.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:24.335+0000 7f7594c1b980 20 remove_watcher() i=7 2024-08-08T23:51:24.351 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:24.351 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:24.351 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:51:24.352 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:24.964 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at block_writes 2024-08-08T23:51:24.964 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.015 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-08T23:51:27.048 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:27.048 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:27.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.095+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.095+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.095+0000 7f1b38128980 20 realm 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.095+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:27.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:27.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.099+0000 7f1b38128980 20 searching for the correct realm 2024-08-08T23:51:27.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.103+0000 7f1b3643d640 0 -- 172.21.15.83:0/23404900 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f1b2c04f040 msgr2=0x7f1b2c026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:27.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.519+0000 7f1b3543b640 0 -- 172.21.15.83:0/23404900 >> [v2:172.21.15.196:6801/988086196,v1:172.21.15.196:6802/988086196] conn(0x55a66b2b4c20 msgr2=0x55a66b2b70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:27.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:27.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:27.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:27.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 zone default found 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 4 Realm: () 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 zonegroup default 2024-08-08T23:51:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.535+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.539+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.539+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.539+0000 7f1b38128980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.539+0000 7f1b38128980 20 started sync module instance, tier type = 2024-08-08T23:51:27.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.539+0000 7f1b38128980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=0 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=1 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=2 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=3 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=4 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=5 2024-08-08T23:51:27.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=6 2024-08-08T23:51:27.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 20 add_watcher() i=7 2024-08-08T23:51:27.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.563+0000 7f1b38128980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:27.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f19df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:27.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:27.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:27.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 5 note: GC not initialized 2024-08-08T23:51:27.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f19de7fc640 20 reqs_thread_entry: start 2024-08-08T23:51:27.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:27.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 Filter name: none 2024-08-08T23:51:27.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1957fff640 20 reqs_thread_entry: start 2024-08-08T23:51:27.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:27.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.571+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:27.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:27.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:27.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:27.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.575+0000 7f1b38128980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:27.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.579+0000 7f19df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:27.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.583+0000 7f1b38128980 20 remove_watcher() i=0 2024-08-08T23:51:27.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.583+0000 7f1b38128980 2 removed watcher, disabling cache 2024-08-08T23:51:27.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.587+0000 7f1b38128980 20 remove_watcher() i=1 2024-08-08T23:51:27.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.587+0000 7f1b38128980 20 remove_watcher() i=2 2024-08-08T23:51:27.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.591+0000 7f1b38128980 20 remove_watcher() i=3 2024-08-08T23:51:27.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.595+0000 7f1b38128980 20 remove_watcher() i=4 2024-08-08T23:51:27.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.595+0000 7f1b38128980 20 remove_watcher() i=5 2024-08-08T23:51:27.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.595+0000 7f1b38128980 20 remove_watcher() i=6 2024-08-08T23:51:27.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.599+0000 7f1b38128980 20 remove_watcher() i=7 2024-08-08T23:51:27.615 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.615 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:27.615 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:51:27.615 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.616 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-08-08T23:51:27.652 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:27.652 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:27.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.695+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 realm 2024-08-08T23:51:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:27.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:27.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.703+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:27.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.703+0000 7fc94cba5980 20 searching for the correct realm 2024-08-08T23:51:27.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.707+0000 7fc94aeba640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc940018070 msgr2=0x7fc9400540a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.711+0000 7fc949eb8640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc944103c20 msgr2=0x7fc944003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:27.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:27.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zone default found 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Realm: () 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zonegroup default 2024-08-08T23:51:27.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:27.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started sync module instance, tier type = 2024-08-08T23:51:27.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=0 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=1 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=2 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=3 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=4 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=5 2024-08-08T23:51:27.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=6 2024-08-08T23:51:27.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=7 2024-08-08T23:51:27.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.955+0000 7fc94cba5980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:27.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.959+0000 7fc8017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:27.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.959+0000 7fc94cba5980 5 note: GC not initialized 2024-08-08T23:51:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc7fb7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 Filter name: none 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc7f97fa640 20 reqs_thread_entry: start 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:27.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-08T23:51:27.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-08T23:51:27.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : miss 2024-08-08T23:51:27.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.963+0000 7fc94cba5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc94cba5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc94cba5980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24, ofs0, ns] 2024-08-08T23:51:27.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333454 cookie 94607737249008 notifier 6203 bl.length()=991 2024-08-08T23:51:27.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:27.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:27.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:27.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_sources= new_sources= 2024-08-08T23:51:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential sources added=[] removed=[] 2024-08-08T23:51:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_dests= new_dests= 2024-08-08T23:51:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential dests added=[] removed=[] 2024-08-08T23:51:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc94cba5980 time 2024-08-08T23:51:27.980925+0000 2024-08-08T23:51:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:51:27.975 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:27.975 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc95047dcc1] 2024-08-08T23:51:27.975 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:27.975 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:27.975 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc94cba5980 thread_name:radosgw-admin 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc94cba5980 time 2024-08-08T23:51:27.980925+0000 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc95047dcc1] 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:27.976 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:51:27.977 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc94f2fe520] 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:51:27.978 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc95047dd1b] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc94cba5980 thread_name:radosgw-admin 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc94f2fe520] 2024-08-08T23:51:27.979 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc95047dd1b] 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:27.980 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:51:28.009 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_done global_id 6483 payload 274 2024-08-08T23:51:28.009 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.009 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:51:27.675+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b9476ad70 auth_method 0 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: dump: 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:51:27.675+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6483 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:51:27.675+0000 7fc94cba5980 10 monclient: get_monmap_and_config success 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:51:27.675+0000 7fc94cba5980 4 set_mon_vals no callback set 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: dump: 2024-08-08T23:51:28.011 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: shutdown 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) unregister_commands rotate-key 2024-08-08T23:51:28.012 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.013 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.014 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: starting msgr at 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: starting objecter 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests hook 0x560b94646e50 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: setting wanted keys 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: calling monclient init 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.015 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key hook 0x560b948244b8 2024-08-08T23:51:28.016 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _add_conns ranks=[2,0,1] 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b946d4ce0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b946d5710 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b9476ad70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.285409s 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b946d4ce0 auth_method 0 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.017 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): get_auth_request con 0x560b946d5710 auth_method 0 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_done global_id 6486 payload 824 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.018 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:51:27.679+0000 7fc949eb8640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:51:27.679+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b9476ad70 auth_method 0 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: dump: 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.019 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: dump: 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6486 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:51:27.679+0000 7fc838608640 4 set_mon_vals no callback set 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: init done 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.021 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:51:27.683+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc8300662d0 auth_method 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:51:27.683+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94850220 auth_method 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:51:27.683+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x560b948701a0 auth_method 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:51:27.683+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b94874500 auth_method 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94873a50 auth_method 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:51:27.687+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.022 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.023 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests cmddesc objecter_requests hook 0x560b9487fab0 EEXIST 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.024 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.025 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x560b9487b550 EEXIST 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b948bbca0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b94882c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948a4610 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.294670s 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): get_auth_request con 0x560b948bbca0 auth_method 0 2024-08-08T23:51:28.026 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b948a4610 auth_method 0 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.027 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b94882c80 auth_method 0 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_done global_id 6489 payload 824 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:51:27.687+0000 7fc949eb8640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: dump: 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.028 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: dump: 2024-08-08T23:51:28.029 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6489 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:51:27.687+0000 7fc94b6bb640 4 set_mon_vals no callback set 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.030 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: get_monmap_and_config 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:51:27.691+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.032 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc8240661b0 auth_method 0 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.033 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.034 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x7ffdf347fbd8 EEXIST 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b948f7c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b948f8060 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948f2340 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.298864s 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b948f8060 auth_method 0 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.035 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b948f2340 auth_method 0 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_done global_id 6200 payload 274 2024-08-08T23:51:28.036 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 1 monclient: found mon.noname-c 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:51:27.691+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b948f7c80 auth_method 0 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: dump: 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.037 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: dump: 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.038 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6200 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: get_monmap_and_config success 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:51:27.691+0000 7fc94cba5980 4 set_mon_vals no callback set 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: shutdown 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.039 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.040 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: starting msgr at 2024-08-08T23:51:28.041 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: starting objecter 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests cmddesc objecter_requests hook 0x560b948f2c50 EEXIST 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: setting wanted keys 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: calling monclient init 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.042 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x560b948b87e8 EEXIST 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b948f2340 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948f7c80 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.043 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b94902550 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.301447s 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b948f7c80 auth_method 0 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b94902550 auth_method 0 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.044 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_done global_id 6203 payload 824 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:51:27.695+0000 7fc94aeba640 1 monclient: found mon.noname-c 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: dump: 2024-08-08T23:51:28.045 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.046 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: dump: 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6203 2024-08-08T23:51:28.047 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:51:27.695+0000 7fc82dffb640 4 set_mon_vals no callback set 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: init done 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cr dump hook 0x560b948ed4e8 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:51:27.695+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:51:27.699+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x560b94912330 auth_method 0 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:51:27.699+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc8140662a0 auth_method 0 2024-08-08T23:51:28.048 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 realm 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:51:27.699+0000 7fc94cba5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:51:27.699+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b949164b0 auth_method 0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:51:27.699+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94919cf0 auth_method 0 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:51:27.703+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:51:27.703+0000 7fc94cba5980 20 searching for the correct realm 2024-08-08T23:51:28.049 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:51:27.703+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc9440b6040 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:51:27.703+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc93c027040 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:51:27.703+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc940018070 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:51:27.707+0000 7fc94aeba640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc940018070 msgr2=0x7fc9400540a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:51:27.707+0000 7fc81bfff640 1 client.6203.objecter ms_handle_reset 0x7fc940018070 session 0x7fc940078240 osd.4 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:51:27.707+0000 7fc81bfff640 10 monclient: _renew_subs 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:51:27.707+0000 7fc81bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:51:27.707+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc814076a50 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:51:27.707+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc944128040 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:51:27.711+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc944103c20 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:51:27.711+0000 7fc949eb8640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc944103c20 msgr2=0x7fc944003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:51:27.915+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc944103c20 auth_method 0 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:28.050 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zone default found 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Realm: () 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:28.051 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:51:27.931+0000 7fc94cba5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zonegroup default 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started sync module instance, tier type = 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=0 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=1 2024-08-08T23:51:28.052 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=2 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=3 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=4 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=5 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=6 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=7 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:51:27.955+0000 7fc94cba5980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.053 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:51:27.959+0000 7fc8017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:51:27.959+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache list hook 0x560b94902950 2024-08-08T23:51:28.054 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache inspect hook 0x560b94902950 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache erase hook 0x560b94902950 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache zap hook 0x560b94902950 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 note: GC not initialized 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:51:27.963+0000 7fc7fb7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace show hook 0x7fc9440047f0 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace history hook 0x7fc9440047f0 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace active hook 0x7fc9440047f0 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace active_short hook 0x7fc9440047f0 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 Filter name: none 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:51:27.963+0000 7fc7f97fa640 20 reqs_thread_entry: start 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-08T23:51:28.055 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : miss 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.056 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24, ofs0, ns] 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333454 cookie 94607737249008 notifier 6203 bl.length()=991 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_sources= new_sources= 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential sources added=[] removed=[] 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_dests= new_dests= 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential dests added=[] removed=[] 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc94cba5980 time 2024-08-08T23:51:27.980925+0000 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:51:28.057 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc95047dcc1] 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc94cba5980 thread_name:radosgw-admin 2024-08-08T23:51:28.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc94f2fe520] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc95047dd1b] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:51:28.059 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:51:28.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:51:28.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:51:28.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:51:28.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:51:28.064 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:51:28.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc7f97fa640 / http_manager 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc7fb7fe640 / http_manager 2024-08-08T23:51:28.066 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc8017e2640 / rgw_dt_lg_renew 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc81bfff640 / ms_dispatch 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc82dffb640 / io_context_pool 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc82ffff640 / ms_dispatch 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc836e05640 / ms_dispatch 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc838608640 / io_context_pool 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc949eb8640 / msgr-worker-2 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94a6b9640 / msgr-worker-1 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94aeba640 / msgr-worker-0 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94b6bb640 / io_context_pool 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94cba5980 / radosgw-admin 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.88424.log 2024-08-08T23:51:28.067 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_done global_id 6483 payload 274 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:51:27.675+0000 7fc94a6b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:51:27.675+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b9476ad70 auth_method 0 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: dump: 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.068 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:51:27.675+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6483 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:51:27.675+0000 7fc94cba5980 10 monclient: get_monmap_and_config success 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:51:27.675+0000 7fc94cba5980 4 set_mon_vals no callback set 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.069 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:51:27.675+0000 7fc838608640 10 monclient: dump: 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: shutdown 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) unregister_commands rotate-key 2024-08-08T23:51:28.070 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.071 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding auth protocol: cephx 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.072 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: crc 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b948299f0) adding con mode: secure 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: starting msgr at 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: starting objecter 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests hook 0x560b94646e50 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: setting wanted keys 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: calling monclient init 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding auth protocol: cephx 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.073 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: crc 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 AuthRegistry(0x560b94824370) adding con mode: secure 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:51:27.679+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key hook 0x560b948244b8 2024-08-08T23:51:28.074 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _add_conns ranks=[2,0,1] 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b946d4ce0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b946d5710 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b9476ad70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.285409s 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b946d4ce0 auth_method 0 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.075 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): get_auth_request con 0x560b946d5710 auth_method 0 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:51:27.679+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient(hunting): handle_auth_done global_id 6486 payload 824 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.076 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:51:27.679+0000 7fc949eb8640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:51:27.679+0000 7fc949eb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:51:27.679+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b9476ad70 auth_method 0 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: dump: 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:51:27.679+0000 7fc836e05640 10 monclient: dump: 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.078 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:51:27.679+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6486 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:51:27.679+0000 7fc838608640 4 set_mon_vals no callback set 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:51:27.679+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:51:27.679+0000 7fc94cba5980 1 librados: init done 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.079 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:51:27.683+0000 7fc836e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:51:27.683+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc8300662d0 auth_method 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:51:27.683+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94850220 auth_method 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:51:27.683+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x560b948701a0 auth_method 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:51:27.683+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b94874500 auth_method 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94873a50 auth_method 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:51:27.687+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding auth protocol: cephx 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.081 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: crc 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487c510) adding con mode: secure 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests cmddesc objecter_requests hook 0x560b9487fab0 EEXIST 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding auth protocol: cephx 2024-08-08T23:51:28.082 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: crc 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 AuthRegistry(0x560b9487b408) adding con mode: secure 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.083 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:51:27.687+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x560b9487b550 EEXIST 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b948bbca0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b94882c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948a4610 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.294670s 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): get_auth_request con 0x560b948bbca0 auth_method 0 2024-08-08T23:51:28.084 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b948a4610 auth_method 0 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:51:27.687+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b94882c80 auth_method 0 2024-08-08T23:51:28.085 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:51:27.687+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient(hunting): handle_auth_done global_id 6489 payload 824 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:51:27.687+0000 7fc949eb8640 1 monclient: found mon.noname-a 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:51:27.687+0000 7fc949eb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: dump: 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.086 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:51:27.687+0000 7fc82ffff640 10 monclient: dump: 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:51:27.687+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6489 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:51:27.687+0000 7fc94b6bb640 4 set_mon_vals no callback set 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.088 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:51:27.687+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:51:27.691+0000 7fc82ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: get_monmap_and_config 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:51:27.691+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding auth protocol: cephx 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.090 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: crc 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x560b948c3920) adding con mode: secure 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc8240661b0 auth_method 0 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.091 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding auth protocol: cephx 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: crc 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347fa90) adding con mode: secure 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.092 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:51:27.691+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x7ffdf347fbd8 EEXIST 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b948f7c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b948f8060 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948f2340 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.298864s 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b948f8060 auth_method 0 2024-08-08T23:51:28.093 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b948f2340 auth_method 0 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:51:27.691+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.094 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_done global_id 6200 payload 274 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 1 monclient: found mon.noname-c 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:51:27.691+0000 7fc94a6b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:51:27.691+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b948f7c80 auth_method 0 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: dump: 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:51:27.691+0000 7fc82dffb640 10 monclient: dump: 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.096 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:51:27.691+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6200 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:51:27.691+0000 7fc94cba5980 10 monclient: get_monmap_and_config success 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:51:27.691+0000 7fc94cba5980 4 set_mon_vals no callback set 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: shutdown 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: build_initial_monmap 2024-08-08T23:51:28.097 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 build_initial for_mkfs: 0 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: monmap: 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.098 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding auth protocol: cephx 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: crc 2024-08-08T23:51:28.099 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948f4010) adding con mode: secure 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: starting msgr at 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: starting objecter 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command objecter_requests cmddesc objecter_requests hook 0x560b948f2c50 EEXIST 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: setting wanted keys 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: calling monclient init 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: init 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding auth protocol: cephx 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.100 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: crc 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 AuthRegistry(0x560b948b86a0) adding con mode: secure 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:51:27.695+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command rotate-key cmddesc rotate-key hook 0x560b948b87e8 EEXIST 2024-08-08T23:51:28.101 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _reopen_session rank -1 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-b con 0x560b948f2340 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-c con 0x560b948f7c80 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): picked mon.noname-a con 0x560b94902550 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): start opening mon connection 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): _renew_subs 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient(hunting): authenticate will time out at 2358.301447s 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): get_auth_request con 0x560b948f7c80 auth_method 0 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.102 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request con 0x560b94902550 auth_method 0 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:51:27.695+0000 7fc94a6b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient(hunting): handle_auth_done global_id 6203 payload 824 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient: _finish_hunting 0 2024-08-08T23:51:28.103 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:51:27.695+0000 7fc94aeba640 1 monclient: found mon.noname-c 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:51:27.695+0000 7fc94aeba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: dump: 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: _finish_auth 0 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: _check_auth_tickets 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:51:27.695+0000 7fc81bfff640 10 monclient: dump: 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:51:28.105 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 monclient: authenticate success, global_id 6203 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:51:27.695+0000 7fc82dffb640 4 set_mon_vals no callback set 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _renew_subs 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:51:27.695+0000 7fc94cba5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:51:27.695+0000 7fc94cba5980 1 librados: init done 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:51:27.695+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cr dump hook 0x560b948ed4e8 2024-08-08T23:51:28.106 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:51:27.695+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:51:27.699+0000 7fc81bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:51:27.699+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x560b94912330 auth_method 0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:51:27.699+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc8140662a0 auth_method 0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 realm 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:51:27.699+0000 7fc94cba5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.107 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:51:27.699+0000 7fc949eb8640 10 monclient: get_auth_request con 0x560b949164b0 auth_method 0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:51:27.699+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:51:27.699+0000 7fc94aeba640 10 monclient: get_auth_request con 0x560b94919cf0 auth_method 0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:51:27.703+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:51:27.703+0000 7fc94cba5980 20 searching for the correct realm 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:51:27.703+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc9440b6040 auth_method 0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:51:27.703+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc93c027040 auth_method 0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:51:27.703+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc940018070 auth_method 0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:51:27.707+0000 7fc94aeba640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fc940018070 msgr2=0x7fc9400540a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:51:27.707+0000 7fc81bfff640 1 client.6203.objecter ms_handle_reset 0x7fc940018070 session 0x7fc940078240 osd.4 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:51:27.707+0000 7fc81bfff640 10 monclient: _renew_subs 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:51:27.707+0000 7fc81bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:51:28.108 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:51:27.707+0000 7fc94aeba640 10 monclient: get_auth_request con 0x7fc814076a50 auth_method 0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:51:27.707+0000 7fc94a6b9640 10 monclient: get_auth_request con 0x7fc944128040 auth_method 0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:51:27.711+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc944103c20 auth_method 0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:51:27.711+0000 7fc949eb8640 0 -- 172.21.15.83:0/3411685281 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc944103c20 msgr2=0x7fc944003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:51:27.915+0000 7fc949eb8640 10 monclient: get_auth_request con 0x7fc944103c20 auth_method 0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:51:27.927+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.109 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zone default found 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Realm: () 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:51:27.931+0000 7fc94cba5980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:51:27.931+0000 7fc94cba5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 zonegroup default 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.110 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started sync module instance, tier type = 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:51:27.931+0000 7fc94cba5980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=0 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=1 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=2 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=3 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=4 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=5 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=6 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:51:27.955+0000 7fc94cba5980 20 add_watcher() i=7 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:51:27.955+0000 7fc94cba5980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.111 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding auth protocol: cephx 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:51:27.959+0000 7fc8017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.112 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: crc 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 AuthRegistry(0x7ffdf347ff20) adding con mode: secure 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:51:27.959+0000 7fc94cba5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:51:27.959+0000 7fc94cba5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache list hook 0x560b94902950 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache inspect hook 0x560b94902950 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache erase hook 0x560b94902950 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command cache zap hook 0x560b94902950 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:51:27.959+0000 7fc94cba5980 5 note: GC not initialized 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:51:27.963+0000 7fc7fb7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace show hook 0x7fc9440047f0 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace history hook 0x7fc9440047f0 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace active hook 0x7fc9440047f0 2024-08-08T23:51:28.113 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:51:27.963+0000 7fc94cba5980 5 asok(0x560b9461b520) register_command sync trace active_short hook 0x7fc9440047f0 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 Filter name: none 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:51:27.963+0000 7fc7f97fa640 20 reqs_thread_entry: start 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : miss 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:51:27.963+0000 7fc94cba5980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.114 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:51:27.963+0000 7fc94cba5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:51:27.971+0000 7fc94cba5980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24, ofs0, ns] 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333454 cookie 94607737249008 notifier 6203 bl.length()=991 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:51:27.971+0000 7fc82dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_sources= new_sources= 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential sources added=[] removed=[] 2024-08-08T23:51:28.115 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_dests= new_dests= 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:51:27.975+0000 7fc94cba5980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential dests added=[] removed=[] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc94cba5980 time 2024-08-08T23:51:27.980925+0000 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc95047dcc1] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:51:28.116 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:51:27.979+0000 7fc94cba5980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fc94cba5980 thread_name:radosgw-admin 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc94f2fe520] 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc95047dd1b] 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7fc95047de75] 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b92ea36e1] 2024-08-08T23:51:28.117 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x560b92eb1d3d] 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc94f2e5d90] 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:51:28.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:51:28.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:51:28.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:51:28.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:51:28.122 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:51:28.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:51:28.124 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc7f97fa640 / http_manager 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc7fb7fe640 / http_manager 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc8017e2640 / rgw_dt_lg_renew 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc81bfff640 / ms_dispatch 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc82dffb640 / io_context_pool 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc82ffff640 / ms_dispatch 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc836e05640 / ms_dispatch 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc838608640 / io_context_pool 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc949eb8640 / msgr-worker-2 2024-08-08T23:51:28.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94a6b9640 / msgr-worker-1 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94aeba640 / msgr-worker-0 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94b6bb640 / io_context_pool 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc94cba5980 / radosgw-admin 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-08-08T23:51:27.986422Z_ff3cb055-e670-4d9f-b8a1-102f1d8e919a/log 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr:Aborted 2024-08-08T23:51:28.126 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 realm 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.067+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.071+0000 7fdb8b167980 20 searching for the correct realm 2024-08-08T23:51:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.075+0000 7fdb8847a640 0 -- 172.21.15.83:0/3180355697 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7fdb78008050 msgr2=0x7fdb78031410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.287+0000 7fdb88c7b640 0 -- 172.21.15.83:0/3180355697 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fdb80015030 msgr2=0x7fdb80075860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:28.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.303+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 zone default found 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 4 Realm: () 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 zonegroup default 2024-08-08T23:51:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.307+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.311+0000 7fdb8b167980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.311+0000 7fdb8b167980 20 started sync module instance, tier type = 2024-08-08T23:51:28.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.311+0000 7fdb8b167980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=0 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=1 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=2 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=3 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=4 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=5 2024-08-08T23:51:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=6 2024-08-08T23:51:28.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 20 add_watcher() i=7 2024-08-08T23:51:28.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.331+0000 7fdb8b167980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:28.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.335+0000 7fda3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.335+0000 7fdb8b167980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:28.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.335+0000 7fdb8b167980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:28.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.335+0000 7fdb8b167980 5 note: GC not initialized 2024-08-08T23:51:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.335+0000 7fda3dfe3640 20 reqs_thread_entry: start 2024-08-08T23:51:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 Filter name: none 2024-08-08T23:51:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fd9af7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:28.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=459 2024-08-08T23:51:28.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:28.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:28.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.339+0000 7fdb8b167980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.343+0000 7fdb8b167980 20 rados_obj.operate() r=0 bl.length=459 2024-08-08T23:51:28.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.343+0000 7fdb8b167980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:28.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.343+0000 7fda3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.351+0000 7fdb8b167980 20 remove_watcher() i=0 2024-08-08T23:51:28.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.351+0000 7fdb8b167980 2 removed watcher, disabling cache 2024-08-08T23:51:28.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.351+0000 7fdb8b167980 20 remove_watcher() i=1 2024-08-08T23:51:28.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.355+0000 7fdb8b167980 20 remove_watcher() i=2 2024-08-08T23:51:28.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.355+0000 7fdb8b167980 20 remove_watcher() i=3 2024-08-08T23:51:28.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.359+0000 7fdb8b167980 20 remove_watcher() i=4 2024-08-08T23:51:28.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.359+0000 7fdb8b167980 20 remove_watcher() i=5 2024-08-08T23:51:28.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.363+0000 7fdb8b167980 20 remove_watcher() i=6 2024-08-08T23:51:28.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.363+0000 7fdb8b167980 20 remove_watcher() i=7 2024-08-08T23:51:28.379 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.379 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:28.379 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:51:28.379 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:28.480 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:51:28.515 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:28.515 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:28.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 realm 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.563+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.567+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:28.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.567+0000 7f9c58f44980 20 searching for the correct realm 2024-08-08T23:51:28.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.567+0000 7f9c56257640 0 -- 172.21.15.83:0/1940279384 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f9c4800f2d0 msgr2=0x7f9c48001f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.779+0000 7f9c56a58640 0 -- 172.21.15.83:0/1940279384 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f9c50008040 msgr2=0x7f9c50008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.795+0000 7f9c58f44980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:28.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 zone default found 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 4 Realm: () 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 zonegroup default 2024-08-08T23:51:28.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.799+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.803+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.803+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.803+0000 7f9c58f44980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.803+0000 7f9c58f44980 20 started sync module instance, tier type = 2024-08-08T23:51:28.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.803+0000 7f9c58f44980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:28.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=0 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=1 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=2 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=3 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=4 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=5 2024-08-08T23:51:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.823+0000 7f9c58f44980 20 add_watcher() i=6 2024-08-08T23:51:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.827+0000 7f9c58f44980 20 add_watcher() i=7 2024-08-08T23:51:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.827+0000 7f9c58f44980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:28.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9b0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 5 note: GC not initialized 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9a87fff640 20 reqs_thread_entry: start 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 20 Filter name: none 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9a85ffb640 20 reqs_thread_entry: start 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-08T23:51:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.831+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-08T23:51:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-08T23:51:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : miss 2024-08-08T23:51:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 20 rados->read ofs=0 len=0 2024-08-08T23:51:28.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 20 rados_obj.operate() r=0 bl.length=459 2024-08-08T23:51:28.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:28.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:28.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:28.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:28.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.835+0000 7f9c58f44980 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to be held by another RGW process; skipping for now 2024-08-08T23:51:28.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.839+0000 7f9b0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.843+0000 7f9c58f44980 20 remove_watcher() i=0 2024-08-08T23:51:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.843+0000 7f9c58f44980 2 removed watcher, disabling cache 2024-08-08T23:51:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.843+0000 7f9c58f44980 20 remove_watcher() i=1 2024-08-08T23:51:28.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.847+0000 7f9c58f44980 20 remove_watcher() i=2 2024-08-08T23:51:28.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.851+0000 7f9c58f44980 20 remove_watcher() i=3 2024-08-08T23:51:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.851+0000 7f9c58f44980 20 remove_watcher() i=4 2024-08-08T23:51:28.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.855+0000 7f9c58f44980 20 remove_watcher() i=5 2024-08-08T23:51:28.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.855+0000 7f9c58f44980 20 remove_watcher() i=6 2024-08-08T23:51:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:28.855+0000 7f9c58f44980 20 remove_watcher() i=7 2024-08-08T23:51:28.878 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-08T23:51:58.880 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:51:58.915 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:58.916 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:58.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:58.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:58.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 realm 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:58.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.966+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:58.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.970+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:58.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.970+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:58.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.970+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:58.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.970+0000 7f356ef77980 20 searching for the correct realm 2024-08-08T23:51:58.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.974+0000 7f356d28c640 0 -- 172.21.15.83:0/1587352796 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f35540638d0 msgr2=0x7f3554078bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:58.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:58.982+0000 7f356c28a640 0 -- 172.21.15.83:0/1587352796 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f355c018040 msgr2=0x7f355c035910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:59.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:59.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:59.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.198+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:59.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 zone default found 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 4 Realm: () 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 zonegroup default 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 started sync module instance, tier type = 2024-08-08T23:51:59.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.202+0000 7f356ef77980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=0 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=1 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=2 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=3 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=4 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=5 2024-08-08T23:51:59.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=6 2024-08-08T23:51:59.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 20 add_watcher() i=7 2024-08-08T23:51:59.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.226+0000 7f356ef77980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:59.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.230+0000 7f34237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:59.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.230+0000 7f356ef77980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:59.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.230+0000 7f356ef77980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:59.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.230+0000 7f356ef77980 5 note: GC not initialized 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.230+0000 7f34227e4640 20 reqs_thread_entry: start 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 Filter name: none 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f341b7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-08T23:51:59.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : miss 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 20 rados_obj.operate() r=0 bl.length=459 2024-08-08T23:51:59.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:59.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:59.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:51:59.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:59.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.234+0000 7f356ef77980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:59.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.238+0000 7f356ef77980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24, ofs0, ns] 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f34437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333455 cookie 93849805658464 notifier 6546 bl.length()=991 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f34437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f34437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:59.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f34437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:59.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_sources= new_sources= 2024-08-08T23:51:59.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential sources added=[] removed=[] 2024-08-08T23:51:59.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_dests= new_dests= 2024-08-08T23:51:59.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.246+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential dests added=[] removed=[] 2024-08-08T23:51:59.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.250+0000 7f356ef77980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24.2.0 2024-08-08T23:51:59.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.250+0000 7f356ef77980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24.2.0 2024-08-08T23:51:59.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.250+0000 7f356ef77980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24.2.1 2024-08-08T23:51:59.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.250+0000 7f356ef77980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24.2.1 2024-08-08T23:51:59.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.250+0000 7f356ef77980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24.0 2024-08-08T23:51:59.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.254+0000 7f356ef77980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 : hit (requested=0x17, cached=0x17) 2024-08-08T23:51:59.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.254+0000 7f356ef77980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 2024-08-08T23:51:59.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f356ef77980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:59.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f356ef77980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f356ef77980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f356ef77980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24, ofs0, ns] 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f3443fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333456 cookie 93849805658464 notifier 6546 bl.length()=959 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f3443fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 info.flags=0x17 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f3443fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 to cache LRU end 2024-08-08T23:51:59.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.258+0000 7f3443fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:51:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.262+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_sources= new_sources= 2024-08-08T23:51:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.262+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential sources added=[] removed=[] 2024-08-08T23:51:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.262+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): orig_dests= new_dests= 2024-08-08T23:51:59.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.262+0000 7f356ef77980 20 handle_bi_update(): bucket=:abort-at-block-writes[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24]): potential dests added=[] removed=[] 2024-08-08T23:51:59.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.262+0000 7f356ef77980 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-08-08T23:51:59.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.266+0000 7f34237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:59.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.274+0000 7f356ef77980 20 remove_watcher() i=0 2024-08-08T23:51:59.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.274+0000 7f356ef77980 2 removed watcher, disabling cache 2024-08-08T23:51:59.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.274+0000 7f356ef77980 20 remove_watcher() i=1 2024-08-08T23:51:59.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.278+0000 7f356ef77980 20 remove_watcher() i=2 2024-08-08T23:51:59.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.278+0000 7f356ef77980 20 remove_watcher() i=3 2024-08-08T23:51:59.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.282+0000 7f356ef77980 20 remove_watcher() i=4 2024-08-08T23:51:59.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.282+0000 7f356ef77980 20 remove_watcher() i=5 2024-08-08T23:51:59.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.286+0000 7f356ef77980 20 remove_watcher() i=6 2024-08-08T23:51:59.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.286+0000 7f356ef77980 20 remove_watcher() i=7 2024-08-08T23:51:59.295 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-08T23:51:59.325 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:51:59.325 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:51:59.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.374+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.374+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.374+0000 7f0d709f1980 20 realm 2024-08-08T23:51:59.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.374+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:51:59.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:59.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:51:59.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.378+0000 7f0d709f1980 20 searching for the correct realm 2024-08-08T23:51:59.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.382+0000 7f0d6ed06640 0 -- 172.21.15.83:0/1093524420 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f0d6403a030 msgr2=0x7f0d6402e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:59.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.598+0000 7f0d6dd04640 0 -- 172.21.15.83:0/1093524420 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f0d680913b0 msgr2=0x7f0d68063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:51:59.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.814+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:51:59.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:51:59.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 zone default found 2024-08-08T23:51:59.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 4 Realm: () 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 zonegroup default 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:51:59.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 started sync module instance, tier type = 2024-08-08T23:51:59.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.818+0000 7f0d709f1980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:51:59.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=0 2024-08-08T23:51:59.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=1 2024-08-08T23:51:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=2 2024-08-08T23:51:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=3 2024-08-08T23:51:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=4 2024-08-08T23:51:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=5 2024-08-08T23:51:59.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=6 2024-08-08T23:51:59.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 20 add_watcher() i=7 2024-08-08T23:51:59.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.842+0000 7f0d709f1980 2 all 8 watchers are set, enabling cache 2024-08-08T23:51:59.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.846+0000 7f0c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:59.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.846+0000 7f0d709f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:51:59.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.846+0000 7f0d709f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:51:59.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 5 note: GC not initialized 2024-08-08T23:51:59.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0b9f7fe640 20 reqs_thread_entry: start 2024-08-08T23:51:59.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 init_complete bucket index max shards: 1 2024-08-08T23:51:59.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 Filter name: none 2024-08-08T23:51:59.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0b9d7fa640 20 reqs_thread_entry: start 2024-08-08T23:51:59.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:59.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:59.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:59.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.850+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.854+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=213 2024-08-08T23:51:59.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.854+0000 7f0d709f1980 20 rados->read ofs=0 len=0 2024-08-08T23:51:59.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.854+0000 7f0d709f1980 20 rados_obj.operate() r=0 bl.length=427 2024-08-08T23:51:59.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.854+0000 7f0d709f1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:51:59.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.854+0000 7f0c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:51:59.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.862+0000 7f0d709f1980 20 remove_watcher() i=0 2024-08-08T23:51:59.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.862+0000 7f0d709f1980 2 removed watcher, disabling cache 2024-08-08T23:51:59.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.862+0000 7f0d709f1980 20 remove_watcher() i=1 2024-08-08T23:51:59.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.866+0000 7f0d709f1980 20 remove_watcher() i=2 2024-08-08T23:51:59.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.866+0000 7f0d709f1980 20 remove_watcher() i=3 2024-08-08T23:51:59.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.870+0000 7f0d709f1980 20 remove_watcher() i=4 2024-08-08T23:51:59.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.870+0000 7f0d709f1980 20 remove_watcher() i=5 2024-08-08T23:51:59.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.874+0000 7f0d709f1980 20 remove_watcher() i=6 2024-08-08T23:51:59.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:51:59.874+0000 7f0d709f1980 20 remove_watcher() i=7 2024-08-08T23:51:59.889 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:51:59.889 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:51:59.889 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:51:59.889 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:00.601 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-08-08T23:52:00.601 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:02.645 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-08T23:52:02.677 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:02.678 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:02.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.726+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 realm 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:02.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:02.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:02.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.730+0000 7f25864d9980 20 searching for the correct realm 2024-08-08T23:52:02.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.734+0000 7f25847ee640 0 -- 172.21.15.83:0/1890655414 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f256c027020 msgr2=0x7f256c077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:02.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.742+0000 7f257bfff640 0 -- 172.21.15.83:0/1890655414 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f257c063440 msgr2=0x7f257c0638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:02.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:02.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.958+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 zone default found 2024-08-08T23:52:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 4 Realm: () 2024-08-08T23:52:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 zonegroup default 2024-08-08T23:52:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:02.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 started sync module instance, tier type = 2024-08-08T23:52:02.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.962+0000 7f25864d9980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=0 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=1 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=2 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=3 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=4 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=5 2024-08-08T23:52:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=6 2024-08-08T23:52:02.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 20 add_watcher() i=7 2024-08-08T23:52:02.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.990+0000 7f25864d9980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:02.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f2439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:02.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:02.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:02.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 5 note: GC not initialized 2024-08-08T23:52:02.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f2438fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:02.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:02.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 20 Filter name: none 2024-08-08T23:52:02.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f23b27fc640 20 reqs_thread_entry: start 2024-08-08T23:52:02.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:02.998+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:02.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:02.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:02.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:02.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados->read ofs=0 len=0 2024-08-08T23:52:02.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:02.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.002+0000 7f25864d9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:03.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.006+0000 7f2439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:03.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.010+0000 7f25864d9980 20 remove_watcher() i=0 2024-08-08T23:52:03.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.010+0000 7f25864d9980 2 removed watcher, disabling cache 2024-08-08T23:52:03.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.014+0000 7f25864d9980 20 remove_watcher() i=1 2024-08-08T23:52:03.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.018+0000 7f25864d9980 20 remove_watcher() i=2 2024-08-08T23:52:03.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.018+0000 7f25864d9980 20 remove_watcher() i=3 2024-08-08T23:52:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.022+0000 7f25864d9980 20 remove_watcher() i=4 2024-08-08T23:52:03.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.022+0000 7f25864d9980 20 remove_watcher() i=5 2024-08-08T23:52:03.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.022+0000 7f25864d9980 20 remove_watcher() i=6 2024-08-08T23:52:03.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.026+0000 7f25864d9980 20 remove_watcher() i=7 2024-08-08T23:52:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:03.035 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:03.035 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:03.035 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-08-08T23:52:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:03.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.118+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.118+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.118+0000 7fe53f08b980 20 realm 2024-08-08T23:52:03.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.118+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.118+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:03.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:03.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:03.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.122+0000 7fe53f08b980 20 searching for the correct realm 2024-08-08T23:52:03.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.126+0000 7fe53d3a0640 0 -- 172.21.15.83:0/2056477283 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fe530073b90 msgr2=0x7fe53005a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:03.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.134+0000 7fe53c39e640 0 -- 172.21.15.83:0/2056477283 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fe5340b7750 msgr2=0x7fe5340ee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:03.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.350+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:03.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:03.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 zone default found 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 4 Realm: () 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 zonegroup default 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.354+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.358+0000 7fe53f08b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.358+0000 7fe53f08b980 20 started sync module instance, tier type = 2024-08-08T23:52:03.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.358+0000 7fe53f08b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=0 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=1 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=2 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=3 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=4 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=5 2024-08-08T23:52:03.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=6 2024-08-08T23:52:03.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 20 add_watcher() i=7 2024-08-08T23:52:03.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.382+0000 7fe53f08b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:03.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.386+0000 7fe3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 5 note: GC not initialized 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe3f1fe3640 20 reqs_thread_entry: start 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:03.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 Filter name: none 2024-08-08T23:52:03.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe3637fe640 20 reqs_thread_entry: start 2024-08-08T23:52:03.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-08T23:52:03.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-08T23:52:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 : miss 2024-08-08T23:52:03.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.390+0000 7fe53f08b980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.394+0000 7fe53f08b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 2024-08-08T23:52:03.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:03.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:03.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:03.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25, ofs0, ns] 2024-08-08T23:52:03.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe413fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 94418392286912 notifier 6603 bl.length()=1007 2024-08-08T23:52:03.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe413fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:03.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe413fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:03.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe413fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:03.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_sources= new_sources= 2024-08-08T23:52:03.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential sources added=[] removed=[] 2024-08-08T23:52:03.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_dests= new_dests= 2024-08-08T23:52:03.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.402+0000 7fe53f08b980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential dests added=[] removed=[] 2024-08-08T23:52:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.406+0000 7fe53f08b980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.1.0 2024-08-08T23:52:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.406+0000 7fe53f08b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.1.0 2024-08-08T23:52:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.406+0000 7fe53f08b980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.1.1 2024-08-08T23:52:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.406+0000 7fe53f08b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.1.1 2024-08-08T23:52:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.406+0000 7fe53f08b980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.0 2024-08-08T23:52:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.410+0000 7fe53f08b980 -1 Injecting error=-5 at location=commit_target_layout 2024-08-08T23:52:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.410+0000 7fe53f08b980 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-08-08T23:52:03.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.418+0000 7fe3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:03.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.422+0000 7fe53f08b980 20 remove_watcher() i=0 2024-08-08T23:52:03.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.422+0000 7fe53f08b980 2 removed watcher, disabling cache 2024-08-08T23:52:03.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.426+0000 7fe53f08b980 20 remove_watcher() i=1 2024-08-08T23:52:03.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.430+0000 7fe53f08b980 20 remove_watcher() i=2 2024-08-08T23:52:03.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.430+0000 7fe53f08b980 20 remove_watcher() i=3 2024-08-08T23:52:03.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.434+0000 7fe53f08b980 20 remove_watcher() i=4 2024-08-08T23:52:03.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.434+0000 7fe53f08b980 20 remove_watcher() i=5 2024-08-08T23:52:03.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.438+0000 7fe53f08b980 20 remove_watcher() i=6 2024-08-08T23:52:03.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.438+0000 7fe53f08b980 20 remove_watcher() i=7 2024-08-08T23:52:03.447 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-08T23:52:03.476 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:03.477 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:03.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.522+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 realm 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:03.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.526+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.530+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:03.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.530+0000 7f9a94ab1980 20 searching for the correct realm 2024-08-08T23:52:03.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.534+0000 7f9a92dc6640 0 -- 172.21.15.83:0/1000633836 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f9a88028040 msgr2=0x7f9a880667a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:03.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.746+0000 7f9a91dc4640 0 -- 172.21.15.83:0/1000633836 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f9a8c08bad0 msgr2=0x7f9a8c08d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:03.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:03.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:03.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:03.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.962+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:03.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:03.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 zone default found 2024-08-08T23:52:03.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 4 Realm: () 2024-08-08T23:52:03.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 zonegroup default 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:03.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 started sync module instance, tier type = 2024-08-08T23:52:03.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.966+0000 7f9a94ab1980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:03.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=0 2024-08-08T23:52:03.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=1 2024-08-08T23:52:03.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=2 2024-08-08T23:52:03.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=3 2024-08-08T23:52:03.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=4 2024-08-08T23:52:03.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=5 2024-08-08T23:52:03.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.990+0000 7f9a94ab1980 20 add_watcher() i=6 2024-08-08T23:52:03.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.994+0000 7f9a94ab1980 20 add_watcher() i=7 2024-08-08T23:52:03.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.994+0000 7f9a94ab1980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:03.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9948fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:03.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:03.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:03.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 5 note: GC not initialized 2024-08-08T23:52:03.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f98c37fe640 20 reqs_thread_entry: start 2024-08-08T23:52:03.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:03.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 Filter name: none 2024-08-08T23:52:03.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f98c17fa640 20 reqs_thread_entry: start 2024-08-08T23:52:03.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:03.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:03.998+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=467 2024-08-08T23:52:03.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:03.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:03.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 rados->read ofs=0 len=0 2024-08-08T23:52:03.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 rados_obj.operate() r=0 bl.length=467 2024-08-08T23:52:03.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.002+0000 7f9a94ab1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:03.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.006+0000 7f9948fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:04.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.010+0000 7f9a94ab1980 20 remove_watcher() i=0 2024-08-08T23:52:04.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.010+0000 7f9a94ab1980 2 removed watcher, disabling cache 2024-08-08T23:52:04.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.014+0000 7f9a94ab1980 20 remove_watcher() i=1 2024-08-08T23:52:04.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.014+0000 7f9a94ab1980 20 remove_watcher() i=2 2024-08-08T23:52:04.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.018+0000 7f9a94ab1980 20 remove_watcher() i=3 2024-08-08T23:52:04.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.018+0000 7f9a94ab1980 20 remove_watcher() i=4 2024-08-08T23:52:04.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.022+0000 7f9a94ab1980 20 remove_watcher() i=5 2024-08-08T23:52:04.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.022+0000 7f9a94ab1980 20 remove_watcher() i=6 2024-08-08T23:52:04.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.022+0000 7f9a94ab1980 20 remove_watcher() i=7 2024-08-08T23:52:04.036 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:04.036 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:04.037 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:04.037 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:04.188 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:52:04.224 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:04.224 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:04.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 realm 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.274+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.278+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:04.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.278+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.278+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:04.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.278+0000 7f43bfb3a980 20 searching for the correct realm 2024-08-08T23:52:04.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.282+0000 7f43bde4f640 0 -- 172.21.15.83:0/2005047533 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f43b40eabb0 msgr2=0x7f43b4001050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:04.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.290+0000 7f43bce4d640 0 -- 172.21.15.83:0/2005047533 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f43b804c900 msgr2=0x7f43b80573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:04.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.506+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:04.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 zone default found 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 4 Realm: () 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:04.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 zonegroup default 2024-08-08T23:52:04.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 started sync module instance, tier type = 2024-08-08T23:52:04.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.510+0000 7f43bfb3a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:04.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=0 2024-08-08T23:52:04.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=1 2024-08-08T23:52:04.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=2 2024-08-08T23:52:04.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=3 2024-08-08T23:52:04.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=4 2024-08-08T23:52:04.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=5 2024-08-08T23:52:04.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.534+0000 7f43bfb3a980 20 add_watcher() i=6 2024-08-08T23:52:04.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.538+0000 7f43bfb3a980 20 add_watcher() i=7 2024-08-08T23:52:04.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.538+0000 7f43bfb3a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:04.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f4273fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f43bfb3a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f43bfb3a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f43bfb3a980 5 note: GC not initialized 2024-08-08T23:52:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f4272fe5640 20 reqs_thread_entry: start 2024-08-08T23:52:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.542+0000 7f43bfb3a980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 20 Filter name: none 2024-08-08T23:52:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f4270fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-08T23:52:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-08T23:52:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 : miss 2024-08-08T23:52:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 20 rados_obj.operate() r=0 bl.length=467 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:04.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.546+0000 7f43bfb3a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 2024-08-08T23:52:04.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.550+0000 7f43bfb3a980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-08T23:52:04.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f43bfb3a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:04.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f43bfb3a980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:04.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f43bfb3a980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:04.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f43bfb3a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25, ofs0, ns] 2024-08-08T23:52:04.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f42a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 94704349280464 notifier 6335 bl.length()=1007 2024-08-08T23:52:04.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f42a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:04.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f42a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:04.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.558+0000 7f42a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:04.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_sources= new_sources= 2024-08-08T23:52:04.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential sources added=[] removed=[] 2024-08-08T23:52:04.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_dests= new_dests= 2024-08-08T23:52:04.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential dests added=[] removed=[] 2024-08-08T23:52:04.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.2.0 2024-08-08T23:52:04.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.2.0 2024-08-08T23:52:04.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.2.1 2024-08-08T23:52:04.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.2.1 2024-08-08T23:52:04.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.562+0000 7f43bfb3a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25.0 2024-08-08T23:52:04.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.570+0000 7f43bfb3a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 : hit (requested=0x17, cached=0x17) 2024-08-08T23:52:04.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.570+0000 7f43bfb3a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25, ofs0, ns] 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f428ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94704349280464 notifier 6335 bl.length()=975 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f428ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 info.flags=0x17 2024-08-08T23:52:04.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f428ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 to cache LRU end 2024-08-08T23:52:04.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f428ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:04.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_sources= new_sources= 2024-08-08T23:52:04.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential sources added=[] removed=[] 2024-08-08T23:52:04.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): orig_dests= new_dests= 2024-08-08T23:52:04.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.574+0000 7f43bfb3a980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25]): potential dests added=[] removed=[] 2024-08-08T23:52:04.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.578+0000 7f43bfb3a980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-08-08T23:52:04.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.582+0000 7f4273fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:04.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.586+0000 7f43bfb3a980 20 remove_watcher() i=0 2024-08-08T23:52:04.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.586+0000 7f43bfb3a980 2 removed watcher, disabling cache 2024-08-08T23:52:04.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.586+0000 7f43bfb3a980 20 remove_watcher() i=1 2024-08-08T23:52:04.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.590+0000 7f43bfb3a980 20 remove_watcher() i=2 2024-08-08T23:52:04.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.594+0000 7f43bfb3a980 20 remove_watcher() i=3 2024-08-08T23:52:04.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.594+0000 7f43bfb3a980 20 remove_watcher() i=4 2024-08-08T23:52:04.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.594+0000 7f43bfb3a980 20 remove_watcher() i=5 2024-08-08T23:52:04.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.598+0000 7f43bfb3a980 20 remove_watcher() i=6 2024-08-08T23:52:04.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.598+0000 7f43bfb3a980 20 remove_watcher() i=7 2024-08-08T23:52:04.607 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-08T23:52:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:04.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.682+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 realm 2024-08-08T23:52:04.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:04.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:04.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:04.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.686+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:04.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.690+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:04.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.690+0000 7f1c5e257980 20 searching for the correct realm 2024-08-08T23:52:04.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.694+0000 7f1c5c56c640 0 -- 172.21.15.83:0/2481517339 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f1c5002b070 msgr2=0x7f1c5005f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:04.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:04.910+0000 7f1c5b56a640 0 -- 172.21.15.83:0/2481517339 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f1c540f9b60 msgr2=0x7f1c540ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:05.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:05.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:05.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.126+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:05.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 zone default found 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 4 Realm: () 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 zonegroup default 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:05.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 started sync module instance, tier type = 2024-08-08T23:52:05.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.130+0000 7f1c5e257980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:05.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=0 2024-08-08T23:52:05.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=1 2024-08-08T23:52:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=2 2024-08-08T23:52:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=3 2024-08-08T23:52:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=4 2024-08-08T23:52:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=5 2024-08-08T23:52:05.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.154+0000 7f1c5e257980 20 add_watcher() i=6 2024-08-08T23:52:05.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.158+0000 7f1c5e257980 20 add_watcher() i=7 2024-08-08T23:52:05.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.158+0000 7f1c5e257980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:05.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.162+0000 7f1b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:05.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.162+0000 7f1c5e257980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:05.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.162+0000 7f1c5e257980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:05.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.162+0000 7f1c5e257980 5 note: GC not initialized 2024-08-08T23:52:05.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.162+0000 7f1b10fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:05.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:05.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 Filter name: none 2024-08-08T23:52:05.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1a8a7fc640 20 reqs_thread_entry: start 2024-08-08T23:52:05.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:05.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:05.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:05.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.166+0000 7f1c5e257980 20 rados->read ofs=0 len=0 2024-08-08T23:52:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.170+0000 7f1c5e257980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.170+0000 7f1c5e257980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.170+0000 7f1b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:05.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.174+0000 7f1c5e257980 20 remove_watcher() i=0 2024-08-08T23:52:05.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.174+0000 7f1c5e257980 2 removed watcher, disabling cache 2024-08-08T23:52:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.178+0000 7f1c5e257980 20 remove_watcher() i=1 2024-08-08T23:52:05.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.182+0000 7f1c5e257980 20 remove_watcher() i=2 2024-08-08T23:52:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.182+0000 7f1c5e257980 20 remove_watcher() i=3 2024-08-08T23:52:05.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.186+0000 7f1c5e257980 20 remove_watcher() i=4 2024-08-08T23:52:05.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.186+0000 7f1c5e257980 20 remove_watcher() i=5 2024-08-08T23:52:05.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.190+0000 7f1c5e257980 20 remove_watcher() i=6 2024-08-08T23:52:05.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:05.190+0000 7f1c5e257980 20 remove_watcher() i=7 2024-08-08T23:52:05.201 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:05.201 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:05.201 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:52:05.201 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:05.932 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-08-08T23:52:05.932 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:07.961 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-08T23:52:07.992 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:07.992 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:08.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 realm 2024-08-08T23:52:08.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.046+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.050+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:08.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.050+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.050+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:08.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.050+0000 7f84c45c4980 20 searching for the correct realm 2024-08-08T23:52:08.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.054+0000 7f84c28d9640 0 -- 172.21.15.83:0/664905500 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f84ac008040 msgr2=0x7f84ac0618f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:08.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.062+0000 7f84c18d7640 0 -- 172.21.15.83:0/664905500 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f84bc02a930 msgr2=0x7f84bc035410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:08.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:08.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:08.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 zone default found 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 4 Realm: () 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:08.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 zonegroup default 2024-08-08T23:52:08.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.278+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 started sync module instance, tier type = 2024-08-08T23:52:08.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.282+0000 7f84c45c4980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:08.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=0 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=1 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=2 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=3 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=4 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=5 2024-08-08T23:52:08.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=6 2024-08-08T23:52:08.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 20 add_watcher() i=7 2024-08-08T23:52:08.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.306+0000 7f84c45c4980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:08.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.310+0000 7f8378fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:08.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:08.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:08.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 5 note: GC not initialized 2024-08-08T23:52:08.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f82f37fe640 20 reqs_thread_entry: start 2024-08-08T23:52:08.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:08.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 Filter name: none 2024-08-08T23:52:08.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f82f17fa640 20 reqs_thread_entry: start 2024-08-08T23:52:08.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:08.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.314+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:08.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:08.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:08.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:08.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.318+0000 7f84c45c4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:08.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.322+0000 7f8378fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:08.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.326+0000 7f84c45c4980 20 remove_watcher() i=0 2024-08-08T23:52:08.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.326+0000 7f84c45c4980 2 removed watcher, disabling cache 2024-08-08T23:52:08.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.330+0000 7f84c45c4980 20 remove_watcher() i=1 2024-08-08T23:52:08.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.330+0000 7f84c45c4980 20 remove_watcher() i=2 2024-08-08T23:52:08.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.334+0000 7f84c45c4980 20 remove_watcher() i=3 2024-08-08T23:52:08.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.334+0000 7f84c45c4980 20 remove_watcher() i=4 2024-08-08T23:52:08.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.338+0000 7f84c45c4980 20 remove_watcher() i=5 2024-08-08T23:52:08.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.338+0000 7f84c45c4980 20 remove_watcher() i=6 2024-08-08T23:52:08.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.342+0000 7f84c45c4980 20 remove_watcher() i=7 2024-08-08T23:52:08.348 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:08.348 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:08.348 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:08.348 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:08.349 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-08-08T23:52:08.386 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:08.386 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:08.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 realm 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.434+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.438+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:08.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.438+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.438+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:08.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.438+0000 7f7befd2e980 20 searching for the correct realm 2024-08-08T23:52:08.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.442+0000 7f7bee043640 0 -- 172.21.15.83:0/3544438124 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f7bd8003040 msgr2=0x7f7bd8053a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:08.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.450+0000 7f7bed041640 0 -- 172.21.15.83:0/3544438124 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f7be8008040 msgr2=0x7f7be802c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:08.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:08.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.666+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 zone default found 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 4 Realm: () 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 zonegroup default 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 started sync module instance, tier type = 2024-08-08T23:52:08.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.670+0000 7f7befd2e980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=0 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=1 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=2 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=3 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=4 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=5 2024-08-08T23:52:08.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.694+0000 7f7befd2e980 20 add_watcher() i=6 2024-08-08T23:52:08.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.698+0000 7f7befd2e980 20 add_watcher() i=7 2024-08-08T23:52:08.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.698+0000 7f7befd2e980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:08.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7aa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:08.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:08.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:08.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 5 note: GC not initialized 2024-08-08T23:52:08.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7aa2fe5640 20 reqs_thread_entry: start 2024-08-08T23:52:08.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:08.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 20 Filter name: none 2024-08-08T23:52:08.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7aa0fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:08.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-08T23:52:08.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.702+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:08.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:08.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-08T23:52:08.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 : miss 2024-08-08T23:52:08.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:08.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 info.flags=0x17 2024-08-08T23:52:08.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 to cache LRU end 2024-08-08T23:52:08.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:08.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:08.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.706+0000 7f7befd2e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 2024-08-08T23:52:08.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7befd2e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 info.flags=0x17 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7befd2e980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 to cache LRU end 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7befd2e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7befd2e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26, ofs0, ns] 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94500789978176 notifier 6693 bl.length()=1007 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7ad0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 info.flags=0x17 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7ad0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 to cache LRU end 2024-08-08T23:52:08.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.714+0000 7f7ad0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:08.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): orig_sources= new_sources= 2024-08-08T23:52:08.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): potential sources added=[] removed=[] 2024-08-08T23:52:08.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): orig_dests= new_dests= 2024-08-08T23:52:08.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): potential dests added=[] removed=[] 2024-08-08T23:52:08.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26.1.0 2024-08-08T23:52:08.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26.1.0 2024-08-08T23:52:08.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26.1.1 2024-08-08T23:52:08.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26.1.1 2024-08-08T23:52:08.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.718+0000 7f7befd2e980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26.0 2024-08-08T23:52:08.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.726+0000 7f7befd2e980 -1 Injecting error=-125 at location=commit_target_layout 2024-08-08T23:52:08.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.726+0000 7f7befd2e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 : hit (requested=0x17, cached=0x17) 2024-08-08T23:52:08.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.726+0000 7f7befd2e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 info.flags=0x17 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 to cache LRU end 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26, ofs0, ns] 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 94500789978176 notifier 6693 bl.length()=975 2024-08-08T23:52:08.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7ad0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 info.flags=0x17 2024-08-08T23:52:08.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7ad0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 to cache LRU end 2024-08-08T23:52:08.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7ad0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:08.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): orig_sources= new_sources= 2024-08-08T23:52:08.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): potential sources added=[] removed=[] 2024-08-08T23:52:08.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): orig_dests= new_dests= 2024-08-08T23:52:08.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.730+0000 7f7befd2e980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26]): potential dests added=[] removed=[] 2024-08-08T23:52:08.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.734+0000 7f7befd2e980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-08-08T23:52:08.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.738+0000 7f7aa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:08.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.742+0000 7f7befd2e980 20 remove_watcher() i=0 2024-08-08T23:52:08.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.742+0000 7f7befd2e980 2 removed watcher, disabling cache 2024-08-08T23:52:08.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.746+0000 7f7befd2e980 20 remove_watcher() i=1 2024-08-08T23:52:08.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.746+0000 7f7befd2e980 20 remove_watcher() i=2 2024-08-08T23:52:08.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.750+0000 7f7befd2e980 20 remove_watcher() i=3 2024-08-08T23:52:08.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.750+0000 7f7befd2e980 20 remove_watcher() i=4 2024-08-08T23:52:08.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.754+0000 7f7befd2e980 20 remove_watcher() i=5 2024-08-08T23:52:08.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.754+0000 7f7befd2e980 20 remove_watcher() i=6 2024-08-08T23:52:08.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.758+0000 7f7befd2e980 20 remove_watcher() i=7 2024-08-08T23:52:08.770 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-08T23:52:08.802 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:08.802 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:08.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 realm 2024-08-08T23:52:08.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:08.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:08.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.854+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.858+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:08.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.858+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:08.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.858+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:08.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.858+0000 7f2024718980 20 searching for the correct realm 2024-08-08T23:52:08.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:08.862+0000 7f2022a2d640 0 -- 172.21.15.83:0/1552634572 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f2018010c40 msgr2=0x7f2018061a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:09.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.078+0000 7f2021a2b640 0 -- 172.21.15.83:0/1552634572 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f201c055ca0 msgr2=0x7f201c042580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:09.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:09.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:09.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:09.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:09.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.294+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:09.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:09.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 zone default found 2024-08-08T23:52:09.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 4 Realm: () 2024-08-08T23:52:09.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 zonegroup default 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:09.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:09.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:09.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 started sync module instance, tier type = 2024-08-08T23:52:09.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.298+0000 7f2024718980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.322+0000 7f2024718980 20 add_watcher() i=0 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=1 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=2 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=3 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=4 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=5 2024-08-08T23:52:09.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=6 2024-08-08T23:52:09.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 20 add_watcher() i=7 2024-08-08T23:52:09.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.326+0000 7f2024718980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:09.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.330+0000 7f1ed8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:09.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.330+0000 7f2024718980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:09.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.330+0000 7f2024718980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:09.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.330+0000 7f2024718980 5 note: GC not initialized 2024-08-08T23:52:09.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f1e537fe640 20 reqs_thread_entry: start 2024-08-08T23:52:09.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:09.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 Filter name: none 2024-08-08T23:52:09.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f1e517fa640 20 reqs_thread_entry: start 2024-08-08T23:52:09.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:09.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:09.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:09.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.334+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.338+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:09.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.338+0000 7f2024718980 20 rados->read ofs=0 len=0 2024-08-08T23:52:09.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.338+0000 7f2024718980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:09.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.338+0000 7f2024718980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:09.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.342+0000 7f1ed8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:09.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.346+0000 7f2024718980 20 remove_watcher() i=0 2024-08-08T23:52:09.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.346+0000 7f2024718980 2 removed watcher, disabling cache 2024-08-08T23:52:09.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.346+0000 7f2024718980 20 remove_watcher() i=1 2024-08-08T23:52:09.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.350+0000 7f2024718980 20 remove_watcher() i=2 2024-08-08T23:52:09.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.354+0000 7f2024718980 20 remove_watcher() i=3 2024-08-08T23:52:09.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.354+0000 7f2024718980 20 remove_watcher() i=4 2024-08-08T23:52:09.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.358+0000 7f2024718980 20 remove_watcher() i=5 2024-08-08T23:52:09.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.358+0000 7f2024718980 20 remove_watcher() i=6 2024-08-08T23:52:09.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:09.358+0000 7f2024718980 20 remove_watcher() i=7 2024-08-08T23:52:09.373 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:09.373 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:09.373 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-08-08T23:52:09.373 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:10.050 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-08-08T23:52:10.051 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:12.142 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-08T23:52:12.173 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:12.173 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:12.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 realm 2024-08-08T23:52:12.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:12.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.226+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.230+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:12.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.230+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.230+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:12.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.230+0000 7ff0a23be980 20 searching for the correct realm 2024-08-08T23:52:12.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.230+0000 7ff09f6d1640 0 -- 172.21.15.83:0/2251832917 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7ff090017030 msgr2=0x7ff090003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:12.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.442+0000 7ff09fed2640 0 -- 172.21.15.83:0/2251832917 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7ff0980cc070 msgr2=0x7ff0980cc450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:12.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.458+0000 7ff0a23be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:12.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 zone default found 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 4 Realm: () 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 zonegroup default 2024-08-08T23:52:12.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.462+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.466+0000 7ff0a23be980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.466+0000 7ff0a23be980 20 started sync module instance, tier type = 2024-08-08T23:52:12.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.466+0000 7ff0a23be980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:12.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=0 2024-08-08T23:52:12.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=1 2024-08-08T23:52:12.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=2 2024-08-08T23:52:12.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=3 2024-08-08T23:52:12.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=4 2024-08-08T23:52:12.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=5 2024-08-08T23:52:12.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.486+0000 7ff0a23be980 20 add_watcher() i=6 2024-08-08T23:52:12.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.490+0000 7ff0a23be980 20 add_watcher() i=7 2024-08-08T23:52:12.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.490+0000 7ff0a23be980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:12.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7fef55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:12.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7ff0a23be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:12.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7ff0a23be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:12.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7ff0a23be980 5 note: GC not initialized 2024-08-08T23:52:12.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7fef54fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:12.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.494+0000 7ff0a23be980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 Filter name: none 2024-08-08T23:52:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7feece7fc640 20 reqs_thread_entry: start 2024-08-08T23:52:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:12.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:12.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:12.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:12.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.498+0000 7ff0a23be980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.502+0000 7ff0a23be980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:12.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.502+0000 7ff0a23be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:12.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.502+0000 7fef55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:12.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.510+0000 7ff0a23be980 20 remove_watcher() i=0 2024-08-08T23:52:12.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.510+0000 7ff0a23be980 2 removed watcher, disabling cache 2024-08-08T23:52:12.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.510+0000 7ff0a23be980 20 remove_watcher() i=1 2024-08-08T23:52:12.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.514+0000 7ff0a23be980 20 remove_watcher() i=2 2024-08-08T23:52:12.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.514+0000 7ff0a23be980 20 remove_watcher() i=3 2024-08-08T23:52:12.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.518+0000 7ff0a23be980 20 remove_watcher() i=4 2024-08-08T23:52:12.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.518+0000 7ff0a23be980 20 remove_watcher() i=5 2024-08-08T23:52:12.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.522+0000 7ff0a23be980 20 remove_watcher() i=6 2024-08-08T23:52:12.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.522+0000 7ff0a23be980 20 remove_watcher() i=7 2024-08-08T23:52:12.533 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:12.533 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:12.533 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:12.533 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:12.534 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-08-08T23:52:12.569 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:12.570 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:12.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 realm 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:12.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:12.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:12.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:12.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.622+0000 7ff0f8531980 20 searching for the correct realm 2024-08-08T23:52:12.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.626+0000 7ff0f6846640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff0ec07c290 msgr2=0x7ff0ec016900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:12.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:12.842+0000 7ff0f5844640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff0f00e9900 msgr2=0x7ff0f00b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:13.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:13.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.058+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:13.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zone default found 2024-08-08T23:52:13.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Realm: () 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zonegroup default 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.066+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started sync module instance, tier type = 2024-08-08T23:52:13.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=0 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=1 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=2 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=3 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=4 2024-08-08T23:52:13.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=5 2024-08-08T23:52:13.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=6 2024-08-08T23:52:13.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.086+0000 7ff0f8531980 20 add_watcher() i=7 2024-08-08T23:52:13.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.086+0000 7ff0f8531980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:13.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7fefacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:13.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:13.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:13.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7ff0f8531980 5 note: GC not initialized 2024-08-08T23:52:13.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7fef277fe640 20 reqs_thread_entry: start 2024-08-08T23:52:13.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.090+0000 7ff0f8531980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:13.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 20 Filter name: none 2024-08-08T23:52:13.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7fef257fa640 20 reqs_thread_entry: start 2024-08-08T23:52:13.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 : miss 2024-08-08T23:52:13.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.094+0000 7ff0f8531980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 2024-08-08T23:52:13.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.102+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.102+0000 7ff0f8531980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.102+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.102+0000 7ff0f8531980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27, ofs0, ns] 2024-08-08T23:52:13.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94438764050400 notifier 6750 bl.length()=1007 2024-08-08T23:52:13.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_sources= new_sources= 2024-08-08T23:52:13.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential sources added=[] removed=[] 2024-08-08T23:52:13.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_dests= new_dests= 2024-08-08T23:52:13.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential dests added=[] removed=[] 2024-08-08T23:52:13.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.0 2024-08-08T23:52:13.110 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0f8531980 time 2024-08-08T23:52:13.118072+0000 2024-08-08T23:52:13.110 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:13.110 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff0fbe09cc1] 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff0f8531980 thread_name:radosgw-admin 2024-08-08T23:52:13.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0f8531980 time 2024-08-08T23:52:13.118072+0000 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff0fbe09cc1] 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:13.112 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.113 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:13.113 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:13.113 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.129 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff0fac8a520] 2024-08-08T23:52:13.129 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:13.129 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff0fbe09d1b] 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:13.130 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff0f8531980 thread_name:radosgw-admin 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff0fac8a520] 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff0fbe09d1b] 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.131 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:52:12.598+0000 7ff0f6045640 1 monclient: found mon.noname-c 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.132 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: dump: 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.133 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: dump: 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.134 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6428 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:52:12.598+0000 7ff0f8531980 4 set_mon_vals no callback set 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: shutdown 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) unregister_commands rotate-key 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.135 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.136 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: starting msgr at 2024-08-08T23:52:13.137 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: starting objecter 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests hook 0x55e43ccb32d0 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: setting wanted keys 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: calling monclient init 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.138 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key hook 0x55e43cec3768 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:52:13.139 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cd3d160 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43ce098f0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43ce0fbe0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.203460s 2024-08-08T23:52:13.140 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43ce098f0 auth_method 0 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cd3d160 auth_method 0 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.141 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_done global_id 6431 payload 824 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:52:12.598+0000 7ff0f5844640 1 monclient: found mon.noname-c 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:52:12.598+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43ce0fbe0 auth_method 0 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: dump: 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.142 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: dump: 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.143 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:52:12.602+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6431 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.144 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:52:12.602+0000 7fefe4608640 4 set_mon_vals no callback set 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:52:12.602+0000 7ff0f8531980 1 librados: init done 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:52:12.602+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7fefdc0662d0 auth_method 0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:52:12.602+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf04630 auth_method 0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:52:12.602+0000 7ff0f6045640 10 monclient: get_auth_request con 0x55e43cf0ddc0 auth_method 0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:52:12.606+0000 7ff0f5844640 10 monclient: get_auth_request con 0x55e43cf12120 auth_method 0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:52:12.606+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf115f0 auth_method 0 2024-08-08T23:52:13.145 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:52:12.606+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:52:12.606+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:52:12.606+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.146 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.147 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:52:12.606+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests cmddesc objecter_requests hook 0x55e43cf1d7e0 EEXIST 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.148 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:52:12.610+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:52:12.610+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x55e43cf19280 EEXIST 2024-08-08T23:52:13.149 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf23d70 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf246a0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf24150 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.212733s 2024-08-08T23:52:13.150 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43cf23d70 auth_method 0 2024-08-08T23:52:13.151 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.151 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.151 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.151 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf24150 auth_method 0 2024-08-08T23:52:13.151 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): get_auth_request con 0x55e43cf246a0 auth_method 0 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.152 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:52:12.610+0000 7ff0f5844640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: dump: 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.153 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.154 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: dump: 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.155 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6744 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:52:12.610+0000 7ff0f7047640 4 set_mon_vals no callback set 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: get_monmap_and_config 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:52:12.610+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.156 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.157 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7fefd00661b0 auth_method 0 2024-08-08T23:52:13.158 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.159 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x7ffd41834e68 EEXIST 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf91580 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf91960 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf66d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.160 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.216905s 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): get_auth_request con 0x55e43cf91960 auth_method 0 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf66d40 auth_method 0 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.161 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_done global_id 6747 payload 274 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:52:12.614+0000 7ff0f6846640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.162 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: dump: 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.163 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: dump: 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.164 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6747 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:52:12.614+0000 7ff0f8531980 4 set_mon_vals no callback set 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: shutdown 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.165 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.166 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: starting msgr at 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: starting objecter 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests cmddesc objecter_requests hook 0x55e43cf613b0 EEXIST 2024-08-08T23:52:13.167 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: setting wanted keys 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: calling monclient init 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.168 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x55e43cf59918 EEXIST 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _add_conns ranks=[2,1,0] 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf66d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf91580 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf98690 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.169 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.219495s 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf98690 auth_method 0 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43cf66d40 auth_method 0 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.170 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_done global_id 6750 payload 824 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:52:12.614+0000 7ff0f6045640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf91580 auth_method 0 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.171 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: dump: 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.172 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: dump: 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.173 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:52:12.618+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6750 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:52:12.618+0000 7fefd9ffb640 4 set_mon_vals no callback set 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:52:12.618+0000 7ff0f8531980 1 librados: init done 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:52:12.618+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cr dump hook 0x55e43cf9a0f8 2024-08-08T23:52:13.174 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:52:12.618+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7fefc00662a0 auth_method 0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:52:12.618+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cfafb10 auth_method 0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 realm 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:52:12.618+0000 7ff0f8531980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.175 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:52:12.622+0000 7ff0f5844640 10 monclient: get_auth_request con 0x55e43cfb3d60 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:52:12.622+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cfb75a0 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 searching for the correct realm 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:52:12.622+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7ff0f0004040 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:52:12.626+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0e8043060 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:52:12.626+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7ff0ec07c290 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:52:12.626+0000 7ff0f6846640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff0ec07c290 msgr2=0x7ff0ec016900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:52:12.830+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7ff0ec07c290 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:52:12.834+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7ff0f00da410 auth_method 0 2024-08-08T23:52:13.176 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:52:12.842+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0f00e9900 auth_method 0 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:52:12.842+0000 7ff0f5844640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff0f00e9900 msgr2=0x7ff0f00b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:52:13.046+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0f00e9900 auth_method 0 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:13.177 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zone default found 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Realm: () 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:13.178 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:52:13.062+0000 7ff0f8531980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zonegroup default 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started sync module instance, tier type = 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=0 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=1 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=2 2024-08-08T23:52:13.179 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=3 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=4 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=5 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=6 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:52:13.086+0000 7ff0f8531980 20 add_watcher() i=7 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:52:13.086+0000 7ff0f8531980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.180 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:52:13.090+0000 7fefacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:52:13.090+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache list hook 0x55e43cf991e0 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache inspect hook 0x55e43cf991e0 2024-08-08T23:52:13.181 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache erase hook 0x55e43cf991e0 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache zap hook 0x55e43cf991e0 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 note: GC not initialized 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:52:13.090+0000 7fef277fe640 20 reqs_thread_entry: start 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace show hook 0x7ff0f0004730 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace history hook 0x7ff0f0004730 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace active hook 0x7ff0f0004730 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace active_short hook 0x7ff0f0004730 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 Filter name: none 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:52:13.094+0000 7fef257fa640 20 reqs_thread_entry: start 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:13.182 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 : miss 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.183 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27, ofs0, ns] 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94438764050400 notifier 6750 bl.length()=1007 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_sources= new_sources= 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential sources added=[] removed=[] 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_dests= new_dests= 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential dests added=[] removed=[] 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.184 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.0 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0f8531980 time 2024-08-08T23:52:13.118072+0000 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff0fbe09cc1] 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:13.185 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff0f8531980 thread_name:radosgw-admin 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff0fac8a520] 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff0fbe09d1b] 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.186 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:52:13.187 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:52:13.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:52:13.189 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:52:13.190 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:52:13.191 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:52:13.192 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:52:13.193 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fef257fa640 / http_manager 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fef277fe640 / http_manager 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefacfe1640 / rgw_dt_lg_renew 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefc7fff640 / ms_dispatch 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefd9ffb640 / io_context_pool 2024-08-08T23:52:13.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefdbfff640 / ms_dispatch 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefe2e05640 / ms_dispatch 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefe4608640 / io_context_pool 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f5844640 / msgr-worker-2 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f6045640 / msgr-worker-1 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f6846640 / msgr-worker-0 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f7047640 / io_context_pool 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f8531980 / radosgw-admin 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.96684.log 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:52:13.195 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:52:12.598+0000 7ff0f6045640 1 monclient: found mon.noname-c 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: dump: 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.196 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:52:12.598+0000 7fefe4608640 10 monclient: dump: 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.197 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6428 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:52:12.598+0000 7ff0f8531980 4 set_mon_vals no callback set 2024-08-08T23:52:13.198 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: shutdown 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) unregister_commands rotate-key 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.199 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding auth protocol: cephx 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.200 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: crc 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec5410) adding con mode: secure 2024-08-08T23:52:13.201 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: starting msgr at 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: starting objecter 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests hook 0x55e43ccb32d0 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: setting wanted keys 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:52:12.598+0000 7ff0f8531980 1 librados: calling monclient init 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.202 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding auth protocol: cephx 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: crc 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 AuthRegistry(0x55e43cec3620) adding con mode: secure 2024-08-08T23:52:13.203 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:52:12.598+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:52:12.598+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key hook 0x55e43cec3768 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cd3d160 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43ce098f0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43ce0fbe0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.204 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:52:12.598+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.203460s 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43ce098f0 auth_method 0 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cd3d160 auth_method 0 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.205 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:52:12.598+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient(hunting): handle_auth_done global_id 6431 payload 824 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:52:12.598+0000 7ff0f5844640 1 monclient: found mon.noname-c 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:52:12.598+0000 7ff0f5844640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:52:12.598+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43ce0fbe0 auth_method 0 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: dump: 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.206 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.207 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:52:12.602+0000 7fefe2e05640 10 monclient: dump: 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:52:12.602+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6431 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.208 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:52:12.602+0000 7fefe4608640 4 set_mon_vals no callback set 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:52:12.602+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:52:12.602+0000 7ff0f8531980 1 librados: init done 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:52:12.602+0000 7fefe2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:52:12.602+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7fefdc0662d0 auth_method 0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:52:12.602+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf04630 auth_method 0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:52:12.602+0000 7ff0f6045640 10 monclient: get_auth_request con 0x55e43cf0ddc0 auth_method 0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:52:12.606+0000 7ff0f5844640 10 monclient: get_auth_request con 0x55e43cf12120 auth_method 0 2024-08-08T23:52:13.209 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:52:12.606+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf115f0 auth_method 0 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:52:12.606+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:52:12.606+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:52:12.606+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.210 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding auth protocol: cephx 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.211 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: crc 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:52:12.606+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf1a240) adding con mode: secure 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:52:12.606+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests cmddesc objecter_requests hook 0x55e43cf1d7e0 EEXIST 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding auth protocol: cephx 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.212 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: crc 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf19138) adding con mode: secure 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:52:12.610+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:52:12.610+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x55e43cf19280 EEXIST 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.213 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _add_conns ranks=[0,1,2] 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf23d70 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf246a0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf24150 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.212733s 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43cf23d70 auth_method 0 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.214 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf24150 auth_method 0 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:52:12.610+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): get_auth_request con 0x55e43cf246a0 auth_method 0 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.215 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:52:12.610+0000 7ff0f5844640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:52:12.610+0000 7ff0f5844640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: dump: 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:52:12.610+0000 7fefdbfff640 10 monclient: dump: 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.217 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6744 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:52:12.610+0000 7ff0f7047640 4 set_mon_vals no callback set 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.218 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:52:12.610+0000 7fefdbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: get_monmap_and_config 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:52:12.610+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:52:12.610+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.219 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding auth protocol: cephx 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.220 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: crc 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:52:12.610+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf616c0) adding con mode: secure 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:52:12.610+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7fefd00661b0 auth_method 0 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.221 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding auth protocol: cephx 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: crc 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x7ffd41834d20) adding con mode: secure 2024-08-08T23:52:13.222 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x7ffd41834e68 EEXIST 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf91580 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf91960 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf66d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.223 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.216905s 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): get_auth_request con 0x55e43cf91960 auth_method 0 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf66d40 auth_method 0 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.224 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient(hunting): handle_auth_done global_id 6747 payload 274 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:52:12.614+0000 7ff0f6846640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: dump: 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.225 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.226 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:52:12.614+0000 7fefd9ffb640 10 monclient: dump: 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6747 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:52:12.614+0000 7ff0f8531980 4 set_mon_vals no callback set 2024-08-08T23:52:13.227 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: shutdown 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: build_initial_monmap 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 build_initial for_mkfs: 0 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: monmap: 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:13.228 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding auth protocol: cephx 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.229 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: crc 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf65e90) adding con mode: secure 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: starting msgr at 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: starting objecter 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command objecter_requests cmddesc objecter_requests hook 0x55e43cf613b0 EEXIST 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: setting wanted keys 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:52:12.614+0000 7ff0f8531980 1 librados: calling monclient init 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: init 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding auth protocol: cephx 2024-08-08T23:52:13.230 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: crc 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 AuthRegistry(0x55e43cf597d0) adding con mode: secure 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:52:12.614+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.231 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:52:12.614+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command rotate-key cmddesc rotate-key hook 0x55e43cf59918 EEXIST 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient: _add_conns ranks=[2,1,0] 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-c con 0x55e43cf66d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-b con 0x55e43cf91580 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): picked mon.noname-a con 0x55e43cf98690 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:52:12.614+0000 7ff0f8531980 10 monclient(hunting): authenticate will time out at 2403.219495s 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request con 0x55e43cf98690 auth_method 0 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.232 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): get_auth_request con 0x55e43cf66d40 auth_method 0 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:52:12.614+0000 7ff0f5844640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient(hunting): handle_auth_done global_id 6750 payload 824 2024-08-08T23:52:13.233 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient: _finish_hunting 0 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:52:12.614+0000 7ff0f6045640 1 monclient: found mon.noname-a 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:52:12.614+0000 7ff0f6045640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:52:12.614+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cf91580 auth_method 0 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: dump: 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: _finish_auth 0 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: _check_auth_tickets 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:52:12.618+0000 7fefc7fff640 10 monclient: dump: 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:52:12.618+0000 7ff0f8531980 5 monclient: authenticate success, global_id 6750 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:52:12.618+0000 7fefd9ffb640 4 set_mon_vals no callback set 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _renew_subs 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:52:12.618+0000 7ff0f8531980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:13.236 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:52:12.618+0000 7ff0f8531980 1 librados: init done 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:52:12.618+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cr dump hook 0x55e43cf9a0f8 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:52:12.618+0000 7fefc7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:52:12.618+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7fefc00662a0 auth_method 0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:52:12.618+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cfafb10 auth_method 0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 realm 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:52:12.618+0000 7ff0f8531980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:52:12.618+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.237 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:52:12.622+0000 7ff0f5844640 10 monclient: get_auth_request con 0x55e43cfb3d60 auth_method 0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:52:12.622+0000 7ff0f6846640 10 monclient: get_auth_request con 0x55e43cfb75a0 auth_method 0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:52:12.622+0000 7ff0f8531980 20 searching for the correct realm 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:52:12.622+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7ff0f0004040 auth_method 0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:52:12.626+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0e8043060 auth_method 0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:52:12.626+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7ff0ec07c290 auth_method 0 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:52:12.626+0000 7ff0f6846640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff0ec07c290 msgr2=0x7ff0ec016900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.238 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:52:12.830+0000 7ff0f6846640 10 monclient: get_auth_request con 0x7ff0ec07c290 auth_method 0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:52:12.834+0000 7ff0f6045640 10 monclient: get_auth_request con 0x7ff0f00da410 auth_method 0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:52:12.842+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0f00e9900 auth_method 0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:52:12.842+0000 7ff0f5844640 0 -- 172.21.15.83:0/957467144 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff0f00e9900 msgr2=0x7ff0f00b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:52:13.046+0000 7ff0f5844640 10 monclient: get_auth_request con 0x7ff0f00e9900 auth_method 0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:52:13.058+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.239 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zone default found 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Realm: () 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:52:13.062+0000 7ff0f8531980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:52:13.062+0000 7ff0f8531980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 zonegroup default 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:52:13.062+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.240 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started sync module instance, tier type = 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:52:13.066+0000 7ff0f8531980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=0 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=1 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=2 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=3 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=4 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=5 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:52:13.082+0000 7ff0f8531980 20 add_watcher() i=6 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:52:13.086+0000 7ff0f8531980 20 add_watcher() i=7 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:52:13.086+0000 7ff0f8531980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.241 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding auth protocol: cephx 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.242 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:52:13.090+0000 7fefacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: crc 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 AuthRegistry(0x7ffd418351b0) adding con mode: secure 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:52:13.090+0000 7ff0f8531980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache list hook 0x55e43cf991e0 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache inspect hook 0x55e43cf991e0 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache erase hook 0x55e43cf991e0 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command cache zap hook 0x55e43cf991e0 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 note: GC not initialized 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:52:13.090+0000 7fef277fe640 20 reqs_thread_entry: start 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace show hook 0x7ff0f0004730 2024-08-08T23:52:13.243 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace history hook 0x7ff0f0004730 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace active hook 0x7ff0f0004730 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:52:13.090+0000 7ff0f8531980 5 asok(0x55e43ccb7520) register_command sync trace active_short hook 0x7ff0f0004730 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:52:13.090+0000 7ff0f8531980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 Filter name: none 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:52:13.094+0000 7fef257fa640 20 reqs_thread_entry: start 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 : miss 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.244 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:52:13.094+0000 7ff0f8531980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:52:13.094+0000 7ff0f8531980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:52:13.102+0000 7ff0f8531980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27, ofs0, ns] 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94438764050400 notifier 6750 bl.length()=1007 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:13.245 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:52:13.106+0000 7fefd9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_sources= new_sources= 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential sources added=[] removed=[] 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_dests= new_dests= 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:52:13.106+0000 7ff0f8531980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential dests added=[] removed=[] 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:52:13.110+0000 7ff0f8531980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:52:13.110+0000 7ff0f8531980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.0 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0f8531980 time 2024-08-08T23:52:13.118072+0000 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:13.246 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff0fbe09cc1] 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:52:13.118+0000 7ff0f8531980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff0f8531980 thread_name:radosgw-admin 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.247 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff0fac8a520] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff0fbe09d1b] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7ff0fbe09e75] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e43be196e1] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x55e43be2800f] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff0fac71d90] 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:13.248 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:52:13.249 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:52:13.250 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:52:13.251 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:52:13.252 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:52:13.253 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:52:13.254 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:52:13.255 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fef257fa640 / http_manager 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fef277fe640 / http_manager 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefacfe1640 / rgw_dt_lg_renew 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefc7fff640 / ms_dispatch 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefd9ffb640 / io_context_pool 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefdbfff640 / ms_dispatch 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefe2e05640 / ms_dispatch 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7fefe4608640 / io_context_pool 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f5844640 / msgr-worker-2 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f6045640 / msgr-worker-1 2024-08-08T23:52:13.256 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f6846640 / msgr-worker-0 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f7047640 / io_context_pool 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff0f8531980 / radosgw-admin 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-08-08T23:52:13.120695Z_47bd7fb0-360b-448b-9142-8367ec0400fc/log 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr:Aborted 2024-08-08T23:52:13.257 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 realm 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.202+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.206+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.206+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.206+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.206+0000 7f264a058980 20 searching for the correct realm 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.210+0000 7f2647b6c640 0 -- 172.21.15.83:0/2835159121 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f2640027910 msgr2=0x7f264003c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.214+0000 7f264736b640 0 -- 172.21.15.83:0/2835159121 >> [v2:172.21.15.196:6801/988086196,v1:172.21.15.196:6802/988086196] conn(0x564aca372730 msgr2=0x564aca374b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 zone default found 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 4 Realm: () 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:13.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 zonegroup default 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 started sync module instance, tier type = 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.226+0000 7f264a058980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=0 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=1 2024-08-08T23:52:13.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=2 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=3 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=4 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=5 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.242+0000 7f264a058980 20 add_watcher() i=6 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f264a058980 20 add_watcher() i=7 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f264a058980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f24fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f264a058980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f264a058980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.246+0000 7f264a058980 5 note: GC not initialized 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f24fcfe1640 20 reqs_thread_entry: start 2024-08-08T23:52:13.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 Filter name: none 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f24767fc640 20 reqs_thread_entry: start 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=467 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados->read ofs=0 len=0 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 rados_obj.operate() r=0 bl.length=467 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.250+0000 7f264a058980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:13.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.254+0000 7f24fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.258+0000 7f264a058980 20 remove_watcher() i=0 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.258+0000 7f264a058980 2 removed watcher, disabling cache 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.262+0000 7f264a058980 20 remove_watcher() i=1 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.262+0000 7f264a058980 20 remove_watcher() i=2 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.262+0000 7f264a058980 20 remove_watcher() i=3 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.266+0000 7f264a058980 20 remove_watcher() i=4 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.266+0000 7f264a058980 20 remove_watcher() i=5 2024-08-08T23:52:13.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.270+0000 7f264a058980 20 remove_watcher() i=6 2024-08-08T23:52:13.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:13.270+0000 7f264a058980 20 remove_watcher() i=7 2024-08-08T23:52:13.276 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:13.276 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:13.276 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:13.276 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:43.597 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:52:43.632 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:43.632 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:43.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:43.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:43.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 realm 2024-08-08T23:52:43.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:43.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:43.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:43.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:43.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:43.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.681+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:43.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.685+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:43.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.685+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:43.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.685+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:43.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.685+0000 7f964e3cd980 20 searching for the correct realm 2024-08-08T23:52:43.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.689+0000 7f964c6e2640 0 -- 172.21.15.83:0/2268956767 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f96400c32a0 msgr2=0x7f96401279b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:43.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:43.905+0000 7f964b6e0640 0 -- 172.21.15.83:0/2268956767 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f9644057040 msgr2=0x7f9644056410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:44.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:44.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:44.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:44.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:44.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.121+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:44.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 zone default found 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 4 Realm: () 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 zonegroup default 2024-08-08T23:52:44.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 started sync module instance, tier type = 2024-08-08T23:52:44.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.125+0000 7f964e3cd980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:44.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=0 2024-08-08T23:52:44.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=1 2024-08-08T23:52:44.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=2 2024-08-08T23:52:44.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=3 2024-08-08T23:52:44.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=4 2024-08-08T23:52:44.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=5 2024-08-08T23:52:44.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=6 2024-08-08T23:52:44.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 20 add_watcher() i=7 2024-08-08T23:52:44.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.153+0000 7f964e3cd980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:44.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.157+0000 7f95027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:44.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:44.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:44.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 5 note: GC not initialized 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f95017e2640 20 reqs_thread_entry: start 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 Filter name: none 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f94fa7fc640 20 reqs_thread_entry: start 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-08T23:52:44.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:44.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-08T23:52:44.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-08T23:52:44.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 : miss 2024-08-08T23:52:44.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:44.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.161+0000 7f964e3cd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 2024-08-08T23:52:44.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f964e3cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:44.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f964e3cd980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:44.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f964e3cd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:44.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f964e3cd980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27, ofs0, ns] 2024-08-08T23:52:44.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f952affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 93957409617296 notifier 6476 bl.length()=1007 2024-08-08T23:52:44.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f952affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:44.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f952affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:44.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.173+0000 7f952affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:44.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_sources= new_sources= 2024-08-08T23:52:44.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential sources added=[] removed=[] 2024-08-08T23:52:44.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_dests= new_dests= 2024-08-08T23:52:44.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential dests added=[] removed=[] 2024-08-08T23:52:44.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:44.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.0 2024-08-08T23:52:44.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:44.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.1.1 2024-08-08T23:52:44.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.177+0000 7f964e3cd980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27.0 2024-08-08T23:52:44.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.185+0000 7f964e3cd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 : hit (requested=0x17, cached=0x17) 2024-08-08T23:52:44.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.185+0000 7f964e3cd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f964e3cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f964e3cd980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f964e3cd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f964e3cd980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27, ofs0, ns] 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f952a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 93957409617296 notifier 6476 bl.length()=975 2024-08-08T23:52:44.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f952a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 info.flags=0x17 2024-08-08T23:52:44.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f952a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 to cache LRU end 2024-08-08T23:52:44.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.189+0000 7f952a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:44.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.193+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_sources= new_sources= 2024-08-08T23:52:44.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.193+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential sources added=[] removed=[] 2024-08-08T23:52:44.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.193+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): orig_dests= new_dests= 2024-08-08T23:52:44.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.193+0000 7f964e3cd980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27]): potential dests added=[] removed=[] 2024-08-08T23:52:44.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.193+0000 7f964e3cd980 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-08-08T23:52:44.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.197+0000 7f95027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:44.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.205+0000 7f964e3cd980 20 remove_watcher() i=0 2024-08-08T23:52:44.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.205+0000 7f964e3cd980 2 removed watcher, disabling cache 2024-08-08T23:52:44.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.205+0000 7f964e3cd980 20 remove_watcher() i=1 2024-08-08T23:52:44.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.209+0000 7f964e3cd980 20 remove_watcher() i=2 2024-08-08T23:52:44.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.209+0000 7f964e3cd980 20 remove_watcher() i=3 2024-08-08T23:52:44.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.213+0000 7f964e3cd980 20 remove_watcher() i=4 2024-08-08T23:52:44.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.213+0000 7f964e3cd980 20 remove_watcher() i=5 2024-08-08T23:52:44.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.217+0000 7f964e3cd980 20 remove_watcher() i=6 2024-08-08T23:52:44.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.217+0000 7f964e3cd980 20 remove_watcher() i=7 2024-08-08T23:52:44.229 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-08T23:52:44.259 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:44.259 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:44.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 realm 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.309+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.313+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:44.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.313+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.313+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:44.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.313+0000 7f0a7366c980 20 searching for the correct realm 2024-08-08T23:52:44.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.317+0000 7f0a71981640 0 -- 172.21.15.83:0/2575707737 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f0a68088040 msgr2=0x7f0a68037a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:44.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.533+0000 7f0a7097f640 0 -- 172.21.15.83:0/2575707737 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f0a6c0e8dc0 msgr2=0x7f0a6c0dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:44.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.749+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 zone default found 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 4 Realm: () 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 zonegroup default 2024-08-08T23:52:44.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:44.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 started sync module instance, tier type = 2024-08-08T23:52:44.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.753+0000 7f0a7366c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:44.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=0 2024-08-08T23:52:44.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=1 2024-08-08T23:52:44.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=2 2024-08-08T23:52:44.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=3 2024-08-08T23:52:44.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=4 2024-08-08T23:52:44.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.781+0000 7f0a7366c980 20 add_watcher() i=5 2024-08-08T23:52:44.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.785+0000 7f0a7366c980 20 add_watcher() i=6 2024-08-08T23:52:44.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.785+0000 7f0a7366c980 20 add_watcher() i=7 2024-08-08T23:52:44.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.785+0000 7f0a7366c980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:44.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.789+0000 7f0927fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:44.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.789+0000 7f0a7366c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:44.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.789+0000 7f0a7366c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:44.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.789+0000 7f0a7366c980 5 note: GC not initialized 2024-08-08T23:52:44.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0926fe5640 20 reqs_thread_entry: start 2024-08-08T23:52:44.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:44.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 Filter name: none 2024-08-08T23:52:44.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0924fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:44.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:44.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:44.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:44.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=221 2024-08-08T23:52:44.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.793+0000 7f0a7366c980 20 rados->read ofs=0 len=0 2024-08-08T23:52:44.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.797+0000 7f0a7366c980 20 rados_obj.operate() r=0 bl.length=435 2024-08-08T23:52:44.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.797+0000 7f0a7366c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:44.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.797+0000 7f0927fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:44.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.805+0000 7f0a7366c980 20 remove_watcher() i=0 2024-08-08T23:52:44.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.805+0000 7f0a7366c980 2 removed watcher, disabling cache 2024-08-08T23:52:44.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.805+0000 7f0a7366c980 20 remove_watcher() i=1 2024-08-08T23:52:44.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.809+0000 7f0a7366c980 20 remove_watcher() i=2 2024-08-08T23:52:44.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.809+0000 7f0a7366c980 20 remove_watcher() i=3 2024-08-08T23:52:44.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.813+0000 7f0a7366c980 20 remove_watcher() i=4 2024-08-08T23:52:44.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.813+0000 7f0a7366c980 20 remove_watcher() i=5 2024-08-08T23:52:44.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.817+0000 7f0a7366c980 20 remove_watcher() i=6 2024-08-08T23:52:44.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:44.817+0000 7f0a7366c980 20 remove_watcher() i=7 2024-08-08T23:52:44.827 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:44.827 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:44.827 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:52:44.827 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:45.482 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-08-08T23:52:45.482 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:47.556 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-08T23:52:47.588 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:47.588 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:47.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 realm 2024-08-08T23:52:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:47.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:47.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:47.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:47.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.637+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:47.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.641+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:47.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.641+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:47.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.641+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:47.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.641+0000 7f6e7a1fc980 20 searching for the correct realm 2024-08-08T23:52:47.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.645+0000 7f6e78511640 0 -- 172.21.15.83:0/1062462402 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6e6c0c0020 msgr2=0x7f6e6c0ef9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:47.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:47.861+0000 7f6e7750f640 0 -- 172.21.15.83:0/1062462402 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6e70065cb0 msgr2=0x7f6e700750b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:48.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.077+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:48.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 zone default found 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 4 Realm: () 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:48.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:48.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 zonegroup default 2024-08-08T23:52:48.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 started sync module instance, tier type = 2024-08-08T23:52:48.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.081+0000 7f6e7a1fc980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:48.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=0 2024-08-08T23:52:48.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=1 2024-08-08T23:52:48.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=2 2024-08-08T23:52:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=3 2024-08-08T23:52:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=4 2024-08-08T23:52:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=5 2024-08-08T23:52:48.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.109+0000 7f6e7a1fc980 20 add_watcher() i=6 2024-08-08T23:52:48.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.113+0000 7f6e7a1fc980 20 add_watcher() i=7 2024-08-08T23:52:48.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.113+0000 7f6e7a1fc980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:48.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6e7a1fc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6e7a1fc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6e7a1fc980 5 note: GC not initialized 2024-08-08T23:52:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6d2cfe1640 20 reqs_thread_entry: start 2024-08-08T23:52:48.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6e7a1fc980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:48.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.117+0000 7f6e7a1fc980 20 Filter name: none 2024-08-08T23:52:48.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6ca67fc640 20 reqs_thread_entry: start 2024-08-08T23:52:48.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:48.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:48.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.121+0000 7f6e7a1fc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.125+0000 7f6e7a1fc980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:48.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.125+0000 7f6e7a1fc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:48.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.125+0000 7f6d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.129+0000 7f6e7a1fc980 20 remove_watcher() i=0 2024-08-08T23:52:48.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.129+0000 7f6e7a1fc980 2 removed watcher, disabling cache 2024-08-08T23:52:48.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.133+0000 7f6e7a1fc980 20 remove_watcher() i=1 2024-08-08T23:52:48.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.137+0000 7f6e7a1fc980 20 remove_watcher() i=2 2024-08-08T23:52:48.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.141+0000 7f6e7a1fc980 20 remove_watcher() i=3 2024-08-08T23:52:48.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.141+0000 7f6e7a1fc980 20 remove_watcher() i=4 2024-08-08T23:52:48.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.145+0000 7f6e7a1fc980 20 remove_watcher() i=5 2024-08-08T23:52:48.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.145+0000 7f6e7a1fc980 20 remove_watcher() i=6 2024-08-08T23:52:48.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.145+0000 7f6e7a1fc980 20 remove_watcher() i=7 2024-08-08T23:52:48.162 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:48.163 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-08-08T23:52:48.196 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:48.196 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:48.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 realm 2024-08-08T23:52:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:48.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.245+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.249+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:48.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.249+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.249+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:48.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.249+0000 7fce460e6980 20 searching for the correct realm 2024-08-08T23:52:48.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.253+0000 7fce443fb640 0 -- 172.21.15.83:0/1026096775 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fce380e7060 msgr2=0x7fce3810f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:48.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.261+0000 7fce433f9640 0 -- 172.21.15.83:0/1026096775 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fce3c0273e0 msgr2=0x7fce3c027840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:48.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:48.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.477+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 zone default found 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 4 Realm: () 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 zonegroup default 2024-08-08T23:52:48.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 started sync module instance, tier type = 2024-08-08T23:52:48.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.481+0000 7fce460e6980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=0 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=1 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=2 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=3 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=4 2024-08-08T23:52:48.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=5 2024-08-08T23:52:48.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.509+0000 7fce460e6980 20 add_watcher() i=6 2024-08-08T23:52:48.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.513+0000 7fce460e6980 20 add_watcher() i=7 2024-08-08T23:52:48.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.513+0000 7fce460e6980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:48.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fccf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fce460e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:48.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fce460e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:48.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fce460e6980 5 note: GC not initialized 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fccf8fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fce460e6980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.517+0000 7fce460e6980 20 Filter name: none 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fcc727fc640 20 reqs_thread_entry: start 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-08-08T23:52:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-08-08T23:52:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-08-08T23:52:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 : miss 2024-08-08T23:52:48.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:48.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:48.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:48.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:48.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:48.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.521+0000 7fce460e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 2024-08-08T23:52:48.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fce460e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:48.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fce460e6980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:48.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fce460e6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:48.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fce460e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28, ofs0, ns] 2024-08-08T23:52:48.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fcd22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94802235299536 notifier 6843 bl.length()=987 2024-08-08T23:52:48.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fcd22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:48.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fcd22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:48.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.529+0000 7fcd22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:48.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.533+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_sources= new_sources= 2024-08-08T23:52:48.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.533+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential sources added=[] removed=[] 2024-08-08T23:52:48.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.533+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_dests= new_dests= 2024-08-08T23:52:48.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.533+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential dests added=[] removed=[] 2024-08-08T23:52:48.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.537+0000 7fce460e6980 -1 Injecting error=-5 at location=do_reshard 2024-08-08T23:52:48.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.541+0000 7fce460e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 : hit (requested=0x17, cached=0x17) 2024-08-08T23:52:48.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.541+0000 7fce460e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 2024-08-08T23:52:48.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fce460e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:48.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fce460e6980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:48.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fce460e6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:48.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fce460e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28, ofs0, ns] 2024-08-08T23:52:48.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fcd227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94802235299536 notifier 6843 bl.length()=955 2024-08-08T23:52:48.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fcd227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:48.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fcd227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:48.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.545+0000 7fcd227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.549+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_sources= new_sources= 2024-08-08T23:52:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.549+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential sources added=[] removed=[] 2024-08-08T23:52:48.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.549+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_dests= new_dests= 2024-08-08T23:52:48.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.549+0000 7fce460e6980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential dests added=[] removed=[] 2024-08-08T23:52:48.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.549+0000 7fce460e6980 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-08-08T23:52:48.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.553+0000 7fccf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.561+0000 7fce460e6980 20 remove_watcher() i=0 2024-08-08T23:52:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.561+0000 7fce460e6980 2 removed watcher, disabling cache 2024-08-08T23:52:48.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.561+0000 7fce460e6980 20 remove_watcher() i=1 2024-08-08T23:52:48.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.565+0000 7fce460e6980 20 remove_watcher() i=2 2024-08-08T23:52:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.565+0000 7fce460e6980 20 remove_watcher() i=3 2024-08-08T23:52:48.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.569+0000 7fce460e6980 20 remove_watcher() i=4 2024-08-08T23:52:48.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.569+0000 7fce460e6980 20 remove_watcher() i=5 2024-08-08T23:52:48.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.573+0000 7fce460e6980 20 remove_watcher() i=6 2024-08-08T23:52:48.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.573+0000 7fce460e6980 20 remove_watcher() i=7 2024-08-08T23:52:48.585 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-08T23:52:48.611 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:48.611 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.657+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 realm 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:48.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:48.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:48.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.661+0000 7fe366966980 20 searching for the correct realm 2024-08-08T23:52:48.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.669+0000 7fe364c7b640 0 -- 172.21.15.83:0/2159124714 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fe358024040 msgr2=0x7fe35805ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:48.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.673+0000 7fe363c79640 0 -- 172.21.15.83:0/2159124714 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fe35c0b93c0 msgr2=0x7fe35c0a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:48.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 zone default found 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 4 Realm: () 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 zonegroup default 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.889+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:48.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 started sync module instance, tier type = 2024-08-08T23:52:48.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.893+0000 7fe366966980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=0 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=1 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=2 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=3 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=4 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=5 2024-08-08T23:52:48.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.913+0000 7fe366966980 20 add_watcher() i=6 2024-08-08T23:52:48.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.917+0000 7fe366966980 20 add_watcher() i=7 2024-08-08T23:52:48.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.917+0000 7fe366966980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:48.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe21a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:48.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 5 note: GC not initialized 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe2197e2640 20 reqs_thread_entry: start 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 Filter name: none 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe18affd640 20 reqs_thread_entry: start 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:48.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.921+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:48.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:48.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:48.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 rados->read ofs=0 len=0 2024-08-08T23:52:48.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:48.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.925+0000 7fe366966980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:48.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.929+0000 7fe21a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:48.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.933+0000 7fe366966980 20 remove_watcher() i=0 2024-08-08T23:52:48.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.933+0000 7fe366966980 2 removed watcher, disabling cache 2024-08-08T23:52:48.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.933+0000 7fe366966980 20 remove_watcher() i=1 2024-08-08T23:52:48.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.937+0000 7fe366966980 20 remove_watcher() i=2 2024-08-08T23:52:48.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.937+0000 7fe366966980 20 remove_watcher() i=3 2024-08-08T23:52:48.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.941+0000 7fe366966980 20 remove_watcher() i=4 2024-08-08T23:52:48.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.941+0000 7fe366966980 20 remove_watcher() i=5 2024-08-08T23:52:48.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.945+0000 7fe366966980 20 remove_watcher() i=6 2024-08-08T23:52:48.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:48.945+0000 7fe366966980 20 remove_watcher() i=7 2024-08-08T23:52:48.956 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:48.957 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:48.957 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:48.957 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:49.064 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:52:49.099 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:49.099 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:49.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.145+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 realm 2024-08-08T23:52:49.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:49.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.149+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.153+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:49.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.153+0000 7f6157636980 20 searching for the correct realm 2024-08-08T23:52:49.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.157+0000 7f615594b640 0 -- 172.21.15.83:0/3416745962 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f614c03e060 msgr2=0x7f614c038b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:49.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.165+0000 7f615594b640 0 -- 172.21.15.83:0/3416745962 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6020076a50 msgr2=0x7f6020078e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:49.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:49.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:49.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:49.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:49.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:49.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:49.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.169+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 zone default found 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 4 Realm: () 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 zonegroup default 2024-08-08T23:52:49.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 started sync module instance, tier type = 2024-08-08T23:52:49.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.173+0000 7f6157636980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=0 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=1 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=2 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=3 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=4 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=5 2024-08-08T23:52:49.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=6 2024-08-08T23:52:49.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 20 add_watcher() i=7 2024-08-08T23:52:49.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.189+0000 7f6157636980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:49.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f600b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:49.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:49.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:49.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 5 note: GC not initialized 2024-08-08T23:52:49.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f600a7e4640 20 reqs_thread_entry: start 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 Filter name: none 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f5f7bfff640 20 reqs_thread_entry: start 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 : miss 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.193+0000 7f6157636980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:49.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.197+0000 7f6157636980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6157636980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6157636980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6157636980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6157636980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28, ofs0, ns] 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6038ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94504176306320 notifier 6560 bl.length()=987 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6038ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6038ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:49.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.205+0000 7f6038ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:49.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_sources= new_sources= 2024-08-08T23:52:49.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential sources added=[] removed=[] 2024-08-08T23:52:49.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_dests= new_dests= 2024-08-08T23:52:49.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential dests added=[] removed=[] 2024-08-08T23:52:49.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28.1.0 2024-08-08T23:52:49.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28.1.0 2024-08-08T23:52:49.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28.1.1 2024-08-08T23:52:49.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28.1.1 2024-08-08T23:52:49.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.209+0000 7f6157636980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28.0 2024-08-08T23:52:49.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.213+0000 7f6157636980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 : hit (requested=0x17, cached=0x17) 2024-08-08T23:52:49.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.213+0000 7f6157636980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 2024-08-08T23:52:49.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6157636980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:49.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6157636980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:49.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6157636980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:49.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6157636980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28, ofs0, ns] 2024-08-08T23:52:49.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6027fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 94504176306320 notifier 6560 bl.length()=955 2024-08-08T23:52:49.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6027fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 info.flags=0x17 2024-08-08T23:52:49.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6027fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 to cache LRU end 2024-08-08T23:52:49.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.217+0000 7f6027fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:49.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.221+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_sources= new_sources= 2024-08-08T23:52:49.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.221+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential sources added=[] removed=[] 2024-08-08T23:52:49.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.221+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): orig_dests= new_dests= 2024-08-08T23:52:49.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.221+0000 7f6157636980 20 handle_bi_update(): bucket=:error-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28]): potential dests added=[] removed=[] 2024-08-08T23:52:49.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.221+0000 7f6157636980 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-08-08T23:52:49.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.225+0000 7f600b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:49.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.229+0000 7f6157636980 20 remove_watcher() i=0 2024-08-08T23:52:49.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.229+0000 7f6157636980 2 removed watcher, disabling cache 2024-08-08T23:52:49.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.233+0000 7f6157636980 20 remove_watcher() i=1 2024-08-08T23:52:49.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.233+0000 7f6157636980 20 remove_watcher() i=2 2024-08-08T23:52:49.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.237+0000 7f6157636980 20 remove_watcher() i=3 2024-08-08T23:52:49.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.241+0000 7f6157636980 20 remove_watcher() i=4 2024-08-08T23:52:49.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.241+0000 7f6157636980 20 remove_watcher() i=5 2024-08-08T23:52:49.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.241+0000 7f6157636980 20 remove_watcher() i=6 2024-08-08T23:52:49.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.245+0000 7f6157636980 20 remove_watcher() i=7 2024-08-08T23:52:49.254 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-08T23:52:49.280 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:49.280 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:49.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 realm 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.329+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.333+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:49.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.333+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.333+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:49.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.333+0000 7f0cdefed980 20 searching for the correct realm 2024-08-08T23:52:49.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.337+0000 7f0cdd302640 0 -- 172.21.15.83:0/3427992390 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f0cc404aa90 msgr2=0x7f0cc403b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:49.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.553+0000 7f0cdc300640 0 -- 172.21.15.83:0/3427992390 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f0ccc0213e0 msgr2=0x7f0ccc021860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:49.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.769+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:49.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 zone default found 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 4 Realm: () 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 zonegroup default 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:49.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 started sync module instance, tier type = 2024-08-08T23:52:49.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.773+0000 7f0cdefed980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=0 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=1 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=2 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=3 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=4 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=5 2024-08-08T23:52:49.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=6 2024-08-08T23:52:49.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 20 add_watcher() i=7 2024-08-08T23:52:49.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.797+0000 7f0cdefed980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:49.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.801+0000 7f0b92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:49.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:49.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:49.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 5 note: GC not initialized 2024-08-08T23:52:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0b91fe3640 20 reqs_thread_entry: start 2024-08-08T23:52:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 Filter name: none 2024-08-08T23:52:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0b037fe640 20 reqs_thread_entry: start 2024-08-08T23:52:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:49.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.805+0000 7f0cdefed980 20 rados->read ofs=0 len=0 2024-08-08T23:52:49.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.809+0000 7f0cdefed980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:49.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.809+0000 7f0cdefed980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:49.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.809+0000 7f0b92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:49.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.813+0000 7f0cdefed980 20 remove_watcher() i=0 2024-08-08T23:52:49.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.813+0000 7f0cdefed980 2 removed watcher, disabling cache 2024-08-08T23:52:49.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.817+0000 7f0cdefed980 20 remove_watcher() i=1 2024-08-08T23:52:49.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.817+0000 7f0cdefed980 20 remove_watcher() i=2 2024-08-08T23:52:49.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.821+0000 7f0cdefed980 20 remove_watcher() i=3 2024-08-08T23:52:49.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.825+0000 7f0cdefed980 20 remove_watcher() i=4 2024-08-08T23:52:49.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.825+0000 7f0cdefed980 20 remove_watcher() i=5 2024-08-08T23:52:49.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.825+0000 7f0cdefed980 20 remove_watcher() i=6 2024-08-08T23:52:49.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:49.829+0000 7f0cdefed980 20 remove_watcher() i=7 2024-08-08T23:52:49.838 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:49.839 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:49.839 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:52:49.839 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:50.537 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at do_reshard 2024-08-08T23:52:50.537 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:52.593 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-08T23:52:52.624 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:52.624 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.673+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 realm 2024-08-08T23:52:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:52.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:52.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.677+0000 7f456dc3d980 20 searching for the correct realm 2024-08-08T23:52:52.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.681+0000 7f456bf52640 0 -- 172.21.15.83:0/1893432494 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x560682c70400 msgr2=0x560682c727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:52:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.689+0000 7f456af50640 0 -- 172.21.15.83:0/1893432494 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f45640b5920 msgr2=0x7f45640da400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:52.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:52.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:52.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.905+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 zone default found 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 4 Realm: () 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 zonegroup default 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:52.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 started sync module instance, tier type = 2024-08-08T23:52:52.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.909+0000 7f456dc3d980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:52.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=0 2024-08-08T23:52:52.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=1 2024-08-08T23:52:52.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=2 2024-08-08T23:52:52.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=3 2024-08-08T23:52:52.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=4 2024-08-08T23:52:52.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=5 2024-08-08T23:52:52.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.933+0000 7f456dc3d980 20 add_watcher() i=6 2024-08-08T23:52:52.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.937+0000 7f456dc3d980 20 add_watcher() i=7 2024-08-08T23:52:52.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.937+0000 7f456dc3d980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:52.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f4421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:52.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f456dc3d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:52.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f456dc3d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:52.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f456dc3d980 5 note: GC not initialized 2024-08-08T23:52:52.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f4420fe1640 20 reqs_thread_entry: start 2024-08-08T23:52:52.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f456dc3d980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:52.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f456dc3d980 20 Filter name: none 2024-08-08T23:52:52.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.941+0000 7f439a7fc640 20 reqs_thread_entry: start 2024-08-08T23:52:52.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:52.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados->read ofs=0 len=0 2024-08-08T23:52:52.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:52.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.945+0000 7f456dc3d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:52.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.949+0000 7f4421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:52.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.953+0000 7f456dc3d980 20 remove_watcher() i=0 2024-08-08T23:52:52.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.953+0000 7f456dc3d980 2 removed watcher, disabling cache 2024-08-08T23:52:52.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.957+0000 7f456dc3d980 20 remove_watcher() i=1 2024-08-08T23:52:52.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.957+0000 7f456dc3d980 20 remove_watcher() i=2 2024-08-08T23:52:52.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.961+0000 7f456dc3d980 20 remove_watcher() i=3 2024-08-08T23:52:52.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.961+0000 7f456dc3d980 20 remove_watcher() i=4 2024-08-08T23:52:52.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.965+0000 7f456dc3d980 20 remove_watcher() i=5 2024-08-08T23:52:52.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.965+0000 7f456dc3d980 20 remove_watcher() i=6 2024-08-08T23:52:52.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:52.969+0000 7f456dc3d980 20 remove_watcher() i=7 2024-08-08T23:52:52.980 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:52.981 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:52.981 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:52.981 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:52.981 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-08-08T23:52:53.017 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:53.017 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:53.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 realm 2024-08-08T23:52:53.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:53.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:53.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.069+0000 7f5a26918980 20 searching for the correct realm 2024-08-08T23:52:53.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.073+0000 7f5a24c2d640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f5a180eb2e0 msgr2=0x7f5a180f4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.081+0000 7f5a23c2b640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f5a1402fc50 msgr2=0x7f5a1406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:53.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 zone default found 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 4 Realm: () 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:53.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:53.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 zonegroup default 2024-08-08T23:52:53.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 started sync module instance, tier type = 2024-08-08T23:52:53.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.301+0000 7f5a26918980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=0 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=1 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=2 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=3 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=4 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=5 2024-08-08T23:52:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=6 2024-08-08T23:52:53.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=7 2024-08-08T23:52:53.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.329+0000 7f5a26918980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.333+0000 7f58dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 5 note: GC not initialized 2024-08-08T23:52:53.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f58d9fdb640 20 reqs_thread_entry: start 2024-08-08T23:52:53.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:53.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 Filter name: none 2024-08-08T23:52:53.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f584b7fe640 20 reqs_thread_entry: start 2024-08-08T23:52:53.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-08T23:52:53.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 : miss 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.337+0000 7f5a26918980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 2024-08-08T23:52:53.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.345+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.345+0000 7f5a26918980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.345+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.345+0000 7f5a26918980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29, ofs0, ns] 2024-08-08T23:52:53.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94808102879696 notifier 6611 bl.length()=987 2024-08-08T23:52:53.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_sources= new_sources= 2024-08-08T23:52:53.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential sources added=[] removed=[] 2024-08-08T23:52:53.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_dests= new_dests= 2024-08-08T23:52:53.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential dests added=[] removed=[] 2024-08-08T23:52:53.347 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a26918980 time 2024-08-08T23:52:53.356465+0000 2024-08-08T23:52:53.347 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:53.350 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.350 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5a2a1f0cc1] 2024-08-08T23:52:53.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.350 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.350 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.353+0000 7f5a26918980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a26918980 time 2024-08-08T23:52:53.356465+0000 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5a2a1f0cc1] 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.351 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-08-08T23:52:53.352 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f5a26918980 thread_name:radosgw-admin 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5a29071520] 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:53.353 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5a2a1f0d1b] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.357+0000 7f5a26918980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f5a26918980 thread_name:radosgw-admin 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5a29071520] 2024-08-08T23:52:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5a2a1f0d1b] 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.356 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_done global_id 6599 payload 274 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:52:53.045+0000 7f5a2442c640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.363 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: dump: 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.364 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 monclient: authenticate success, global_id 6599 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: dump: 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.365 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:52:53.045+0000 7f5a26918980 4 set_mon_vals no callback set 2024-08-08T23:52:53.366 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: shutdown 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) unregister_commands rotate-key 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.367 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.368 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: starting msgr at 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: starting objecter 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests hook 0x563a3b271b40 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: setting wanted keys 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: calling monclient init 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.369 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.370 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key hook 0x563a3b3b5ce8 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b241530 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b2fbfb0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b2fecc0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.371 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.651832s 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b2fbfb0 auth_method 0 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b2fecc0 auth_method 0 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.372 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_done global_id 6602 payload 824 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:52:53.049+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b241530 auth_method 0 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: dump: 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.373 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.374 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: dump: 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.375 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:52:53.049+0000 7f591260c640 4 set_mon_vals no callback set 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:52:53.049+0000 7f5a26918980 5 monclient: authenticate success, global_id 6602 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:52:53.049+0000 7f5a26918980 1 librados: init done 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:52:53.049+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f590c0662a0 auth_method 0 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b3ddbe0 auth_method 0 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:52:53.053+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b400790 auth_method 0 2024-08-08T23:52:53.376 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:52:53.053+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x563a3b404af0 auth_method 0 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:52:53.053+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b404040 auth_method 0 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:52:53.053+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:52:53.053+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:52:53.053+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.377 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.378 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests cmddesc objecter_requests hook 0x563a3b410050 EEXIST 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.379 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x563a3b40bb00 EEXIST 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:52:53.380 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b4165e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b416f10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4169c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.660996s 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b416f10 auth_method 0 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): get_auth_request con 0x563a3b4169c0 auth_method 0 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.381 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4165e0 auth_method 0 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.382 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6930 payload 824 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 1 monclient: found mon.noname-a 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: dump: 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.383 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: dump: 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.384 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 monclient: authenticate success, global_id 6930 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:52:53.057+0000 7f5a2542e640 4 set_mon_vals no callback set 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.385 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: get_monmap_and_config 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.386 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.387 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f58fc0661b0 auth_method 0 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.388 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x7ffff3f95788 EEXIST 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.389 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _add_conns ranks=[2,0,1] 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4582a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b4597a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b482bc0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.665094s 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b4597a0 auth_method 0 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.390 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4582a0 auth_method 0 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 1 monclient: found mon.noname-a 2024-08-08T23:52:53.391 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: dump: 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.392 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: dump: 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.393 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 monclient: authenticate success, global_id 6933 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:52:53.061+0000 7f5a26918980 4 set_mon_vals no callback set 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: shutdown 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.394 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.395 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: starting msgr at 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: starting objecter 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests cmddesc objecter_requests hook 0x563a3b4177d0 EEXIST 2024-08-08T23:52:53.396 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: setting wanted keys 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: calling monclient init 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.397 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x563a3b44c188 EEXIST 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b4582a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4597a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b482bc0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.398 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.667572s 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b4597a0 auth_method 0 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4582a0 auth_method 0 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.399 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: dump: 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.400 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.401 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: dump: 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.402 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:52:53.065+0000 7f58fb7fe640 4 set_mon_vals no callback set 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:52:53.065+0000 7f5a26918980 5 monclient: authenticate success, global_id 6611 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:52:53.065+0000 7f5a26918980 1 librados: init done 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:52:53.065+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cr dump hook 0x563a3b48b298 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:52:53.065+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b4a1e80 auth_method 0 2024-08-08T23:52:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:52:53.065+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f58ec0662a0 auth_method 0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 realm 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:52:53.065+0000 7f5a26918980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:52:53.069+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x563a3b4a61c0 auth_method 0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:52:53.069+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b4a9950 auth_method 0 2024-08-08T23:52:53.404 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 searching for the correct realm 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:52:53.069+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f5a14074c20 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:52:53.073+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1c008050 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x7f5a180eb2e0 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f5a180eb2e0 msgr2=0x7f5a180f4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 1 client.6611.objecter ms_handle_reset 0x7f5a180eb2e0 session 0x7f5a180a6070 osd.4 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 10 monclient: _renew_subs 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x7f58ec076a50 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:52:53.077+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f5a1402d070 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:52:53.081+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1402fc50 auth_method 0 2024-08-08T23:52:53.405 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:52:53.081+0000 7f5a23c2b640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f5a1402fc50 msgr2=0x7f5a1406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:52:53.285+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1402fc50 auth_method 0 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.406 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 zone default found 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 Realm: () 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:52:53.301+0000 7f5a26918980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 zonegroup default 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.407 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 started sync module instance, tier type = 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=0 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=1 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=2 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=3 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=4 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=5 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=6 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=7 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:52:53.329+0000 7f5a26918980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:53.408 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.409 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:52:53.333+0000 7f58dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:52:53.337+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache list hook 0x563a3b48db40 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache inspect hook 0x563a3b48db40 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache erase hook 0x563a3b48db40 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache zap hook 0x563a3b48db40 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 note: GC not initialized 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:52:53.337+0000 7f58d9fdb640 20 reqs_thread_entry: start 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace show hook 0x7f5a180047f0 2024-08-08T23:52:53.410 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace history hook 0x7f5a180047f0 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace active hook 0x7f5a180047f0 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace active_short hook 0x7f5a180047f0 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 Filter name: none 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:52:53.337+0000 7f584b7fe640 20 reqs_thread_entry: start 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 : miss 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:53.411 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29, ofs0, ns] 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94808102879696 notifier 6611 bl.length()=987 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.412 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_sources= new_sources= 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential sources added=[] removed=[] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_dests= new_dests= 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential dests added=[] removed=[] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:52:53.353+0000 7f5a26918980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a26918980 time 2024-08-08T23:52:53.356465+0000 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5a2a1f0cc1] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:53.413 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:52:53.357+0000 7f5a26918980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f5a26918980 thread_name:radosgw-admin 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5a29071520] 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5a2a1f0d1b] 2024-08-08T23:52:53.414 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:52:53.415 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:52:53.416 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:52:53.417 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:52:53.417 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:52:53.417 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:52:53.445 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:52:53.446 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:52:53.447 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:52:53.448 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:52:53.449 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f584b7fe640 / http_manager 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58d9fdb640 / http_manager 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58dafdd640 / rgw_dt_lg_renew 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58f9ffb640 / ms_dispatch 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58fb7fe640 / io_context_pool 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5909ffb640 / ms_dispatch 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5910e09640 / ms_dispatch 2024-08-08T23:52:53.450 INFO:tasks.workunit.client.0.smithi083.stderr: 7f591260c640 / io_context_pool 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a23c2b640 / msgr-worker-2 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a2442c640 / msgr-worker-1 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a24c2d640 / msgr-worker-0 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a2542e640 / io_context_pool 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a26918980 / radosgw-admin 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.102584.log 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.451 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient(hunting): handle_auth_done global_id 6599 payload 274 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-08-08T23:52:53.045+0000 7f5a2442c640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-08-08T23:52:53.045+0000 7f5a2442c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: dump: 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.452 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 monclient: authenticate success, global_id 6599 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-08-08T23:52:53.045+0000 7f591260c640 10 monclient: dump: 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.453 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-08-08T23:52:53.045+0000 7f5a26918980 4 set_mon_vals no callback set 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: shutdown 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) unregister_commands rotate-key 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.454 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.455 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding auth protocol: cephx 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: crc 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3bb1d0) adding con mode: secure 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: starting msgr at 2024-08-08T23:52:53.456 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: starting objecter 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests hook 0x563a3b271b40 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: setting wanted keys 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-08-08T23:52:53.045+0000 7f5a26918980 1 librados: calling monclient init 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding auth protocol: cephx 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.457 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: crc 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 AuthRegistry(0x563a3b3b5ba0) adding con mode: secure 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-08-08T23:52:53.045+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-08-08T23:52:53.045+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key hook 0x563a3b3b5ce8 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient: _add_conns ranks=[1,2,0] 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b241530 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.458 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b2fbfb0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b2fecc0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-08-08T23:52:53.045+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.651832s 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b2fbfb0 auth_method 0 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-08-08T23:52:53.045+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b2fecc0 auth_method 0 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.459 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-08-08T23:52:53.045+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_done global_id 6602 payload 824 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-08-08T23:52:53.049+0000 7f5a23c2b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-08-08T23:52:53.049+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b241530 auth_method 0 2024-08-08T23:52:53.460 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: dump: 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.461 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-08-08T23:52:53.049+0000 7f5910e09640 10 monclient: dump: 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.462 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-08-08T23:52:53.049+0000 7f591260c640 4 set_mon_vals no callback set 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-08-08T23:52:53.049+0000 7f5a26918980 5 monclient: authenticate success, global_id 6602 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-08-08T23:52:53.049+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-08-08T23:52:53.049+0000 7f5a26918980 1 librados: init done 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-08-08T23:52:53.049+0000 7f5910e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-08-08T23:52:53.049+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f590c0662a0 auth_method 0 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-08-08T23:52:53.049+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b3ddbe0 auth_method 0 2024-08-08T23:52:53.463 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-08-08T23:52:53.053+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b400790 auth_method 0 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-08-08T23:52:53.053+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x563a3b404af0 auth_method 0 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-08-08T23:52:53.053+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b404040 auth_method 0 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-08-08T23:52:53.053+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-08-08T23:52:53.053+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-08-08T23:52:53.053+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.464 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding auth protocol: cephx 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.465 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: crc 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-08-08T23:52:53.053+0000 7f5a26918980 5 AuthRegistry(0x563a3b40cb60) adding con mode: secure 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests cmddesc objecter_requests hook 0x563a3b410050 EEXIST 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding auth protocol: cephx 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.466 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: crc 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 AuthRegistry(0x563a3b40b9b8) adding con mode: secure 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-08-08T23:52:53.057+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x563a3b40bb00 EEXIST 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.467 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _add_conns ranks=[1,0,2] 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b4165e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b416f10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4169c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.660996s 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b416f10 auth_method 0 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): get_auth_request con 0x563a3b4169c0 auth_method 0 2024-08-08T23:52:53.468 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-08-08T23:52:53.057+0000 7f5a2442c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4165e0 auth_method 0 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.469 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-08-08T23:52:53.057+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6930 payload 824 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 1 monclient: found mon.noname-a 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-08-08T23:52:53.057+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: dump: 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-08-08T23:52:53.057+0000 7f5909ffb640 10 monclient: dump: 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.471 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-08-08T23:52:53.057+0000 7f5a26918980 5 monclient: authenticate success, global_id 6930 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-08-08T23:52:53.057+0000 7f5a2542e640 4 set_mon_vals no callback set 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-08-08T23:52:53.057+0000 7f5a26918980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.472 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-08-08T23:52:53.057+0000 7f5909ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: get_monmap_and_config 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.473 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding auth protocol: cephx 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.474 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: crc 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b4540e0) adding con mode: secure 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f58fc0661b0 auth_method 0 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding auth protocol: cephx 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.475 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: crc 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95640) adding con mode: secure 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x7ffff3f95788 EEXIST 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _add_conns ranks=[2,0,1] 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4582a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.476 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b4597a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b482bc0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.665094s 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b4597a0 auth_method 0 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4582a0 auth_method 0 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.477 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 1 monclient: found mon.noname-a 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: dump: 2024-08-08T23:52:53.478 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-08-08T23:52:53.061+0000 7f58fb7fe640 10 monclient: dump: 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 monclient: authenticate success, global_id 6933 2024-08-08T23:52:53.480 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: get_monmap_and_config success 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-08-08T23:52:53.061+0000 7f5a26918980 4 set_mon_vals no callback set 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: shutdown 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: build_initial_monmap 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 build_initial for_mkfs: 0 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: monmap: 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-08-08T23:52:53.481 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding auth protocol: cephx 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.482 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: crc 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b483b80) adding con mode: secure 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: starting msgr at 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: starting objecter 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command objecter_requests cmddesc objecter_requests hook 0x563a3b4177d0 EEXIST 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: setting wanted keys 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-08-08T23:52:53.061+0000 7f5a26918980 1 librados: calling monclient init 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: init 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.483 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding auth protocol: cephx 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: crc 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 AuthRegistry(0x563a3b44c040) adding con mode: secure 2024-08-08T23:52:53.484 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-08-08T23:52:53.061+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-08-08T23:52:53.061+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command rotate-key cmddesc rotate-key hook 0x563a3b44c188 EEXIST 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _reopen_session rank -1 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient: _add_conns ranks=[0,2,1] 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-a con 0x563a3b4582a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-c con 0x563a3b4597a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): picked mon.noname-b con 0x563a3b482bc0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): start opening mon connection 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): _renew_subs 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-08-08T23:52:53.061+0000 7f5a26918980 10 monclient(hunting): authenticate will time out at 2443.667572s 2024-08-08T23:52:53.485 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request con 0x563a3b4597a0 auth_method 0 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request con 0x563a3b4582a0 auth_method 0 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth method 2 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-08T23:52:53.486 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-08-08T23:52:53.061+0000 7f5a23c2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _finish_hunting 0 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 1 monclient: found mon.noname-c 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-08-08T23:52:53.061+0000 7f5a24c2d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: dump: 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.487 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: _finish_auth 0 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: _check_auth_tickets 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_config config(0 keys) 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 10 monclient: dump: 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a06244b8-ff5b-4931-b711-c5bff452d3eb 2024-08-08T23:52:53.488 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-08-08T23:27:16.110579+0000 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-08-08T23:52:53.065+0000 7f58fb7fe640 4 set_mon_vals no callback set 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-08-08T23:52:53.065+0000 7f5a26918980 5 monclient: authenticate success, global_id 6611 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _renew_subs 2024-08-08T23:52:53.489 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-08-08T23:52:53.065+0000 7f5a26918980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-08-08T23:52:53.065+0000 7f5a26918980 1 librados: init done 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-08-08T23:52:53.065+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cr dump hook 0x563a3b48b298 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-08-08T23:52:53.065+0000 7f58f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6832/3816591878,v1:172.21.15.196:6833/3816591878] 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-08-08T23:52:53.065+0000 7f5a2442c640 10 monclient: get_auth_request con 0x563a3b4a1e80 auth_method 0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-08-08T23:52:53.065+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f58ec0662a0 auth_method 0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 realm 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.490 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-08-08T23:52:53.065+0000 7f5a26918980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-08-08T23:52:53.065+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-08-08T23:52:53.069+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x563a3b4a61c0 auth_method 0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-08-08T23:52:53.069+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x563a3b4a9950 auth_method 0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-08-08T23:52:53.069+0000 7f5a26918980 20 searching for the correct realm 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-08-08T23:52:53.069+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f5a14074c20 auth_method 0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-08-08T23:52:53.073+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1c008050 auth_method 0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x7f5a180eb2e0 auth_method 0 2024-08-08T23:52:53.491 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f5a180eb2e0 msgr2=0x7f5a180f4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 1 client.6611.objecter ms_handle_reset 0x7f5a180eb2e0 session 0x7f5a180a6070 osd.4 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 10 monclient: _renew_subs 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-08-08T23:52:53.073+0000 7f58f9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-08-08T23:52:53.073+0000 7f5a24c2d640 10 monclient: get_auth_request con 0x7f58ec076a50 auth_method 0 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-08-08T23:52:53.077+0000 7f5a2442c640 10 monclient: get_auth_request con 0x7f5a1402d070 auth_method 0 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-08-08T23:52:53.081+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1402fc50 auth_method 0 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-08-08T23:52:53.081+0000 7f5a23c2b640 0 -- 172.21.15.83:0/1072596564 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f5a1402fc50 msgr2=0x7f5a1406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-08-08T23:52:53.285+0000 7f5a23c2b640 10 monclient: get_auth_request con 0x7f5a1402fc50 auth_method 0 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:53.492 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-08-08T23:52:53.297+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 zone default found 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 Realm: () 2024-08-08T23:52:53.493 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-08-08T23:52:53.301+0000 7f5a26918980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-08-08T23:52:53.301+0000 7f5a26918980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 zonegroup default 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 started sync module instance, tier type = 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-08-08T23:52:53.301+0000 7f5a26918980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=0 2024-08-08T23:52:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=1 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=2 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=3 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=4 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=5 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=6 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-08-08T23:52:53.329+0000 7f5a26918980 20 add_watcher() i=7 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-08-08T23:52:53.329+0000 7f5a26918980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding auth protocol: cephx 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.495 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: crc 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-08-08T23:52:53.333+0000 7f58dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-08-08T23:52:53.333+0000 7f5a26918980 5 AuthRegistry(0x7ffff3f95ad0) adding con mode: secure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-08-08T23:52:53.337+0000 7f5a26918980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:53.496 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache list hook 0x563a3b48db40 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache inspect hook 0x563a3b48db40 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache erase hook 0x563a3b48db40 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command cache zap hook 0x563a3b48db40 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 note: GC not initialized 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-08-08T23:52:53.337+0000 7f58d9fdb640 20 reqs_thread_entry: start 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace show hook 0x7f5a180047f0 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace history hook 0x7f5a180047f0 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace active hook 0x7f5a180047f0 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-08-08T23:52:53.337+0000 7f5a26918980 5 asok(0x563a3b1a9520) register_command sync trace active_short hook 0x7f5a180047f0 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 Filter name: none 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-08-08T23:52:53.337+0000 7f584b7fe640 20 reqs_thread_entry: start 2024-08-08T23:52:53.497 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 : miss 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-08-08T23:52:53.337+0000 7f5a26918980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-08-08T23:52:53.337+0000 7f5a26918980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 2024-08-08T23:52:53.498 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-08-08T23:52:53.345+0000 7f5a26918980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29, ofs0, ns] 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94808102879696 notifier 6611 bl.length()=987 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-08-08T23:52:53.349+0000 7f58fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_sources= new_sources= 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential sources added=[] removed=[] 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_dests= new_dests= 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-08-08T23:52:53.349+0000 7f5a26918980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential dests added=[] removed=[] 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-08-08T23:52:53.353+0000 7f5a26918980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a26918980 time 2024-08-08T23:52:53.356465+0000 2024-08-08T23:52:53.499 INFO:tasks.workunit.client.0.smithi083.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5a2a1f0cc1] 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-08-08T23:52:53.357+0000 7f5a26918980 -1 *** Caught signal (Aborted) ** 2024-08-08T23:52:53.500 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f5a26918980 thread_name:radosgw-admin 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.1.0-1345-g0a88632b (0a88632b45f25ae38493667c7dbd155f6e59b499) squid (rc) 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5a29071520] 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 2: pthread_kill() 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5a2a1f0d1b] 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x183e75) [0x7f5a2a1f0e75] 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a391206e1] 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x563a3912edad] 2024-08-08T23:52:53.501 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5a29058d90] 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-08-08T23:52:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-08-08T23:52:53.503 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-08-08T23:52:53.504 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-08-08T23:52:53.505 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-08-08T23:52:53.506 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-08T23:52:53.507 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 7f584b7fe640 / http_manager 2024-08-08T23:52:53.508 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58d9fdb640 / http_manager 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58dafdd640 / rgw_dt_lg_renew 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58f9ffb640 / ms_dispatch 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f58fb7fe640 / io_context_pool 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5909ffb640 / ms_dispatch 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5910e09640 / ms_dispatch 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f591260c640 / io_context_pool 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a23c2b640 / msgr-worker-2 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a2442c640 / msgr-worker-1 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a24c2d640 / msgr-worker-0 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a2542e640 / io_context_pool 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: 7f5a26918980 / radosgw-admin 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-08-08T23:52:53.361923Z_b38babcd-2347-4c1b-9661-a3d5b782f6d6/log 2024-08-08T23:52:53.509 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:Aborted 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 realm 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.445+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.449+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.449+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.449+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:52:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.449+0000 7f70646cc980 20 searching for the correct realm 2024-08-08T23:52:53.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.453+0000 7f70619df640 0 -- 172.21.15.83:0/3183602140 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f70540b0070 msgr2=0x7f7054107ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.665+0000 7f70621e0640 0 -- 172.21.15.83:0/3183602140 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f705c008050 msgr2=0x7f705c035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:52:53.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:52:53.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:52:53.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:52:53.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:52:53.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:52:53.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:52:53.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.681+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 zone default found 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 4 Realm: () 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:52:53.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:52:53.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 zonegroup default 2024-08-08T23:52:53.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.685+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.689+0000 7f70646cc980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:52:53.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.689+0000 7f70646cc980 20 started sync module instance, tier type = 2024-08-08T23:52:53.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.689+0000 7f70646cc980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=0 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=1 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=2 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=3 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=4 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=5 2024-08-08T23:52:53.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.709+0000 7f70646cc980 20 add_watcher() i=6 2024-08-08T23:52:53.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.713+0000 7f70646cc980 20 add_watcher() i=7 2024-08-08T23:52:53.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.713+0000 7f70646cc980 2 all 8 watchers are set, enabling cache 2024-08-08T23:52:53.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.717+0000 7f6f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.717+0000 7f70646cc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:52:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.717+0000 7f70646cc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:52:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.717+0000 7f70646cc980 5 note: GC not initialized 2024-08-08T23:52:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.717+0000 7f6e937fe640 20 reqs_thread_entry: start 2024-08-08T23:52:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 init_complete bucket index max shards: 1 2024-08-08T23:52:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 Filter name: none 2024-08-08T23:52:53.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f6e917fa640 20 reqs_thread_entry: start 2024-08-08T23:52:53.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:53.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=457 2024-08-08T23:52:53.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:53.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.721+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.725+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:52:53.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.725+0000 7f70646cc980 20 rados->read ofs=0 len=0 2024-08-08T23:52:53.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.725+0000 7f70646cc980 20 rados_obj.operate() r=0 bl.length=457 2024-08-08T23:52:53.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.725+0000 7f70646cc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:52:53.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.729+0000 7f6f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:52:53.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.733+0000 7f70646cc980 20 remove_watcher() i=0 2024-08-08T23:52:53.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.733+0000 7f70646cc980 2 removed watcher, disabling cache 2024-08-08T23:52:53.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.733+0000 7f70646cc980 20 remove_watcher() i=1 2024-08-08T23:52:53.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.737+0000 7f70646cc980 20 remove_watcher() i=2 2024-08-08T23:52:53.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.741+0000 7f70646cc980 20 remove_watcher() i=3 2024-08-08T23:52:53.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.741+0000 7f70646cc980 20 remove_watcher() i=4 2024-08-08T23:52:53.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.745+0000 7f70646cc980 20 remove_watcher() i=5 2024-08-08T23:52:53.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.745+0000 7f70646cc980 20 remove_watcher() i=6 2024-08-08T23:52:53.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:52:53.745+0000 7f70646cc980 20 remove_watcher() i=7 2024-08-08T23:52:53.759 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:52:53.759 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:52:53.759 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-08-08T23:52:53.759 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:24.036 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-08-08T23:53:24.071 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:24.071 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:24.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 realm 2024-08-08T23:53:24.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:24.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.121+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.125+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:24.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.125+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.125+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:24.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.125+0000 7ff4f67e7980 20 searching for the correct realm 2024-08-08T23:53:24.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.129+0000 7ff4f4afc640 0 -- 172.21.15.83:0/1338103799 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff4dc008070 msgr2=0x7ff4dc014900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:24.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.345+0000 7ff4f3afa640 0 -- 172.21.15.83:0/1338103799 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff4e40ccba0 msgr2=0x7ff4e4100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:24.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:24.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.561+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 zone default found 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 4 Realm: () 2024-08-08T23:53:24.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 zonegroup default 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.565+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.569+0000 7ff4f67e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.569+0000 7ff4f67e7980 20 started sync module instance, tier type = 2024-08-08T23:53:24.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.569+0000 7ff4f67e7980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=0 2024-08-08T23:53:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=1 2024-08-08T23:53:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=2 2024-08-08T23:53:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=3 2024-08-08T23:53:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=4 2024-08-08T23:53:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=5 2024-08-08T23:53:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.589+0000 7ff4f67e7980 20 add_watcher() i=6 2024-08-08T23:53:24.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.593+0000 7ff4f67e7980 20 add_watcher() i=7 2024-08-08T23:53:24.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.593+0000 7ff4f67e7980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:24.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.593+0000 7ff3aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:24.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:24.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:24.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 5 note: GC not initialized 2024-08-08T23:53:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff3a9fdb640 20 reqs_thread_entry: start 2024-08-08T23:53:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 Filter name: none 2024-08-08T23:53:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff31b7fe640 20 reqs_thread_entry: start 2024-08-08T23:53:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 : miss 2024-08-08T23:53:24.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:53:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:53:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:53:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:53:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.597+0000 7ff4f67e7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 2024-08-08T23:53:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff4f67e7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:53:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff4f67e7980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:53:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff4f67e7980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:53:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff4f67e7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29, ofs0, ns] 2024-08-08T23:53:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff3cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 94771925507600 notifier 6644 bl.length()=987 2024-08-08T23:53:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff3cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:53:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff3cb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:53:24.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.609+0000 7ff3cb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:53:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_sources= new_sources= 2024-08-08T23:53:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential sources added=[] removed=[] 2024-08-08T23:53:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_dests= new_dests= 2024-08-08T23:53:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential dests added=[] removed=[] 2024-08-08T23:53:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29.1.0 2024-08-08T23:53:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29.1.0 2024-08-08T23:53:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29.1.1 2024-08-08T23:53:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29.1.1 2024-08-08T23:53:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.613+0000 7ff4f67e7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29.0 2024-08-08T23:53:24.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.617+0000 7ff4f67e7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 : hit (requested=0x17, cached=0x17) 2024-08-08T23:53:24.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.617+0000 7ff4f67e7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29, ofs0, ns] 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff3cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 94771925507600 notifier 6644 bl.length()=955 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff3cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 info.flags=0x17 2024-08-08T23:53:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff3cb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 to cache LRU end 2024-08-08T23:53:24.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff3cb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-08-08T23:53:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_sources= new_sources= 2024-08-08T23:53:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential sources added=[] removed=[] 2024-08-08T23:53:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): orig_dests= new_dests= 2024-08-08T23:53:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.621+0000 7ff4f67e7980 20 handle_bi_update(): bucket=:abort-at-do-reshard[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29]): potential dests added=[] removed=[] 2024-08-08T23:53:24.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.625+0000 7ff4f67e7980 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-08-08T23:53:24.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.629+0000 7ff3aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:24.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.633+0000 7ff4f67e7980 20 remove_watcher() i=0 2024-08-08T23:53:24.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.633+0000 7ff4f67e7980 2 removed watcher, disabling cache 2024-08-08T23:53:24.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.637+0000 7ff4f67e7980 20 remove_watcher() i=1 2024-08-08T23:53:24.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.637+0000 7ff4f67e7980 20 remove_watcher() i=2 2024-08-08T23:53:24.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.641+0000 7ff4f67e7980 20 remove_watcher() i=3 2024-08-08T23:53:24.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.641+0000 7ff4f67e7980 20 remove_watcher() i=4 2024-08-08T23:53:24.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.645+0000 7ff4f67e7980 20 remove_watcher() i=5 2024-08-08T23:53:24.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.645+0000 7ff4f67e7980 20 remove_watcher() i=6 2024-08-08T23:53:24.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.645+0000 7ff4f67e7980 20 remove_watcher() i=7 2024-08-08T23:53:24.656 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-08T23:53:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:24.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.729+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 realm 2024-08-08T23:53:24.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:24.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.733+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.737+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:24.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.737+0000 7fb7b2c86980 20 searching for the correct realm 2024-08-08T23:53:24.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.741+0000 7fb7b079a640 0 -- 172.21.15.83:0/2686734583 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fb7a8026040 msgr2=0x7fb7a8030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:24.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.745+0000 7fb7aff99640 0 -- 172.21.15.83:0/2686734583 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fb7a800c400 msgr2=0x7fb7a800c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.961+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:24.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 zone default found 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 4 Realm: () 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:24.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 zonegroup default 2024-08-08T23:53:24.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:24.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 started sync module instance, tier type = 2024-08-08T23:53:24.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.965+0000 7fb7b2c86980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=0 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=1 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=2 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=3 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=4 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=5 2024-08-08T23:53:24.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.989+0000 7fb7b2c86980 20 add_watcher() i=6 2024-08-08T23:53:24.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.993+0000 7fb7b2c86980 20 add_watcher() i=7 2024-08-08T23:53:24.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.993+0000 7fb7b2c86980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:24.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb6667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 5 note: GC not initialized 2024-08-08T23:53:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb6657e2640 20 reqs_thread_entry: start 2024-08-08T23:53:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 20 Filter name: none 2024-08-08T23:53:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb5d6ffd640 20 reqs_thread_entry: start 2024-08-08T23:53:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:24.997+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:53:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:53:24.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:24.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=211 2024-08-08T23:53:24.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados->read ofs=0 len=0 2024-08-08T23:53:24.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 rados_obj.operate() r=0 bl.length=425 2024-08-08T23:53:24.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.001+0000 7fb7b2c86980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:25.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.005+0000 7fb6667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:25.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.009+0000 7fb7b2c86980 20 remove_watcher() i=0 2024-08-08T23:53:25.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.009+0000 7fb7b2c86980 2 removed watcher, disabling cache 2024-08-08T23:53:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.013+0000 7fb7b2c86980 20 remove_watcher() i=1 2024-08-08T23:53:25.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.017+0000 7fb7b2c86980 20 remove_watcher() i=2 2024-08-08T23:53:25.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.017+0000 7fb7b2c86980 20 remove_watcher() i=3 2024-08-08T23:53:25.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.021+0000 7fb7b2c86980 20 remove_watcher() i=4 2024-08-08T23:53:25.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.021+0000 7fb7b2c86980 20 remove_watcher() i=5 2024-08-08T23:53:25.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.025+0000 7fb7b2c86980 20 remove_watcher() i=6 2024-08-08T23:53:25.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.029+0000 7fb7b2c86980 20 remove_watcher() i=7 2024-08-08T23:53:25.046 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:25.047 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:53:25.047 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-08-08T23:53:25.047 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:25.680 INFO:tasks.workunit.client.0.smithi083.stderr: test: reshard versioned bucket 2024-08-08T23:53:25.681 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-08-08T23:53:25.714 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:25.714 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:25.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.949+0000 7f7bfe63f640 0 --2- 172.21.15.83:0/642108886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555937bd4120 0x555937d48310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-08T23:53:25.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 realm 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.977+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.981+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:25.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.981+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.981+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:25.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.981+0000 7f7c00b2b980 20 searching for the correct realm 2024-08-08T23:53:25.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.985+0000 7f7bfde3e640 0 -- 172.21.15.83:0/4124625805 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f7bf00ce940 msgr2=0x7f7bf00db400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:25.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:25.989+0000 7f7bfde3e640 0 -- 172.21.15.83:0/4124625805 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f7ac80769d0 msgr2=0x7f7ac8078e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:25.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 zone default found 2024-08-08T23:53:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 4 Realm: () 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 zonegroup default 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.001+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.005+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.005+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.005+0000 7f7c00b2b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.005+0000 7f7c00b2b980 20 started sync module instance, tier type = 2024-08-08T23:53:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.005+0000 7f7c00b2b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=0 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=1 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=2 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=3 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=4 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=5 2024-08-08T23:53:26.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.017+0000 7f7c00b2b980 20 add_watcher() i=6 2024-08-08T23:53:26.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7c00b2b980 20 add_watcher() i=7 2024-08-08T23:53:26.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7c00b2b980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:26.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7ab4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7c00b2b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7c00b2b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.021+0000 7f7c00b2b980 5 note: GC not initialized 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7a2f7fe640 20 reqs_thread_entry: start 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 Filter name: none 2024-08-08T23:53:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7a2d7fa640 20 reqs_thread_entry: start 2024-08-08T23:53:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:26.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.025+0000 7f7c00b2b980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.029+0000 7f7c00b2b980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:26.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.029+0000 7f7c00b2b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:26.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.029+0000 7f7ab4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.033+0000 7f7c00b2b980 20 remove_watcher() i=0 2024-08-08T23:53:26.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.033+0000 7f7c00b2b980 2 removed watcher, disabling cache 2024-08-08T23:53:26.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.037+0000 7f7c00b2b980 20 remove_watcher() i=1 2024-08-08T23:53:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.037+0000 7f7c00b2b980 20 remove_watcher() i=2 2024-08-08T23:53:26.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.041+0000 7f7c00b2b980 20 remove_watcher() i=3 2024-08-08T23:53:26.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.041+0000 7f7c00b2b980 20 remove_watcher() i=4 2024-08-08T23:53:26.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.045+0000 7f7c00b2b980 20 remove_watcher() i=5 2024-08-08T23:53:26.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.045+0000 7f7c00b2b980 20 remove_watcher() i=6 2024-08-08T23:53:26.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.045+0000 7f7c00b2b980 20 remove_watcher() i=7 2024-08-08T23:53:26.054 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:26.054 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:53:26.054 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-08-08T23:53:26.054 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:26.054 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-08-08T23:53:26.083 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:26.084 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:26.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 realm 2024-08-08T23:53:26.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.133+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.137+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:26.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.137+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.137+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:26.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.137+0000 7f6cf87ce980 20 searching for the correct realm 2024-08-08T23:53:26.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.141+0000 7f6cf6ae3640 0 -- 172.21.15.83:0/2808651063 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6cec0f6960 msgr2=0x7f6cec0e9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:26.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.149+0000 7f6cf5ae1640 0 -- 172.21.15.83:0/2808651063 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6cf004d400 msgr2=0x7f6cf004d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.365+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:26.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 zone default found 2024-08-08T23:53:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 4 Realm: () 2024-08-08T23:53:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 zonegroup default 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 started sync module instance, tier type = 2024-08-08T23:53:26.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.369+0000 7f6cf87ce980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:26.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=0 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=1 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=2 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=3 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=4 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=5 2024-08-08T23:53:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.393+0000 7f6cf87ce980 20 add_watcher() i=6 2024-08-08T23:53:26.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.397+0000 7f6cf87ce980 20 add_watcher() i=7 2024-08-08T23:53:26.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.397+0000 7f6cf87ce980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:26.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6bacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:26.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:26.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 5 note: GC not initialized 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6b277fe640 20 reqs_thread_entry: start 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 Filter name: none 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6b257fa640 20 reqs_thread_entry: start 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-08T23:53:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-08T23:53:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-08T23:53:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : miss 2024-08-08T23:53:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 adding default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:26.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.401+0000 7f6cf87ce980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:26.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6cf87ce980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6cf87ce980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6cf87ce980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6cf87ce980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6bd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94215262903168 notifier 6692 bl.length()=897 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6bd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6bd9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.409+0000 7f6bd9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:26.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.413+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:26.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.413+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:26.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.413+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:26.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.413+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:26.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.0 2024-08-08T23:53:26.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.0 2024-08-08T23:53:26.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.1 2024-08-08T23:53:26.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.1 2024-08-08T23:53:26.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.0 2024-08-08T23:53:26.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : hit (requested=0x17, cached=0x17) 2024-08-08T23:53:26.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.417+0000 7f6cf87ce980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6bd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94215262903168 notifier 6692 bl.length()=865 2024-08-08T23:53:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6bd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6bd97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6bd97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:26.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:26.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:26.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:26.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.421+0000 7f6cf87ce980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:26.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.425+0000 7f6cf87ce980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-08-08T23:53:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.429+0000 7f6bacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.433+0000 7f6cf87ce980 20 remove_watcher() i=0 2024-08-08T23:53:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.433+0000 7f6cf87ce980 2 removed watcher, disabling cache 2024-08-08T23:53:26.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.437+0000 7f6cf87ce980 20 remove_watcher() i=1 2024-08-08T23:53:26.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.437+0000 7f6cf87ce980 20 remove_watcher() i=2 2024-08-08T23:53:26.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.441+0000 7f6cf87ce980 20 remove_watcher() i=3 2024-08-08T23:53:26.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.441+0000 7f6cf87ce980 20 remove_watcher() i=4 2024-08-08T23:53:26.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.445+0000 7f6cf87ce980 20 remove_watcher() i=5 2024-08-08T23:53:26.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.445+0000 7f6cf87ce980 20 remove_watcher() i=6 2024-08-08T23:53:26.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.445+0000 7f6cf87ce980 20 remove_watcher() i=7 2024-08-08T23:53:26.458 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-08-08T23:53:26.488 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:26.488 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:26.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 realm 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.537+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.541+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:26.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.541+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.541+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:26.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.541+0000 7f6bca58d980 20 searching for the correct realm 2024-08-08T23:53:26.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.545+0000 7f6bc88a2640 0 -- 172.21.15.83:0/476377078 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6bbc008070 msgr2=0x7f6bbc076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:26.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.553+0000 7f6bc78a0640 0 -- 172.21.15.83:0/476377078 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6bc002f910 msgr2=0x7f6bc004f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:26.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.769+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 zone default found 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 4 Realm: () 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 zonegroup default 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.773+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.777+0000 7f6bca58d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.777+0000 7f6bca58d980 20 started sync module instance, tier type = 2024-08-08T23:53:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.777+0000 7f6bca58d980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=0 2024-08-08T23:53:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=1 2024-08-08T23:53:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=2 2024-08-08T23:53:26.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=3 2024-08-08T23:53:26.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=4 2024-08-08T23:53:26.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=5 2024-08-08T23:53:26.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=6 2024-08-08T23:53:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 20 add_watcher() i=7 2024-08-08T23:53:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.801+0000 7f6bca58d980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:26.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.805+0000 7f6a7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 5 note: GC not initialized 2024-08-08T23:53:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6a7dfdb640 20 reqs_thread_entry: start 2024-08-08T23:53:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 Filter name: none 2024-08-08T23:53:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f69ef7fe640 20 reqs_thread_entry: start 2024-08-08T23:53:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:26.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.809+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.813+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:26.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.813+0000 7f6bca58d980 20 rados->read ofs=0 len=0 2024-08-08T23:53:26.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.813+0000 7f6bca58d980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:26.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.813+0000 7f6bca58d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.813+0000 7f6a7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:26.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.821+0000 7f6bca58d980 20 remove_watcher() i=0 2024-08-08T23:53:26.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.821+0000 7f6bca58d980 2 removed watcher, disabling cache 2024-08-08T23:53:26.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.821+0000 7f6bca58d980 20 remove_watcher() i=1 2024-08-08T23:53:26.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.825+0000 7f6bca58d980 20 remove_watcher() i=2 2024-08-08T23:53:26.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.825+0000 7f6bca58d980 20 remove_watcher() i=3 2024-08-08T23:53:26.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.829+0000 7f6bca58d980 20 remove_watcher() i=4 2024-08-08T23:53:26.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.829+0000 7f6bca58d980 20 remove_watcher() i=5 2024-08-08T23:53:26.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.833+0000 7f6bca58d980 20 remove_watcher() i=6 2024-08-08T23:53:26.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:26.833+0000 7f6bca58d980 20 remove_watcher() i=7 2024-08-08T23:53:26.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:26.844 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:53:26.844 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-08-08T23:53:26.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:26.938 INFO:tasks.workunit.client.0.smithi083.stderr: test: reshard removes olh entries with empty name 2024-08-08T23:53:27.314 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-08T23:53:27.345 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:27.345 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:27.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.393+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 realm 2024-08-08T23:53:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:27.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:27.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:27.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.397+0000 7f40ad3c2980 20 searching for the correct realm 2024-08-08T23:53:27.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.405+0000 7f40ab6d7640 0 -- 172.21.15.83:0/1688105982 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x55c473131e80 msgr2=0x55c473134270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:27.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.409+0000 7f40aa6d5640 0 -- 172.21.15.83:0/1688105982 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f40a4115830 msgr2=0x7f40a40d60e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.417+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:27.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:27.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 zone default found 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 4 Realm: () 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 zonegroup default 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 started sync module instance, tier type = 2024-08-08T23:53:27.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.421+0000 7f40ad3c2980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:27.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=0 2024-08-08T23:53:27.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=1 2024-08-08T23:53:27.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=2 2024-08-08T23:53:27.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=3 2024-08-08T23:53:27.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=4 2024-08-08T23:53:27.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=5 2024-08-08T23:53:27.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=6 2024-08-08T23:53:27.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 20 add_watcher() i=7 2024-08-08T23:53:27.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.437+0000 7f40ad3c2980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:27.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f3f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:27.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 5 note: GC not initialized 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f3edbfff640 20 reqs_thread_entry: start 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 Filter name: none 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f3ed9ffb640 20 reqs_thread_entry: start 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.441+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.445+0000 7f40ad3c2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:27.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.449+0000 7f3f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:27.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.453+0000 7f40ad3c2980 20 remove_watcher() i=0 2024-08-08T23:53:27.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.453+0000 7f40ad3c2980 2 removed watcher, disabling cache 2024-08-08T23:53:27.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.453+0000 7f40ad3c2980 20 remove_watcher() i=1 2024-08-08T23:53:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.457+0000 7f40ad3c2980 20 remove_watcher() i=2 2024-08-08T23:53:27.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.457+0000 7f40ad3c2980 20 remove_watcher() i=3 2024-08-08T23:53:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.461+0000 7f40ad3c2980 20 remove_watcher() i=4 2024-08-08T23:53:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.461+0000 7f40ad3c2980 20 remove_watcher() i=5 2024-08-08T23:53:27.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.461+0000 7f40ad3c2980 20 remove_watcher() i=6 2024-08-08T23:53:27.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.465+0000 7f40ad3c2980 20 remove_watcher() i=7 2024-08-08T23:53:27.473 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:27.473 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:53:27.473 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-08-08T23:53:27.473 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:27.473 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-08-08T23:53:27.499 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:27.499 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:27.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.545+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 realm 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:27.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.549+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.553+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:27.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.553+0000 7fd057691980 20 searching for the correct realm 2024-08-08T23:53:27.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.557+0000 7fd0559a6640 0 -- 172.21.15.83:0/3770056150 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fd04c032060 msgr2=0x7fd04c0832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:27.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.561+0000 7fd0549a4640 0 -- 172.21.15.83:0/3770056150 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fd050009250 msgr2=0x7fd0500f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:27.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:27.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.777+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 zone default found 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 4 Realm: () 2024-08-08T23:53:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 zonegroup default 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 started sync module instance, tier type = 2024-08-08T23:53:27.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.781+0000 7fd057691980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=0 2024-08-08T23:53:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=1 2024-08-08T23:53:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=2 2024-08-08T23:53:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=3 2024-08-08T23:53:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=4 2024-08-08T23:53:27.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=5 2024-08-08T23:53:27.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.805+0000 7fd057691980 20 add_watcher() i=6 2024-08-08T23:53:27.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.809+0000 7fd057691980 20 add_watcher() i=7 2024-08-08T23:53:27.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.809+0000 7fd057691980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:27.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fcf0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 5 note: GC not initialized 2024-08-08T23:53:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fcf0a7e4640 20 reqs_thread_entry: start 2024-08-08T23:53:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 20 Filter name: none 2024-08-08T23:53:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fce7bfff640 20 reqs_thread_entry: start 2024-08-08T23:53:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.813+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.817+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:27.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.817+0000 7fd057691980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.817+0000 7fd057691980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.817+0000 7fd057691980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:27.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.817+0000 7fcf0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:27.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.825+0000 7fd057691980 20 remove_watcher() i=0 2024-08-08T23:53:27.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.825+0000 7fd057691980 2 removed watcher, disabling cache 2024-08-08T23:53:27.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.825+0000 7fd057691980 20 remove_watcher() i=1 2024-08-08T23:53:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.829+0000 7fd057691980 20 remove_watcher() i=2 2024-08-08T23:53:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.829+0000 7fd057691980 20 remove_watcher() i=3 2024-08-08T23:53:27.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.833+0000 7fd057691980 20 remove_watcher() i=4 2024-08-08T23:53:27.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.833+0000 7fd057691980 20 remove_watcher() i=5 2024-08-08T23:53:27.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.837+0000 7fd057691980 20 remove_watcher() i=6 2024-08-08T23:53:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.837+0000 7fd057691980 20 remove_watcher() i=7 2024-08-08T23:53:27.848 INFO:tasks.workunit.client.0.smithi083.stderr:rados -p default.rgw.buckets.index setomapval .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-08-08T23:53:27.875 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:27.875 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:27.895 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket a-bucket 2024-08-08T23:53:27.921 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:27.921 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 realm 2024-08-08T23:53:27.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:27.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:27.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:27.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.969+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.973+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.973+0000 7f288a732980 20 searching for the correct realm 2024-08-08T23:53:27.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.977+0000 7f2888246640 0 -- 172.21.15.83:0/2215399357 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f2878035b60 msgr2=0x7f287802e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:27.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:27.981+0000 7f2887a45640 0 -- 172.21.15.83:0/2215399357 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f2878045960 msgr2=0x7f287802c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.197+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:28.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 zone default found 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 4 Realm: () 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 zonegroup default 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 started sync module instance, tier type = 2024-08-08T23:53:28.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.201+0000 7f288a732980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:28.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=0 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=1 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=2 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=3 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=4 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=5 2024-08-08T23:53:28.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.225+0000 7f288a732980 20 add_watcher() i=6 2024-08-08T23:53:28.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.229+0000 7f288a732980 20 add_watcher() i=7 2024-08-08T23:53:28.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.229+0000 7f288a732980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:28.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f273e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:28.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:28.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:28.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 5 note: GC not initialized 2024-08-08T23:53:28.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f273d7e2640 20 reqs_thread_entry: start 2024-08-08T23:53:28.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:28.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 Filter name: none 2024-08-08T23:53:28.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f26b6ffd640 20 reqs_thread_entry: start 2024-08-08T23:53:28.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:28.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:28.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:28.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-08-08T23:53:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 INFO: main: starting shard=0 2024-08-08T23:53:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:53:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.233+0000 7f288a732980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:53:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: starting shard=1 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: starting shard=2 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:53:28.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:53:28.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:28.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f288a732980 20 INFO: main: done 2024-08-08T23:53:28.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.237+0000 7f273e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:28.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.245+0000 7f288a732980 20 remove_watcher() i=0 2024-08-08T23:53:28.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.245+0000 7f288a732980 2 removed watcher, disabling cache 2024-08-08T23:53:28.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.245+0000 7f288a732980 20 remove_watcher() i=1 2024-08-08T23:53:28.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.249+0000 7f288a732980 20 remove_watcher() i=2 2024-08-08T23:53:28.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.249+0000 7f288a732980 20 remove_watcher() i=3 2024-08-08T23:53:28.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.253+0000 7f288a732980 20 remove_watcher() i=4 2024-08-08T23:53:28.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.253+0000 7f288a732980 20 remove_watcher() i=5 2024-08-08T23:53:28.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.257+0000 7f288a732980 20 remove_watcher() i=6 2024-08-08T23:53:28.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.257+0000 7f288a732980 20 remove_watcher() i=7 2024-08-08T23:53:28.268 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-08-08T23:53:28.301 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:28.301 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:28.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 realm 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.353+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.357+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:28.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.357+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.357+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:28.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.357+0000 7feced31a980 20 searching for the correct realm 2024-08-08T23:53:28.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.361+0000 7feceb62f640 0 -- 172.21.15.83:0/4174159907 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fece0090410 msgr2=0x7fece0087860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:28.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.577+0000 7fecea62d640 0 -- 172.21.15.83:0/4174159907 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fece41040f0 msgr2=0x7fece40b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:28.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.793+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:28.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 zone default found 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 4 Realm: () 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 zonegroup default 2024-08-08T23:53:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 started sync module instance, tier type = 2024-08-08T23:53:28.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.797+0000 7feced31a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:28.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=0 2024-08-08T23:53:28.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=1 2024-08-08T23:53:28.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=2 2024-08-08T23:53:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=3 2024-08-08T23:53:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=4 2024-08-08T23:53:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=5 2024-08-08T23:53:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=6 2024-08-08T23:53:28.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 20 add_watcher() i=7 2024-08-08T23:53:28.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.821+0000 7feced31a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.825+0000 7feba17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:28.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:28.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:28.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 5 note: GC not initialized 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feb1bfff640 20 reqs_thread_entry: start 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 Filter name: none 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feb19ffb640 20 reqs_thread_entry: start 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-08T23:53:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-08T23:53:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-08T23:53:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : miss 2024-08-08T23:53:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.829+0000 7feced31a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:53:28.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.837+0000 7feced31a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.837+0000 7feced31a980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.837+0000 7feced31a980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.837+0000 7feced31a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7febcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 94682707899920 notifier 6785 bl.length()=903 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7febcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:53:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7febcdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:53:28.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7febcdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:28.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:53:28.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:53:28.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:53:28.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.841+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:53:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.3.0 2024-08-08T23:53:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.3.0 2024-08-08T23:53:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:53:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.0 2024-08-08T23:53:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-08-08T23:53:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:53:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.845+0000 7feced31a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.1 2024-08-08T23:53:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:53:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.2.2 2024-08-08T23:53:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 : hit (requested=0x17, cached=0x17) 2024-08-08T23:53:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 2024-08-08T23:53:28.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:53:28.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:53:28.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:28.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.849+0000 7feced31a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18, ofs0, ns] 2024-08-08T23:53:28.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7febce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94682707899920 notifier 6785 bl.length()=871 2024-08-08T23:53:28.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7febce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 info.flags=0x17 2024-08-08T23:53:28.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7febce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18 to cache LRU end 2024-08-08T23:53:28.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7febce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_sources= new_sources= 2024-08-08T23:53:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential sources added=[] removed=[] 2024-08-08T23:53:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): orig_dests= new_dests= 2024-08-08T23:53:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.853+0000 7feced31a980 20 handle_bi_update(): bucket=:a-bucket[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18]): potential dests added=[] removed=[] 2024-08-08T23:53:28.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.857+0000 7feced31a980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-08-08T23:53:28.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.861+0000 7feba17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:28.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.865+0000 7feced31a980 20 remove_watcher() i=0 2024-08-08T23:53:28.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.865+0000 7feced31a980 2 removed watcher, disabling cache 2024-08-08T23:53:28.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.865+0000 7feced31a980 20 remove_watcher() i=1 2024-08-08T23:53:28.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.869+0000 7feced31a980 20 remove_watcher() i=2 2024-08-08T23:53:28.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.873+0000 7feced31a980 20 remove_watcher() i=3 2024-08-08T23:53:28.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.873+0000 7feced31a980 20 remove_watcher() i=4 2024-08-08T23:53:28.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.873+0000 7feced31a980 20 remove_watcher() i=5 2024-08-08T23:53:28.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.877+0000 7feced31a980 20 remove_watcher() i=6 2024-08-08T23:53:28.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.877+0000 7feced31a980 20 remove_watcher() i=7 2024-08-08T23:53:28.889 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket a-bucket 2024-08-08T23:53:28.919 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:28.919 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:28.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 realm 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.969+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.973+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:28.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.973+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:28.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.973+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:28.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.973+0000 7f515e14a980 20 searching for the correct realm 2024-08-08T23:53:28.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:28.973+0000 7f515b45d640 0 -- 172.21.15.83:0/3095181119 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f514c0b7430 msgr2=0x7f514c0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:29.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.185+0000 7f515bc5e640 0 -- 172.21.15.83:0/3095181119 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f5154015030 msgr2=0x7f5154016420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:29.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:29.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:29.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:29.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 zone default found 2024-08-08T23:53:29.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 4 Realm: () 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 zonegroup default 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.205+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.209+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.209+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.209+0000 7f515e14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.209+0000 7f515e14a980 20 started sync module instance, tier type = 2024-08-08T23:53:29.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.209+0000 7f515e14a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=0 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=1 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=2 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=3 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=4 2024-08-08T23:53:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=5 2024-08-08T23:53:29.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=6 2024-08-08T23:53:29.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 20 add_watcher() i=7 2024-08-08T23:53:29.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.229+0000 7f515e14a980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:29.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.233+0000 7f5011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:29.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:29.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:29.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 5 note: GC not initialized 2024-08-08T23:53:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f5010fe1640 20 reqs_thread_entry: start 2024-08-08T23:53:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 Filter name: none 2024-08-08T23:53:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f4f8a7fc640 20 reqs_thread_entry: start 2024-08-08T23:53:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=200 2024-08-08T23:53:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 rados_obj.operate() r=0 bl.length=414 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 INFO: main: starting shard=0 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.3.0 2024-08-08T23:53:29.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.237+0000 7f515e14a980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18.3.0 2024-08-08T23:53:29.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.241+0000 7f515e14a980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:29.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.241+0000 7f515e14a980 20 INFO: main: done 2024-08-08T23:53:29.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.241+0000 7f5011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:29.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.245+0000 7f515e14a980 20 remove_watcher() i=0 2024-08-08T23:53:29.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.245+0000 7f515e14a980 2 removed watcher, disabling cache 2024-08-08T23:53:29.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.249+0000 7f515e14a980 20 remove_watcher() i=1 2024-08-08T23:53:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.249+0000 7f515e14a980 20 remove_watcher() i=2 2024-08-08T23:53:29.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.253+0000 7f515e14a980 20 remove_watcher() i=3 2024-08-08T23:53:29.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.257+0000 7f515e14a980 20 remove_watcher() i=4 2024-08-08T23:53:29.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.257+0000 7f515e14a980 20 remove_watcher() i=5 2024-08-08T23:53:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.257+0000 7f515e14a980 20 remove_watcher() i=6 2024-08-08T23:53:29.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.261+0000 7f515e14a980 20 remove_watcher() i=7 2024-08-08T23:53:29.269 INFO:tasks.workunit.client.0.smithi083.stderr: test: PUT succeeds during reshard 2024-08-08T23:53:29.269 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-08-08T23:53:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:29.299 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:29.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.345+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 realm 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:29.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.349+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.353+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:29.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.353+0000 7f9bed609980 20 searching for the correct realm 2024-08-08T23:53:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.357+0000 7f9beb91e640 0 -- 172.21.15.83:0/1782866144 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f9bd40ee040 msgr2=0x7f9bd40ee420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:29.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.573+0000 7f9be3fff640 0 -- 172.21.15.83:0/1782866144 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f9bdc069070 msgr2=0x7f9bdc0138e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:29.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:29.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 zone default found 2024-08-08T23:53:29.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 4 Realm: () 2024-08-08T23:53:29.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 zonegroup default 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.589+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.593+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.593+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.593+0000 7f9bed609980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:29.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.593+0000 7f9bed609980 20 started sync module instance, tier type = 2024-08-08T23:53:29.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.593+0000 7f9bed609980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=0 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=1 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=2 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=3 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=4 2024-08-08T23:53:29.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=5 2024-08-08T23:53:29.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.613+0000 7f9bed609980 20 add_watcher() i=6 2024-08-08T23:53:29.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.617+0000 7f9bed609980 20 add_watcher() i=7 2024-08-08T23:53:29.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.617+0000 7f9bed609980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:29.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:29.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:29.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:29.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 5 note: GC not initialized 2024-08-08T23:53:29.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9aa0fe1640 20 reqs_thread_entry: start 2024-08-08T23:53:29.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:29.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 20 Filter name: none 2024-08-08T23:53:29.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9a1a7fc640 20 reqs_thread_entry: start 2024-08-08T23:53:29.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.621+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:29.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:29.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados->read ofs=0 len=0 2024-08-08T23:53:29.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:29.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.625+0000 7f9bed609980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:29.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.629+0000 7f9aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:29.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.633+0000 7f9bed609980 20 remove_watcher() i=0 2024-08-08T23:53:29.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.633+0000 7f9bed609980 2 removed watcher, disabling cache 2024-08-08T23:53:29.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.633+0000 7f9bed609980 20 remove_watcher() i=1 2024-08-08T23:53:29.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.637+0000 7f9bed609980 20 remove_watcher() i=2 2024-08-08T23:53:29.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.641+0000 7f9bed609980 20 remove_watcher() i=3 2024-08-08T23:53:29.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.641+0000 7f9bed609980 20 remove_watcher() i=4 2024-08-08T23:53:29.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.645+0000 7f9bed609980 20 remove_watcher() i=5 2024-08-08T23:53:29.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.645+0000 7f9bed609980 20 remove_watcher() i=6 2024-08-08T23:53:29.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.645+0000 7f9bed609980 20 remove_watcher() i=7 2024-08-08T23:53:29.655 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:29.655 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-08-08T23:53:29.655 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-08-08T23:53:29.655 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:29.655 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-08-08T23:53:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:29.686 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:29.941+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 realm 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.149+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.153+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:30.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.153+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.153+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:30.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.153+0000 7f3ac4627980 20 searching for the correct realm 2024-08-08T23:53:30.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.161+0000 7f3ac293c640 0 -- 172.21.15.83:0/3134983046 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f3ab8031880 msgr2=0x7f3ab8055d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:30.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.377+0000 7f3ac193a640 0 -- 172.21.15.83:0/3134983046 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f3abc01a040 msgr2=0x7f3abc070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:30.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.593+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:30.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:30.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 zone default found 2024-08-08T23:53:30.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 4 Realm: () 2024-08-08T23:53:30.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:30.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:30.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:30.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 zonegroup default 2024-08-08T23:53:30.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.597+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.601+0000 7f3ac4627980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:30.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.601+0000 7f3ac4627980 20 started sync module instance, tier type = 2024-08-08T23:53:30.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.601+0000 7f3ac4627980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:30.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=0 2024-08-08T23:53:30.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=1 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=2 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=3 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=4 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=5 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=6 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 20 add_watcher() i=7 2024-08-08T23:53:30.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.621+0000 7f3ac4627980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:30.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.625+0000 7f3978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:30.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:30.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:30.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 5 note: GC not initialized 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f38f37fe640 20 reqs_thread_entry: start 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 Filter name: none 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f38f17fa640 20 reqs_thread_entry: start 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-08T23:53:30.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:30.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-08T23:53:30.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-08T23:53:30.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : miss 2024-08-08T23:53:30.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rados->read ofs=0 len=0 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 adding default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:30.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.629+0000 7f3ac4627980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:30.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f3ac4627980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:30.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f3ac4627980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:30.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f3ac4627980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:30.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f3ac4627980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:30.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f39a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94850108869520 notifier 6830 bl.length()=897 2024-08-08T23:53:30.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f39a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:30.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f39a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:30.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.637+0000 7f39a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:30.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.641+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:30.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.641+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:30.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.641+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:30.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.641+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:30.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:30.645+0000 7f3ac4627980 -1 Injecting delay=5.000000000s at location=do_reshard 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:35.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.0 2024-08-08T23:53:35.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.0 2024-08-08T23:53:35.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.1 2024-08-08T23:53:35.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.645+0000 7f3ac4627980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.1.1 2024-08-08T23:53:35.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.649+0000 7f3ac4627980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : hit (requested=0x17, cached=0x17) 2024-08-08T23:53:35.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.649+0000 7f3ac4627980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f3ac4627980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f3ac4627980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f3ac4627980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f3ac4627980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f39a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94850108869520 notifier 6830 bl.length()=865 2024-08-08T23:53:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f39a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f39a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.653+0000 7f39a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:35.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.657+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:35.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.657+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:35.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.657+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:35.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.657+0000 7f3ac4627980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.661+0000 7f3ac4627980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-08-08T23:53:35.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.665+0000 7f3978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:35.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.673+0000 7f3ac4627980 20 remove_watcher() i=0 2024-08-08T23:53:35.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.673+0000 7f3ac4627980 2 removed watcher, disabling cache 2024-08-08T23:53:35.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.673+0000 7f3ac4627980 20 remove_watcher() i=1 2024-08-08T23:53:35.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.677+0000 7f3ac4627980 20 remove_watcher() i=2 2024-08-08T23:53:35.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.677+0000 7f3ac4627980 20 remove_watcher() i=3 2024-08-08T23:53:35.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.681+0000 7f3ac4627980 20 remove_watcher() i=4 2024-08-08T23:53:35.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.685+0000 7f3ac4627980 20 remove_watcher() i=5 2024-08-08T23:53:35.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.685+0000 7f3ac4627980 20 remove_watcher() i=6 2024-08-08T23:53:35.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:35.689+0000 7f3ac4627980 20 remove_watcher() i=7 2024-08-08T23:53:35.787 INFO:tasks.workunit.client.0.smithi083.stderr:put object successful 2024-08-08T23:53:35.787 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-08-08T23:53:35.787 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-08-08T23:53:36.681 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-08T23:53:37.113 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-08T23:53:38.696 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:53:38.696 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object x 2024-08-08T23:53:38.731 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:38.731 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:38.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.781+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 realm 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:38.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:38.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:38.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.785+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:38.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.789+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:38.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.789+0000 7fbac4b70980 20 searching for the correct realm 2024-08-08T23:53:38.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.793+0000 7fbac2e85640 0 -- 172.21.15.83:0/414187571 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fbab805d5f0 msgr2=0x7fbab80751e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:38.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:38.797+0000 7fbac1e83640 0 -- 172.21.15.83:0/414187571 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fbab40453e0 msgr2=0x7fbab4045860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:39.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:39.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.012+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:39.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 zone default found 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 4 Realm: () 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 zonegroup default 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 started sync module instance, tier type = 2024-08-08T23:53:39.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.016+0000 7fbac4b70980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:39.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=0 2024-08-08T23:53:39.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=1 2024-08-08T23:53:39.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=2 2024-08-08T23:53:39.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=3 2024-08-08T23:53:39.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=4 2024-08-08T23:53:39.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=5 2024-08-08T23:53:39.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.040+0000 7fbac4b70980 20 add_watcher() i=6 2024-08-08T23:53:39.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.044+0000 7fbac4b70980 20 add_watcher() i=7 2024-08-08T23:53:39.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.044+0000 7fbac4b70980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:39.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fb978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:39.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fbac4b70980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:39.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fbac4b70980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:39.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fbac4b70980 5 note: GC not initialized 2024-08-08T23:53:39.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fb8f37fe640 20 reqs_thread_entry: start 2024-08-08T23:53:39.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fbac4b70980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:39.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.048+0000 7fbac4b70980 20 Filter name: none 2024-08-08T23:53:39.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fb8f17fa640 20 reqs_thread_entry: start 2024-08-08T23:53:39.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:39.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:39.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:39.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-08-08T23:53:39.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 INFO: main: starting shard=0 2024-08-08T23:53:39.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:39.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:39.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:53:39.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 INFO: main: starting shard=1 2024-08-08T23:53:39.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:39.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.052+0000 7fbac4b70980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:39.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:39.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 20 INFO: main: starting shard=2 2024-08-08T23:53:39.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:39.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:39.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:39.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fbac4b70980 20 INFO: main: done 2024-08-08T23:53:39.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.056+0000 7fb978fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:39.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.060+0000 7fbac4b70980 20 remove_watcher() i=0 2024-08-08T23:53:39.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.060+0000 7fbac4b70980 2 removed watcher, disabling cache 2024-08-08T23:53:39.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.064+0000 7fbac4b70980 20 remove_watcher() i=1 2024-08-08T23:53:39.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.068+0000 7fbac4b70980 20 remove_watcher() i=2 2024-08-08T23:53:39.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.068+0000 7fbac4b70980 20 remove_watcher() i=3 2024-08-08T23:53:39.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.072+0000 7fbac4b70980 20 remove_watcher() i=4 2024-08-08T23:53:39.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.072+0000 7fbac4b70980 20 remove_watcher() i=5 2024-08-08T23:53:39.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.076+0000 7fbac4b70980 20 remove_watcher() i=6 2024-08-08T23:53:39.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.076+0000 7fbac4b70980 20 remove_watcher() i=7 2024-08-08T23:53:39.266 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:53:39.267 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object y 2024-08-08T23:53:39.302 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:39.302 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:39.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 realm 2024-08-08T23:53:39.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:39.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.352+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.356+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:39.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.356+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.356+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:39.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.356+0000 7f6f8a365980 20 searching for the correct realm 2024-08-08T23:53:39.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.360+0000 7f6f8867a640 0 -- 172.21.15.83:0/1919612699 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f6f7c0c3c00 msgr2=0x7f6f7c0eb930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:39.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.368+0000 7f6f87678640 0 -- 172.21.15.83:0/1919612699 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f6f8005e410 msgr2=0x7f6f8005e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:39.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.584+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:39.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 zone default found 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 4 Realm: () 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 zonegroup default 2024-08-08T23:53:39.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.588+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.592+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.592+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.592+0000 7f6f8a365980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.592+0000 7f6f8a365980 20 started sync module instance, tier type = 2024-08-08T23:53:39.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.592+0000 7f6f8a365980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=0 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=1 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=2 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=3 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=4 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=5 2024-08-08T23:53:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=6 2024-08-08T23:53:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 20 add_watcher() i=7 2024-08-08T23:53:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.612+0000 7f6f8a365980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:39.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.616+0000 7f6e3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:39.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.616+0000 7f6f8a365980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:39.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.616+0000 7f6f8a365980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:39.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.616+0000 7f6f8a365980 5 note: GC not initialized 2024-08-08T23:53:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6e3cfe1640 20 reqs_thread_entry: start 2024-08-08T23:53:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 Filter name: none 2024-08-08T23:53:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6db67fc640 20 reqs_thread_entry: start 2024-08-08T23:53:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-08-08T23:53:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 INFO: main: starting shard=0 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 INFO: main: starting shard=1 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.620+0000 7f6f8a365980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:39.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:39.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 20 INFO: main: starting shard=2 2024-08-08T23:53:39.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:39.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:39.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:53:39.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6f8a365980 20 INFO: main: done 2024-08-08T23:53:39.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.624+0000 7f6e3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.628+0000 7f6f8a365980 20 remove_watcher() i=0 2024-08-08T23:53:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.628+0000 7f6f8a365980 2 removed watcher, disabling cache 2024-08-08T23:53:39.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.632+0000 7f6f8a365980 20 remove_watcher() i=1 2024-08-08T23:53:39.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.632+0000 7f6f8a365980 20 remove_watcher() i=2 2024-08-08T23:53:39.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.636+0000 7f6f8a365980 20 remove_watcher() i=3 2024-08-08T23:53:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.636+0000 7f6f8a365980 20 remove_watcher() i=4 2024-08-08T23:53:39.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.640+0000 7f6f8a365980 20 remove_watcher() i=5 2024-08-08T23:53:39.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.640+0000 7f6f8a365980 20 remove_watcher() i=6 2024-08-08T23:53:39.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.644+0000 7f6f8a365980 20 remove_watcher() i=7 2024-08-08T23:53:39.807 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-08T23:53:39.807 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object z 2024-08-08T23:53:39.842 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:39.842 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:39.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 realm 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:39.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.892+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.896+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:39.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.896+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:39.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.896+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:39.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.896+0000 7f0514904980 20 searching for the correct realm 2024-08-08T23:53:39.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:39.900+0000 7f0512c19640 0 -- 172.21.15.83:0/1527432947 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f050804e040 msgr2=0x7f050803f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:40.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.116+0000 7f0511c17640 0 -- 172.21.15.83:0/1527432947 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f050c05b320 msgr2=0x7f050c055700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:40.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:40.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:40.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:40.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.332+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 zone default found 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 4 Realm: () 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:40.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:40.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 zonegroup default 2024-08-08T23:53:40.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:40.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:40.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:40.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 started sync module instance, tier type = 2024-08-08T23:53:40.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.336+0000 7f0514904980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:40.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=0 2024-08-08T23:53:40.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=1 2024-08-08T23:53:40.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=2 2024-08-08T23:53:40.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=3 2024-08-08T23:53:40.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=4 2024-08-08T23:53:40.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.360+0000 7f0514904980 20 add_watcher() i=5 2024-08-08T23:53:40.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.364+0000 7f0514904980 20 add_watcher() i=6 2024-08-08T23:53:40.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.364+0000 7f0514904980 20 add_watcher() i=7 2024-08-08T23:53:40.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.364+0000 7f0514904980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:40.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f03c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f0514904980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f0514904980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f0514904980 5 note: GC not initialized 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f03437fe640 20 reqs_thread_entry: start 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.368+0000 7f0514904980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 Filter name: none 2024-08-08T23:53:40.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f03417fa640 20 reqs_thread_entry: start 2024-08-08T23:53:40.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:40.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 rados->read ofs=0 len=0 2024-08-08T23:53:40.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:40.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 INFO: main: starting shard=0 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 INFO: main: starting shard=1 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:40.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.372+0000 7f0514904980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 20 INFO: main: starting shard=2 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-08T23:53:40.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f0514904980 20 INFO: main: done 2024-08-08T23:53:40.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.376+0000 7f03c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:40.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.380+0000 7f0514904980 20 remove_watcher() i=0 2024-08-08T23:53:40.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.380+0000 7f0514904980 2 removed watcher, disabling cache 2024-08-08T23:53:40.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.384+0000 7f0514904980 20 remove_watcher() i=1 2024-08-08T23:53:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.388+0000 7f0514904980 20 remove_watcher() i=2 2024-08-08T23:53:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.388+0000 7f0514904980 20 remove_watcher() i=3 2024-08-08T23:53:40.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.392+0000 7f0514904980 20 remove_watcher() i=4 2024-08-08T23:53:40.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.392+0000 7f0514904980 20 remove_watcher() i=5 2024-08-08T23:53:40.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.396+0000 7f0514904980 20 remove_watcher() i=6 2024-08-08T23:53:40.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:40.396+0000 7f0514904980 20 remove_watcher() i=7 2024-08-08T23:53:40.437 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-08T23:53:40.874 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-08T23:53:41.281 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-08-08T23:53:41.313 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:41.313 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:41.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 realm 2024-08-08T23:53:41.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:41.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.356+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.360+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:41.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.360+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.360+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:41.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.360+0000 7f832b0a7980 20 searching for the correct realm 2024-08-08T23:53:41.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.364+0000 7f8328bbb640 0 -- 172.21.15.83:0/3912040836 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f83200dfbe0 msgr2=0x7f83200d6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:41.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.372+0000 7f83283ba640 0 -- 172.21.15.83:0/3912040836 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f83200cc910 msgr2=0x7f83200e73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:41.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:41.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.588+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 zone default found 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 4 Realm: () 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 zonegroup default 2024-08-08T23:53:41.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 started sync module instance, tier type = 2024-08-08T23:53:41.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.592+0000 7f832b0a7980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:41.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=0 2024-08-08T23:53:41.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=1 2024-08-08T23:53:41.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=2 2024-08-08T23:53:41.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=3 2024-08-08T23:53:41.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=4 2024-08-08T23:53:41.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=5 2024-08-08T23:53:41.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=6 2024-08-08T23:53:41.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 20 add_watcher() i=7 2024-08-08T23:53:41.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.616+0000 7f832b0a7980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:41.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.620+0000 7f81df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:41.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:41.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:41.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 5 note: GC not initialized 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f81de7e4640 20 reqs_thread_entry: start 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 Filter name: none 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f81d77fe640 20 reqs_thread_entry: start 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-08T23:53:41.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:41.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-08T23:53:41.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-08T23:53:41.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : miss 2024-08-08T23:53:41.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 adding default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:41.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.624+0000 7f832b0a7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:41.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.636+0000 7f832b0a7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:41.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.636+0000 7f832b0a7980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.636+0000 7f832b0a7980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.636+0000 7f832b0a7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f81ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94053665884400 notifier 7284 bl.length()=897 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f81ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f81ff7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:41.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f81ff7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:41.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:41.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:41.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:41.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.640+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:41.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.0 2024-08-08T23:53:41.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.0 2024-08-08T23:53:41.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.1 2024-08-08T23:53:41.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.1 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.2 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.2 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.3 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.3 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.4 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.4 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.5 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.5 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.6 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.6 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.7 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.7 2024-08-08T23:53:41.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.8 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.8 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.10 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.10 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.11 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.11 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.12 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.12 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.13 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.13 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.14 2024-08-08T23:53:41.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.14 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.15 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.15 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.16 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.16 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.0 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:41.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.1 2024-08-08T23:53:41.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:41.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.644+0000 7f832b0a7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.2.2 2024-08-08T23:53:41.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.648+0000 7f832b0a7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : hit (requested=0x17, cached=0x17) 2024-08-08T23:53:41.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.648+0000 7f832b0a7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:41.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f832b0a7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:41.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f832b0a7980 10 moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:41.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f832b0a7980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:41.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f832b0a7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19, ofs0, ns] 2024-08-08T23:53:41.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f81fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94053665884400 notifier 7284 bl.length()=865 2024-08-08T23:53:41.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f81fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:41.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f81fffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:41.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.652+0000 7f81fffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:41.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.656+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_sources= new_sources= 2024-08-08T23:53:41.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.656+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential sources added=[] removed=[] 2024-08-08T23:53:41.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.656+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): orig_dests= new_dests= 2024-08-08T23:53:41.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.656+0000 7f832b0a7980 20 handle_bi_update(): bucket=:myver[24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19]): potential dests added=[] removed=[] 2024-08-08T23:53:41.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.656+0000 7f832b0a7980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-08-08T23:53:41.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.660+0000 7f81df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:41.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.664+0000 7f832b0a7980 20 remove_watcher() i=0 2024-08-08T23:53:41.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.664+0000 7f832b0a7980 2 removed watcher, disabling cache 2024-08-08T23:53:41.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.668+0000 7f832b0a7980 20 remove_watcher() i=1 2024-08-08T23:53:41.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.672+0000 7f832b0a7980 20 remove_watcher() i=2 2024-08-08T23:53:41.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.672+0000 7f832b0a7980 20 remove_watcher() i=3 2024-08-08T23:53:41.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.676+0000 7f832b0a7980 20 remove_watcher() i=4 2024-08-08T23:53:41.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.676+0000 7f832b0a7980 20 remove_watcher() i=5 2024-08-08T23:53:41.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.676+0000 7f832b0a7980 20 remove_watcher() i=6 2024-08-08T23:53:41.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.680+0000 7f832b0a7980 20 remove_watcher() i=7 2024-08-08T23:53:41.688 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-08T23:53:41.718 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:41.718 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:41.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.760+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 realm 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:41.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:41.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.764+0000 7f63a16c7980 20 searching for the correct realm 2024-08-08T23:53:41.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.772+0000 7f639f1db640 0 -- 172.21.15.83:0/2698981298 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x7f639800dc20 msgr2=0x7f6398082920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:41.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.988+0000 7f639e9da640 0 -- 172.21.15.83:0/2698981298 >> [v2:172.21.15.196:6801/988086196,v1:172.21.15.196:6802/988086196] conn(0x55eb83cb6cc0 msgr2=0x55eb83cb90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:41.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:41.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:41.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:41.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:41.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:41.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:41.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:41.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 zone default found 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 4 Realm: () 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 zonegroup default 2024-08-08T23:53:41.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:41.996+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.000+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.000+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:41.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.000+0000 7f63a16c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:41.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.000+0000 7f63a16c7980 20 started sync module instance, tier type = 2024-08-08T23:53:41.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.000+0000 7f63a16c7980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:42.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=0 2024-08-08T23:53:42.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=1 2024-08-08T23:53:42.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=2 2024-08-08T23:53:42.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=3 2024-08-08T23:53:42.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=4 2024-08-08T23:53:42.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=5 2024-08-08T23:53:42.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.024+0000 7f63a16c7980 20 add_watcher() i=6 2024-08-08T23:53:42.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.028+0000 7f63a16c7980 20 add_watcher() i=7 2024-08-08T23:53:42.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.028+0000 7f63a16c7980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:42.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f6255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:42.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:42.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:42.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 5 note: GC not initialized 2024-08-08T23:53:42.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f6254fe1640 20 reqs_thread_entry: start 2024-08-08T23:53:42.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:42.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 20 Filter name: none 2024-08-08T23:53:42.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f61ce7fc640 20 reqs_thread_entry: start 2024-08-08T23:53:42.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-08T23:53:42.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.032+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:42.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-08T23:53:42.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-08T23:53:42.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 : miss 2024-08-08T23:53:42.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:42.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 info.flags=0x17 2024-08-08T23:53:42.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 adding default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 to cache LRU end 2024-08-08T23:53:42.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-08T23:53:42.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-08-08T23:53:42.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19 2024-08-08T23:53:42.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.0 2024-08-08T23:53:42.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.0 2024-08-08T23:53:42.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 1 NOTICE: finished shard 0 (0 entries removed) 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.1 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.036+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.1 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 1 NOTICE: finished shard 1 (0 entries removed) 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.2 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.2 2024-08-08T23:53:42.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 1 NOTICE: finished shard 2 (0 entries removed) 2024-08-08T23:53:42.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.3 2024-08-08T23:53:42.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.3 2024-08-08T23:53:42.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 1 NOTICE: finished shard 3 (0 entries removed) 2024-08-08T23:53:42.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.4 2024-08-08T23:53:42.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.4 2024-08-08T23:53:42.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 1 NOTICE: finished shard 4 (0 entries removed) 2024-08-08T23:53:42.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.5 2024-08-08T23:53:42.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.040+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.5 2024-08-08T23:53:42.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 1 NOTICE: finished shard 5 (0 entries removed) 2024-08-08T23:53:42.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.6 2024-08-08T23:53:42.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.6 2024-08-08T23:53:42.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 1 NOTICE: finished shard 6 (0 entries removed) 2024-08-08T23:53:42.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.7 2024-08-08T23:53:42.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.7 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 1 NOTICE: finished shard 7 (0 entries removed) 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.8 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.8 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 1 NOTICE: finished shard 8 (0 entries removed) 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.044+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.10 2024-08-08T23:53:42.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.10 2024-08-08T23:53:42.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 1 NOTICE: finished shard 10 (0 entries removed) 2024-08-08T23:53:42.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.11 2024-08-08T23:53:42.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.11 2024-08-08T23:53:42.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 1 NOTICE: finished shard 11 (0 entries removed) 2024-08-08T23:53:42.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.12 2024-08-08T23:53:42.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.048+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.12 2024-08-08T23:53:42.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 1 NOTICE: finished shard 12 (0 entries removed) 2024-08-08T23:53:42.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.13 2024-08-08T23:53:42.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.13 2024-08-08T23:53:42.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 1 NOTICE: finished shard 13 (0 entries removed) 2024-08-08T23:53:42.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.14 2024-08-08T23:53:42.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.14 2024-08-08T23:53:42.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 1 NOTICE: finished shard 14 (0 entries removed) 2024-08-08T23:53:42.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.15 2024-08-08T23:53:42.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.15 2024-08-08T23:53:42.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 1 NOTICE: finished shard 15 (0 entries removed) 2024-08-08T23:53:42.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 10 bucket_obj is .dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.16 2024-08-08T23:53:42.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.052+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.16 2024-08-08T23:53:42.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 1 NOTICE: finished shard 16 (0 entries removed) 2024-08-08T23:53:42.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:x state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to m0ckqlm1q6x7xrfikhzzariyxmrfm83s 2024-08-08T23:53:42.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 20 get_obj_state_impl: setting s->olh_tag to n1rt8a43k9vu6cbzzyh0iw3saw1qxdhh 2024-08-08T23:53:42.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.056+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1rt8a43k9vu6cbzzyh0iw3saw1qxdhh 2024-08-08T23:53:42.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.060+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-08-08T23:53:42.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=3 key=x[XEeHNZdaMvjs8PvG5lmak.Q181g2wod] 2024-08-08T23:53:42.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:XEeHNZdaMvjs8PvG5lmak.Q181g2wod_x state=0x55eb83d1feb8 s->prefetch_data=0 2024-08-08T23:53:42.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 10 manifest: total_size = 22 2024-08-08T23:53:42.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8143158869020433379 2024-08-08T23:53:42.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:XEeHNZdaMvjs8PvG5lmak.Q181g2wod_x state=0x55eb83d1feb8 s->prefetch_data=0 2024-08-08T23:53:42.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 prepare_atomic_modification: state is not atomic. state=0x55eb83d1feb8 2024-08-08T23:53:42.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.064+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.076+0000 7f6282ffd640 20 handle_completion(): completion ok for obj=x[XEeHNZdaMvjs8PvG5lmak.Q181g2wod] 2024-08-08T23:53:42.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.076+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:x state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.076+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1rt8a43k9vu6cbzzyh0iw3saw1qxdhh 2024-08-08T23:53:42.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.084+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.084+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.088+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.088+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:y state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.088+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to cpy29yvd1rdmoqug324c3zwtizlbalzk 2024-08-08T23:53:42.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.088+0000 7f63a16c7980 20 get_obj_state_impl: setting s->olh_tag to ywoa1h5rnja8ha6bbq3iq0sjmuctuz9z 2024-08-08T23:53:42.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.088+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ywoa1h5rnja8ha6bbq3iq0sjmuctuz9z 2024-08-08T23:53:42.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.092+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-08-08T23:53:42.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=3 key=y[kq0c4OVDGF1L9MD6lBQ0T7mX5oV47a2] 2024-08-08T23:53:42.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:kq0c4OVDGF1L9MD6lBQ0T7mX5oV47a2_y state=0x55eb83d20a28 s->prefetch_data=0 2024-08-08T23:53:42.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 10 manifest: total_size = 22 2024-08-08T23:53:42.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17444058049516384398 2024-08-08T23:53:42.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:kq0c4OVDGF1L9MD6lBQ0T7mX5oV47a2_y state=0x55eb83d20a28 s->prefetch_data=0 2024-08-08T23:53:42.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 prepare_atomic_modification: state is not atomic. state=0x55eb83d20a28 2024-08-08T23:53:42.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.096+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.104+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:y state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.104+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ywoa1h5rnja8ha6bbq3iq0sjmuctuz9z 2024-08-08T23:53:42.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.104+0000 7f6282ffd640 20 handle_completion(): completion ok for obj=y[kq0c4OVDGF1L9MD6lBQ0T7mX5oV47a2] 2024-08-08T23:53:42.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.112+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.112+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.116+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.116+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:z state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.116+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to j72jqptao6m73mhjzegymwdmqhzftgs6 2024-08-08T23:53:42.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.116+0000 7f63a16c7980 20 get_obj_state_impl: setting s->olh_tag to dd2eonsz5lz3uwbu0xzqzcq8hik9hpef 2024-08-08T23:53:42.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.116+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dd2eonsz5lz3uwbu0xzqzcq8hik9hpef 2024-08-08T23:53:42.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.120+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 olh_log_entry: epoch=2 op=3 key=z[X3.fuhj4dsthYe8OHjjUi6NDOSq6iVz] 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:X3.fuhj4dsthYe8OHjjUi6NDOSq6iVz_z state=0x55eb83d1fa18 s->prefetch_data=0 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 10 manifest: total_size = 12 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 get_obj_state: setting s->obj_tag to 24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9969928130153855985 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:_:X3.fuhj4dsthYe8OHjjUi6NDOSq6iVz_z state=0x55eb83d1fa18 s->prefetch_data=0 2024-08-08T23:53:42.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 prepare_atomic_modification: state is not atomic. state=0x55eb83d1fa18 2024-08-08T23:53:42.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.124+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.132+0000 7f63a16c7980 20 get_obj_state: octx=0x55eb83a42c80 obj=myver:z state=0x55eb83ce8778 s->prefetch_data=0 2024-08-08T23:53:42.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.132+0000 7f63a16c7980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dd2eonsz5lz3uwbu0xzqzcq8hik9hpef 2024-08-08T23:53:42.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.132+0000 7f62827fc640 20 handle_completion(): completion ok for obj=z[X3.fuhj4dsthYe8OHjjUi6NDOSq6iVz] 2024-08-08T23:53:42.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.140+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.144+0000 7f63a16c7980 20 bucket index object: :.dir.24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.19.3.9 2024-08-08T23:53:42.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.144+0000 7f63a16c7980 1 NOTICE: finished shard 9 (3 entries removed) 2024-08-08T23:53:42.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.144+0000 7f63a16c7980 1 NOTICE: finished all shards (3 entries removed) 2024-08-08T23:53:42.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.144+0000 7f6255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:42.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.148+0000 7f63a16c7980 20 remove_watcher() i=0 2024-08-08T23:53:42.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.148+0000 7f63a16c7980 2 removed watcher, disabling cache 2024-08-08T23:53:42.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.152+0000 7f63a16c7980 20 remove_watcher() i=1 2024-08-08T23:53:42.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.156+0000 7f63a16c7980 20 remove_watcher() i=2 2024-08-08T23:53:42.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.156+0000 7f63a16c7980 20 remove_watcher() i=3 2024-08-08T23:53:42.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.160+0000 7f63a16c7980 20 remove_watcher() i=4 2024-08-08T23:53:42.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.160+0000 7f63a16c7980 20 remove_watcher() i=5 2024-08-08T23:53:42.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.164+0000 7f63a16c7980 20 remove_watcher() i=6 2024-08-08T23:53:42.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.164+0000 7f63a16c7980 20 remove_watcher() i=7 2024-08-08T23:53:42.522 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-08-08T23:53:42.554 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:53:42.555 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:53:42.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 realm 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.604+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.608+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:42.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.608+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.608+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:53:42.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.608+0000 7f32246ba980 20 searching for the correct realm 2024-08-08T23:53:42.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.612+0000 7f32229cf640 0 -- 172.21.15.83:0/2298806277 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f32180f6040 msgr2=0x7f32180f6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:53:42.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.620+0000 7f32219cd640 0 -- 172.21.15.83:0/2298806277 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f321c07bdb0 msgr2=0x7f321c075040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:53:42.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.836+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 zone default found 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 4 Realm: () 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 zonegroup default 2024-08-08T23:53:42.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:53:42.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 started sync module instance, tier type = 2024-08-08T23:53:42.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.840+0000 7f32246ba980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=0 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=1 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=2 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=3 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=4 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=5 2024-08-08T23:53:42.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.864+0000 7f32246ba980 20 add_watcher() i=6 2024-08-08T23:53:42.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.868+0000 7f32246ba980 20 add_watcher() i=7 2024-08-08T23:53:42.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.868+0000 7f32246ba980 2 all 8 watchers are set, enabling cache 2024-08-08T23:53:42.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f30d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:42.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:53:42.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:53:42.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 5 note: GC not initialized 2024-08-08T23:53:42.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f30537fe640 20 reqs_thread_entry: start 2024-08-08T23:53:42.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 init_complete bucket index max shards: 1 2024-08-08T23:53:42.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 Filter name: none 2024-08-08T23:53:42.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f30517fa640 20 reqs_thread_entry: start 2024-08-08T23:53:42.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:42.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.872+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:42.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:42.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=197 2024-08-08T23:53:42.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 rados->read ofs=0 len=0 2024-08-08T23:53:42.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 rados_obj.operate() r=0 bl.length=411 2024-08-08T23:53:42.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.876+0000 7f32246ba980 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-08T23:53:42.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.880+0000 7f30d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:53:42.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.884+0000 7f32246ba980 20 remove_watcher() i=0 2024-08-08T23:53:42.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.884+0000 7f32246ba980 2 removed watcher, disabling cache 2024-08-08T23:53:42.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.888+0000 7f32246ba980 20 remove_watcher() i=1 2024-08-08T23:53:42.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.888+0000 7f32246ba980 20 remove_watcher() i=2 2024-08-08T23:53:42.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.892+0000 7f32246ba980 20 remove_watcher() i=3 2024-08-08T23:53:42.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.892+0000 7f32246ba980 20 remove_watcher() i=4 2024-08-08T23:53:42.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.896+0000 7f32246ba980 20 remove_watcher() i=5 2024-08-08T23:53:42.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.896+0000 7f32246ba980 20 remove_watcher() i=6 2024-08-08T23:53:42.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-08-08T23:53:42.896+0000 7f32246ba980 20 remove_watcher() i=7 2024-08-08T23:53:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-08-08T23:53:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket a-bucket 2024-08-08T23:53:43.087 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket myver 2024-08-08T23:53:43.678 INFO:tasks.workunit.client.0.smithi083.stderr:Completed resharding tests 2024-08-08T23:53:43.679 INFO:tasks.workunit.client.0.smithi083.stdout:connected to http://localhost:80 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-08-08T23:53:43.786 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-08T23:53:43.787 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-08T23:53:43.787 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-08-08T23:53:43.787 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-08-08T23:53:43.788 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-08-08T23:53:43.788 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-08T23:53:43.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-08T23:53:43.842 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-08-08T23:53:43.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-08T23:53:44.276 DEBUG:teuthology.parallel:result is None 2024-08-08T23:53:44.277 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:53:44.287 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:53:44.288 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-08T23:53:44.334 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-08T23:53:44.335 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-08-08T23:53:44.350 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-08-08T23:53:44.350 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-08-08T23:53:44.351 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-08-08T23:53:44.351 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b ceph-squid https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-08-08T23:53:44.382 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-08-08T23:53:48.862 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-08-08T23:53:48.863 DEBUG:teuthology.orchestra.run.smithi083:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-08-08T23:53:48.956 INFO:teuthology.orchestra.run.smithi083.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-08-08T23:53:49.017 INFO:teuthology.orchestra.run.smithi083.stdout:Reading package lists... 2024-08-08T23:53:49.231 INFO:teuthology.orchestra.run.smithi083.stdout:Building dependency tree... 2024-08-08T23:53:49.232 INFO:teuthology.orchestra.run.smithi083.stdout:Reading state information... 2024-08-08T23:53:49.432 INFO:teuthology.orchestra.run.smithi083.stdout:The following packages were automatically installed and are no longer required: 2024-08-08T23:53:49.432 INFO:teuthology.orchestra.run.smithi083.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-08T23:53:49.432 INFO:teuthology.orchestra.run.smithi083.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-08T23:53:49.432 INFO:teuthology.orchestra.run.smithi083.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-08T23:53:49.433 INFO:teuthology.orchestra.run.smithi083.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-08T23:53:49.433 INFO:teuthology.orchestra.run.smithi083.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-08T23:53:49.433 INFO:teuthology.orchestra.run.smithi083.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-08T23:53:49.434 INFO:teuthology.orchestra.run.smithi083.stdout:The following additional packages will be installed: 2024-08-08T23:53:49.435 INFO:teuthology.orchestra.run.smithi083.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-08-08T23:53:49.435 INFO:teuthology.orchestra.run.smithi083.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-08-08T23:53:49.437 INFO:teuthology.orchestra.run.smithi083.stdout:Suggested packages: 2024-08-08T23:53:49.437 INFO:teuthology.orchestra.run.smithi083.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-08-08T23:53:49.437 INFO:teuthology.orchestra.run.smithi083.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-08-08T23:53:49.437 INFO:teuthology.orchestra.run.smithi083.stdout: fonts-wqy-zenhei fonts-indic 2024-08-08T23:53:49.470 INFO:teuthology.orchestra.run.smithi083.stdout:The following NEW packages will be installed: 2024-08-08T23:53:49.471 INFO:teuthology.orchestra.run.smithi083.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-08-08T23:53:49.471 INFO:teuthology.orchestra.run.smithi083.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-08-08T23:53:49.522 INFO:teuthology.orchestra.run.smithi083.stdout:0 upgraded, 9 newly installed, 0 to remove and 317 not upgraded. 2024-08-08T23:53:49.522 INFO:teuthology.orchestra.run.smithi083.stdout:Need to get 46.0 MB of archives. 2024-08-08T23:53:49.522 INFO:teuthology.orchestra.run.smithi083.stdout:After this operation, 155 MB of additional disk space will be used. 2024-08-08T23:53:49.522 INFO:teuthology.orchestra.run.smithi083.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-08-08T23:53:49.599 INFO:teuthology.orchestra.run.smithi083.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-08-08T23:53:49.682 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-08-08T23:53:49.682 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-08-08T23:53:49.685 INFO:teuthology.orchestra.run.smithi083.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-08-08T23:53:49.686 INFO:teuthology.orchestra.run.smithi083.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-08-08T23:53:50.065 INFO:teuthology.orchestra.run.smithi083.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-08-08T23:53:50.066 INFO:teuthology.orchestra.run.smithi083.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-08-08T23:53:50.135 INFO:teuthology.orchestra.run.smithi083.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-08-08T23:53:50.515 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: unable to initialize frontend: Dialog 2024-08-08T23:53:50.515 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-08-08T23:53:50.516 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: falling back to frontend: Readline 2024-08-08T23:53:50.532 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: unable to initialize frontend: Readline 2024-08-08T23:53:50.532 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: (This frontend requires a controlling tty.) 2024-08-08T23:53:50.532 INFO:teuthology.orchestra.run.smithi083.stderr:debconf: falling back to frontend: Teletype 2024-08-08T23:53:50.535 INFO:teuthology.orchestra.run.smithi083.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-08-08T23:53:50.570 INFO:teuthology.orchestra.run.smithi083.stdout:Fetched 46.0 MB in 1s (62.5 MB/s) 2024-08-08T23:53:50.683 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgtk2.0-common. 2024-08-08T23:53:50.775 INFO:teuthology.orchestra.run.smithi083.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174886 files and directories currently installed.) 2024-08-08T23:53:50.781 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-08-08T23:53:50.823 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:51.728 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-08-08T23:53:51.757 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-08T23:53:51.837 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgail18:amd64. 2024-08-08T23:53:52.278 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-08T23:53:52.316 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:52.536 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgail-common:amd64. 2024-08-08T23:53:52.552 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-08T23:53:52.594 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:52.871 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-08-08T23:53:52.888 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-08T23:53:52.929 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:53.291 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-08-08T23:53:53.319 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-08-08T23:53:53.353 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:54.930 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-08-08T23:53:54.958 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-08-08T23:53:55.022 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:55.452 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-08-08T23:53:55.481 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-08-08T23:53:55.514 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:56.256 INFO:teuthology.orchestra.run.smithi083.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-08-08T23:53:56.284 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-08-08T23:53:56.326 INFO:teuthology.orchestra.run.smithi083.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:56.702 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-08-08T23:53:57.832 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-08-08T23:53:57.859 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-08-08T23:53:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:58.399 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:58.785 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:58.895 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-08-08T23:53:58.963 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:53:59.053 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-08-08T23:53:59.083 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-08-08T23:53:59.110 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-08-08T23:53:59.135 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-08-08T23:53:59.260 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-08-08T23:53:59.405 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-08-08T23:53:59.531 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-08-08T23:53:59.624 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-08-08T23:53:59.675 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-08-08T23:53:59.726 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-08-08T23:53:59.752 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-08-08T23:53:59.779 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-08-08T23:53:59.834 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:53:59.951 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-08-08T23:54:00.078 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-08-08T23:54:00.169 INFO:teuthology.orchestra.run.smithi083.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-08-08T23:54:00.263 INFO:teuthology.orchestra.run.smithi083.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-08T23:54:00.390 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-08T23:54:01.441 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-08T23:54:01.533 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-08T23:54:01.827 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-08T23:54:02.312 INFO:teuthology.orchestra.run.smithi083.stdout: Gradle will be installed under /opt/gradle 2024-08-08T23:54:02.349 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-08-08 23:54:02-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-08-08T23:54:02.372 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-08-08T23:54:02.386 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-08-08T23:54:02.436 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-08-08T23:54:02.436 INFO:teuthology.orchestra.run.smithi083.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-08-08T23:54:02.436 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-08-08 23:54:02-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-08-08T23:54:02.437 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-08-08T23:54:02.447 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-08-08T23:54:02.542 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 302 Found 2024-08-08T23:54:02.542 INFO:teuthology.orchestra.run.smithi083.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240808%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240808T235402Z&X-Amz-Expires=300&X-Amz-Signature=952b6434c89542b4aaaafbf687491bc3f79b37333b4bfa256aa80c22ceff721d&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-08-08T23:54:02.542 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-08-08 23:54:02-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240808%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240808T235402Z&X-Amz-Expires=300&X-Amz-Signature=952b6434c89542b4aaaafbf687491bc3f79b37333b4bfa256aa80c22ceff721d&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-08-08T23:54:02.599 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.111.133, ... 2024-08-08T23:54:02.612 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-08-08T23:54:02.692 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-08T23:54:02.692 INFO:teuthology.orchestra.run.smithi083.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-08-08T23:54:02.692 INFO:teuthology.orchestra.run.smithi083.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-08-08T23:54:02.692 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-08T23:54:02.705 INFO:teuthology.orchestra.run.smithi083.stderr: 0K .......... .......... .......... .......... .......... 0% 3.78M 24s 2024-08-08T23:54:02.716 INFO:teuthology.orchestra.run.smithi083.stderr: 50K .......... .......... .......... .......... .......... 0% 4.03M 23s 2024-08-08T23:54:02.719 INFO:teuthology.orchestra.run.smithi083.stderr: 100K .......... .......... .......... .......... .......... 0% 20.5M 17s 2024-08-08T23:54:02.721 INFO:teuthology.orchestra.run.smithi083.stderr: 150K .......... .......... .......... .......... .......... 0% 17.5M 14s 2024-08-08T23:54:02.728 INFO:teuthology.orchestra.run.smithi083.stderr: 200K .......... .......... .......... .......... .......... 0% 7.03M 14s 2024-08-08T23:54:02.730 INFO:teuthology.orchestra.run.smithi083.stderr: 250K .......... .......... .......... .......... .......... 0% 29.7M 12s 2024-08-08T23:54:02.732 INFO:teuthology.orchestra.run.smithi083.stderr: 300K .......... .......... .......... .......... .......... 0% 23.9M 11s 2024-08-08T23:54:02.733 INFO:teuthology.orchestra.run.smithi083.stderr: 350K .......... .......... .......... .......... .......... 0% 47.5M 10s 2024-08-08T23:54:02.735 INFO:teuthology.orchestra.run.smithi083.stderr: 400K .......... .......... .......... .......... .......... 0% 30.9M 9s 2024-08-08T23:54:02.741 INFO:teuthology.orchestra.run.smithi083.stderr: 450K .......... .......... .......... .......... .......... 0% 8.51M 9s 2024-08-08T23:54:02.741 INFO:teuthology.orchestra.run.smithi083.stderr: 500K .......... .......... .......... .......... .......... 0% 121M 8s 2024-08-08T23:54:02.743 INFO:teuthology.orchestra.run.smithi083.stderr: 550K .......... .......... .......... .......... .......... 0% 31.7M 8s 2024-08-08T23:54:02.750 INFO:teuthology.orchestra.run.smithi083.stderr: 600K .......... .......... .......... .......... .......... 0% 45.3M 7s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 650K .......... .......... .......... .......... .......... 0% 65.2M 7s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 700K .......... .......... .......... .......... .......... 0% 63.3M 7s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 750K .......... .......... .......... .......... .......... 0% 134M 6s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 800K .......... .......... .......... .......... .......... 0% 51.6M 6s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 850K .......... .......... .......... .......... .......... 0% 109M 6s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 900K .......... .......... .......... .......... .......... 1% 54.2M 5s 2024-08-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi083.stderr: 950K .......... .......... .......... .......... .......... 1% 136M 5s 2024-08-08T23:54:04.072 INFO:teuthology.orchestra.run.smithi083.stderr: 1000K .......... .......... .......... .......... .......... 1% 9.72M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1050K .......... .......... .......... .......... .......... 1% 89.8M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1100K .......... .......... .......... .......... .......... 1% 63.5M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1150K .......... .......... .......... .......... .......... 1% 86.4M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1200K .......... .......... .......... .......... .......... 1% 90.5M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1250K .......... .......... .......... .......... .......... 1% 90.1M 5s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1300K .......... .......... .......... .......... .......... 1% 78.4M 4s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1350K .......... .......... .......... .......... .......... 1% 90.1M 4s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1400K .......... .......... .......... .......... .......... 1% 89.4M 4s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1450K .......... .......... .......... .......... .......... 1% 87.5M 4s 2024-08-08T23:54:04.073 INFO:teuthology.orchestra.run.smithi083.stderr: 1500K .......... .......... .......... .......... .......... 1% 70.7M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1550K .......... .......... .......... .......... .......... 1% 86.6M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1600K .......... .......... .......... .......... .......... 1% 83.0M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1650K .......... .......... .......... .......... .......... 1% 82.2M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1700K .......... .......... .......... .......... .......... 1% 81.2M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1750K .......... .......... .......... .......... .......... 1% 92.6M 4s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1800K .......... .......... .......... .......... .......... 1% 86.7M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1850K .......... .......... .......... .......... .......... 2% 92.9M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1900K .......... .......... .......... .......... .......... 2% 76.5M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 1950K .......... .......... .......... .......... .......... 2% 89.7M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 2000K .......... .......... .......... .......... .......... 2% 71.3M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 2050K .......... .......... .......... .......... .......... 2% 82.8M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 2100K .......... .......... .......... .......... .......... 2% 72.4M 3s 2024-08-08T23:54:04.074 INFO:teuthology.orchestra.run.smithi083.stderr: 2150K .......... .......... .......... .......... .......... 2% 88.2M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2200K .......... .......... .......... .......... .......... 2% 81.8M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2250K .......... .......... .......... .......... .......... 2% 84.4M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2300K .......... .......... .......... .......... .......... 2% 67.6M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2350K .......... .......... .......... .......... .......... 2% 78.1M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2400K .......... .......... .......... .......... .......... 2% 81.2M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2450K .......... .......... .......... .......... .......... 2% 78.1M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2500K .......... .......... .......... .......... .......... 2% 72.9M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2550K .......... .......... .......... .......... .......... 2% 79.9M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2600K .......... .......... .......... .......... .......... 2% 79.4M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2650K .......... .......... .......... .......... .......... 2% 82.4M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2700K .......... .......... .......... .......... .......... 2% 74.8M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2750K .......... .......... .......... .......... .......... 3% 89.0M 3s 2024-08-08T23:54:04.075 INFO:teuthology.orchestra.run.smithi083.stderr: 2800K .......... .......... .......... .......... .......... 3% 89.4M 3s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 2850K .......... .......... .......... .......... .......... 3% 91.3M 3s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 2900K .......... .......... .......... .......... .......... 3% 81.5M 3s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 2950K .......... .......... .......... .......... .......... 3% 91.1M 3s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3000K .......... .......... .......... .......... .......... 3% 88.1M 3s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3050K .......... .......... .......... .......... .......... 3% 83.0M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3100K .......... .......... .......... .......... .......... 3% 64.9M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3150K .......... .......... .......... .......... .......... 3% 83.2M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3200K .......... .......... .......... .......... .......... 3% 77.9M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3250K .......... .......... .......... .......... .......... 3% 79.9M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3300K .......... .......... .......... .......... .......... 3% 76.6M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3350K .......... .......... .......... .......... .......... 3% 76.5M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3400K .......... .......... .......... .......... .......... 3% 85.0M 2s 2024-08-08T23:54:04.076 INFO:teuthology.orchestra.run.smithi083.stderr: 3450K .......... .......... .......... .......... .......... 3% 78.9M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3500K .......... .......... .......... .......... .......... 3% 68.3M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3550K .......... .......... .......... .......... .......... 3% 82.4M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3600K .......... .......... .......... .......... .......... 3% 84.1M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3650K .......... .......... .......... .......... .......... 3% 80.9M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3700K .......... .......... .......... .......... .......... 4% 78.0M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3750K .......... .......... .......... .......... .......... 4% 88.5M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3800K .......... .......... .......... .......... .......... 4% 83.9M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3850K .......... .......... .......... .......... .......... 4% 90.4M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3900K .......... .......... .......... .......... .......... 4% 73.0M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 3950K .......... .......... .......... .......... .......... 4% 88.0M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 4000K .......... .......... .......... .......... .......... 4% 82.1M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 4050K .......... .......... .......... .......... .......... 4% 82.3M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 4100K .......... .......... .......... .......... .......... 4% 71.0M 2s 2024-08-08T23:54:04.077 INFO:teuthology.orchestra.run.smithi083.stderr: 4150K .......... .......... .......... .......... .......... 4% 85.2M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4200K .......... .......... .......... .......... .......... 4% 66.9M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4250K .......... .......... .......... .......... .......... 4% 85.0M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4300K .......... .......... .......... .......... .......... 4% 70.8M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4350K .......... .......... .......... .......... .......... 4% 81.2M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4400K .......... .......... .......... .......... .......... 4% 83.9M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4450K .......... .......... .......... .......... .......... 4% 83.8M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4500K .......... .......... .......... .......... .......... 4% 80.7M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4550K .......... .......... .......... .......... .......... 4% 92.8M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4600K .......... .......... .......... .......... .......... 5% 91.6M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4650K .......... .......... .......... .......... .......... 5% 94.9M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4700K .......... .......... .......... .......... .......... 5% 69.4M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4750K .......... .......... .......... .......... .......... 5% 139M 2s 2024-08-08T23:54:04.078 INFO:teuthology.orchestra.run.smithi083.stderr: 4800K .......... .......... .......... .......... .......... 5% 134M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 4850K .......... .......... .......... .......... .......... 5% 154M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 4900K .......... .......... .......... .......... .......... 5% 153M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 4950K .......... .......... .......... .......... .......... 5% 168M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5000K .......... .......... .......... .......... .......... 5% 165M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5050K .......... .......... .......... .......... .......... 5% 167M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5100K .......... .......... .......... .......... .......... 5% 140M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5150K .......... .......... .......... .......... .......... 5% 174M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5200K .......... .......... .......... .......... .......... 5% 168M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5250K .......... .......... .......... .......... .......... 5% 159M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5300K .......... .......... .......... .......... .......... 5% 132M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5350K .......... .......... .......... .......... .......... 5% 153M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5400K .......... .......... .......... .......... .......... 5% 161M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5450K .......... .......... .......... .......... .......... 5% 149M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5500K .......... .......... .......... .......... .......... 5% 147M 2s 2024-08-08T23:54:04.079 INFO:teuthology.orchestra.run.smithi083.stderr: 5550K .......... .......... .......... .......... .......... 6% 176M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5600K .......... .......... .......... .......... .......... 6% 169M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5650K .......... .......... .......... .......... .......... 6% 183M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5700K .......... .......... .......... .......... .......... 6% 151M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5750K .......... .......... .......... .......... .......... 6% 174M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5800K .......... .......... .......... .......... .......... 6% 172M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5850K .......... .......... .......... .......... .......... 6% 183M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5900K .......... .......... .......... .......... .......... 6% 141M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 5950K .......... .......... .......... .......... .......... 6% 168M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 6000K .......... .......... .......... .......... .......... 6% 174M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 6050K .......... .......... .......... .......... .......... 6% 168M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 6100K .......... .......... .......... .......... .......... 6% 153M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 6150K .......... .......... .......... .......... .......... 6% 177M 2s 2024-08-08T23:54:04.080 INFO:teuthology.orchestra.run.smithi083.stderr: 6200K .......... .......... .......... .......... .......... 6% 175M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6250K .......... .......... .......... .......... .......... 6% 206M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6300K .......... .......... .......... .......... .......... 6% 166M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6350K .......... .......... .......... .......... .......... 6% 207M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6400K .......... .......... .......... .......... .......... 6% 191M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6450K .......... .......... .......... .......... .......... 6% 201M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6500K .......... .......... .......... .......... .......... 7% 182M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6550K .......... .......... .......... .......... .......... 7% 190M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6600K .......... .......... .......... .......... .......... 7% 190M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6650K .......... .......... .......... .......... .......... 7% 201M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6700K .......... .......... .......... .......... .......... 7% 170M 2s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6750K .......... .......... .......... .......... .......... 7% 202M 1s 2024-08-08T23:54:04.081 INFO:teuthology.orchestra.run.smithi083.stderr: 6800K .......... .......... .......... .......... .......... 7% 193M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 6850K .......... .......... .......... .......... .......... 7% 188M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 6900K .......... .......... .......... .......... .......... 7% 179M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 6950K .......... .......... .......... .......... .......... 7% 170M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7000K .......... .......... .......... .......... .......... 7% 213M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7050K .......... .......... .......... .......... .......... 7% 208M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7100K .......... .......... .......... .......... .......... 7% 174M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7150K .......... .......... .......... .......... .......... 7% 213M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7200K .......... .......... .......... .......... .......... 7% 212M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7250K .......... .......... .......... .......... .......... 7% 208M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7300K .......... .......... .......... .......... .......... 7% 185M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7350K .......... .......... .......... .......... .......... 7% 213M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7400K .......... .......... .......... .......... .......... 8% 213M 1s 2024-08-08T23:54:04.082 INFO:teuthology.orchestra.run.smithi083.stderr: 7450K .......... .......... .......... .......... .......... 8% 219M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7500K .......... .......... .......... .......... .......... 8% 178M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7550K .......... .......... .......... .......... .......... 8% 178M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7600K .......... .......... .......... .......... .......... 8% 176M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7650K .......... .......... .......... .......... .......... 8% 184M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7700K .......... .......... .......... .......... .......... 8% 185M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7750K .......... .......... .......... .......... .......... 8% 229M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7800K .......... .......... .......... .......... .......... 8% 219M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7850K .......... .......... .......... .......... .......... 8% 222M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7900K .......... .......... .......... .......... .......... 8% 174M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 7950K .......... .......... .......... .......... .......... 8% 194M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 8000K .......... .......... .......... .......... .......... 8% 223M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 8050K .......... .......... .......... .......... .......... 8% 200M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 8100K .......... .......... .......... .......... .......... 8% 200M 1s 2024-08-08T23:54:04.083 INFO:teuthology.orchestra.run.smithi083.stderr: 8150K .......... .......... .......... .......... .......... 8% 225M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8200K .......... .......... .......... .......... .......... 8% 220M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8250K .......... .......... .......... .......... .......... 8% 206M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8300K .......... .......... .......... .......... .......... 8% 134M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8350K .......... .......... .......... .......... .......... 9% 221M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8400K .......... .......... .......... .......... .......... 9% 224M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8450K .......... .......... .......... .......... .......... 9% 207M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8500K .......... .......... .......... .......... .......... 9% 171M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8550K .......... .......... .......... .......... .......... 9% 203M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8600K .......... .......... .......... .......... .......... 9% 220M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8650K .......... .......... .......... .......... .......... 9% 210M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8700K .......... .......... .......... .......... .......... 9% 190M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8750K .......... .......... .......... .......... .......... 9% 236M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8800K .......... .......... .......... .......... .......... 9% 223M 1s 2024-08-08T23:54:04.084 INFO:teuthology.orchestra.run.smithi083.stderr: 8850K .......... .......... .......... .......... .......... 9% 213M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 8900K .......... .......... .......... .......... .......... 9% 215M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 8950K .......... .......... .......... .......... .......... 9% 222M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9000K .......... .......... .......... .......... .......... 9% 206M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9050K .......... .......... .......... .......... .......... 9% 215M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9100K .......... .......... .......... .......... .......... 9% 195M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9150K .......... .......... .......... .......... .......... 9% 239M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9200K .......... .......... .......... .......... .......... 9% 238M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9250K .......... .......... .......... .......... .......... 10% 190M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9300K .......... .......... .......... .......... .......... 10% 196M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9350K .......... .......... .......... .......... .......... 10% 223M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9400K .......... .......... .......... .......... .......... 10% 207M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9450K .......... .......... .......... .......... .......... 10% 219M 1s 2024-08-08T23:54:04.085 INFO:teuthology.orchestra.run.smithi083.stderr: 9500K .......... .......... .......... .......... .......... 10% 204M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9550K .......... .......... .......... .......... .......... 10% 240M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9600K .......... .......... .......... .......... .......... 10% 245M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9650K .......... .......... .......... .......... .......... 10% 249M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9700K .......... .......... .......... .......... .......... 10% 224M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9750K .......... .......... .......... .......... .......... 10% 245M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9800K .......... .......... .......... .......... .......... 10% 241M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9850K .......... .......... .......... .......... .......... 10% 253M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9900K .......... .......... .......... .......... .......... 10% 204M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 9950K .......... .......... .......... .......... .......... 10% 249M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 10000K .......... .......... .......... .......... .......... 10% 247M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 10050K .......... .......... .......... .......... .......... 10% 238M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 10100K .......... .......... .......... .......... .......... 10% 227M 1s 2024-08-08T23:54:04.086 INFO:teuthology.orchestra.run.smithi083.stderr: 10150K .......... .......... .......... .......... .......... 10% 253M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10200K .......... .......... .......... .......... .......... 11% 196M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10250K .......... .......... .......... .......... .......... 11% 242M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10300K .......... .......... .......... .......... .......... 11% 182M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10350K .......... .......... .......... .......... .......... 11% 165M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10400K .......... .......... .......... .......... .......... 11% 267M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10450K .......... .......... .......... .......... .......... 11% 275M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10500K .......... .......... .......... .......... .......... 11% 274M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10550K .......... .......... .......... .......... .......... 11% 234M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10600K .......... .......... .......... .......... .......... 11% 254M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10650K .......... .......... .......... .......... .......... 11% 240M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10700K .......... .......... .......... .......... .......... 11% 240M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10750K .......... .......... .......... .......... .......... 11% 205M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10800K .......... .......... .......... .......... .......... 11% 261M 1s 2024-08-08T23:54:04.087 INFO:teuthology.orchestra.run.smithi083.stderr: 10850K .......... .......... .......... .......... .......... 11% 268M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 10900K .......... .......... .......... .......... .......... 11% 272M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 10950K .......... .......... .......... .......... .......... 11% 244M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11000K .......... .......... .......... .......... .......... 11% 270M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11050K .......... .......... .......... .......... .......... 11% 194M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11100K .......... .......... .......... .......... .......... 12% 239M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11150K .......... .......... .......... .......... .......... 12% 236M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11200K .......... .......... .......... .......... .......... 12% 253M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11250K .......... .......... .......... .......... .......... 12% 236M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11300K .......... .......... .......... .......... .......... 12% 220M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11350K .......... .......... .......... .......... .......... 12% 224M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11400K .......... .......... .......... .......... .......... 12% 265M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11450K .......... .......... .......... .......... .......... 12% 277M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11500K .......... .......... .......... .......... .......... 12% 265M 1s 2024-08-08T23:54:04.088 INFO:teuthology.orchestra.run.smithi083.stderr: 11550K .......... .......... .......... .......... .......... 12% 232M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11600K .......... .......... .......... .......... .......... 12% 284M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11650K .......... .......... .......... .......... .......... 12% 288M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11700K .......... .......... .......... .......... .......... 12% 288M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11750K .......... .......... .......... .......... .......... 12% 238M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11800K .......... .......... .......... .......... .......... 12% 256M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11850K .......... .......... .......... .......... .......... 12% 266M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11900K .......... .......... .......... .......... .......... 12% 274M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 11950K .......... .......... .......... .......... .......... 12% 213M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 12000K .......... .......... .......... .......... .......... 12% 277M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 12050K .......... .......... .......... .......... .......... 13% 284M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 12100K .......... .......... .......... .......... .......... 13% 266M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 12150K .......... .......... .......... .......... .......... 13% 253M 1s 2024-08-08T23:54:04.089 INFO:teuthology.orchestra.run.smithi083.stderr: 12200K .......... .......... .......... .......... .......... 13% 287M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12250K .......... .......... .......... .......... .......... 13% 222M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12300K .......... .......... .......... .......... .......... 13% 228M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12350K .......... .......... .......... .......... .......... 13% 266M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12400K .......... .......... .......... .......... .......... 13% 181M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12450K .......... .......... .......... .......... .......... 13% 217M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12500K .......... .......... .......... .......... .......... 13% 290M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12550K .......... .......... .......... .......... .......... 13% 289M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12600K .......... .......... .......... .......... .......... 13% 287M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12650K .......... .......... .......... .......... .......... 13% 262M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12700K .......... .......... .......... .......... .......... 13% 20.7M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12750K .......... .......... .......... .......... .......... 13% 188M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12800K .......... .......... .......... .......... .......... 13% 252M 1s 2024-08-08T23:54:04.090 INFO:teuthology.orchestra.run.smithi083.stderr: 12850K .......... .......... .......... .......... .......... 13% 248M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 12900K .......... .......... .......... .......... .......... 13% 264M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 12950K .......... .......... .......... .......... .......... 13% 227M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13000K .......... .......... .......... .......... .......... 14% 211M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13050K .......... .......... .......... .......... .......... 14% 275M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13100K .......... .......... .......... .......... .......... 14% 297M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13150K .......... .......... .......... .......... .......... 14% 250M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13200K .......... .......... .......... .......... .......... 14% 262M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13250K .......... .......... .......... .......... .......... 14% 283M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13300K .......... .......... .......... .......... .......... 14% 264M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13350K .......... .......... .......... .......... .......... 14% 244M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13400K .......... .......... .......... .......... .......... 14% 307M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13450K .......... .......... .......... .......... .......... 14% 306M 1s 2024-08-08T23:54:04.091 INFO:teuthology.orchestra.run.smithi083.stderr: 13500K .......... .......... .......... .......... .......... 14% 300M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13550K .......... .......... .......... .......... .......... 14% 254M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13600K .......... .......... .......... .......... .......... 14% 284M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13650K .......... .......... .......... .......... .......... 14% 252M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13700K .......... .......... .......... .......... .......... 14% 264M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13750K .......... .......... .......... .......... .......... 14% 248M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13800K .......... .......... .......... .......... .......... 14% 285M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13850K .......... .......... .......... .......... .......... 14% 286M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13900K .......... .......... .......... .......... .......... 15% 284M 1s 2024-08-08T23:54:04.092 INFO:teuthology.orchestra.run.smithi083.stderr: 13950K .......... .......... .......... .......... .......... 15% 229M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14000K .......... .......... .......... .......... .......... 15% 268M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14050K .......... .......... .......... .......... .......... 15% 280M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14100K .......... .......... .......... .......... .......... 15% 284M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14150K .......... .......... .......... .......... .......... 15% 275M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14200K .......... .......... .......... .......... .......... 15% 285M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14250K .......... .......... .......... .......... .......... 15% 302M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14300K .......... .......... .......... .......... .......... 15% 278M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14350K .......... .......... .......... .......... .......... 15% 247M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14400K .......... .......... .......... .......... .......... 15% 336M 1s 2024-08-08T23:54:04.094 INFO:teuthology.orchestra.run.smithi083.stderr: 14450K .......... .......... .......... .......... .......... 15% 243M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14500K .......... .......... .......... .......... .......... 15% 270M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14550K .......... .......... .......... .......... .......... 15% 227M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14600K .......... .......... .......... .......... .......... 15% 265M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14650K .......... .......... .......... .......... .......... 15% 260M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14700K .......... .......... .......... .......... .......... 15% 302M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14750K .......... .......... .......... .......... .......... 15% 242M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14800K .......... .......... .......... .......... .......... 15% 301M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14850K .......... .......... .......... .......... .......... 16% 291M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14900K .......... .......... .......... .......... .......... 16% 298M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 14950K .......... .......... .......... .......... .......... 16% 209M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 15000K .......... .......... .......... .......... .......... 16% 255M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 15050K .......... .......... .......... .......... .......... 16% 281M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 15100K .......... .......... .......... .......... .......... 16% 234M 1s 2024-08-08T23:54:04.095 INFO:teuthology.orchestra.run.smithi083.stderr: 15150K .......... .......... .......... .......... .......... 16% 272M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15200K .......... .......... .......... .......... .......... 16% 305M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15250K .......... .......... .......... .......... .......... 16% 316M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15300K .......... .......... .......... .......... .......... 16% 314M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15350K .......... .......... .......... .......... .......... 16% 263M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15400K .......... .......... .......... .......... .......... 16% 312M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15450K .......... .......... .......... .......... .......... 16% 304M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15500K .......... .......... .......... .......... .......... 16% 23.9M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15550K .......... .......... .......... .......... .......... 16% 194M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15600K .......... .......... .......... .......... .......... 16% 281M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15650K .......... .......... .......... .......... .......... 16% 254M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15700K .......... .......... .......... .......... .......... 16% 287M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15750K .......... .......... .......... .......... .......... 17% 260M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15800K .......... .......... .......... .......... .......... 17% 261M 1s 2024-08-08T23:54:04.096 INFO:teuthology.orchestra.run.smithi083.stderr: 15850K .......... .......... .......... .......... .......... 17% 263M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 15900K .......... .......... .......... .......... .......... 17% 287M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 15950K .......... .......... .......... .......... .......... 17% 258M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16000K .......... .......... .......... .......... .......... 17% 286M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16050K .......... .......... .......... .......... .......... 17% 274M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16100K .......... .......... .......... .......... .......... 17% 274M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16150K .......... .......... .......... .......... .......... 17% 262M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16200K .......... .......... .......... .......... .......... 17% 286M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16250K .......... .......... .......... .......... .......... 17% 286M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16300K .......... .......... .......... .......... .......... 17% 292M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16350K .......... .......... .......... .......... .......... 17% 248M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16400K .......... .......... .......... .......... .......... 17% 311M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16450K .......... .......... .......... .......... .......... 17% 309M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16500K .......... .......... .......... .......... .......... 17% 201M 1s 2024-08-08T23:54:04.097 INFO:teuthology.orchestra.run.smithi083.stderr: 16550K .......... .......... .......... .......... .......... 17% 271M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16600K .......... .......... .......... .......... .......... 17% 250M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16650K .......... .......... .......... .......... .......... 17% 249M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16700K .......... .......... .......... .......... .......... 18% 272M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16750K .......... .......... .......... .......... .......... 18% 265M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16800K .......... .......... .......... .......... .......... 18% 271M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16850K .......... .......... .......... .......... .......... 18% 267M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16900K .......... .......... .......... .......... .......... 18% 265M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 16950K .......... .......... .......... .......... .......... 18% 255M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 17000K .......... .......... .......... .......... .......... 18% 285M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 17050K .......... .......... .......... .......... .......... 18% 301M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 17100K .......... .......... .......... .......... .......... 18% 284M 1s 2024-08-08T23:54:04.098 INFO:teuthology.orchestra.run.smithi083.stderr: 17150K .......... .......... .......... .......... .......... 18% 256M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17200K .......... .......... .......... .......... .......... 18% 307M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17250K .......... .......... .......... .......... .......... 18% 303M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17300K .......... .......... .......... .......... .......... 18% 282M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17350K .......... .......... .......... .......... .......... 18% 238M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17400K .......... .......... .......... .......... .......... 18% 274M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17450K .......... .......... .......... .......... .......... 18% 306M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17500K .......... .......... .......... .......... .......... 18% 288M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17550K .......... .......... .......... .......... .......... 18% 244M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17600K .......... .......... .......... .......... .......... 18% 292M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17650K .......... .......... .......... .......... .......... 19% 314M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17700K .......... .......... .......... .......... .......... 19% 304M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17750K .......... .......... .......... .......... .......... 19% 272M 1s 2024-08-08T23:54:04.099 INFO:teuthology.orchestra.run.smithi083.stderr: 17800K .......... .......... .......... .......... .......... 19% 93.5M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 17850K .......... .......... .......... .......... .......... 19% 250M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 17900K .......... .......... .......... .......... .......... 19% 210M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 17950K .......... .......... .......... .......... .......... 19% 209M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18000K .......... .......... .......... .......... .......... 19% 265M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18050K .......... .......... .......... .......... .......... 19% 268M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18100K .......... .......... .......... .......... .......... 19% 266M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18150K .......... .......... .......... .......... .......... 19% 228M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18200K .......... .......... .......... .......... .......... 19% 253M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18250K .......... .......... .......... .......... .......... 19% 238M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18300K .......... .......... .......... .......... .......... 19% 241M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18350K .......... .......... .......... .......... .......... 19% 211M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18400K .......... .......... .......... .......... .......... 19% 268M 1s 2024-08-08T23:54:04.100 INFO:teuthology.orchestra.run.smithi083.stderr: 18450K .......... .......... .......... .......... .......... 19% 271M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18500K .......... .......... .......... .......... .......... 19% 49.4M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18550K .......... .......... .......... .......... .......... 20% 199M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18600K .......... .......... .......... .......... .......... 20% 222M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18650K .......... .......... .......... .......... .......... 20% 210M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18700K .......... .......... .......... .......... .......... 20% 239M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18750K .......... .......... .......... .......... .......... 20% 213M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18800K .......... .......... .......... .......... .......... 20% 214M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18850K .......... .......... .......... .......... .......... 20% 251M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18900K .......... .......... .......... .......... .......... 20% 237M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 18950K .......... .......... .......... .......... .......... 20% 198M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 19000K .......... .......... .......... .......... .......... 20% 236M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 19050K .......... .......... .......... .......... .......... 20% 241M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 19100K .......... .......... .......... .......... .......... 20% 239M 1s 2024-08-08T23:54:04.101 INFO:teuthology.orchestra.run.smithi083.stderr: 19150K .......... .......... .......... .......... .......... 20% 189M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19200K .......... .......... .......... .......... .......... 20% 258M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19250K .......... .......... .......... .......... .......... 20% 253M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19300K .......... .......... .......... .......... .......... 20% 257M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19350K .......... .......... .......... .......... .......... 20% 217M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19400K .......... .......... .......... .......... .......... 20% 203M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19450K .......... .......... .......... .......... .......... 20% 243M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19500K .......... .......... .......... .......... .......... 21% 252M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19550K .......... .......... .......... .......... .......... 21% 215M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19600K .......... .......... .......... .......... .......... 21% 255M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19650K .......... .......... .......... .......... .......... 21% 238M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19700K .......... .......... .......... .......... .......... 21% 222M 1s 2024-08-08T23:54:04.102 INFO:teuthology.orchestra.run.smithi083.stderr: 19750K .......... .......... .......... .......... .......... 21% 207M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 19800K .......... .......... .......... .......... .......... 21% 244M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 19850K .......... .......... .......... .......... .......... 21% 255M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 19900K .......... .......... .......... .......... .......... 21% 238M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 19950K .......... .......... .......... .......... .......... 21% 210M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20000K .......... .......... .......... .......... .......... 21% 253M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20050K .......... .......... .......... .......... .......... 21% 213M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20100K .......... .......... .......... .......... .......... 21% 216M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20150K .......... .......... .......... .......... .......... 21% 205M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20200K .......... .......... .......... .......... .......... 21% 223M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20250K .......... .......... .......... .......... .......... 21% 227M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20300K .......... .......... .......... .......... .......... 21% 257M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20350K .......... .......... .......... .......... .......... 21% 191M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20400K .......... .......... .......... .......... .......... 22% 247M 1s 2024-08-08T23:54:04.103 INFO:teuthology.orchestra.run.smithi083.stderr: 20450K .......... .......... .......... .......... .......... 22% 250M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20500K .......... .......... .......... .......... .......... 22% 228M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20550K .......... .......... .......... .......... .......... 22% 205M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20600K .......... .......... .......... .......... .......... 22% 170M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20650K .......... .......... .......... .......... .......... 22% 203M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20700K .......... .......... .......... .......... .......... 22% 210M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20750K .......... .......... .......... .......... .......... 22% 256M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20800K .......... .......... .......... .......... .......... 22% 250M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20850K .......... .......... .......... .......... .......... 22% 226M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20900K .......... .......... .......... .......... .......... 22% 198M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 20950K .......... .......... .......... .......... .......... 22% 224M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 21000K .......... .......... .......... .......... .......... 22% 254M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 21050K .......... .......... .......... .......... .......... 22% 252M 1s 2024-08-08T23:54:04.104 INFO:teuthology.orchestra.run.smithi083.stderr: 21100K .......... .......... .......... .......... .......... 22% 214M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21150K .......... .......... .......... .......... .......... 22% 239M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21200K .......... .......... .......... .......... .......... 22% 254M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21250K .......... .......... .......... .......... .......... 22% 221M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21300K .......... .......... .......... .......... .......... 22% 201M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21350K .......... .......... .......... .......... .......... 23% 244M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21400K .......... .......... .......... .......... .......... 23% 250M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21450K .......... .......... .......... .......... .......... 23% 246M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21500K .......... .......... .......... .......... .......... 23% 205M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21550K .......... .......... .......... .......... .......... 23% 279M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21600K .......... .......... .......... .......... .......... 23% 259M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21650K .......... .......... .......... .......... .......... 23% 244M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21700K .......... .......... .......... .......... .......... 23% 235M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21750K .......... .......... .......... .......... .......... 23% 271M 1s 2024-08-08T23:54:04.105 INFO:teuthology.orchestra.run.smithi083.stderr: 21800K .......... .......... .......... .......... .......... 23% 236M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 21850K .......... .......... .......... .......... .......... 23% 259M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 21900K .......... .......... .......... .......... .......... 23% 192M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 21950K .......... .......... .......... .......... .......... 23% 257M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22000K .......... .......... .......... .......... .......... 23% 245M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22050K .......... .......... .......... .......... .......... 23% 272M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22100K .......... .......... .......... .......... .......... 23% 249M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22150K .......... .......... .......... .......... .......... 23% 265M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22200K .......... .......... .......... .......... .......... 23% 249M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22250K .......... .......... .......... .......... .......... 24% 215M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22300K .......... .......... .......... .......... .......... 24% 181M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22350K .......... .......... .......... .......... .......... 24% 247M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22400K .......... .......... .......... .......... .......... 24% 245M 1s 2024-08-08T23:54:04.106 INFO:teuthology.orchestra.run.smithi083.stderr: 22450K .......... .......... .......... .......... .......... 24% 287M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22500K .......... .......... .......... .......... .......... 24% 255M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22550K .......... .......... .......... .......... .......... 24% 261M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22600K .......... .......... .......... .......... .......... 24% 251M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22650K .......... .......... .......... .......... .......... 24% 246M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22700K .......... .......... .......... .......... .......... 24% 219M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22750K .......... .......... .......... .......... .......... 24% 283M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22800K .......... .......... .......... .......... .......... 24% 254M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22850K .......... .......... .......... .......... .......... 24% 274M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22900K .......... .......... .......... .......... .......... 24% 247M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 22950K .......... .......... .......... .......... .......... 24% 163M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 23000K .......... .......... .......... .......... .......... 24% 233M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 23050K .......... .......... .......... .......... .......... 24% 262M 1s 2024-08-08T23:54:04.107 INFO:teuthology.orchestra.run.smithi083.stderr: 23100K .......... .......... .......... .......... .......... 24% 222M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23150K .......... .......... .......... .......... .......... 24% 271M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23200K .......... .......... .......... .......... .......... 25% 255M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23250K .......... .......... .......... .......... .......... 25% 267M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23300K .......... .......... .......... .......... .......... 25% 257M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23350K .......... .......... .......... .......... .......... 25% 299M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23400K .......... .......... .......... .......... .......... 25% 77.3M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23450K .......... .......... .......... .......... .......... 25% 224M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23500K .......... .......... .......... .......... .......... 25% 206M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23550K .......... .......... .......... .......... .......... 25% 278M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23600K .......... .......... .......... .......... .......... 25% 286M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23650K .......... .......... .......... .......... .......... 25% 269M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23700K .......... .......... .......... .......... .......... 25% 252M 1s 2024-08-08T23:54:04.108 INFO:teuthology.orchestra.run.smithi083.stderr: 23750K .......... .......... .......... .......... .......... 25% 109M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 23800K .......... .......... .......... .......... .......... 25% 201M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 23850K .......... .......... .......... .......... .......... 25% 220M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 23900K .......... .......... .......... .......... .......... 25% 209M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 23950K .......... .......... .......... .......... .......... 25% 265M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24000K .......... .......... .......... .......... .......... 25% 263M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24050K .......... .......... .......... .......... .......... 25% 235M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24100K .......... .......... .......... .......... .......... 25% 114M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24150K .......... .......... .......... .......... .......... 26% 226M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24200K .......... .......... .......... .......... .......... 26% 238M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24250K .......... .......... .......... .......... .......... 26% 247M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24300K .......... .......... .......... .......... .......... 26% 215M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24350K .......... .......... .......... .......... .......... 26% 277M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24400K .......... .......... .......... .......... .......... 26% 257M 1s 2024-08-08T23:54:04.109 INFO:teuthology.orchestra.run.smithi083.stderr: 24450K .......... .......... .......... .......... .......... 26% 276M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24500K .......... .......... .......... .......... .......... 26% 211M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24550K .......... .......... .......... .......... .......... 26% 271M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24600K .......... .......... .......... .......... .......... 26% 268M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24650K .......... .......... .......... .......... .......... 26% 268M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24700K .......... .......... .......... .......... .......... 26% 155M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24750K .......... .......... .......... .......... .......... 26% 255M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24800K .......... .......... .......... .......... .......... 26% 235M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24850K .......... .......... .......... .......... .......... 26% 254M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24900K .......... .......... .......... .......... .......... 26% 232M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 24950K .......... .......... .......... .......... .......... 26% 270M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 25000K .......... .......... .......... .......... .......... 26% 254M 1s 2024-08-08T23:54:04.110 INFO:teuthology.orchestra.run.smithi083.stderr: 25050K .......... .......... .......... .......... .......... 27% 244M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25100K .......... .......... .......... .......... .......... 27% 193M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25150K .......... .......... .......... .......... .......... 27% 249M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25200K .......... .......... .......... .......... .......... 27% 246M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25250K .......... .......... .......... .......... .......... 27% 270M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25300K .......... .......... .......... .......... .......... 27% 250M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25350K .......... .......... .......... .......... .......... 27% 232M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25400K .......... .......... .......... .......... .......... 27% 224M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25450K .......... .......... .......... .......... .......... 27% 247M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25500K .......... .......... .......... .......... .......... 27% 225M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25550K .......... .......... .......... .......... .......... 27% 255M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25600K .......... .......... .......... .......... .......... 27% 240M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25650K .......... .......... .......... .......... .......... 27% 267M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25700K .......... .......... .......... .......... .......... 27% 239M 1s 2024-08-08T23:54:04.111 INFO:teuthology.orchestra.run.smithi083.stderr: 25750K .......... .......... .......... .......... .......... 27% 251M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 25800K .......... .......... .......... .......... .......... 27% 229M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 25850K .......... .......... .......... .......... .......... 27% 251M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 25900K .......... .......... .......... .......... .......... 27% 202M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 25950K .......... .......... .......... .......... .......... 27% 211M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26000K .......... .......... .......... .......... .......... 28% 244M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26050K .......... .......... .......... .......... .......... 28% 226M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26100K .......... .......... .......... .......... .......... 28% 250M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26150K .......... .......... .......... .......... .......... 28% 285M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26200K .......... .......... .......... .......... .......... 28% 276M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26250K .......... .......... .......... .......... .......... 28% 287M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26300K .......... .......... .......... .......... .......... 28% 213M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26350K .......... .......... .......... .......... .......... 28% 256M 1s 2024-08-08T23:54:04.112 INFO:teuthology.orchestra.run.smithi083.stderr: 26400K .......... .......... .......... .......... .......... 28% 236M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26450K .......... .......... .......... .......... .......... 28% 261M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26500K .......... .......... .......... .......... .......... 28% 260M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26550K .......... .......... .......... .......... .......... 28% 284M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26600K .......... .......... .......... .......... .......... 28% 272M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26650K .......... .......... .......... .......... .......... 28% 83.5M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26700K .......... .......... .......... .......... .......... 28% 218M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26750K .......... .......... .......... .......... .......... 28% 236M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26800K .......... .......... .......... .......... .......... 28% 283M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26850K .......... .......... .......... .......... .......... 28% 290M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26900K .......... .......... .......... .......... .......... 29% 245M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 26950K .......... .......... .......... .......... .......... 29% 120M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 27000K .......... .......... .......... .......... .......... 29% 231M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 27050K .......... .......... .......... .......... .......... 29% 263M 1s 2024-08-08T23:54:04.113 INFO:teuthology.orchestra.run.smithi083.stderr: 27100K .......... .......... .......... .......... .......... 29% 214M 1s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27150K .......... .......... .......... .......... .......... 29% 272M 1s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27200K .......... .......... .......... .......... .......... 29% 257M 1s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27250K .......... .......... .......... .......... .......... 29% 285M 1s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27300K .......... .......... .......... .......... .......... 29% 263M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27350K .......... .......... .......... .......... .......... 29% 272M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27400K .......... .......... .......... .......... .......... 29% 247M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27450K .......... .......... .......... .......... .......... 29% 277M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27500K .......... .......... .......... .......... .......... 29% 220M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27550K .......... .......... .......... .......... .......... 29% 265M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27600K .......... .......... .......... .......... .......... 29% 280M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27650K .......... .......... .......... .......... .......... 29% 259M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27700K .......... .......... .......... .......... .......... 29% 250M 0s 2024-08-08T23:54:04.114 INFO:teuthology.orchestra.run.smithi083.stderr: 27750K .......... .......... .......... .......... .......... 29% 274M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 27800K .......... .......... .......... .......... .......... 29% 295M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 27850K .......... .......... .......... .......... .......... 30% 296M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 27900K .......... .......... .......... .......... .......... 30% 77.0M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 27950K .......... .......... .......... .......... .......... 30% 262M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28000K .......... .......... .......... .......... .......... 30% 268M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28050K .......... .......... .......... .......... .......... 30% 268M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28100K .......... .......... .......... .......... .......... 30% 268M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28150K .......... .......... .......... .......... .......... 30% 294M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28200K .......... .......... .......... .......... .......... 30% 267M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28250K .......... .......... .......... .......... .......... 30% 260M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28300K .......... .......... .......... .......... .......... 30% 231M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28350K .......... .......... .......... .......... .......... 30% 279M 0s 2024-08-08T23:54:04.115 INFO:teuthology.orchestra.run.smithi083.stderr: 28400K .......... .......... .......... .......... .......... 30% 293M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28450K .......... .......... .......... .......... .......... 30% 271M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28500K .......... .......... .......... .......... .......... 30% 236M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28550K .......... .......... .......... .......... .......... 30% 297M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28600K .......... .......... .......... .......... .......... 30% 299M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28650K .......... .......... .......... .......... .......... 30% 247M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28700K .......... .......... .......... .......... .......... 30% 158M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28750K .......... .......... .......... .......... .......... 31% 219M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28800K .......... .......... .......... .......... .......... 31% 247M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28850K .......... .......... .......... .......... .......... 31% 256M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28900K .......... .......... .......... .......... .......... 31% 262M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 28950K .......... .......... .......... .......... .......... 31% 276M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 29000K .......... .......... .......... .......... .......... 31% 293M 0s 2024-08-08T23:54:04.116 INFO:teuthology.orchestra.run.smithi083.stderr: 29050K .......... .......... .......... .......... .......... 31% 255M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29100K .......... .......... .......... .......... .......... 31% 238M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29150K .......... .......... .......... .......... .......... 31% 223M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29200K .......... .......... .......... .......... .......... 31% 223M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29250K .......... .......... .......... .......... .......... 31% 256M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29300K .......... .......... .......... .......... .......... 31% 257M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29350K .......... .......... .......... .......... .......... 31% 256M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29400K .......... .......... .......... .......... .......... 31% 274M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29450K .......... .......... .......... .......... .......... 31% 285M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29500K .......... .......... .......... .......... .......... 31% 66.8M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29550K .......... .......... .......... .......... .......... 31% 235M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29600K .......... .......... .......... .......... .......... 31% 273M 0s 2024-08-08T23:54:04.117 INFO:teuthology.orchestra.run.smithi083.stderr: 29650K .......... .......... .......... .......... .......... 31% 300M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29700K .......... .......... .......... .......... .......... 32% 243M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29750K .......... .......... .......... .......... .......... 32% 277M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29800K .......... .......... .......... .......... .......... 32% 79.5M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29850K .......... .......... .......... .......... .......... 32% 153M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29900K .......... .......... .......... .......... .......... 32% 209M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 29950K .......... .......... .......... .......... .......... 32% 239M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30000K .......... .......... .......... .......... .......... 32% 272M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30050K .......... .......... .......... .......... .......... 32% 266M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30100K .......... .......... .......... .......... .......... 32% 263M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30150K .......... .......... .......... .......... .......... 32% 296M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30200K .......... .......... .......... .......... .......... 32% 249M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30250K .......... .......... .......... .......... .......... 32% 260M 0s 2024-08-08T23:54:04.118 INFO:teuthology.orchestra.run.smithi083.stderr: 30300K .......... .......... .......... .......... .......... 32% 213M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30350K .......... .......... .......... .......... .......... 32% 276M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30400K .......... .......... .......... .......... .......... 32% 293M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30450K .......... .......... .......... .......... .......... 32% 282M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30500K .......... .......... .......... .......... .......... 32% 246M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30550K .......... .......... .......... .......... .......... 32% 252M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30600K .......... .......... .......... .......... .......... 32% 293M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30650K .......... .......... .......... .......... .......... 33% 279M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30700K .......... .......... .......... .......... .......... 33% 267M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30750K .......... .......... .......... .......... .......... 33% 275M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30800K .......... .......... .......... .......... .......... 33% 302M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30850K .......... .......... .......... .......... .......... 33% 268M 0s 2024-08-08T23:54:04.119 INFO:teuthology.orchestra.run.smithi083.stderr: 30900K .......... .......... .......... .......... .......... 33% 257M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 30950K .......... .......... .......... .......... .......... 33% 267M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31000K .......... .......... .......... .......... .......... 33% 284M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31050K .......... .......... .......... .......... .......... 33% 304M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31100K .......... .......... .......... .......... .......... 33% 248M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31150K .......... .......... .......... .......... .......... 33% 100M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31200K .......... .......... .......... .......... .......... 33% 263M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31250K .......... .......... .......... .......... .......... 33% 274M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31300K .......... .......... .......... .......... .......... 33% 273M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31350K .......... .......... .......... .......... .......... 33% 283M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31400K .......... .......... .......... .......... .......... 33% 285M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31450K .......... .......... .......... .......... .......... 33% 302M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31500K .......... .......... .......... .......... .......... 33% 252M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31550K .......... .......... .......... .......... .......... 34% 276M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31600K .......... .......... .......... .......... .......... 34% 277M 0s 2024-08-08T23:54:04.120 INFO:teuthology.orchestra.run.smithi083.stderr: 31650K .......... .......... .......... .......... .......... 34% 240M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31700K .......... .......... .......... .......... .......... 34% 245M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31750K .......... .......... .......... .......... .......... 34% 262M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31800K .......... .......... .......... .......... .......... 34% 286M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31850K .......... .......... .......... .......... .......... 34% 299M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31900K .......... .......... .......... .......... .......... 34% 242M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 31950K .......... .......... .......... .......... .......... 34% 264M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32000K .......... .......... .......... .......... .......... 34% 256M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32050K .......... .......... .......... .......... .......... 34% 296M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32100K .......... .......... .......... .......... .......... 34% 247M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32150K .......... .......... .......... .......... .......... 34% 301M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32200K .......... .......... .......... .......... .......... 34% 296M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32250K .......... .......... .......... .......... .......... 34% 299M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32300K .......... .......... .......... .......... .......... 34% 224M 0s 2024-08-08T23:54:04.121 INFO:teuthology.orchestra.run.smithi083.stderr: 32350K .......... .......... .......... .......... .......... 34% 301M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32400K .......... .......... .......... .......... .......... 34% 64.8M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32450K .......... .......... .......... .......... .......... 34% 279M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32500K .......... .......... .......... .......... .......... 35% 260M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32550K .......... .......... .......... .......... .......... 35% 220M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32600K .......... .......... .......... .......... .......... 35% 256M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32650K .......... .......... .......... .......... .......... 35% 297M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32700K .......... .......... .......... .......... .......... 35% 90.2M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32750K .......... .......... .......... .......... .......... 35% 202M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32800K .......... .......... .......... .......... .......... 35% 292M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32850K .......... .......... .......... .......... .......... 35% 207M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32900K .......... .......... .......... .......... .......... 35% 305M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 32950K .......... .......... .......... .......... .......... 35% 296M 0s 2024-08-08T23:54:04.122 INFO:teuthology.orchestra.run.smithi083.stderr: 33000K .......... .......... .......... .......... .......... 35% 262M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33050K .......... .......... .......... .......... .......... 35% 311M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33100K .......... .......... .......... .......... .......... 35% 135M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33150K .......... .......... .......... .......... .......... 35% 245M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33200K .......... .......... .......... .......... .......... 35% 264M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33250K .......... .......... .......... .......... .......... 35% 304M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33300K .......... .......... .......... .......... .......... 35% 280M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33350K .......... .......... .......... .......... .......... 35% 293M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33400K .......... .......... .......... .......... .......... 36% 315M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33450K .......... .......... .......... .......... .......... 36% 155M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33500K .......... .......... .......... .......... .......... 36% 200M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33550K .......... .......... .......... .......... .......... 36% 309M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33600K .......... .......... .......... .......... .......... 36% 284M 0s 2024-08-08T23:54:04.123 INFO:teuthology.orchestra.run.smithi083.stderr: 33650K .......... .......... .......... .......... .......... 36% 316M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33700K .......... .......... .......... .......... .......... 36% 115M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33750K .......... .......... .......... .......... .......... 36% 256M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33800K .......... .......... .......... .......... .......... 36% 293M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33850K .......... .......... .......... .......... .......... 36% 282M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33900K .......... .......... .......... .......... .......... 36% 246M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 33950K .......... .......... .......... .......... .......... 36% 320M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34000K .......... .......... .......... .......... .......... 36% 114M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34050K .......... .......... .......... .......... .......... 36% 272M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34100K .......... .......... .......... .......... .......... 36% 242M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34150K .......... .......... .......... .......... .......... 36% 318M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34200K .......... .......... .......... .......... .......... 36% 288M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34250K .......... .......... .......... .......... .......... 36% 266M 0s 2024-08-08T23:54:04.124 INFO:teuthology.orchestra.run.smithi083.stderr: 34300K .......... .......... .......... .......... .......... 36% 237M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34350K .......... .......... .......... .......... .......... 37% 321M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34400K .......... .......... .......... .......... .......... 37% 293M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34450K .......... .......... .......... .......... .......... 37% 270M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34500K .......... .......... .......... .......... .......... 37% 247M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34550K .......... .......... .......... .......... .......... 37% 285M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34600K .......... .......... .......... .......... .......... 37% 315M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34650K .......... .......... .......... .......... .......... 37% 289M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34700K .......... .......... .......... .......... .......... 37% 217M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34750K .......... .......... .......... .......... .......... 37% 310M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34800K .......... .......... .......... .......... .......... 37% 313M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34850K .......... .......... .......... .......... .......... 37% 314M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34900K .......... .......... .......... .......... .......... 37% 202M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 34950K .......... .......... .......... .......... .......... 37% 270M 0s 2024-08-08T23:54:04.125 INFO:teuthology.orchestra.run.smithi083.stderr: 35000K .......... .......... .......... .......... .......... 37% 280M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35050K .......... .......... .......... .......... .......... 37% 311M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35100K .......... .......... .......... .......... .......... 37% 249M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35150K .......... .......... .......... .......... .......... 37% 269M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35200K .......... .......... .......... .......... .......... 37% 288M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35250K .......... .......... .......... .......... .......... 37% 306M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35300K .......... .......... .......... .......... .......... 38% 278M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35350K .......... .......... .......... .......... .......... 38% 74.1M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35400K .......... .......... .......... .......... .......... 38% 261M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35450K .......... .......... .......... .......... .......... 38% 265M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35500K .......... .......... .......... .......... .......... 38% 219M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35550K .......... .......... .......... .......... .......... 38% 307M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35600K .......... .......... .......... .......... .......... 38% 231M 0s 2024-08-08T23:54:04.126 INFO:teuthology.orchestra.run.smithi083.stderr: 35650K .......... .......... .......... .......... .......... 38% 92.2M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35700K .......... .......... .......... .......... .......... 38% 196M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35750K .......... .......... .......... .......... .......... 38% 295M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35800K .......... .......... .......... .......... .......... 38% 273M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35850K .......... .......... .......... .......... .......... 38% 271M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35900K .......... .......... .......... .......... .......... 38% 234M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 35950K .......... .......... .......... .......... .......... 38% 270M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36000K .......... .......... .......... .......... .......... 38% 295M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36050K .......... .......... .......... .......... .......... 38% 180M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36100K .......... .......... .......... .......... .......... 38% 241M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36150K .......... .......... .......... .......... .......... 38% 162M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36200K .......... .......... .......... .......... .......... 39% 278M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36250K .......... .......... .......... .......... .......... 39% 283M 0s 2024-08-08T23:54:04.127 INFO:teuthology.orchestra.run.smithi083.stderr: 36300K .......... .......... .......... .......... .......... 39% 247M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36350K .......... .......... .......... .......... .......... 39% 293M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36400K .......... .......... .......... .......... .......... 39% 293M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36450K .......... .......... .......... .......... .......... 39% 290M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36500K .......... .......... .......... .......... .......... 39% 274M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36550K .......... .......... .......... .......... .......... 39% 286M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36600K .......... .......... .......... .......... .......... 39% 289M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36650K .......... .......... .......... .......... .......... 39% 316M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36700K .......... .......... .......... .......... .......... 39% 119M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36750K .......... .......... .......... .......... .......... 39% 303M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36800K .......... .......... .......... .......... .......... 39% 303M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36850K .......... .......... .......... .......... .......... 39% 259M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36900K .......... .......... .......... .......... .......... 39% 281M 0s 2024-08-08T23:54:04.128 INFO:teuthology.orchestra.run.smithi083.stderr: 36950K .......... .......... .......... .......... .......... 39% 73.1M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37000K .......... .......... .......... .......... .......... 39% 272M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37050K .......... .......... .......... .......... .......... 39% 314M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37100K .......... .......... .......... .......... .......... 39% 240M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37150K .......... .......... .......... .......... .......... 40% 330M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37200K .......... .......... .......... .......... .......... 40% 280M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37250K .......... .......... .......... .......... .......... 40% 304M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37300K .......... .......... .......... .......... .......... 40% 269M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37350K .......... .......... .......... .......... .......... 40% 258M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37400K .......... .......... .......... .......... .......... 40% 301M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37450K .......... .......... .......... .......... .......... 40% 302M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37500K .......... .......... .......... .......... .......... 40% 262M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37550K .......... .......... .......... .......... .......... 40% 312M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37600K .......... .......... .......... .......... .......... 40% 249M 0s 2024-08-08T23:54:04.129 INFO:teuthology.orchestra.run.smithi083.stderr: 37650K .......... .......... .......... .......... .......... 40% 277M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37700K .......... .......... .......... .......... .......... 40% 289M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37750K .......... .......... .......... .......... .......... 40% 275M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37800K .......... .......... .......... .......... .......... 40% 311M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37850K .......... .......... .......... .......... .......... 40% 285M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37900K .......... .......... .......... .......... .......... 40% 245M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 37950K .......... .......... .......... .......... .......... 40% 321M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38000K .......... .......... .......... .......... .......... 40% 275M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38050K .......... .......... .......... .......... .......... 41% 221M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38100K .......... .......... .......... .......... .......... 41% 262M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38150K .......... .......... .......... .......... .......... 41% 269M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38200K .......... .......... .......... .......... .......... 41% 312M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38250K .......... .......... .......... .......... .......... 41% 68.8M 0s 2024-08-08T23:54:04.130 INFO:teuthology.orchestra.run.smithi083.stderr: 38300K .......... .......... .......... .......... .......... 41% 189M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38350K .......... .......... .......... .......... .......... 41% 291M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38400K .......... .......... .......... .......... .......... 41% 286M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38450K .......... .......... .......... .......... .......... 41% 295M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38500K .......... .......... .......... .......... .......... 41% 246M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38550K .......... .......... .......... .......... .......... 41% 295M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38600K .......... .......... .......... .......... .......... 41% 310M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38650K .......... .......... .......... .......... .......... 41% 179M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38700K .......... .......... .......... .......... .......... 41% 248M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38750K .......... .......... .......... .......... .......... 41% 275M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38800K .......... .......... .......... .......... .......... 41% 212M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38850K .......... .......... .......... .......... .......... 41% 142M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38900K .......... .......... .......... .......... .......... 41% 253M 0s 2024-08-08T23:54:04.131 INFO:teuthology.orchestra.run.smithi083.stderr: 38950K .......... .......... .......... .......... .......... 41% 302M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39000K .......... .......... .......... .......... .......... 42% 325M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39050K .......... .......... .......... .......... .......... 42% 273M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39100K .......... .......... .......... .......... .......... 42% 178M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39150K .......... .......... .......... .......... .......... 42% 282M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39200K .......... .......... .......... .......... .......... 42% 204M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39250K .......... .......... .......... .......... .......... 42% 289M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39300K .......... .......... .......... .......... .......... 42% 265M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39350K .......... .......... .......... .......... .......... 42% 258M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39400K .......... .......... .......... .......... .......... 42% 279M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39450K .......... .......... .......... .......... .......... 42% 320M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39500K .......... .......... .......... .......... .......... 42% 258M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39550K .......... .......... .......... .......... .......... 42% 198M 0s 2024-08-08T23:54:04.132 INFO:teuthology.orchestra.run.smithi083.stderr: 39600K .......... .......... .......... .......... .......... 42% 307M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39650K .......... .......... .......... .......... .......... 42% 296M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39700K .......... .......... .......... .......... .......... 42% 260M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39750K .......... .......... .......... .......... .......... 42% 122M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39800K .......... .......... .......... .......... .......... 42% 276M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39850K .......... .......... .......... .......... .......... 42% 315M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39900K .......... .......... .......... .......... .......... 43% 77.5M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 39950K .......... .......... .......... .......... .......... 43% 212M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40000K .......... .......... .......... .......... .......... 43% 302M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40050K .......... .......... .......... .......... .......... 43% 307M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40100K .......... .......... .......... .......... .......... 43% 218M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40150K .......... .......... .......... .......... .......... 43% 297M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40200K .......... .......... .......... .......... .......... 43% 330M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40250K .......... .......... .......... .......... .......... 43% 299M 0s 2024-08-08T23:54:04.133 INFO:teuthology.orchestra.run.smithi083.stderr: 40300K .......... .......... .......... .......... .......... 43% 251M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40350K .......... .......... .......... .......... .......... 43% 305M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40400K .......... .......... .......... .......... .......... 43% 329M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40450K .......... .......... .......... .......... .......... 43% 335M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40500K .......... .......... .......... .......... .......... 43% 144M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40550K .......... .......... .......... .......... .......... 43% 304M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40600K .......... .......... .......... .......... .......... 43% 295M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40650K .......... .......... .......... .......... .......... 43% 311M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40700K .......... .......... .......... .......... .......... 43% 280M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40750K .......... .......... .......... .......... .......... 43% 176M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40800K .......... .......... .......... .......... .......... 43% 263M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40850K .......... .......... .......... .......... .......... 44% 311M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40900K .......... .......... .......... .......... .......... 44% 305M 0s 2024-08-08T23:54:04.134 INFO:teuthology.orchestra.run.smithi083.stderr: 40950K .......... .......... .......... .......... .......... 44% 359M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41000K .......... .......... .......... .......... .......... 44% 299M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41050K .......... .......... .......... .......... .......... 44% 209M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41100K .......... .......... .......... .......... .......... 44% 260M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41150K .......... .......... .......... .......... .......... 44% 343M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41200K .......... .......... .......... .......... .......... 44% 68.3M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41250K .......... .......... .......... .......... .......... 44% 287M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41300K .......... .......... .......... .......... .......... 44% 292M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41350K .......... .......... .......... .......... .......... 44% 338M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41400K .......... .......... .......... .......... .......... 44% 311M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41450K .......... .......... .......... .......... .......... 44% 215M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41500K .......... .......... .......... .......... .......... 44% 265M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41550K .......... .......... .......... .......... .......... 44% 200M 0s 2024-08-08T23:54:04.135 INFO:teuthology.orchestra.run.smithi083.stderr: 41600K .......... .......... .......... .......... .......... 44% 286M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41650K .......... .......... .......... .......... .......... 44% 297M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41700K .......... .......... .......... .......... .......... 44% 287M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41750K .......... .......... .......... .......... .......... 44% 330M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41800K .......... .......... .......... .......... .......... 45% 334M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41850K .......... .......... .......... .......... .......... 45% 155M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41900K .......... .......... .......... .......... .......... 45% 180M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 41950K .......... .......... .......... .......... .......... 45% 247M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42000K .......... .......... .......... .......... .......... 45% 301M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42050K .......... .......... .......... .......... .......... 45% 321M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42100K .......... .......... .......... .......... .......... 45% 235M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42150K .......... .......... .......... .......... .......... 45% 281M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42200K .......... .......... .......... .......... .......... 45% 241M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42250K .......... .......... .......... .......... .......... 45% 341M 0s 2024-08-08T23:54:04.136 INFO:teuthology.orchestra.run.smithi083.stderr: 42300K .......... .......... .......... .......... .......... 45% 131M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42350K .......... .......... .......... .......... .......... 45% 281M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42400K .......... .......... .......... .......... .......... 45% 288M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42450K .......... .......... .......... .......... .......... 45% 315M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42500K .......... .......... .......... .......... .......... 45% 296M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42550K .......... .......... .......... .......... .......... 45% 301M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42600K .......... .......... .......... .......... .......... 45% 316M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42650K .......... .......... .......... .......... .......... 45% 243M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42700K .......... .......... .......... .......... .......... 46% 192M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42750K .......... .......... .......... .......... .......... 46% 304M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42800K .......... .......... .......... .......... .......... 46% 135M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42850K .......... .......... .......... .......... .......... 46% 314M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42900K .......... .......... .......... .......... .......... 46% 90.4M 0s 2024-08-08T23:54:04.137 INFO:teuthology.orchestra.run.smithi083.stderr: 42950K .......... .......... .......... .......... .......... 46% 243M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43000K .......... .......... .......... .......... .......... 46% 129M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43050K .......... .......... .......... .......... .......... 46% 297M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43100K .......... .......... .......... .......... .......... 46% 258M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43150K .......... .......... .......... .......... .......... 46% 280M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43200K .......... .......... .......... .......... .......... 46% 306M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43250K .......... .......... .......... .......... .......... 46% 334M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43300K .......... .......... .......... .......... .......... 46% 283M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43350K .......... .......... .......... .......... .......... 46% 321M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43400K .......... .......... .......... .......... .......... 46% 173M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43450K .......... .......... .......... .......... .......... 46% 273M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43500K .......... .......... .......... .......... .......... 46% 266M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43550K .......... .......... .......... .......... .......... 46% 157M 0s 2024-08-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi083.stderr: 43600K .......... .......... .......... .......... .......... 46% 322M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43650K .......... .......... .......... .......... .......... 47% 235M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43700K .......... .......... .......... .......... .......... 47% 250M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43750K .......... .......... .......... .......... .......... 47% 318M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43800K .......... .......... .......... .......... .......... 47% 307M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43850K .......... .......... .......... .......... .......... 47% 271M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43900K .......... .......... .......... .......... .......... 47% 243M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 43950K .......... .......... .......... .......... .......... 47% 339M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44000K .......... .......... .......... .......... .......... 47% 311M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44050K .......... .......... .......... .......... .......... 47% 306M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44100K .......... .......... .......... .......... .......... 47% 293M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44150K .......... .......... .......... .......... .......... 47% 346M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44200K .......... .......... .......... .......... .......... 47% 95.3M 0s 2024-08-08T23:54:04.139 INFO:teuthology.orchestra.run.smithi083.stderr: 44250K .......... .......... .......... .......... .......... 47% 146M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44300K .......... .......... .......... .......... .......... 47% 274M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44350K .......... .......... .......... .......... .......... 47% 318M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44400K .......... .......... .......... .......... .......... 47% 336M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44450K .......... .......... .......... .......... .......... 47% 164M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44500K .......... .......... .......... .......... .......... 47% 196M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44550K .......... .......... .......... .......... .......... 48% 312M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44600K .......... .......... .......... .......... .......... 48% 337M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44650K .......... .......... .......... .......... .......... 48% 305M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44700K .......... .......... .......... .......... .......... 48% 272M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44750K .......... .......... .......... .......... .......... 48% 224M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44800K .......... .......... .......... .......... .......... 48% 292M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44850K .......... .......... .......... .......... .......... 48% 300M 0s 2024-08-08T23:54:04.140 INFO:teuthology.orchestra.run.smithi083.stderr: 44900K .......... .......... .......... .......... .......... 48% 290M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 44950K .......... .......... .......... .......... .......... 48% 253M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45000K .......... .......... .......... .......... .......... 48% 251M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45050K .......... .......... .......... .......... .......... 48% 296M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45100K .......... .......... .......... .......... .......... 48% 185M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45150K .......... .......... .......... .......... .......... 48% 240M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45200K .......... .......... .......... .......... .......... 48% 303M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45250K .......... .......... .......... .......... .......... 48% 234M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45300K .......... .......... .......... .......... .......... 48% 249M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45350K .......... .......... .......... .......... .......... 48% 178M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45400K .......... .......... .......... .......... .......... 48% 258M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45450K .......... .......... .......... .......... .......... 48% 298M 0s 2024-08-08T23:54:04.141 INFO:teuthology.orchestra.run.smithi083.stderr: 45500K .......... .......... .......... .......... .......... 49% 257M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45550K .......... .......... .......... .......... .......... 49% 338M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45600K .......... .......... .......... .......... .......... 49% 210M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45650K .......... .......... .......... .......... .......... 49% 335M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45700K .......... .......... .......... .......... .......... 49% 313M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45750K .......... .......... .......... .......... .......... 49% 356M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45800K .......... .......... .......... .......... .......... 49% 144M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45850K .......... .......... .......... .......... .......... 49% 152M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45900K .......... .......... .......... .......... .......... 49% 128M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 45950K .......... .......... .......... .......... .......... 49% 137M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 46000K .......... .......... .......... .......... .......... 49% 216M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 46050K .......... .......... .......... .......... .......... 49% 169M 0s 2024-08-08T23:54:04.142 INFO:teuthology.orchestra.run.smithi083.stderr: 46100K .......... .......... .......... .......... .......... 49% 271M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46150K .......... .......... .......... .......... .......... 49% 314M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46200K .......... .......... .......... .......... .......... 49% 296M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46250K .......... .......... .......... .......... .......... 49% 283M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46300K .......... .......... .......... .......... .......... 49% 289M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46350K .......... .......... .......... .......... .......... 49% 72.7M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46400K .......... .......... .......... .......... .......... 49% 260M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46450K .......... .......... .......... .......... .......... 50% 318M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46500K .......... .......... .......... .......... .......... 50% 302M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46550K .......... .......... .......... .......... .......... 50% 338M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46600K .......... .......... .......... .......... .......... 50% 300M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46650K .......... .......... .......... .......... .......... 50% 288M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46700K .......... .......... .......... .......... .......... 50% 258M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46750K .......... .......... .......... .......... .......... 50% 350M 0s 2024-08-08T23:54:04.143 INFO:teuthology.orchestra.run.smithi083.stderr: 46800K .......... .......... .......... .......... .......... 50% 320M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 46850K .......... .......... .......... .......... .......... 50% 289M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 46900K .......... .......... .......... .......... .......... 50% 264M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 46950K .......... .......... .......... .......... .......... 50% 346M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47000K .......... .......... .......... .......... .......... 50% 311M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47050K .......... .......... .......... .......... .......... 50% 341M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47100K .......... .......... .......... .......... .......... 50% 140M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47150K .......... .......... .......... .......... .......... 50% 268M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47200K .......... .......... .......... .......... .......... 50% 292M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47250K .......... .......... .......... .......... .......... 50% 337M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47300K .......... .......... .......... .......... .......... 50% 134M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47350K .......... .......... .......... .......... .......... 51% 312M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47400K .......... .......... .......... .......... .......... 51% 329M 0s 2024-08-08T23:54:04.144 INFO:teuthology.orchestra.run.smithi083.stderr: 47450K .......... .......... .......... .......... .......... 51% 339M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47500K .......... .......... .......... .......... .......... 51% 165M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47550K .......... .......... .......... .......... .......... 51% 231M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47600K .......... .......... .......... .......... .......... 51% 281M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47650K .......... .......... .......... .......... .......... 51% 325M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47700K .......... .......... .......... .......... .......... 51% 298M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47750K .......... .......... .......... .......... .......... 51% 309M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47800K .......... .......... .......... .......... .......... 51% 350M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47850K .......... .......... .......... .......... .......... 51% 207M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47900K .......... .......... .......... .......... .......... 51% 261M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 47950K .......... .......... .......... .......... .......... 51% 329M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 48000K .......... .......... .......... .......... .......... 51% 165M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 48050K .......... .......... .......... .......... .......... 51% 310M 0s 2024-08-08T23:54:04.145 INFO:teuthology.orchestra.run.smithi083.stderr: 48100K .......... .......... .......... .......... .......... 51% 160M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48150K .......... .......... .......... .......... .......... 51% 298M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48200K .......... .......... .......... .......... .......... 51% 351M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48250K .......... .......... .......... .......... .......... 51% 177M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48300K .......... .......... .......... .......... .......... 52% 274M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48350K .......... .......... .......... .......... .......... 52% 340M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48400K .......... .......... .......... .......... .......... 52% 329M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48450K .......... .......... .......... .......... .......... 52% 176M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48500K .......... .......... .......... .......... .......... 52% 273M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48550K .......... .......... .......... .......... .......... 52% 255M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48600K .......... .......... .......... .......... .......... 52% 305M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48650K .......... .......... .......... .......... .......... 52% 157M 0s 2024-08-08T23:54:04.146 INFO:teuthology.orchestra.run.smithi083.stderr: 48700K .......... .......... .......... .......... .......... 52% 164M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 48750K .......... .......... .......... .......... .......... 52% 322M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 48800K .......... .......... .......... .......... .......... 52% 347M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 48850K .......... .......... .......... .......... .......... 52% 354M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 48900K .......... .......... .......... .......... .......... 52% 119M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 48950K .......... .......... .......... .......... .......... 52% 120M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49000K .......... .......... .......... .......... .......... 52% 309M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49050K .......... .......... .......... .......... .......... 52% 323M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49100K .......... .......... .......... .......... .......... 52% 107M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49150K .......... .......... .......... .......... .......... 52% 324M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49200K .......... .......... .......... .......... .......... 53% 164M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49250K .......... .......... .......... .......... .......... 53% 250M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49300K .......... .......... .......... .......... .......... 53% 88.0M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49350K .......... .......... .......... .......... .......... 53% 309M 0s 2024-08-08T23:54:04.147 INFO:teuthology.orchestra.run.smithi083.stderr: 49400K .......... .......... .......... .......... .......... 53% 340M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49450K .......... .......... .......... .......... .......... 53% 328M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49500K .......... .......... .......... .......... .......... 53% 315M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49550K .......... .......... .......... .......... .......... 53% 128M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49600K .......... .......... .......... .......... .......... 53% 305M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49650K .......... .......... .......... .......... .......... 53% 330M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49700K .......... .......... .......... .......... .......... 53% 275M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49750K .......... .......... .......... .......... .......... 53% 329M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49800K .......... .......... .......... .......... .......... 53% 330M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49850K .......... .......... .......... .......... .......... 53% 342M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49900K .......... .......... .......... .......... .......... 53% 294M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 49950K .......... .......... .......... .......... .......... 53% 357M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 50000K .......... .......... .......... .......... .......... 53% 323M 0s 2024-08-08T23:54:04.148 INFO:teuthology.orchestra.run.smithi083.stderr: 50050K .......... .......... .......... .......... .......... 53% 179M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50100K .......... .......... .......... .......... .......... 53% 237M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50150K .......... .......... .......... .......... .......... 54% 334M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50200K .......... .......... .......... .......... .......... 54% 244M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50250K .......... .......... .......... .......... .......... 54% 285M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50300K .......... .......... .......... .......... .......... 54% 287M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50350K .......... .......... .......... .......... .......... 54% 327M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50400K .......... .......... .......... .......... .......... 54% 324M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50450K .......... .......... .......... .......... .......... 54% 342M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50500K .......... .......... .......... .......... .......... 54% 298M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50550K .......... .......... .......... .......... .......... 54% 252M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50600K .......... .......... .......... .......... .......... 54% 148M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50650K .......... .......... .......... .......... .......... 54% 303M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50700K .......... .......... .......... .......... .......... 54% 300M 0s 2024-08-08T23:54:04.149 INFO:teuthology.orchestra.run.smithi083.stderr: 50750K .......... .......... .......... .......... .......... 54% 307M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 50800K .......... .......... .......... .......... .......... 54% 332M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 50850K .......... .......... .......... .......... .......... 54% 345M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 50900K .......... .......... .......... .......... .......... 54% 278M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 50950K .......... .......... .......... .......... .......... 54% 350M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51000K .......... .......... .......... .......... .......... 54% 147M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51050K .......... .......... .......... .......... .......... 55% 303M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51100K .......... .......... .......... .......... .......... 55% 238M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51150K .......... .......... .......... .......... .......... 55% 351M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51200K .......... .......... .......... .......... .......... 55% 83.0M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51250K .......... .......... .......... .......... .......... 55% 354M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51300K .......... .......... .......... .......... .......... 55% 241M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51350K .......... .......... .......... .......... .......... 55% 271M 0s 2024-08-08T23:54:04.150 INFO:teuthology.orchestra.run.smithi083.stderr: 51400K .......... .......... .......... .......... .......... 55% 335M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51450K .......... .......... .......... .......... .......... 55% 352M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51500K .......... .......... .......... .......... .......... 55% 339M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51550K .......... .......... .......... .......... .......... 55% 276M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51600K .......... .......... .......... .......... .......... 55% 353M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51650K .......... .......... .......... .......... .......... 55% 331M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51700K .......... .......... .......... .......... .......... 55% 70.3M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51750K .......... .......... .......... .......... .......... 55% 274M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51800K .......... .......... .......... .......... .......... 55% 317M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51850K .......... .......... .......... .......... .......... 55% 330M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51900K .......... .......... .......... .......... .......... 55% 352M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 51950K .......... .......... .......... .......... .......... 55% 193M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 52000K .......... .......... .......... .......... .......... 56% 121M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 52050K .......... .......... .......... .......... .......... 56% 319M 0s 2024-08-08T23:54:04.151 INFO:teuthology.orchestra.run.smithi083.stderr: 52100K .......... .......... .......... .......... .......... 56% 334M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52150K .......... .......... .......... .......... .......... 56% 157M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52200K .......... .......... .......... .......... .......... 56% 137M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52250K .......... .......... .......... .......... .......... 56% 82.4M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52300K .......... .......... .......... .......... .......... 56% 326M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52350K .......... .......... .......... .......... .......... 56% 255M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52400K .......... .......... .......... .......... .......... 56% 338M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52450K .......... .......... .......... .......... .......... 56% 112M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52500K .......... .......... .......... .......... .......... 56% 300M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52550K .......... .......... .......... .......... .......... 56% 299M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52600K .......... .......... .......... .......... .......... 56% 358M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52650K .......... .......... .......... .......... .......... 56% 208M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52700K .......... .......... .......... .......... .......... 56% 304M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52750K .......... .......... .......... .......... .......... 56% 292M 0s 2024-08-08T23:54:04.152 INFO:teuthology.orchestra.run.smithi083.stderr: 52800K .......... .......... .......... .......... .......... 56% 330M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 52850K .......... .......... .......... .......... .......... 56% 335M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 52900K .......... .......... .......... .......... .......... 56% 345M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 52950K .......... .......... .......... .......... .......... 57% 156M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53000K .......... .......... .......... .......... .......... 57% 330M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53050K .......... .......... .......... .......... .......... 57% 345M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53100K .......... .......... .......... .......... .......... 57% 265M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53150K .......... .......... .......... .......... .......... 57% 214M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53200K .......... .......... .......... .......... .......... 57% 314M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53250K .......... .......... .......... .......... .......... 57% 320M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53300K .......... .......... .......... .......... .......... 57% 363M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53350K .......... .......... .......... .......... .......... 57% 234M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53400K .......... .......... .......... .......... .......... 57% 304M 0s 2024-08-08T23:54:04.153 INFO:teuthology.orchestra.run.smithi083.stderr: 53450K .......... .......... .......... .......... .......... 57% 312M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53500K .......... .......... .......... .......... .......... 57% 348M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53550K .......... .......... .......... .......... .......... 57% 277M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53600K .......... .......... .......... .......... .......... 57% 336M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53650K .......... .......... .......... .......... .......... 57% 184M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53700K .......... .......... .......... .......... .......... 57% 20.6M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53750K .......... .......... .......... .......... .......... 57% 230M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53800K .......... .......... .......... .......... .......... 57% 328M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53850K .......... .......... .......... .......... .......... 58% 296M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53900K .......... .......... .......... .......... .......... 58% 351M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 53950K .......... .......... .......... .......... .......... 58% 267M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 54000K .......... .......... .......... .......... .......... 58% 302M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 54050K .......... .......... .......... .......... .......... 58% 324M 0s 2024-08-08T23:54:04.154 INFO:teuthology.orchestra.run.smithi083.stderr: 54100K .......... .......... .......... .......... .......... 58% 307M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54150K .......... .......... .......... .......... .......... 58% 288M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54200K .......... .......... .......... .......... .......... 58% 355M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54250K .......... .......... .......... .......... .......... 58% 371M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54300K .......... .......... .......... .......... .......... 58% 362M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54350K .......... .......... .......... .......... .......... 58% 246M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54400K .......... .......... .......... .......... .......... 58% 312M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54450K .......... .......... .......... .......... .......... 58% 343M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54500K .......... .......... .......... .......... .......... 58% 363M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54550K .......... .......... .......... .......... .......... 58% 313M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54600K .......... .......... .......... .......... .......... 58% 314M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54650K .......... .......... .......... .......... .......... 58% 332M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54700K .......... .......... .......... .......... .......... 58% 355M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54750K .......... .......... .......... .......... .......... 58% 308M 0s 2024-08-08T23:54:04.155 INFO:teuthology.orchestra.run.smithi083.stderr: 54800K .......... .......... .......... .......... .......... 59% 364M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 54850K .......... .......... .......... .......... .......... 59% 338M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 54900K .......... .......... .......... .......... .......... 59% 339M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 54950K .......... .......... .......... .......... .......... 59% 336M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55000K .......... .......... .......... .......... .......... 59% 361M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55050K .......... .......... .......... .......... .......... 59% 320M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55100K .......... .......... .......... .......... .......... 59% 363M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55150K .......... .......... .......... .......... .......... 59% 293M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55200K .......... .......... .......... .......... .......... 59% 356M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55250K .......... .......... .......... .......... .......... 59% 276M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55300K .......... .......... .......... .......... .......... 59% 235M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55350K .......... .......... .......... .......... .......... 59% 315M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55400K .......... .......... .......... .......... .......... 59% 60.4M 0s 2024-08-08T23:54:04.156 INFO:teuthology.orchestra.run.smithi083.stderr: 55450K .......... .......... .......... .......... .......... 59% 286M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55500K .......... .......... .......... .......... .......... 59% 289M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55550K .......... .......... .......... .......... .......... 59% 278M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55600K .......... .......... .......... .......... .......... 59% 329M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55650K .......... .......... .......... .......... .......... 59% 283M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55700K .......... .......... .......... .......... .......... 60% 353M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55750K .......... .......... .......... .......... .......... 60% 306M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55800K .......... .......... .......... .......... .......... 60% 367M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55850K .......... .......... .......... .......... .......... 60% 370M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55900K .......... .......... .......... .......... .......... 60% 318M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 55950K .......... .......... .......... .......... .......... 60% 279M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 56000K .......... .......... .......... .......... .......... 60% 361M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 56050K .......... .......... .......... .......... .......... 60% 327M 0s 2024-08-08T23:54:04.157 INFO:teuthology.orchestra.run.smithi083.stderr: 56100K .......... .......... .......... .......... .......... 60% 359M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56150K .......... .......... .......... .......... .......... 60% 213M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56200K .......... .......... .......... .......... .......... 60% 334M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56250K .......... .......... .......... .......... .......... 60% 367M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56300K .......... .......... .......... .......... .......... 60% 285M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56350K .......... .......... .......... .......... .......... 60% 209M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56400K .......... .......... .......... .......... .......... 60% 343M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56450K .......... .......... .......... .......... .......... 60% 326M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56500K .......... .......... .......... .......... .......... 60% 340M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56550K .......... .......... .......... .......... .......... 60% 325M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56600K .......... .......... .......... .......... .......... 60% 133M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56650K .......... .......... .......... .......... .......... 61% 342M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56700K .......... .......... .......... .......... .......... 61% 20.6M 0s 2024-08-08T23:54:04.158 INFO:teuthology.orchestra.run.smithi083.stderr: 56750K .......... .......... .......... .......... .......... 61% 244M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 56800K .......... .......... .......... .......... .......... 61% 332M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 56850K .......... .......... .......... .......... .......... 61% 248M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 56900K .......... .......... .......... .......... .......... 61% 312M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 56950K .......... .......... .......... .......... .......... 61% 293M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57000K .......... .......... .......... .......... .......... 61% 309M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57050K .......... .......... .......... .......... .......... 61% 337M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57100K .......... .......... .......... .......... .......... 61% 307M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57150K .......... .......... .......... .......... .......... 61% 259M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57200K .......... .......... .......... .......... .......... 61% 338M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57250K .......... .......... .......... .......... .......... 61% 347M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57300K .......... .......... .......... .......... .......... 61% 326M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57350K .......... .......... .......... .......... .......... 61% 319M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57400K .......... .......... .......... .......... .......... 61% 327M 0s 2024-08-08T23:54:04.159 INFO:teuthology.orchestra.run.smithi083.stderr: 57450K .......... .......... .......... .......... .......... 61% 245M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57500K .......... .......... .......... .......... .......... 61% 321M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57550K .......... .......... .......... .......... .......... 62% 245M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57600K .......... .......... .......... .......... .......... 62% 325M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57650K .......... .......... .......... .......... .......... 62% 324M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57700K .......... .......... .......... .......... .......... 62% 347M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57750K .......... .......... .......... .......... .......... 62% 301M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57800K .......... .......... .......... .......... .......... 62% 328M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57850K .......... .......... .......... .......... .......... 62% 355M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57900K .......... .......... .......... .......... .......... 62% 312M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 57950K .......... .......... .......... .......... .......... 62% 255M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 58000K .......... .......... .......... .......... .......... 62% 351M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 58050K .......... .......... .......... .......... .......... 62% 359M 0s 2024-08-08T23:54:04.160 INFO:teuthology.orchestra.run.smithi083.stderr: 58100K .......... .......... .......... .......... .......... 62% 316M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58150K .......... .......... .......... .......... .......... 62% 315M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58200K .......... .......... .......... .......... .......... 62% 323M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58250K .......... .......... .......... .......... .......... 62% 350M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58300K .......... .......... .......... .......... .......... 62% 353M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58350K .......... .......... .......... .......... .......... 62% 180M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58400K .......... .......... .......... .......... .......... 62% 308M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58450K .......... .......... .......... .......... .......... 62% 149M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58500K .......... .......... .......... .......... .......... 63% 115M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58550K .......... .......... .......... .......... .......... 63% 252M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58600K .......... .......... .......... .......... .......... 63% 330M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58650K .......... .......... .......... .......... .......... 63% 321M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58700K .......... .......... .......... .......... .......... 63% 327M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58750K .......... .......... .......... .......... .......... 63% 295M 0s 2024-08-08T23:54:04.161 INFO:teuthology.orchestra.run.smithi083.stderr: 58800K .......... .......... .......... .......... .......... 63% 314M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 58850K .......... .......... .......... .......... .......... 63% 332M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 58900K .......... .......... .......... .......... .......... 63% 329M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 58950K .......... .......... .......... .......... .......... 63% 316M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59000K .......... .......... .......... .......... .......... 63% 325M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59050K .......... .......... .......... .......... .......... 63% 323M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59100K .......... .......... .......... .......... .......... 63% 351M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59150K .......... .......... .......... .......... .......... 63% 287M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59200K .......... .......... .......... .......... .......... 63% 337M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59250K .......... .......... .......... .......... .......... 63% 217M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59300K .......... .......... .......... .......... .......... 63% 286M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59350K .......... .......... .......... .......... .......... 63% 258M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59400K .......... .......... .......... .......... .......... 63% 333M 0s 2024-08-08T23:54:04.162 INFO:teuthology.orchestra.run.smithi083.stderr: 59450K .......... .......... .......... .......... .......... 64% 351M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59500K .......... .......... .......... .......... .......... 64% 158M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59550K .......... .......... .......... .......... .......... 64% 264M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59600K .......... .......... .......... .......... .......... 64% 358M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59650K .......... .......... .......... .......... .......... 64% 359M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59700K .......... .......... .......... .......... .......... 64% 20.6M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59750K .......... .......... .......... .......... .......... 64% 283M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59800K .......... .......... .......... .......... .......... 64% 325M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59850K .......... .......... .......... .......... .......... 64% 343M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59900K .......... .......... .......... .......... .......... 64% 349M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 59950K .......... .......... .......... .......... .......... 64% 187M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 60000K .......... .......... .......... .......... .......... 64% 316M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 60050K .......... .......... .......... .......... .......... 64% 342M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 60100K .......... .......... .......... .......... .......... 64% 321M 0s 2024-08-08T23:54:04.163 INFO:teuthology.orchestra.run.smithi083.stderr: 60150K .......... .......... .......... .......... .......... 64% 326M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60200K .......... .......... .......... .......... .......... 64% 330M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60250K .......... .......... .......... .......... .......... 64% 349M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60300K .......... .......... .......... .......... .......... 64% 292M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60350K .......... .......... .......... .......... .......... 65% 272M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60400K .......... .......... .......... .......... .......... 65% 363M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60450K .......... .......... .......... .......... .......... 65% 334M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60500K .......... .......... .......... .......... .......... 65% 306M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60550K .......... .......... .......... .......... .......... 65% 303M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60600K .......... .......... .......... .......... .......... 65% 364M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60650K .......... .......... .......... .......... .......... 65% 345M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60700K .......... .......... .......... .......... .......... 65% 297M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60750K .......... .......... .......... .......... .......... 65% 261M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60800K .......... .......... .......... .......... .......... 65% 367M 0s 2024-08-08T23:54:04.164 INFO:teuthology.orchestra.run.smithi083.stderr: 60850K .......... .......... .......... .......... .......... 65% 177M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 60900K .......... .......... .......... .......... .......... 65% 309M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 60950K .......... .......... .......... .......... .......... 65% 294M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61000K .......... .......... .......... .......... .......... 65% 334M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61050K .......... .......... .......... .......... .......... 65% 326M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61100K .......... .......... .......... .......... .......... 65% 341M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61150K .......... .......... .......... .......... .......... 65% 278M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61200K .......... .......... .......... .......... .......... 65% 347M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61250K .......... .......... .......... .......... .......... 65% 355M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61300K .......... .......... .......... .......... .......... 66% 324M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61350K .......... .......... .......... .......... .......... 66% 296M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61400K .......... .......... .......... .......... .......... 66% 343M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61450K .......... .......... .......... .......... .......... 66% 268M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61500K .......... .......... .......... .......... .......... 66% 123M 0s 2024-08-08T23:54:04.165 INFO:teuthology.orchestra.run.smithi083.stderr: 61550K .......... .......... .......... .......... .......... 66% 213M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61600K .......... .......... .......... .......... .......... 66% 288M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61650K .......... .......... .......... .......... .......... 66% 345M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61700K .......... .......... .......... .......... .......... 66% 290M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61750K .......... .......... .......... .......... .......... 66% 143M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61800K .......... .......... .......... .......... .......... 66% 297M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61850K .......... .......... .......... .......... .......... 66% 328M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61900K .......... .......... .......... .......... .......... 66% 290M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 61950K .......... .......... .......... .......... .......... 66% 325M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 62000K .......... .......... .......... .......... .......... 66% 319M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 62050K .......... .......... .......... .......... .......... 66% 339M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 62100K .......... .......... .......... .......... .......... 66% 324M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 62150K .......... .......... .......... .......... .......... 66% 340M 0s 2024-08-08T23:54:04.166 INFO:teuthology.orchestra.run.smithi083.stderr: 62200K .......... .......... .......... .......... .......... 67% 319M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62250K .......... .......... .......... .......... .......... 67% 315M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62300K .......... .......... .......... .......... .......... 67% 285M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62350K .......... .......... .......... .......... .......... 67% 93.3M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62400K .......... .......... .......... .......... .......... 67% 208M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62450K .......... .......... .......... .......... .......... 67% 337M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62500K .......... .......... .......... .......... .......... 67% 296M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62550K .......... .......... .......... .......... .......... 67% 358M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62600K .......... .......... .......... .......... .......... 67% 378M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62650K .......... .......... .......... .......... .......... 67% 22.8M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62700K .......... .......... .......... .......... .......... 67% 187M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62750K .......... .......... .......... .......... .......... 67% 335M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62800K .......... .......... .......... .......... .......... 67% 330M 0s 2024-08-08T23:54:04.167 INFO:teuthology.orchestra.run.smithi083.stderr: 62850K .......... .......... .......... .......... .......... 67% 376M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 62900K .......... .......... .......... .......... .......... 67% 304M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 62950K .......... .......... .......... .......... .......... 67% 342M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63000K .......... .......... .......... .......... .......... 67% 357M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63050K .......... .......... .......... .......... .......... 67% 255M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63100K .......... .......... .......... .......... .......... 67% 256M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63150K .......... .......... .......... .......... .......... 68% 347M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63200K .......... .......... .......... .......... .......... 68% 314M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63250K .......... .......... .......... .......... .......... 68% 317M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63300K .......... .......... .......... .......... .......... 68% 311M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63350K .......... .......... .......... .......... .......... 68% 345M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63400K .......... .......... .......... .......... .......... 68% 318M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63450K .......... .......... .......... .......... .......... 68% 195M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63500K .......... .......... .......... .......... .......... 68% 270M 0s 2024-08-08T23:54:04.168 INFO:teuthology.orchestra.run.smithi083.stderr: 63550K .......... .......... .......... .......... .......... 68% 334M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63600K .......... .......... .......... .......... .......... 68% 341M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63650K .......... .......... .......... .......... .......... 68% 329M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63700K .......... .......... .......... .......... .......... 68% 328M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63750K .......... .......... .......... .......... .......... 68% 368M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63800K .......... .......... .......... .......... .......... 68% 171M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63850K .......... .......... .......... .......... .......... 68% 306M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63900K .......... .......... .......... .......... .......... 68% 248M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 63950K .......... .......... .......... .......... .......... 68% 303M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 64000K .......... .......... .......... .......... .......... 68% 328M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 64050K .......... .......... .......... .......... .......... 68% 314M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 64100K .......... .......... .......... .......... .......... 69% 314M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 64150K .......... .......... .......... .......... .......... 69% 365M 0s 2024-08-08T23:54:04.169 INFO:teuthology.orchestra.run.smithi083.stderr: 64200K .......... .......... .......... .......... .......... 69% 319M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64250K .......... .......... .......... .......... .......... 69% 327M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64300K .......... .......... .......... .......... .......... 69% 301M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64350K .......... .......... .......... .......... .......... 69% 338M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64400K .......... .......... .......... .......... .......... 69% 309M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64450K .......... .......... .......... .......... .......... 69% 331M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64500K .......... .......... .......... .......... .......... 69% 309M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64550K .......... .......... .......... .......... .......... 69% 249M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64600K .......... .......... .......... .......... .......... 69% 144M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64650K .......... .......... .......... .......... .......... 69% 318M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64700K .......... .......... .......... .......... .......... 69% 279M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64750K .......... .......... .......... .......... .......... 69% 360M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64800K .......... .......... .......... .......... .......... 69% 340M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64850K .......... .......... .......... .......... .......... 69% 104M 0s 2024-08-08T23:54:04.170 INFO:teuthology.orchestra.run.smithi083.stderr: 64900K .......... .......... .......... .......... .......... 69% 225M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 64950K .......... .......... .......... .......... .......... 69% 311M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65000K .......... .......... .......... .......... .......... 70% 316M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65050K .......... .......... .......... .......... .......... 70% 372M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65100K .......... .......... .......... .......... .......... 70% 305M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65150K .......... .......... .......... .......... .......... 70% 289M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65200K .......... .......... .......... .......... .......... 70% 309M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65250K .......... .......... .......... .......... .......... 70% 356M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65300K .......... .......... .......... .......... .......... 70% 324M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65350K .......... .......... .......... .......... .......... 70% 247M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65400K .......... .......... .......... .......... .......... 70% 336M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65450K .......... .......... .......... .......... .......... 70% 271M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65500K .......... .......... .......... .......... .......... 70% 273M 0s 2024-08-08T23:54:04.171 INFO:teuthology.orchestra.run.smithi083.stderr: 65550K .......... .......... .......... .......... .......... 70% 22.9M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65600K .......... .......... .......... .......... .......... 70% 316M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65650K .......... .......... .......... .......... .......... 70% 285M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65700K .......... .......... .......... .......... .......... 70% 327M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65750K .......... .......... .......... .......... .......... 70% 316M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65800K .......... .......... .......... .......... .......... 70% 315M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65850K .......... .......... .......... .......... .......... 70% 235M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65900K .......... .......... .......... .......... .......... 70% 144M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 65950K .......... .......... .......... .......... .......... 71% 333M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 66000K .......... .......... .......... .......... .......... 71% 348M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 66050K .......... .......... .......... .......... .......... 71% 282M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 66100K .......... .......... .......... .......... .......... 71% 308M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 66150K .......... .......... .......... .......... .......... 71% 369M 0s 2024-08-08T23:54:04.172 INFO:teuthology.orchestra.run.smithi083.stderr: 66200K .......... .......... .......... .......... .......... 71% 250M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66250K .......... .......... .......... .......... .......... 71% 322M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66300K .......... .......... .......... .......... .......... 71% 303M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66350K .......... .......... .......... .......... .......... 71% 370M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66400K .......... .......... .......... .......... .......... 71% 111M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66450K .......... .......... .......... .......... .......... 71% 326M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66500K .......... .......... .......... .......... .......... 71% 299M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66550K .......... .......... .......... .......... .......... 71% 330M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66600K .......... .......... .......... .......... .......... 71% 366M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66650K .......... .......... .......... .......... .......... 71% 373M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66700K .......... .......... .......... .......... .......... 71% 130M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66750K .......... .......... .......... .......... .......... 71% 292M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66800K .......... .......... .......... .......... .......... 71% 336M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66850K .......... .......... .......... .......... .......... 72% 365M 0s 2024-08-08T23:54:04.173 INFO:teuthology.orchestra.run.smithi083.stderr: 66900K .......... .......... .......... .......... .......... 72% 293M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 66950K .......... .......... .......... .......... .......... 72% 346M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67000K .......... .......... .......... .......... .......... 72% 334M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67050K .......... .......... .......... .......... .......... 72% 339M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67100K .......... .......... .......... .......... .......... 72% 312M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67150K .......... .......... .......... .......... .......... 72% 369M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67200K .......... .......... .......... .......... .......... 72% 349M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67250K .......... .......... .......... .......... .......... 72% 12.3M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67300K .......... .......... .......... .......... .......... 72% 262M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67350K .......... .......... .......... .......... .......... 72% 315M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67400K .......... .......... .......... .......... .......... 72% 343M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67450K .......... .......... .......... .......... .......... 72% 306M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67500K .......... .......... .......... .......... .......... 72% 259M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67550K .......... .......... .......... .......... .......... 72% 308M 0s 2024-08-08T23:54:04.174 INFO:teuthology.orchestra.run.smithi083.stderr: 67600K .......... .......... .......... .......... .......... 72% 334M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67650K .......... .......... .......... .......... .......... 72% 310M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67700K .......... .......... .......... .......... .......... 72% 278M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67750K .......... .......... .......... .......... .......... 72% 300M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67800K .......... .......... .......... .......... .......... 73% 336M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67850K .......... .......... .......... .......... .......... 73% 326M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67900K .......... .......... .......... .......... .......... 73% 281M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 67950K .......... .......... .......... .......... .......... 73% 338M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68000K .......... .......... .......... .......... .......... 73% 358M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68050K .......... .......... .......... .......... .......... 73% 381M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68100K .......... .......... .......... .......... .......... 73% 330M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68150K .......... .......... .......... .......... .......... 73% 318M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68200K .......... .......... .......... .......... .......... 73% 321M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68250K .......... .......... .......... .......... .......... 73% 315M 0s 2024-08-08T23:54:04.175 INFO:teuthology.orchestra.run.smithi083.stderr: 68300K .......... .......... .......... .......... .......... 73% 279M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68350K .......... .......... .......... .......... .......... 73% 326M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68400K .......... .......... .......... .......... .......... 73% 331M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68450K .......... .......... .......... .......... .......... 73% 343M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68500K .......... .......... .......... .......... .......... 73% 295M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68550K .......... .......... .......... .......... .......... 73% 303M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68600K .......... .......... .......... .......... .......... 73% 344M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68650K .......... .......... .......... .......... .......... 73% 356M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68700K .......... .......... .......... .......... .......... 74% 269M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68750K .......... .......... .......... .......... .......... 74% 326M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68800K .......... .......... .......... .......... .......... 74% 320M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68850K .......... .......... .......... .......... .......... 74% 319M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68900K .......... .......... .......... .......... .......... 74% 302M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 68950K .......... .......... .......... .......... .......... 74% 365M 0s 2024-08-08T23:54:04.176 INFO:teuthology.orchestra.run.smithi083.stderr: 69000K .......... .......... .......... .......... .......... 74% 366M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69050K .......... .......... .......... .......... .......... 74% 358M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69100K .......... .......... .......... .......... .......... 74% 289M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69150K .......... .......... .......... .......... .......... 74% 325M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69200K .......... .......... .......... .......... .......... 74% 314M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69250K .......... .......... .......... .......... .......... 74% 324M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69300K .......... .......... .......... .......... .......... 74% 315M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69350K .......... .......... .......... .......... .......... 74% 331M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69400K .......... .......... .......... .......... .......... 74% 349M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69450K .......... .......... .......... .......... .......... 74% 348M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69500K .......... .......... .......... .......... .......... 74% 252M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69550K .......... .......... .......... .......... .......... 74% 321M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69600K .......... .......... .......... .......... .......... 74% 339M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69650K .......... .......... .......... .......... .......... 75% 326M 0s 2024-08-08T23:54:04.177 INFO:teuthology.orchestra.run.smithi083.stderr: 69700K .......... .......... .......... .......... .......... 75% 280M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 69750K .......... .......... .......... .......... .......... 75% 286M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 69800K .......... .......... .......... .......... .......... 75% 342M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 69850K .......... .......... .......... .......... .......... 75% 343M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 69900K .......... .......... .......... .......... .......... 75% 304M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 69950K .......... .......... .......... .......... .......... 75% 338M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70000K .......... .......... .......... .......... .......... 75% 377M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70050K .......... .......... .......... .......... .......... 75% 371M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70100K .......... .......... .......... .......... .......... 75% 13.9M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70150K .......... .......... .......... .......... .......... 75% 296M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70200K .......... .......... .......... .......... .......... 75% 361M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70250K .......... .......... .......... .......... .......... 75% 47.6M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70300K .......... .......... .......... .......... .......... 75% 74.7M 0s 2024-08-08T23:54:04.178 INFO:teuthology.orchestra.run.smithi083.stderr: 70350K .......... .......... .......... .......... .......... 75% 190M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70400K .......... .......... .......... .......... .......... 75% 366M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70450K .......... .......... .......... .......... .......... 75% 157M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70500K .......... .......... .......... .......... .......... 75% 287M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70550K .......... .......... .......... .......... .......... 75% 321M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70600K .......... .......... .......... .......... .......... 76% 281M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70650K .......... .......... .......... .......... .......... 76% 357M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70700K .......... .......... .......... .......... .......... 76% 219M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70750K .......... .......... .......... .......... .......... 76% 284M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70800K .......... .......... .......... .......... .......... 76% 210M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70850K .......... .......... .......... .......... .......... 76% 186M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70900K .......... .......... .......... .......... .......... 76% 172M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 70950K .......... .......... .......... .......... .......... 76% 185M 0s 2024-08-08T23:54:04.179 INFO:teuthology.orchestra.run.smithi083.stderr: 71000K .......... .......... .......... .......... .......... 76% 208M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71050K .......... .......... .......... .......... .......... 76% 186M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71100K .......... .......... .......... .......... .......... 76% 182M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71150K .......... .......... .......... .......... .......... 76% 218M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71200K .......... .......... .......... .......... .......... 76% 204M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71250K .......... .......... .......... .......... .......... 76% 193M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71300K .......... .......... .......... .......... .......... 76% 189M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71350K .......... .......... .......... .......... .......... 76% 218M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71400K .......... .......... .......... .......... .......... 76% 208M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71450K .......... .......... .......... .......... .......... 76% 192M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71500K .......... .......... .......... .......... .......... 77% 165M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71550K .......... .......... .......... .......... .......... 77% 201M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71600K .......... .......... .......... .......... .......... 77% 198M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71650K .......... .......... .......... .......... .......... 77% 203M 0s 2024-08-08T23:54:04.180 INFO:teuthology.orchestra.run.smithi083.stderr: 71700K .......... .......... .......... .......... .......... 77% 237M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 71750K .......... .......... .......... .......... .......... 77% 201M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 71800K .......... .......... .......... .......... .......... 77% 199M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 71850K .......... .......... .......... .......... .......... 77% 215M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 71900K .......... .......... .......... .......... .......... 77% 182M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 71950K .......... .......... .......... .......... .......... 77% 221M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72000K .......... .......... .......... .......... .......... 77% 222M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72050K .......... .......... .......... .......... .......... 77% 198M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72100K .......... .......... .......... .......... .......... 77% 193M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72150K .......... .......... .......... .......... .......... 77% 202M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72200K .......... .......... .......... .......... .......... 77% 217M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72250K .......... .......... .......... .......... .......... 77% 222M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72300K .......... .......... .......... .......... .......... 77% 186M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72350K .......... .......... .......... .......... .......... 77% 212M 0s 2024-08-08T23:54:04.181 INFO:teuthology.orchestra.run.smithi083.stderr: 72400K .......... .......... .......... .......... .......... 77% 214M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72450K .......... .......... .......... .......... .......... 78% 200M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72500K .......... .......... .......... .......... .......... 78% 165M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72550K .......... .......... .......... .......... .......... 78% 193M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72600K .......... .......... .......... .......... .......... 78% 201M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72650K .......... .......... .......... .......... .......... 78% 217M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72700K .......... .......... .......... .......... .......... 78% 194M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72750K .......... .......... .......... .......... .......... 78% 213M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72800K .......... .......... .......... .......... .......... 78% 200M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72850K .......... .......... .......... .......... .......... 78% 223M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72900K .......... .......... .......... .......... .......... 78% 167M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 72950K .......... .......... .......... .......... .......... 78% 197M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 73000K .......... .......... .......... .......... .......... 78% 208M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 73050K .......... .......... .......... .......... .......... 78% 203M 0s 2024-08-08T23:54:04.182 INFO:teuthology.orchestra.run.smithi083.stderr: 73100K .......... .......... .......... .......... .......... 78% 177M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73150K .......... .......... .......... .......... .......... 78% 197M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73200K .......... .......... .......... .......... .......... 78% 199M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73250K .......... .......... .......... .......... .......... 78% 183M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73300K .......... .......... .......... .......... .......... 78% 149M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73350K .......... .......... .......... .......... .......... 79% 197M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73400K .......... .......... .......... .......... .......... 79% 195M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73450K .......... .......... .......... .......... .......... 79% 203M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73500K .......... .......... .......... .......... .......... 79% 184M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73550K .......... .......... .......... .......... .......... 79% 211M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73600K .......... .......... .......... .......... .......... 79% 228M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73650K .......... .......... .......... .......... .......... 79% 226M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73700K .......... .......... .......... .......... .......... 79% 171M 0s 2024-08-08T23:54:04.183 INFO:teuthology.orchestra.run.smithi083.stderr: 73750K .......... .......... .......... .......... .......... 79% 207M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 73800K .......... .......... .......... .......... .......... 79% 215M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 73850K .......... .......... .......... .......... .......... 79% 173M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 73900K .......... .......... .......... .......... .......... 79% 186M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 73950K .......... .......... .......... .......... .......... 79% 221M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74000K .......... .......... .......... .......... .......... 79% 200M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74050K .......... .......... .......... .......... .......... 79% 203M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74100K .......... .......... .......... .......... .......... 79% 171M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74150K .......... .......... .......... .......... .......... 79% 220M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74200K .......... .......... .......... .......... .......... 79% 227M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74250K .......... .......... .......... .......... .......... 79% 227M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74300K .......... .......... .......... .......... .......... 80% 199M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74350K .......... .......... .......... .......... .......... 80% 212M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74400K .......... .......... .......... .......... .......... 80% 228M 0s 2024-08-08T23:54:04.184 INFO:teuthology.orchestra.run.smithi083.stderr: 74450K .......... .......... .......... .......... .......... 80% 213M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74500K .......... .......... .......... .......... .......... 80% 187M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74550K .......... .......... .......... .......... .......... 80% 230M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74600K .......... .......... .......... .......... .......... 80% 201M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74650K .......... .......... .......... .......... .......... 80% 229M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74700K .......... .......... .......... .......... .......... 80% 204M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74750K .......... .......... .......... .......... .......... 80% 231M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74800K .......... .......... .......... .......... .......... 80% 210M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74850K .......... .......... .......... .......... .......... 80% 226M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74900K .......... .......... .......... .......... .......... 80% 184M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 74950K .......... .......... .......... .......... .......... 80% 227M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 75000K .......... .......... .......... .......... .......... 80% 164M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 75050K .......... .......... .......... .......... .......... 80% 206M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 75100K .......... .......... .......... .......... .......... 80% 170M 0s 2024-08-08T23:54:04.185 INFO:teuthology.orchestra.run.smithi083.stderr: 75150K .......... .......... .......... .......... .......... 80% 200M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75200K .......... .......... .......... .......... .......... 81% 208M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75250K .......... .......... .......... .......... .......... 81% 204M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75300K .......... .......... .......... .......... .......... 81% 194M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75350K .......... .......... .......... .......... .......... 81% 191M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75400K .......... .......... .......... .......... .......... 81% 224M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75450K .......... .......... .......... .......... .......... 81% 234M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75500K .......... .......... .......... .......... .......... 81% 186M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75550K .......... .......... .......... .......... .......... 81% 232M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75600K .......... .......... .......... .......... .......... 81% 214M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75650K .......... .......... .......... .......... .......... 81% 223M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75700K .......... .......... .......... .......... .......... 81% 201M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75750K .......... .......... .......... .......... .......... 81% 214M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75800K .......... .......... .......... .......... .......... 81% 210M 0s 2024-08-08T23:54:04.186 INFO:teuthology.orchestra.run.smithi083.stderr: 75850K .......... .......... .......... .......... .......... 81% 234M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 75900K .......... .......... .......... .......... .......... 81% 181M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 75950K .......... .......... .......... .......... .......... 81% 209M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76000K .......... .......... .......... .......... .......... 81% 228M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76050K .......... .......... .......... .......... .......... 81% 224M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76100K .......... .......... .......... .......... .......... 81% 193M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76150K .......... .......... .......... .......... .......... 82% 239M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76200K .......... .......... .......... .......... .......... 82% 233M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76250K .......... .......... .......... .......... .......... 82% 220M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76300K .......... .......... .......... .......... .......... 82% 177M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76350K .......... .......... .......... .......... .......... 82% 224M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76400K .......... .......... .......... .......... .......... 82% 237M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76450K .......... .......... .......... .......... .......... 82% 225M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76500K .......... .......... .......... .......... .......... 82% 203M 0s 2024-08-08T23:54:04.187 INFO:teuthology.orchestra.run.smithi083.stderr: 76550K .......... .......... .......... .......... .......... 82% 229M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76600K .......... .......... .......... .......... .......... 82% 204M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76650K .......... .......... .......... .......... .......... 82% 230M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76700K .......... .......... .......... .......... .......... 82% 199M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76750K .......... .......... .......... .......... .......... 82% 213M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76800K .......... .......... .......... .......... .......... 82% 231M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76850K .......... .......... .......... .......... .......... 82% 236M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76900K .......... .......... .......... .......... .......... 82% 209M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 76950K .......... .......... .......... .......... .......... 82% 213M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 77000K .......... .......... .......... .......... .......... 82% 219M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 77050K .......... .......... .......... .......... .......... 82% 241M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 77100K .......... .......... .......... .......... .......... 83% 199M 0s 2024-08-08T23:54:04.188 INFO:teuthology.orchestra.run.smithi083.stderr: 77150K .......... .......... .......... .......... .......... 83% 235M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77200K .......... .......... .......... .......... .......... 83% 238M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77250K .......... .......... .......... .......... .......... 83% 234M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77300K .......... .......... .......... .......... .......... 83% 211M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77350K .......... .......... .......... .......... .......... 83% 241M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77400K .......... .......... .......... .......... .......... 83% 238M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77450K .......... .......... .......... .......... .......... 83% 235M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77500K .......... .......... .......... .......... .......... 83% 47.6M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77550K .......... .......... .......... .......... .......... 83% 212M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77600K .......... .......... .......... .......... .......... 83% 209M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77650K .......... .......... .......... .......... .......... 83% 217M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77700K .......... .......... .......... .......... .......... 83% 196M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77750K .......... .......... .......... .......... .......... 83% 217M 0s 2024-08-08T23:54:04.189 INFO:teuthology.orchestra.run.smithi083.stderr: 77800K .......... .......... .......... .......... .......... 83% 227M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 77850K .......... .......... .......... .......... .......... 83% 212M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 77900K .......... .......... .......... .......... .......... 83% 160M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 77950K .......... .......... .......... .......... .......... 83% 215M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78000K .......... .......... .......... .......... .......... 84% 233M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78050K .......... .......... .......... .......... .......... 84% 229M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78100K .......... .......... .......... .......... .......... 84% 201M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78150K .......... .......... .......... .......... .......... 84% 230M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78200K .......... .......... .......... .......... .......... 84% 224M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78250K .......... .......... .......... .......... .......... 84% 233M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78300K .......... .......... .......... .......... .......... 84% 196M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78350K .......... .......... .......... .......... .......... 84% 216M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78400K .......... .......... .......... .......... .......... 84% 226M 0s 2024-08-08T23:54:04.190 INFO:teuthology.orchestra.run.smithi083.stderr: 78450K .......... .......... .......... .......... .......... 84% 229M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78500K .......... .......... .......... .......... .......... 84% 207M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78550K .......... .......... .......... .......... .......... 84% 230M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78600K .......... .......... .......... .......... .......... 84% 220M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78650K .......... .......... .......... .......... .......... 84% 228M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78700K .......... .......... .......... .......... .......... 84% 198M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78750K .......... .......... .......... .......... .......... 84% 234M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78800K .......... .......... .......... .......... .......... 84% 228M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78850K .......... .......... .......... .......... .......... 84% 218M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78900K .......... .......... .......... .......... .......... 84% 205M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 78950K .......... .......... .......... .......... .......... 85% 231M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 79000K .......... .......... .......... .......... .......... 85% 224M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 79050K .......... .......... .......... .......... .......... 85% 244M 0s 2024-08-08T23:54:04.191 INFO:teuthology.orchestra.run.smithi083.stderr: 79100K .......... .......... .......... .......... .......... 85% 176M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79150K .......... .......... .......... .......... .......... 85% 386M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79200K .......... .......... .......... .......... .......... 85% 408M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79250K .......... .......... .......... .......... .......... 85% 408M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79300K .......... .......... .......... .......... .......... 85% 308M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79350K .......... .......... .......... .......... .......... 85% 369M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79400K .......... .......... .......... .......... .......... 85% 360M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79450K .......... .......... .......... .......... .......... 85% 378M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79500K .......... .......... .......... .......... .......... 85% 318M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79550K .......... .......... .......... .......... .......... 85% 317M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79600K .......... .......... .......... .......... .......... 85% 312M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79650K .......... .......... .......... .......... .......... 85% 323M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79700K .......... .......... .......... .......... .......... 85% 299M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79750K .......... .......... .......... .......... .......... 85% 322M 0s 2024-08-08T23:54:04.192 INFO:teuthology.orchestra.run.smithi083.stderr: 79800K .......... .......... .......... .......... .......... 85% 322M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 79850K .......... .......... .......... .......... .......... 86% 385M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 79900K .......... .......... .......... .......... .......... 86% 283M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 79950K .......... .......... .......... .......... .......... 86% 368M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80000K .......... .......... .......... .......... .......... 86% 366M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80050K .......... .......... .......... .......... .......... 86% 386M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80100K .......... .......... .......... .......... .......... 86% 325M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80150K .......... .......... .......... .......... .......... 86% 21.6M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80200K .......... .......... .......... .......... .......... 86% 340M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80250K .......... .......... .......... .......... .......... 86% 287M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80300K .......... .......... .......... .......... .......... 86% 272M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80350K .......... .......... .......... .......... .......... 86% 313M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80400K .......... .......... .......... .......... .......... 86% 319M 0s 2024-08-08T23:54:04.193 INFO:teuthology.orchestra.run.smithi083.stderr: 80450K .......... .......... .......... .......... .......... 86% 328M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80500K .......... .......... .......... .......... .......... 86% 286M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80550K .......... .......... .......... .......... .......... 86% 355M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80600K .......... .......... .......... .......... .......... 86% 354M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80650K .......... .......... .......... .......... .......... 86% 356M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80700K .......... .......... .......... .......... .......... 86% 281M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80750K .......... .......... .......... .......... .......... 86% 351M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80800K .......... .......... .......... .......... .......... 87% 361M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80850K .......... .......... .......... .......... .......... 87% 347M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80900K .......... .......... .......... .......... .......... 87% 338M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 80950K .......... .......... .......... .......... .......... 87% 348M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 81000K .......... .......... .......... .......... .......... 87% 360M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 81050K .......... .......... .......... .......... .......... 87% 350M 0s 2024-08-08T23:54:04.194 INFO:teuthology.orchestra.run.smithi083.stderr: 81100K .......... .......... .......... .......... .......... 87% 319M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81150K .......... .......... .......... .......... .......... 87% 352M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81200K .......... .......... .......... .......... .......... 87% 364M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81250K .......... .......... .......... .......... .......... 87% 356M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81300K .......... .......... .......... .......... .......... 87% 303M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81350K .......... .......... .......... .......... .......... 87% 360M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81400K .......... .......... .......... .......... .......... 87% 364M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81450K .......... .......... .......... .......... .......... 87% 335M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81500K .......... .......... .......... .......... .......... 87% 271M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81550K .......... .......... .......... .......... .......... 87% 369M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81600K .......... .......... .......... .......... .......... 87% 375M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81650K .......... .......... .......... .......... .......... 87% 352M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81700K .......... .......... .......... .......... .......... 87% 153M 0s 2024-08-08T23:54:04.195 INFO:teuthology.orchestra.run.smithi083.stderr: 81750K .......... .......... .......... .......... .......... 88% 359M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 81800K .......... .......... .......... .......... .......... 88% 271M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 81850K .......... .......... .......... .......... .......... 88% 82.3M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 81900K .......... .......... .......... .......... .......... 88% 270M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 81950K .......... .......... .......... .......... .......... 88% 290M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82000K .......... .......... .......... .......... .......... 88% 288M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82050K .......... .......... .......... .......... .......... 88% 369M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82100K .......... .......... .......... .......... .......... 88% 385M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82150K .......... .......... .......... .......... .......... 88% 116M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82200K .......... .......... .......... .......... .......... 88% 359M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82250K .......... .......... .......... .......... .......... 88% 206M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82300K .......... .......... .......... .......... .......... 88% 294M 0s 2024-08-08T23:54:04.196 INFO:teuthology.orchestra.run.smithi083.stderr: 82350K .......... .......... .......... .......... .......... 88% 317M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82400K .......... .......... .......... .......... .......... 88% 375M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82450K .......... .......... .......... .......... .......... 88% 369M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82500K .......... .......... .......... .......... .......... 88% 363M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82550K .......... .......... .......... .......... .......... 88% 325M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82600K .......... .......... .......... .......... .......... 88% 81.8M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82650K .......... .......... .......... .......... .......... 89% 311M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82700K .......... .......... .......... .......... .......... 89% 331M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82750K .......... .......... .......... .......... .......... 89% 267M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82800K .......... .......... .......... .......... .......... 89% 378M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82850K .......... .......... .......... .......... .......... 89% 395M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82900K .......... .......... .......... .......... .......... 89% 386M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 82950K .......... .......... .......... .......... .......... 89% 17.7M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 83000K .......... .......... .......... .......... .......... 89% 339M 0s 2024-08-08T23:54:04.197 INFO:teuthology.orchestra.run.smithi083.stderr: 83050K .......... .......... .......... .......... .......... 89% 342M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83100K .......... .......... .......... .......... .......... 89% 337M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83150K .......... .......... .......... .......... .......... 89% 317M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83200K .......... .......... .......... .......... .......... 89% 359M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83250K .......... .......... .......... .......... .......... 89% 327M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83300K .......... .......... .......... .......... .......... 89% 347M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83350K .......... .......... .......... .......... .......... 89% 311M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83400K .......... .......... .......... .......... .......... 89% 316M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83450K .......... .......... .......... .......... .......... 89% 328M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83500K .......... .......... .......... .......... .......... 89% 370M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83550K .......... .......... .......... .......... .......... 89% 292M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83600K .......... .......... .......... .......... .......... 90% 349M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83650K .......... .......... .......... .......... .......... 90% 371M 0s 2024-08-08T23:54:04.198 INFO:teuthology.orchestra.run.smithi083.stderr: 83700K .......... .......... .......... .......... .......... 90% 359M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 83750K .......... .......... .......... .......... .......... 90% 310M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 83800K .......... .......... .......... .......... .......... 90% 357M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 83850K .......... .......... .......... .......... .......... 90% 328M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 83900K .......... .......... .......... .......... .......... 90% 356M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 83950K .......... .......... .......... .......... .......... 90% 307M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84000K .......... .......... .......... .......... .......... 90% 381M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84050K .......... .......... .......... .......... .......... 90% 373M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84100K .......... .......... .......... .......... .......... 90% 352M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84150K .......... .......... .......... .......... .......... 90% 307M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84200K .......... .......... .......... .......... .......... 90% 342M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84250K .......... .......... .......... .......... .......... 90% 364M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84300K .......... .......... .......... .......... .......... 90% 365M 0s 2024-08-08T23:54:04.199 INFO:teuthology.orchestra.run.smithi083.stderr: 84350K .......... .......... .......... .......... .......... 90% 256M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84400K .......... .......... .......... .......... .......... 90% 362M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84450K .......... .......... .......... .......... .......... 90% 342M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84500K .......... .......... .......... .......... .......... 91% 370M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84550K .......... .......... .......... .......... .......... 91% 306M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84600K .......... .......... .......... .......... .......... 91% 365M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84650K .......... .......... .......... .......... .......... 91% 338M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84700K .......... .......... .......... .......... .......... 91% 397M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84750K .......... .......... .......... .......... .......... 91% 312M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84800K .......... .......... .......... .......... .......... 91% 370M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84850K .......... .......... .......... .......... .......... 91% 193M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84900K .......... .......... .......... .......... .......... 91% 239M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 84950K .......... .......... .......... .......... .......... 91% 242M 0s 2024-08-08T23:54:04.200 INFO:teuthology.orchestra.run.smithi083.stderr: 85000K .......... .......... .......... .......... .......... 91% 364M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85050K .......... .......... .......... .......... .......... 91% 325M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85100K .......... .......... .......... .......... .......... 91% 258M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85150K .......... .......... .......... .......... .......... 91% 206M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85200K .......... .......... .......... .......... .......... 91% 281M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85250K .......... .......... .......... .......... .......... 91% 377M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85300K .......... .......... .......... .......... .......... 91% 97.2M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85350K .......... .......... .......... .......... .......... 91% 333M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85400K .......... .......... .......... .......... .......... 91% 318M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85450K .......... .......... .......... .......... .......... 92% 353M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85500K .......... .......... .......... .......... .......... 92% 372M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85550K .......... .......... .......... .......... .......... 92% 89.1M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85600K .......... .......... .......... .......... .......... 92% 357M 0s 2024-08-08T23:54:04.201 INFO:teuthology.orchestra.run.smithi083.stderr: 85650K .......... .......... .......... .......... .......... 92% 338M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85700K .......... .......... .......... .......... .......... 92% 354M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85750K .......... .......... .......... .......... .......... 92% 311M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85800K .......... .......... .......... .......... .......... 92% 359M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85850K .......... .......... .......... .......... .......... 92% 16.9M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85900K .......... .......... .......... .......... .......... 92% 314M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 85950K .......... .......... .......... .......... .......... 92% 278M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86000K .......... .......... .......... .......... .......... 92% 322M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86050K .......... .......... .......... .......... .......... 92% 364M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86100K .......... .......... .......... .......... .......... 92% 284M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86150K .......... .......... .......... .......... .......... 92% 305M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86200K .......... .......... .......... .......... .......... 92% 331M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86250K .......... .......... .......... .......... .......... 92% 328M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86300K .......... .......... .......... .......... .......... 92% 340M 0s 2024-08-08T23:54:04.202 INFO:teuthology.orchestra.run.smithi083.stderr: 86350K .......... .......... .......... .......... .......... 93% 319M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86400K .......... .......... .......... .......... .......... 93% 308M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86450K .......... .......... .......... .......... .......... 93% 352M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86500K .......... .......... .......... .......... .......... 93% 370M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86550K .......... .......... .......... .......... .......... 93% 333M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86600K .......... .......... .......... .......... .......... 93% 315M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86650K .......... .......... .......... .......... .......... 93% 284M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86700K .......... .......... .......... .......... .......... 93% 281M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86750K .......... .......... .......... .......... .......... 93% 293M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86800K .......... .......... .......... .......... .......... 93% 360M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86850K .......... .......... .......... .......... .......... 93% 358M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86900K .......... .......... .......... .......... .......... 93% 371M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 86950K .......... .......... .......... .......... .......... 93% 381M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 87000K .......... .......... .......... .......... .......... 93% 409M 0s 2024-08-08T23:54:04.203 INFO:teuthology.orchestra.run.smithi083.stderr: 87050K .......... .......... .......... .......... .......... 93% 331M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87100K .......... .......... .......... .......... .......... 93% 380M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87150K .......... .......... .......... .......... .......... 93% 410M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87200K .......... .......... .......... .......... .......... 93% 368M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87250K .......... .......... .......... .......... .......... 93% 379M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87300K .......... .......... .......... .......... .......... 94% 393M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87350K .......... .......... .......... .......... .......... 94% 324M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87400K .......... .......... .......... .......... .......... 94% 207M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87450K .......... .......... .......... .......... .......... 94% 344M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87500K .......... .......... .......... .......... .......... 94% 358M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87550K .......... .......... .......... .......... .......... 94% 315M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87600K .......... .......... .......... .......... .......... 94% 400M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87650K .......... .......... .......... .......... .......... 94% 411M 0s 2024-08-08T23:54:04.204 INFO:teuthology.orchestra.run.smithi083.stderr: 87700K .......... .......... .......... .......... .......... 94% 224M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 87750K .......... .......... .......... .......... .......... 94% 306M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 87800K .......... .......... .......... .......... .......... 94% 348M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 87850K .......... .......... .......... .......... .......... 94% 395M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 87900K .......... .......... .......... .......... .......... 94% 397M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 87950K .......... .......... .......... .......... .......... 94% 316M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88000K .......... .......... .......... .......... .......... 94% 363M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88050K .......... .......... .......... .......... .......... 94% 378M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88100K .......... .......... .......... .......... .......... 94% 385M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88150K .......... .......... .......... .......... .......... 94% 287M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88200K .......... .......... .......... .......... .......... 94% 309M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88250K .......... .......... .......... .......... .......... 95% 377M 0s 2024-08-08T23:54:04.205 INFO:teuthology.orchestra.run.smithi083.stderr: 88300K .......... .......... .......... .......... .......... 95% 134M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88350K .......... .......... .......... .......... .......... 95% 159M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88400K .......... .......... .......... .......... .......... 95% 323M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88450K .......... .......... .......... .......... .......... 95% 77.5M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88500K .......... .......... .......... .......... .......... 95% 324M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88550K .......... .......... .......... .......... .......... 95% 322M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88600K .......... .......... .......... .......... .......... 95% 373M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88650K .......... .......... .......... .......... .......... 95% 385M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88700K .......... .......... .......... .......... .......... 95% 362M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88750K .......... .......... .......... .......... .......... 95% 276M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88800K .......... .......... .......... .......... .......... 95% 401M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88850K .......... .......... .......... .......... .......... 95% 17.5M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88900K .......... .......... .......... .......... .......... 95% 356M 0s 2024-08-08T23:54:04.206 INFO:teuthology.orchestra.run.smithi083.stderr: 88950K .......... .......... .......... .......... .......... 95% 108M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89000K .......... .......... .......... .......... .......... 95% 323M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89050K .......... .......... .......... .......... .......... 95% 366M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89100K .......... .......... .......... .......... .......... 95% 377M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89150K .......... .......... .......... .......... .......... 96% 327M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89200K .......... .......... .......... .......... .......... 96% 357M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89250K .......... .......... .......... .......... .......... 96% 377M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89300K .......... .......... .......... .......... .......... 96% 398M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89350K .......... .......... .......... .......... .......... 96% 366M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89400K .......... .......... .......... .......... .......... 96% 339M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89450K .......... .......... .......... .......... .......... 96% 258M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89500K .......... .......... .......... .......... .......... 96% 361M 0s 2024-08-08T23:54:04.207 INFO:teuthology.orchestra.run.smithi083.stderr: 89550K .......... .......... .......... .......... .......... 96% 280M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89600K .......... .......... .......... .......... .......... 96% 362M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89650K .......... .......... .......... .......... .......... 96% 403M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89700K .......... .......... .......... .......... .......... 96% 381M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89750K .......... .......... .......... .......... .......... 96% 334M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89800K .......... .......... .......... .......... .......... 96% 386M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89850K .......... .......... .......... .......... .......... 96% 172M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89900K .......... .......... .......... .......... .......... 96% 345M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 89950K .......... .......... .......... .......... .......... 96% 300M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90000K .......... .......... .......... .......... .......... 96% 363M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90050K .......... .......... .......... .......... .......... 96% 331M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90100K .......... .......... .......... .......... .......... 97% 336M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90150K .......... .......... .......... .......... .......... 97% 358M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90200K .......... .......... .......... .......... .......... 97% 302M 0s 2024-08-08T23:54:04.208 INFO:teuthology.orchestra.run.smithi083.stderr: 90250K .......... .......... .......... .......... .......... 97% 371M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90300K .......... .......... .......... .......... .......... 97% 358M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90350K .......... .......... .......... .......... .......... 97% 318M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90400K .......... .......... .......... .......... .......... 97% 396M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90450K .......... .......... .......... .......... .......... 97% 357M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90500K .......... .......... .......... .......... .......... 97% 373M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90550K .......... .......... .......... .......... .......... 97% 347M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90600K .......... .......... .......... .......... .......... 97% 379M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90650K .......... .......... .......... .......... .......... 97% 374M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90700K .......... .......... .......... .......... .......... 97% 390M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90750K .......... .......... .......... .......... .......... 97% 131M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90800K .......... .......... .......... .......... .......... 97% 290M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90850K .......... .......... .......... .......... .......... 97% 361M 0s 2024-08-08T23:54:04.209 INFO:teuthology.orchestra.run.smithi083.stderr: 90900K .......... .......... .......... .......... .......... 97% 375M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 90950K .......... .......... .......... .......... .......... 97% 328M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91000K .......... .......... .......... .......... .......... 98% 393M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91050K .......... .......... .......... .......... .......... 98% 358M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91100K .......... .......... .......... .......... .......... 98% 412M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91150K .......... .......... .......... .......... .......... 98% 330M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91200K .......... .......... .......... .......... .......... 98% 387M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91250K .......... .......... .......... .......... .......... 98% 411M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91300K .......... .......... .......... .......... .......... 98% 396M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91350K .......... .......... .......... .......... .......... 98% 341M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91400K .......... .......... .......... .......... .......... 98% 196M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91450K .......... .......... .......... .......... .......... 98% 66.8M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91500K .......... .......... .......... .......... .......... 98% 325M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91550K .......... .......... .......... .......... .......... 98% 301M 0s 2024-08-08T23:54:04.210 INFO:teuthology.orchestra.run.smithi083.stderr: 91600K .......... .......... .......... .......... .......... 98% 404M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91650K .......... .......... .......... .......... .......... 98% 373M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91700K .......... .......... .......... .......... .......... 98% 415M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91750K .......... .......... .......... .......... .......... 98% 18.0M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91800K .......... .......... .......... .......... .......... 98% 311M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91850K .......... .......... .......... .......... .......... 98% 391M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91900K .......... .......... .......... .......... .......... 98% 296M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 91950K .......... .......... .......... .......... .......... 99% 113M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92000K .......... .......... .......... .......... .......... 99% 340M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92050K .......... .......... .......... .......... .......... 99% 384M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92100K .......... .......... .......... .......... .......... 99% 337M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92150K .......... .......... .......... .......... .......... 99% 362M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92200K .......... .......... .......... .......... .......... 99% 394M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92250K .......... .......... .......... .......... .......... 99% 391M 0s 2024-08-08T23:54:04.211 INFO:teuthology.orchestra.run.smithi083.stderr: 92300K .......... .......... .......... .......... .......... 99% 101M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92350K .......... .......... .......... .......... .......... 99% 348M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92400K .......... .......... .......... .......... .......... 99% 333M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92450K .......... .......... .......... .......... .......... 99% 433M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92500K .......... .......... .......... .......... .......... 99% 440M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92550K .......... .......... .......... .......... .......... 99% 378M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92600K .......... .......... .......... .......... .......... 99% 373M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92650K .......... .......... .......... .......... .......... 99% 376M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92700K .......... .......... .......... .......... .......... 99% 394M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92750K .......... .......... .......... .......... .......... 99% 429M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92800K .......... .......... .......... .......... .......... 99% 371M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92850K .......... .......... .......... .......... .......... 99% 432M 0s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 92900K 100% 134G=0.5s 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-08T23:54:04.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08 23:54:03 (184 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-08-08T23:54:04.213 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-08T23:54:04.239 INFO:teuthology.orchestra.run.smithi083.stdout:Archive: gradle-6.0.1-bin.zip 2024-08-08T23:54:04.239 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-08-08T23:54:04.239 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-08-08T23:54:04.240 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-08-08T23:54:04.241 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-08-08T23:54:04.242 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-08-08T23:54:04.243 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-08-08T23:54:04.244 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-08-08T23:54:04.245 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-08-08T23:54:04.246 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-08-08T23:54:04.247 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-08-08T23:54:04.248 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-08-08T23:54:04.249 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-08-08T23:54:04.250 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-08-08T23:54:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-08-08T23:54:04.252 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-08-08T23:54:04.253 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-08-08T23:54:04.254 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-08-08T23:54:04.255 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-08-08T23:54:04.256 INFO:teuthology.orchestra.run.smithi083.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-08-08T23:54:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.351 INFO:teuthology.orchestra.run.smithi083.stdout:Welcome to Gradle 6.0.1! 2024-08-08T23:54:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout:Here are the highlights of this release: 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Substantial improvements in dependency management, including 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Advanced control of transitive versions 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for optional features and dependencies 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Rules to tweak published metadata 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for Java 13 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Faster incremental Java and Groovy compilation 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - New Zinc compiler for Scala 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - VS2019 support 2024-08-08T23:54:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for Gradle Enterprise plugin 3.0 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout:------------------------------------------------------------ 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout:Gradle 6.0.1 2024-08-08T23:54:04.355 INFO:teuthology.orchestra.run.smithi083.stdout:------------------------------------------------------------ 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:Kotlin: 1.3.50 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:Groovy: 2.5.8 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout:OS: Linux 5.15.0-118-generic amd64 2024-08-08T23:54:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.371 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-08-08T23:54:04.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-08-08T23:54:04.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi083.front.sepia.ceph.com 2024-08-08T23:54:04.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-08-08T23:54:04.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi196.front.sepia.ceph.com 2024-08-08T23:54:04.371 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-08-08T23:54:04.559 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-08-08T23:54:04.559 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-08-08T23:54:04.559 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'BMCJCERFABHVFMOAIFYI', 'access_secret': 'vtG8324JjB+Me85rwiKEIzFkLrT9UyC20fe0YO2BQ1SCD+gL7glLHA==', 'region': 'mexico', 'endpoint': 'smithi083.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi083.front.sepia.ceph.com'} 2024-08-08T23:54:04.559 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-08-08T23:54:04.560 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'BMCJCERFABHVFMOAIFYI', '--secret', 'vtG8324JjB+Me85rwiKEIzFkLrT9UyC20fe0YO2BQ1SCD+gL7glLHA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-08-08T23:54:04.560 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key BMCJCERFABHVFMOAIFYI --secret vtG8324JjB+Me85rwiKEIzFkLrT9UyC20fe0YO2BQ1SCD+gL7glLHA== --email tester.client.0_test@test.test --cluster ceph 2024-08-08T23:54:04.596 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:54:04.596 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:54:04.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 realm 2024-08-08T23:54:04.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:54:04.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.635+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.639+0000 7fc7df17d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:04.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.639+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.639+0000 7fc7df17d980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:54:04.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.639+0000 7fc7df17d980 20 searching for the correct realm 2024-08-08T23:54:04.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.643+0000 7fc7dcc91640 0 -- 172.21.15.83:0/2637522617 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fc7d4074070 msgr2=0x7fc7d4065120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:54:04.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.647+0000 7fc7dc490640 0 -- 172.21.15.83:0/2637522617 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc7d4036570 msgr2=0x7fc7d406e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:54:04.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:54:04.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:54:04.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:54:04.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:04.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.863+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:54:04.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 zone default found 2024-08-08T23:54:04.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 4 Realm: () 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 zonegroup default 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 started sync module instance, tier type = 2024-08-08T23:54:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.867+0000 7fc7df17d980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=0 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=1 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=2 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=3 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=4 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=5 2024-08-08T23:54:04.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=6 2024-08-08T23:54:04.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 20 add_watcher() i=7 2024-08-08T23:54:04.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.891+0000 7fc7df17d980 2 all 8 watchers are set, enabling cache 2024-08-08T23:54:04.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.895+0000 7fc692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:04.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.895+0000 7fc7df17d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:54:04.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.895+0000 7fc7df17d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:54:04.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.895+0000 7fc7df17d980 5 note: GC not initialized 2024-08-08T23:54:04.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc691fe3640 20 reqs_thread_entry: start 2024-08-08T23:54:04.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 init_complete bucket index max shards: 1 2024-08-08T23:54:04.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 Filter name: none 2024-08-08T23:54:04.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc6037fe640 20 reqs_thread_entry: start 2024-08-08T23:54:04.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-08-08T23:54:04.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-08T23:54:04.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache get: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI : miss 2024-08-08T23:54:04.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados->read ofs=0 len=0 2024-08-08T23:54:04.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:04.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI info.flags=0x0 2024-08-08T23:54:04.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 adding default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI to cache LRU end 2024-08-08T23:54:04.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache get: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI : hit (negative entry) 2024-08-08T23:54:04.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.899+0000 7fc7df17d980 10 cache get: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI : hit (negative entry) 2024-08-08T23:54:04.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-08-08T23:54:04.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc7df17d980 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-08T23:54:04.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc7df17d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-08-08T23:54:04.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc6b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94450363494096 notifier 6971 bl.length()=670 2024-08-08T23:54:04.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc6b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-08-08T23:54:04.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.903+0000 7fc6b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-08T23:54:04.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.907+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-08-08T23:54:04.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.907+0000 7fc7df17d980 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-08T23:54:04.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.907+0000 7fc7df17d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-08-08T23:54:04.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.911+0000 7fc6b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 94450363482720 notifier 6971 bl.length()=200 2024-08-08T23:54:04.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.911+0000 7fc6b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-08-08T23:54:04.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.911+0000 7fc6b37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-08T23:54:04.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc7df17d980 10 cache put: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI info.flags=0x7 2024-08-08T23:54:04.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc7df17d980 10 moving default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI to cache LRU end 2024-08-08T23:54:04.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc7df17d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:BMCJCERFABHVFMOAIFYI, ofs0, ns] 2024-08-08T23:54:04.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc6b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94450363483920 notifier 6971 bl.length()=189 2024-08-08T23:54:04.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc6b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI info.flags=0x7 2024-08-08T23:54:04.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.915+0000 7fc6b37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BMCJCERFABHVFMOAIFYI to cache LRU end 2024-08-08T23:54:04.914 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-08T23:54:04.914 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "tester.client.0", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Ms. tester.client.0", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "tester.client.0_test@test.test", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "tester.client.0", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "BMCJCERFABHVFMOAIFYI", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "vtG8324JjB+Me85rwiKEIzFkLrT9UyC20fe0YO2BQ1SCD+gL7glLHA==", 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:54:04.906714Z" 2024-08-08T23:54:04.915 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:54:04.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-08T23:54:04.917 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-08T23:54:04.906682Z", 2024-08-08T23:54:04.918 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-08T23:54:04.918 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-08T23:54:04.918 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-08T23:54:04.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:04.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.919+0000 7fc692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:04.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.923+0000 7fc7df17d980 20 remove_watcher() i=0 2024-08-08T23:54:04.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.923+0000 7fc7df17d980 2 removed watcher, disabling cache 2024-08-08T23:54:04.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.927+0000 7fc7df17d980 20 remove_watcher() i=1 2024-08-08T23:54:04.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.927+0000 7fc7df17d980 20 remove_watcher() i=2 2024-08-08T23:54:04.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.931+0000 7fc7df17d980 20 remove_watcher() i=3 2024-08-08T23:54:04.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.931+0000 7fc7df17d980 20 remove_watcher() i=4 2024-08-08T23:54:04.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.935+0000 7fc7df17d980 20 remove_watcher() i=5 2024-08-08T23:54:04.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.935+0000 7fc7df17d980 20 remove_watcher() i=6 2024-08-08T23:54:04.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:04.939+0000 7fc7df17d980 20 remove_watcher() i=7 2024-08-08T23:54:04.952 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-08T23:54:04.952 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-08-08T23:54:05.002 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-08-08T23:54:05.002 DEBUG:teuthology.orchestra.run.smithi083:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-08-08T23:54:05.051 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-08T23:54:05.124 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:54:05.125 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.171+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 realm 2024-08-08T23:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:05.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.175+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.179+0000 7f5327ffa980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:54:05.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.179+0000 7f5327ffa980 20 searching for the correct realm 2024-08-08T23:54:05.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.183+0000 7f5325b0e640 0 -- 172.21.15.83:0/1561736054 >> [v2:172.21.15.83:6816/3379310080,v1:172.21.15.83:6817/3379310080] conn(0x55fdbdd01fa0 msgr2=0x55fdbdd04440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-08T23:54:05.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.191+0000 7f532530d640 0 -- 172.21.15.83:0/1561736054 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f5320087b50 msgr2=0x7f532007da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:54:05.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:54:05.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:05.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.403+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 zone default found 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 4 Realm: () 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 zonegroup default 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados->read ofs=0 len=0 2024-08-08T23:54:05.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:05.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 started sync module instance, tier type = 2024-08-08T23:54:05.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.407+0000 7f5327ffa980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:54:05.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=0 2024-08-08T23:54:05.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=1 2024-08-08T23:54:05.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=2 2024-08-08T23:54:05.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=3 2024-08-08T23:54:05.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=4 2024-08-08T23:54:05.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=5 2024-08-08T23:54:05.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.431+0000 7f5327ffa980 20 add_watcher() i=6 2024-08-08T23:54:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.435+0000 7f5327ffa980 20 add_watcher() i=7 2024-08-08T23:54:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.435+0000 7f5327ffa980 2 all 8 watchers are set, enabling cache 2024-08-08T23:54:05.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.439+0000 7f51dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:05.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.439+0000 7f5327ffa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:54:05.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.439+0000 7f5327ffa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:54:05.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.531+0000 7f51dafe5640 20 reqs_thread_entry: start 2024-08-08T23:54:05.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.531+0000 7f5327ffa980 20 init_complete bucket index max shards: 1 2024-08-08T23:54:05.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.531+0000 7f5327ffa980 20 Filter name: none 2024-08-08T23:54:05.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.531+0000 7f51d8fe1640 20 reqs_thread_entry: start 2024-08-08T23:54:05.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.535+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-08T23:54:05.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.535+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.539+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.539+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.543+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-08T23:54:05.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.547+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.547+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.243224067356300060', time=2024-08-09T01:49:27.062415+0000, chain.objs.size()=5 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1_1 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2_1 2024-08-08T23:54:05.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.551+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.3 2024-08-08T23:54:05.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.555+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.559+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-08T23:54:05.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.563+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.563+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.567+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.567+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-08T23:54:05.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.571+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.571+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.575+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.575+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-08T23:54:05.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.579+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.583+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.583+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.583+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_FZUUsXqL5biMUL2YY6KRmhmhp5ge425', time=2024-08-09T01:49:26.928177+0000, chain.objs.size()=2 2024-08-08T23:54:05.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.583+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.aM7C4EHGX9RvarBaAQTwc3LpRSloHWN_0 2024-08-08T23:54:05.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.583+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.aM7C4EHGX9RvarBaAQTwc3LpRSloHWN_1 2024-08-08T23:54:05.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.587+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.591+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-08T23:54:05.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-08T23:54:05.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17296439175460687549', time=2024-08-09T01:49:27.230042+0000, chain.objs.size()=5 2024-08-08T23:54:05.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.1 2024-08-08T23:54:05.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.1_1 2024-08-08T23:54:05.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.2 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.2_1 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-FROZEN.2~Z7vHnF-IfhoaWAqQD14mgF8Jx7cMscn.3 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11146297945782778295', time=2024-08-09T01:49:27.241218+0000, chain.objs.size()=5 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.1 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.595+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.1_1 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.599+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.2 2024-08-08T23:54:05.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.599+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__shadow_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.2_1 2024-08-08T23:54:05.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.599+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-LUKEWARM.2~YlNZIt1fbiC7lfhhZmjNZ4CuBVNZk0-.3 2024-08-08T23:54:05.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.603+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.611+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-08T23:54:05.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_5hn4zpoUqn79e7X5PMbGQF4aw3VZRxm', time=2024-08-09T01:49:26.939381+0000, chain.objs.size()=1 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.m_tkaIJjZWcrc1Xkfo2TQf8NZPq60FA_1 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_9qkTfmA-IfL8_6IyRcy3_zNOFMlgc4_', time=2024-08-09T01:49:27.092692+0000, chain.objs.size()=2 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.KhHnmnKNTbns4QitybazR6Ms-0qQc9N_1 2024-08-08T23:54:05.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.615+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.KhHnmnKNTbns4QitybazR6Ms-0qQc9N_2 2024-08-08T23:54:05.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.619+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.627+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-08T23:54:05.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.631+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.631+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.635+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.635+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-08T23:54:05.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.639+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.639+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.639+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.643+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-08T23:54:05.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.647+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.647+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12173854997364093900', time=2024-08-09T01:49:27.127355+0000, chain.objs.size()=5 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1_1 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2_1 2024-08-08T23:54:05.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.651+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.3 2024-08-08T23:54:05.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.655+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.659+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-08T23:54:05.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5106900696669816458', time=2024-08-09T01:49:26.951137+0000, chain.objs.size()=2 2024-08-08T23:54:05.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_0 2024-08-08T23:54:05.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.663+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_1 2024-08-08T23:54:05.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.667+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.671+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-08T23:54:05.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15997185950050351804', time=2024-08-09T01:49:26.740852+0000, chain.objs.size()=4 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.1 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.2 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.3 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12__multipart_foo.2~_xaIDD8ussiU-hFV4XE72HmVUnJlhhH.4 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11894868164724224001', time=2024-08-09T01:49:26.824070+0000, chain.objs.size()=4 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.1 2024-08-08T23:54:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.2 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.3 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.675+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11__multipart_foo.2~YHRWIg08mFwNPamoAhbmwCksbp_BiG5.4 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_1juCu-NMPeKI_oiWy28l3PB3CHPmR5T', time=2024-08-09T01:49:26.980630+0000, chain.objs.size()=1 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.HHQHMDmiqNpmFQyKxJpSW0zwZ3TnstM_1 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14240023846591834488', time=2024-08-09T01:49:27.252052+0000, chain.objs.size()=3 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.1 2024-08-08T23:54:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.2 2024-08-08T23:54:05.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.679+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15__multipart_foo-STANDARD.2~WEXkX-Ofwx-8Gjaw52SH_UFstHBbRlv.3 2024-08-08T23:54:05.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.683+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1513323009152464874', time=2024-08-09T01:49:27.297161+0000, chain.objs.size()=3 2024-08-08T23:54:05.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.683+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_0 2024-08-08T23:54:05.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.687+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_1 2024-08-08T23:54:05.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.687+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.wLzbxJFkXoqgHcIwF5NpQmOrlsvP0-1_2 2024-08-08T23:54:05.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.695+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.699+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-08T23:54:05.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.703+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.707+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.707+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.707+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_Nw_ixemvPBMlql9B2ARhC3ub1kttUxf', time=2024-08-09T01:49:27.014351+0000, chain.objs.size()=2 2024-08-08T23:54:05.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.707+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.rg0jdvhfwLEK_l_PDwOKxNwwkqyHKWa_0 2024-08-08T23:54:05.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.707+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.rg0jdvhfwLEK_l_PDwOKxNwwkqyHKWa_1 2024-08-08T23:54:05.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.711+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.719+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-08T23:54:05.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_aAdOaZqjkdkTxVOFYiYPggd5tArnL-b', time=2024-08-09T01:49:27.001732+0000, chain.objs.size()=2 2024-08-08T23:54:05.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.8cGr6TMmn6T-ePKHlM5R451miK7TfwY_0 2024-08-08T23:54:05.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.723+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.8cGr6TMmn6T-ePKHlM5R451miK7TfwY_1 2024-08-08T23:54:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.731+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.735+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-08T23:54:05.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3279501397558441388', time=2024-08-09T01:49:27.024129+0000, chain.objs.size()=1 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.kNYKSnlLZx1hlscgepxB4UyIaM73B61_1 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10877469105968786809', time=2024-08-09T01:49:27.152647+0000, chain.objs.size()=3 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.1 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.2 2024-08-08T23:54:05.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.739+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.3 2024-08-08T23:54:05.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.747+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.751+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-08T23:54:05.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.755+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.755+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7106492504919518263', time=2024-08-09T01:49:26.871012+0000, chain.objs.size()=4 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.1 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.2 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.3 2024-08-08T23:54:05.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.759+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10__multipart_foo.2~EqXaZBcteRLLAbADypcRtSgy8dZlHCA.4 2024-08-08T23:54:05.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.763+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.767+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-08T23:54:05.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8806665927140681536', time=2024-08-09T01:49:26.776481+0000, chain.objs.size()=4 2024-08-08T23:54:05.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.1 2024-08-08T23:54:05.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.2 2024-08-08T23:54:05.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.3 2024-08-08T23:54:05.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.775+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13__multipart_foo.2~5nS5vKSVS2qmQ7gtd5ku1xGX2N10a2Q.4 2024-08-08T23:54:05.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.779+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.787+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-08T23:54:05.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.787+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.791+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.791+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.791+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-08T23:54:05.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.795+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-08T23:54:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10472271874240480183', time=2024-08-09T01:49:26.967958+0000, chain.objs.size()=2 2024-08-08T23:54:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_0 2024-08-08T23:54:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.oCySIUPJxb973t9gGyvMx4lDG52iRjs_1 2024-08-08T23:54:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_U7TbV8w6VNfw3OLfbzDXTsf6abH-Yjn', time=2024-08-09T01:49:27.172321+0000, chain.objs.size()=1 2024-08-08T23:54:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.23T3XERP-X5W_DpEa6uaNTuJB6ScMBJ_0 2024-08-08T23:54:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3463980139044234834', time=2024-08-09T01:49:27.306523+0000, chain.objs.size()=3 2024-08-08T23:54:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_0 2024-08-08T23:54:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_1 2024-08-08T23:54:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.799+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14__shadow_.qtiS_QKrjEjL_clAWeyhkcITRl00cfj_2 2024-08-08T23:54:05.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.811+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.815+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-08T23:54:05.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_m-_hrP9E0shXTv2DxAcFeae0NGPoExM', time=2024-08-09T01:49:26.960630+0000, chain.objs.size()=2 2024-08-08T23:54:05.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.hRcwEHnEVUxXw0nMDKtbtgb5CXw-F1g_0 2024-08-08T23:54:05.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.819+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.hRcwEHnEVUxXw0nMDKtbtgb5CXw-F1g_1 2024-08-08T23:54:05.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.827+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.831+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-08T23:54:05.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12765809670424004002', time=2024-08-09T01:49:26.910793+0000, chain.objs.size()=2 2024-08-08T23:54:05.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_0 2024-08-08T23:54:05.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.835+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_1 2024-08-08T23:54:05.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.839+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.847+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-08T23:54:05.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_h-ge7XacCEYX8VGn3ffzExMKihT7WOD', time=2024-08-09T01:49:27.117566+0000, chain.objs.size()=3 2024-08-08T23:54:05.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_0 2024-08-08T23:54:05.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_1 2024-08-08T23:54:05.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.851+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.Jnk_hssfGkFIxt9GgjIgTS3LtaFnS8G_2 2024-08-08T23:54:05.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.859+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.863+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-08T23:54:05.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.867+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.867+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-08T23:54:05.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8740020376603191148', time=2024-08-09T01:49:26.989061+0000, chain.objs.size()=1 2024-08-08T23:54:05.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.kNYKSnlLZx1hlscgepxB4UyIaM73B61_1 2024-08-08T23:54:05.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18195015135753957291', time=2024-08-09T01:49:27.072587+0000, chain.objs.size()=5 2024-08-08T23:54:05.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1 2024-08-08T23:54:05.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.1_1 2024-08-08T23:54:05.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2 2024-08-08T23:54:05.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.2_1 2024-08-08T23:54:05.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.871+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-FROZEN.2~lES9ZqOYZeIUVFm9uDJj7UXsLSUczsG.3 2024-08-08T23:54:05.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.875+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.883+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-08T23:54:05.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9427506456995623029', time=2024-08-09T01:49:27.185222+0000, chain.objs.size()=3 2024-08-08T23:54:05.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.1 2024-08-08T23:54:05.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.2 2024-08-08T23:54:05.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.887+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-STANDARD.2~bBR5JiIa1MWMTvzqH1EtIkOr6Y2meYY.3 2024-08-08T23:54:05.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.891+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.899+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-08T23:54:05.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.903+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.903+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.907+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.907+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-08T23:54:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.911+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.915+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.915+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.915+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3475198129503779459', time=2024-08-09T01:49:26.920136+0000, chain.objs.size()=2 2024-08-08T23:54:05.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.915+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_0 2024-08-08T23:54:05.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.915+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16__shadow_.PM-LvJspCaw388Kt92-ylkKKZ71nLOO_1 2024-08-08T23:54:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.923+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.927+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-08T23:54:05.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.931+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.931+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.935+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.935+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-08T23:54:05.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.939+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.943+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.943+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.943+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-08T23:54:05.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.947+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-08T23:54:05.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_yVwbKHbWDotBKgD0hWMY-yOjGi45bm_', time=2024-08-09T01:49:27.082020+0000, chain.objs.size()=3 2024-08-08T23:54:05.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_0 2024-08-08T23:54:05.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_1 2024-08-08T23:54:05.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.HiwXXDhXsB9iTv4VWwOtkP8EU-yFGbM_2 2024-08-08T23:54:05.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_j643ZazwBmQh0xBhcjU9MuvrYB4572Z', time=2024-08-09T01:49:27.161408+0000, chain.objs.size()=1 2024-08-08T23:54:05.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.951+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.OfEVwON5y0_7MAsVGcUdNYW2NwcOjqh_0 2024-08-08T23:54:05.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.959+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.963+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-08T23:54:05.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.967+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.971+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.971+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.971+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='_7nxR25cBIV1RCftUcvvw41QTgJDXyxU', time=2024-08-09T01:49:27.140944+0000, chain.objs.size()=2 2024-08-08T23:54:05.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.971+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.sh-cBEorFMdHuzkJ3ITVvH0HoYa45pZ_1 2024-08-08T23:54:05.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.971+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_.sh-cBEorFMdHuzkJ3ITVvH0HoYa45pZ_2 2024-08-08T23:54:05.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.975+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.983+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-08T23:54:05.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.987+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:05.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.987+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:05.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-08T23:54:05.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6043401729715430728', time=2024-08-09T01:49:27.104230+0000, chain.objs.size()=5 2024-08-08T23:54:05.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1 2024-08-08T23:54:05.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.1_1 2024-08-08T23:54:05.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2 2024-08-08T23:54:05.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__shadow_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.2_1 2024-08-08T23:54:05.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.991+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17__multipart_foo-LUKEWARM.2~BsUNjGCYiqATaMD1DGKmCGtwyBVpAPk.3 2024-08-08T23:54:05.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:05.995+0000 7f5327ffa980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-08T23:54:06.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.003+0000 7f5327ffa980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-08T23:54:06.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.007+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.007+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.011+0000 7f5327ffa980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.015+0000 7f51dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:06.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.019+0000 7f5327ffa980 20 remove_watcher() i=0 2024-08-08T23:54:06.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.019+0000 7f5327ffa980 2 removed watcher, disabling cache 2024-08-08T23:54:06.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.023+0000 7f5327ffa980 20 remove_watcher() i=1 2024-08-08T23:54:06.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.027+0000 7f5327ffa980 20 remove_watcher() i=2 2024-08-08T23:54:06.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.027+0000 7f5327ffa980 20 remove_watcher() i=3 2024-08-08T23:54:06.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.031+0000 7f5327ffa980 20 remove_watcher() i=4 2024-08-08T23:54:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.031+0000 7f5327ffa980 20 remove_watcher() i=5 2024-08-08T23:54:06.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.035+0000 7f5327ffa980 20 remove_watcher() i=6 2024-08-08T23:54:06.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.035+0000 7f5327ffa980 20 remove_watcher() i=7 2024-08-08T23:54:06.052 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-08T23:54:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-08T23:54:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-08T23:54:06.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.171+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 realm 2024-08-08T23:54:06.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-08T23:54:06.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:06.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.175+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.179+0000 7fa56e9ad980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-08T23:54:06.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.179+0000 7fa56e9ad980 20 searching for the correct realm 2024-08-08T23:54:06.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.179+0000 7fa56ccc2640 0 -- 172.21.15.83:0/2692638385 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fa5600383f0 msgr2=0x7fa5600387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:54:06.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.395+0000 7fa56bcc0640 0 -- 172.21.15.83:0/2692638385 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fa55c00c730 msgr2=0x7fa55c020030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got default.zone. 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-08T23:54:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-08T23:54:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.611+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados_obj.operate() r=0 bl.length=46 2024-08-08T23:54:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados_obj.operate() r=0 bl.length=470 2024-08-08T23:54:06.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 zone default found 2024-08-08T23:54:06.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 4 Realm: () 2024-08-08T23:54:06.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-08T23:54:06.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-08T23:54:06.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-08T23:54:06.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 zonegroup default 2024-08-08T23:54:06.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados->read ofs=0 len=0 2024-08-08T23:54:06.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-08T23:54:06.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 started sync module instance, tier type = 2024-08-08T23:54:06.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.615+0000 7fa56e9ad980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-08T23:54:06.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=0 2024-08-08T23:54:06.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=1 2024-08-08T23:54:06.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=2 2024-08-08T23:54:06.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=3 2024-08-08T23:54:06.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=4 2024-08-08T23:54:06.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=5 2024-08-08T23:54:06.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=6 2024-08-08T23:54:06.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 20 add_watcher() i=7 2024-08-08T23:54:06.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.639+0000 7fa56e9ad980 2 all 8 watchers are set, enabling cache 2024-08-08T23:54:06.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.643+0000 7fa422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:06.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.647+0000 7fa56e9ad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-08T23:54:06.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.647+0000 7fa56e9ad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-08T23:54:06.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.739+0000 7fa421fdb640 20 reqs_thread_entry: start 2024-08-08T23:54:06.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.739+0000 7fa56e9ad980 20 init_complete bucket index max shards: 1 2024-08-08T23:54:06.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.739+0000 7fa56e9ad980 20 Filter name: none 2024-08-08T23:54:06.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.739+0000 7fa3937fe640 20 reqs_thread_entry: start 2024-08-08T23:54:06.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.739+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-08T23:54:06.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.743+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.743+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.743+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.743+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-08T23:54:06.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.747+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.747+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.751+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.751+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-08T23:54:06.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.755+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.759+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.759+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.759+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-08T23:54:06.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.763+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.763+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.763+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.763+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-08T23:54:06.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.767+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.767+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.771+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.771+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-08T23:54:06.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.775+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.775+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.775+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.779+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-08T23:54:06.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.779+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.779+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.779+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.783+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-08T23:54:06.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.787+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.787+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.787+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.787+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-08T23:54:06.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.791+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.791+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.795+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.795+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-08T23:54:06.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.799+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.799+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.799+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.803+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-08T23:54:06.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.803+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.807+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.807+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.807+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-08T23:54:06.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.811+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.811+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.811+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.815+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-08T23:54:06.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.815+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.819+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.819+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.819+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-08T23:54:06.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.823+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.823+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.827+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.827+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-08T23:54:06.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.831+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.831+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.831+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.831+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-08T23:54:06.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.835+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.835+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.835+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.839+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-08T23:54:06.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.843+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.843+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.843+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.843+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-08T23:54:06.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.847+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.847+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.851+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.851+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-08T23:54:06.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.855+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.855+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.855+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.859+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-08T23:54:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.863+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.863+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.867+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.867+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-08T23:54:06.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.871+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.871+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.871+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.875+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-08T23:54:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.875+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.879+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.879+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.883+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-08T23:54:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.887+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.887+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.887+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.891+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-08T23:54:06.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.895+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.895+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.899+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.899+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-08T23:54:06.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.903+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.903+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.907+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.911+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-08T23:54:06.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.915+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.915+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.915+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.919+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-08T23:54:06.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.923+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.923+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.927+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.927+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-08T23:54:06.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.931+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.935+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.935+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.939+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-08T23:54:06.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.943+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.943+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.943+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.947+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-08T23:54:06.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.951+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.951+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.955+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.955+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-08T23:54:06.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.959+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.963+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.963+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.967+0000 7fa56e9ad980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-08T23:54:06.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.971+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.971+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-08T23:54:06.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.971+0000 7fa56e9ad980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-08T23:54:06.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.979+0000 7fa422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-08T23:54:06.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.983+0000 7fa56e9ad980 20 remove_watcher() i=0 2024-08-08T23:54:06.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.983+0000 7fa56e9ad980 2 removed watcher, disabling cache 2024-08-08T23:54:06.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.987+0000 7fa56e9ad980 20 remove_watcher() i=1 2024-08-08T23:54:06.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.987+0000 7fa56e9ad980 20 remove_watcher() i=2 2024-08-08T23:54:06.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.991+0000 7fa56e9ad980 20 remove_watcher() i=3 2024-08-08T23:54:06.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.995+0000 7fa56e9ad980 20 remove_watcher() i=4 2024-08-08T23:54:06.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.995+0000 7fa56e9ad980 20 remove_watcher() i=5 2024-08-08T23:54:06.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.995+0000 7fa56e9ad980 20 remove_watcher() i=6 2024-08-08T23:54:06.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-08T23:54:06.999+0000 7fa56e9ad980 20 remove_watcher() i=7 2024-08-08T23:54:07.014 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-08-08T23:54:07.642 INFO:teuthology.orchestra.run.smithi083.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-08-08T23:54:12.142 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean UP-TO-DATE 2024-08-08T23:54:31.042 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-08-08T23:54:31.042 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-08-08T23:54:31.042 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-08-08T23:54:31.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:31.842 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-08-08T23:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-08T23:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-08T23:54:31.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-08-08T23:54:31.843 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-08-08T23:54:38.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:38.042 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-08-08T23:54:38.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:38.042 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-08-08T23:54:46.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:46.342 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-08-08T23:54:46.942 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:46.942 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-08-08T23:54:47.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:47.142 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-08-08T23:54:47.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:47.742 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-08-08T23:54:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:58.642 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-08-08T23:54:59.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:59.242 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-08-08T23:54:59.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:59.342 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-08-08T23:54:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:59.542 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-08-08T23:54:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:54:59.742 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-08-08T23:55:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:55:00.342 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-08-08T23:55:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:55:09.543 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-08-08T23:55:10.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:55:10.742 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-08-08T23:55:11.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:55:11.142 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-08-08T23:55:11.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08 23:55:11,078 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-08T23:56:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:00.244 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-08-08T23:56:01.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:01.347 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-08-08T23:56:01.547 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:01.547 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-08-08T23:56:02.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:02.143 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-08-08T23:56:02.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:02.343 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-08-08T23:56:03.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:03.243 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-08-08T23:56:20.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-08-08T23:56:21.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:21.643 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-08-08T23:56:21.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:21.743 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-08-08T23:56:21.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:21.943 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-08-08T23:56:32.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:32.744 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-08-08T23:56:34.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:34.644 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests STANDARD_OUT 2024-08-08T23:56:34.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08 23:56:34,587 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-08T23:56:34.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08 23:56:34,593 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-08T23:56:34.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08 23:56:34,594 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-08T23:56:35.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:35.243 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-08-08T23:56:48.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:48.044 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-08-08T23:56:49.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:49.043 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-08-08T23:56:53.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:53.344 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-08-08T23:56:54.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:56:54.043 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-08-08T23:59:26.645 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:26.645 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-08-08T23:59:27.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:27.344 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-08-08T23:59:38.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:38.044 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-08-08T23:59:38.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:38.644 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-08-08T23:59:47.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:47.744 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-08-08T23:59:48.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-08-08T23:59:51.844 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-08T23:59:51.844 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-08-09T00:00:01.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:01.744 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-08-09T00:00:02.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:02.345 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-08-09T00:00:04.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:04.144 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-08-09T00:00:04.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:04.644 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-08-09T00:00:05.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:05.344 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-08-09T00:00:05.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:05.644 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-08-09T00:00:06.244 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:06.244 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-08-09T00:00:06.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:06.544 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-08-09T00:00:07.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:07.144 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-08-09T00:00:07.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:07.345 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-08-09T00:00:08.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:08.044 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-08-09T00:00:08.244 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:08.244 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-08-09T00:00:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:08.944 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-08-09T00:00:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:09.144 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-08-09T00:00:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:09.744 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-08-09T00:00:28.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:28.545 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-08-09T00:00:29.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:29.245 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-08-09T00:00:29.245 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 6m 22s 2024-08-09T00:00:29.246 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-08-09T00:00:29.587 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:29.619 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:29.619 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:29.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 realm 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.663+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:29.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:29.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:29.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:29.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:29.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:29.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.667+0000 7f16afa0a980 20 searching for the correct realm 2024-08-09T00:00:29.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.671+0000 7f16add1f640 0 -- 172.21.15.83:0/2488887958 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f169807e720 msgr2=0x7f169806a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:00:29.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:29.887+0000 7f16acd1d640 0 -- 172.21.15.83:0/2488887958 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f16a80ff5d0 msgr2=0x7f16a80ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:00:30.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:30.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:30.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:30.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:30.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:30.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:30.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.103+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:30.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:30.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 zone default found 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 4 Realm: () 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 zonegroup default 2024-08-09T00:00:30.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 started sync module instance, tier type = 2024-08-09T00:00:30.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.107+0000 7f16afa0a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:30.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=0 2024-08-09T00:00:30.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=1 2024-08-09T00:00:30.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=2 2024-08-09T00:00:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=3 2024-08-09T00:00:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=4 2024-08-09T00:00:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=5 2024-08-09T00:00:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=6 2024-08-09T00:00:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 20 add_watcher() i=7 2024-08-09T00:00:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.131+0000 7f16afa0a980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:30.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.135+0000 7f15637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.135+0000 7f16afa0a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.135+0000 7f16afa0a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.219+0000 7f15627e4640 20 reqs_thread_entry: start 2024-08-09T00:00:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.223+0000 7f16afa0a980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.223+0000 7f16afa0a980 20 Filter name: none 2024-08-09T00:00:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.223+0000 7f14d3fff640 20 reqs_thread_entry: start 2024-08-09T00:00:30.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.223+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:30.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8687358618866339846', time=2024-08-09T01:55:46.252940+0000, chain.objs.size()=7 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.1 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.1_1 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.1_2 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.2 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.2_1 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.2_2 2024-08-09T00:00:30.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.227+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~Qr1O2YRhB6gGU2CU_iPVH4LwUvzGNRl.3 2024-08-09T00:00:30.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.235+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.239+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:30.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.243+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8499100203568032520', time=2024-08-09T01:58:32.681965+0000, chain.objs.size()=21 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.1 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.1_1 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.2 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.2_1 2024-08-09T00:00:30.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.3 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.3_1 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.4 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.4_1 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.5 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.5_1 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.6 2024-08-09T00:00:30.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.247+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.6_1 2024-08-09T00:00:30.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.7 2024-08-09T00:00:30.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.7_1 2024-08-09T00:00:30.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.8 2024-08-09T00:00:30.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.8_1 2024-08-09T00:00:30.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.9 2024-08-09T00:00:30.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.9_1 2024-08-09T00:00:30.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.10 2024-08-09T00:00:30.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.10_1 2024-08-09T00:00:30.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.259+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~h8oEEvxhTVw42p0XkwEsuAh6nRoDfdY.11 2024-08-09T00:00:30.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.271+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.279+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.283+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.283+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.283+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.283+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:30.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.287+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.287+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11542020547246907415', time=2024-08-09T01:54:58.868587+0000, chain.objs.size()=9 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__multipart_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.1 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__shadow_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.1_1 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__multipart_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.2 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__shadow_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.2_1 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__multipart_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.3 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__shadow_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.3_1 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__multipart_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.4 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__shadow_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.4_1 2024-08-09T00:00:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.291+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.32__multipart_key1.2~t-zO30vK9NVgHXtoPT2nQBIV0NmkfBI.5 2024-08-09T00:00:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.299+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-09T00:00:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2559874919139270846', time=2024-08-09T01:59:47.918764+0000, chain.objs.size()=9 2024-08-09T00:00:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__multipart_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.1 2024-08-09T00:00:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__shadow_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.1_1 2024-08-09T00:00:30.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__multipart_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.2 2024-08-09T00:00:30.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__shadow_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.2_1 2024-08-09T00:00:30.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__multipart_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.3 2024-08-09T00:00:30.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__shadow_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.3_1 2024-08-09T00:00:30.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__multipart_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.4 2024-08-09T00:00:30.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__shadow_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.4_1 2024-08-09T00:00:30.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.47__multipart_key1.2~k7zYd9tSmwy08HCy5gf-3vJxtccsT8U.5 2024-08-09T00:00:30.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0', time=2024-08-09T01:59:56.529921+0000, chain.objs.size()=1 2024-08-09T00:00:30.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.17 2024-08-09T00:00:30.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0', time=2024-08-09T01:59:57.213386+0000, chain.objs.size()=26 2024-08-09T00:00:30.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.1 2024-08-09T00:00:30.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.307+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.2 2024-08-09T00:00:30.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.3 2024-08-09T00:00:30.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.4 2024-08-09T00:00:30.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.5 2024-08-09T00:00:30.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.6 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.7 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.8 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.9 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.10 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.11 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.12 2024-08-09T00:00:30.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.319+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.13 2024-08-09T00:00:30.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.323+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.14 2024-08-09T00:00:30.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.15 2024-08-09T00:00:30.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.16 2024-08-09T00:00:30.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.zkA-ImF9Kl0uT0P_PR5yL8ERw7cQhvhy.17 2024-08-09T00:00:30.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.18 2024-08-09T00:00:30.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.19 2024-08-09T00:00:30.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.20 2024-08-09T00:00:30.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.21 2024-08-09T00:00:30.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.22 2024-08-09T00:00:30.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.24 2024-08-09T00:00:30.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.25 2024-08-09T00:00:30.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.331+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.26 2024-08-09T00:00:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.335+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.48__multipart_key1.2~pwDsa5GFp4Lh87hrrfRelMYf4kmIIr0.27 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10226789184020105190', time=2024-08-09T02:00:28.719793+0000, chain.objs.size()=21 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.1 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.1_1 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.2 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.2_1 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.3 2024-08-09T00:00:30.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.3_1 2024-08-09T00:00:30.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.4 2024-08-09T00:00:30.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.4_1 2024-08-09T00:00:30.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.5 2024-08-09T00:00:30.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.339+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.5_1 2024-08-09T00:00:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.343+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.6 2024-08-09T00:00:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.343+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.6_1 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.7 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.7_1 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.8 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.8_1 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.9 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.9_1 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.10 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__shadow_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.10_1 2024-08-09T00:00:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.347+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.56__multipart_key1.2~grhy-_U5XfL-PKi-BKGyL-zcTKa16WT.11 2024-08-09T00:00:30.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.359+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.359+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1247774560033133421', time=2024-08-09T01:56:34.350162+0000, chain.objs.size()=9 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__multipart_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.1 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__shadow_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.1_1 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__multipart_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.2 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__shadow_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.2_1 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__multipart_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.3 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__shadow_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.3_1 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__multipart_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.4 2024-08-09T00:00:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__shadow_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.4_1 2024-08-09T00:00:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.42__multipart_key1.2~FiYrOfpZcKRuCkO-rsxXby3XrVEf15x.5 2024-08-09T00:00:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='2~DXmrahntJvvW-hlZSq61mGg5H2WA871', time=2024-08-09T01:56:53.769884+0000, chain.objs.size()=5 2024-08-09T00:00:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.44__multipart_key1.2~DXmrahntJvvW-hlZSq61mGg5H2WA871.7 2024-08-09T00:00:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.44__shadow_key1.2~DXmrahntJvvW-hlZSq61mGg5H2WA871.7_1 2024-08-09T00:00:30.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.363+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.44__multipart_key1.2~DXmrahntJvvW-hlZSq61mGg5H2WA871.10 2024-08-09T00:00:30.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.367+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.44__shadow_key1.2~DXmrahntJvvW-hlZSq61mGg5H2WA871.10_1 2024-08-09T00:00:30.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.371+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.44__multipart_key1.2~DXmrahntJvvW-hlZSq61mGg5H2WA871.13 2024-08-09T00:00:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.375+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.379+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6152650742872424530', time=2024-08-09T01:56:00.955210+0000, chain.objs.size()=5 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.36__shadow_.ZmRG6XzwyEfdvGDe5qC4BQ_ftEH-bjn_1 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.36__shadow_.ZmRG6XzwyEfdvGDe5qC4BQ_ftEH-bjn_2 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.36__shadow_.ZmRG6XzwyEfdvGDe5qC4BQ_ftEH-bjn_3 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.36__shadow_.ZmRG6XzwyEfdvGDe5qC4BQ_ftEH-bjn_4 2024-08-09T00:00:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.383+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.36__shadow_.ZmRG6XzwyEfdvGDe5qC4BQ_ftEH-bjn_5 2024-08-09T00:00:30.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.387+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.391+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.391+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.391+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.395+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.395+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:30.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.395+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.395+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.395+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:30.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14925041463260910187', time=2024-08-09T01:56:00.500459+0000, chain.objs.size()=7 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.1 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.1_1 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.1_2 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.2 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.2_1 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.2_2 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~NGn9DObpVE0dOiEu4s-JZ1MB5xVFetC.3 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5874895048619821772', time=2024-08-09T01:56:21.181137+0000, chain.objs.size()=9 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__multipart_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.1 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__shadow_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.1_1 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__multipart_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.2 2024-08-09T00:00:30.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__shadow_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.2_1 2024-08-09T00:00:30.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.399+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__multipart_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.3 2024-08-09T00:00:30.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.403+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__shadow_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.3_1 2024-08-09T00:00:30.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__multipart_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.4 2024-08-09T00:00:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__shadow_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.4_1 2024-08-09T00:00:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.41__multipart_key1.2~J60_c_x8VfSIVS1Q0yL95UU0cPV0Ond.5 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1285975260173636399', time=2024-08-09T01:58:50.612736+0000, chain.objs.size()=19 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.1 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.1_1 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.2 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.2_1 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.3 2024-08-09T00:00:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.3_1 2024-08-09T00:00:30.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.407+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.4 2024-08-09T00:00:30.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.4_1 2024-08-09T00:00:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.5 2024-08-09T00:00:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.5_1 2024-08-09T00:00:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.6 2024-08-09T00:00:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.6_1 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.7 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.7_1 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.8 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.8_1 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.9 2024-08-09T00:00:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.415+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.9_1 2024-08-09T00:00:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.419+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~tMlv8elniqifjOvAqTCFL8PW5h6rvK8.10 2024-08-09T00:00:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.423+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.427+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1433728816867760402', time=2024-08-09T01:55:40.957478+0000, chain.objs.size()=9 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.1 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.1_1 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.2 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.2_1 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.3 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.3_1 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.4 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.4_1 2024-08-09T00:00:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.431+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~GJivns8wr3Tjn8Q1JVZ_I2_sey49XiX.5 2024-08-09T00:00:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.435+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.439+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:30.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.439+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12127394104235657576', time=2024-08-09T01:56:00.170786+0000, chain.objs.size()=7 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.1 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.1_1 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.1_2 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.2 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.2_1 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.2_2 2024-08-09T00:00:30.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.443+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~kRVtbiGp5cHsXXNh574gPAnMUANOjgo.3 2024-08-09T00:00:30.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.447+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.447+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:30.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr', time=2024-08-09T01:54:46.297949+0000, chain.objs.size()=9 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__multipart_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.1 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__shadow_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.1_1 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__multipart_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.2 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__shadow_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.2_1 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__multipart_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.3 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__shadow_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.3_1 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__multipart_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.4 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__shadow_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.4_1 2024-08-09T00:00:30.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.451+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.30__multipart_key1.2~sC8QEtAcT80-BsZUfTMG_jjQ04-K0yr.5 2024-08-09T00:00:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.455+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.459+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:30.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.459+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.459+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.691566949733514434', time=2024-08-09T01:55:09.830620+0000, chain.objs.size()=9 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.1 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.1_1 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.2 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.2_1 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.3 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.3_1 2024-08-09T00:00:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.4 2024-08-09T00:00:30.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.4_1 2024-08-09T00:00:30.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.463+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.5 2024-08-09T00:00:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.467+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.467+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.988077944421057697', time=2024-08-09T01:55:30.416967+0000, chain.objs.size()=9 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.1 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.1_1 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.2 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.2_1 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.3 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.3_1 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.4 2024-08-09T00:00:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.4_1 2024-08-09T00:00:30.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.471+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~S5iH-wdy9Xe95XjTiNiMbCYQScW2LqH.5 2024-08-09T00:00:30.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.475+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.479+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:30.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.479+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.479+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.479+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.483+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:30.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.483+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.483+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.483+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:30.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15024764619677903815', time=2024-08-09T01:55:36.208543+0000, chain.objs.size()=9 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.1 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.1_1 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.2 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.2_1 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.3 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.3_1 2024-08-09T00:00:30.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.4 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__shadow_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.4_1 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.37__multipart_key1.2~_8tqfimpfT_fX688_IUg01-HKv2zYxO.5 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11273086746200758295', time=2024-08-09T01:56:48.457546+0000, chain.objs.size()=1 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__shadow_.twgTc2ZZFvdnpQkrTlrdYEfKfGW6TrQ_1 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11052441466396171532', time=2024-08-09T01:59:26.902501+0000, chain.objs.size()=16 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.1 2024-08-09T00:00:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.487+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.1_1 2024-08-09T00:00:30.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.491+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.1_2 2024-08-09T00:00:30.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.491+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.2 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.2_1 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.2_2 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.3 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.3_1 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.3_2 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.4 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.4_1 2024-08-09T00:00:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.4_2 2024-08-09T00:00:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.5 2024-08-09T00:00:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.5_1 2024-08-09T00:00:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.495+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.5_2 2024-08-09T00:00:30.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.503+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~VAtVsyoHUJ0xY9gsGXlVy74egS2wuYV.6 2024-08-09T00:00:30.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.503+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.507+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:30.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.507+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:30.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14939560445386977280', time=2024-08-09T01:55:10.302838+0000, chain.objs.size()=9 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.1 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.1_1 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.2 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.2_1 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.3 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.3_1 2024-08-09T00:00:30.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.4 2024-08-09T00:00:30.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__shadow_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.4_1 2024-08-09T00:00:30.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.511+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.34__multipart_key1.2~8ptFoP-Ckc6d6uItF2rIyqSSqGrtpRl.5 2024-08-09T00:00:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.519+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:30.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17784872485362147141', time=2024-08-09T01:59:08.941530+0000, chain.objs.size()=16 2024-08-09T00:00:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.1 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.1_1 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.1_2 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.2 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.2_1 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.2_2 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.3 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.3_1 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.3_2 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.4 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.4_1 2024-08-09T00:00:30.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.523+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.4_2 2024-08-09T00:00:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.527+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.5 2024-08-09T00:00:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.527+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.5_1 2024-08-09T00:00:30.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.527+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.5_2 2024-08-09T00:00:30.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.527+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~yb3OBt_lQqLLG6AwMrfpDLyXgyOUbZK.6 2024-08-09T00:00:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.535+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.535+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:30.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.539+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.539+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.539+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.539+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:30.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.539+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.543+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.543+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.543+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:30.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.543+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.547+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:30.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1751398974604973205', time=2024-08-09T01:59:26.542930+0000, chain.objs.size()=16 2024-08-09T00:00:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.1 2024-08-09T00:00:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.1_1 2024-08-09T00:00:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.1_2 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.2 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.2_1 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.2_2 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.3 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.3_1 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.3_2 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.4 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.4_1 2024-08-09T00:00:30.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.551+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.4_2 2024-08-09T00:00:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.555+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.5 2024-08-09T00:00:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.555+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.5_1 2024-08-09T00:00:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.555+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.5_2 2024-08-09T00:00:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.555+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~NbdOSiJraofv9gAAhO5v2cr4QHeh8Xc.6 2024-08-09T00:00:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.559+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.563+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.567+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.567+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.567+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.567+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.567+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.571+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9742928246183440780', time=2024-08-09T01:56:48.285929+0000, chain.objs.size()=9 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__multipart_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.1 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__shadow_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.1_1 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__multipart_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.2 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__shadow_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.2_1 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__multipart_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.3 2024-08-09T00:00:30.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__shadow_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.3_1 2024-08-09T00:00:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__multipart_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.4 2024-08-09T00:00:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__shadow_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.4_1 2024-08-09T00:00:30.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.575+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.43__multipart_file.mpg.2~94SB5ZHkklq5gxaTyJ-Wbi_TvzSAJDG.5 2024-08-09T00:00:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.579+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.583+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.583+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.583+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.583+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.583+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.587+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.587+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.587+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.587+0000 7f16afa0a980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:30.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:30.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15510030536063539328', time=2024-08-09T01:58:14.191589+0000, chain.objs.size()=21 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.1 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.1_1 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.2 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.2_1 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.3 2024-08-09T00:00:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.3_1 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.4 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.4_1 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.5 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.5_1 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.6 2024-08-09T00:00:30.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.591+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.6_1 2024-08-09T00:00:30.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.7 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.7_1 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.8 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.8_1 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.9 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.9_1 2024-08-09T00:00:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.10 2024-08-09T00:00:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.595+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__shadow_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.10_1 2024-08-09T00:00:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.599+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.45__multipart_key1.2~_NBRQlt8vwTaJl5YrBqhwZYvEb8q0GN.11 2024-08-09T00:00:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.599+0000 7f16afa0a980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5867498146519043938', time=2024-08-09T01:59:38.270799+0000, chain.objs.size()=9 2024-08-09T00:00:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.599+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__multipart_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.1 2024-08-09T00:00:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.599+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__shadow_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.1_1 2024-08-09T00:00:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__multipart_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.2 2024-08-09T00:00:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__shadow_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.2_1 2024-08-09T00:00:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__multipart_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.3 2024-08-09T00:00:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__shadow_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.3_1 2024-08-09T00:00:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__multipart_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.4 2024-08-09T00:00:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__shadow_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.4_1 2024-08-09T00:00:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.603+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.46__multipart_key1.2~6qtAGf-TeW7UwTJY54fyWhoGxVsVquY.5 2024-08-09T00:00:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.611+0000 7f16afa0a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:00:30.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.615+0000 7f15637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:30.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.619+0000 7f16afa0a980 20 remove_watcher() i=0 2024-08-09T00:00:30.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.619+0000 7f16afa0a980 2 removed watcher, disabling cache 2024-08-09T00:00:30.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.619+0000 7f16afa0a980 20 remove_watcher() i=1 2024-08-09T00:00:30.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.619+0000 7f16afa0a980 20 remove_watcher() i=2 2024-08-09T00:00:30.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.623+0000 7f16afa0a980 20 remove_watcher() i=3 2024-08-09T00:00:30.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.623+0000 7f16afa0a980 20 remove_watcher() i=4 2024-08-09T00:00:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.623+0000 7f16afa0a980 20 remove_watcher() i=5 2024-08-09T00:00:30.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.623+0000 7f16afa0a980 20 remove_watcher() i=6 2024-08-09T00:00:30.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.627+0000 7f16afa0a980 20 remove_watcher() i=7 2024-08-09T00:00:30.639 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:30.709 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:30.709 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:30.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 realm 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.755+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.759+0000 7fdf6c37c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.759+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.759+0000 7fdf6c37c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:30.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.759+0000 7fdf6c37c980 20 searching for the correct realm 2024-08-09T00:00:30.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.763+0000 7fdf6a691640 0 -- 172.21.15.83:0/1761917831 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fdf60019040 msgr2=0x7fdf6005a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:30.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.771+0000 7fdf6968f640 0 -- 172.21.15.83:0/1761917831 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fdf5c0b7ab0 msgr2=0x7fdf5c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:30.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.987+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:30.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:30.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 zone default found 2024-08-09T00:00:30.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 4 Realm: () 2024-08-09T00:00:30.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:30.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:30.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:30.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 zonegroup default 2024-08-09T00:00:30.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados->read ofs=0 len=0 2024-08-09T00:00:30.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:30.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 started sync module instance, tier type = 2024-08-09T00:00:30.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:30.991+0000 7fdf6c37c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=0 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=1 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=2 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=3 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=4 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=5 2024-08-09T00:00:31.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.015+0000 7fdf6c37c980 20 add_watcher() i=6 2024-08-09T00:00:31.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.019+0000 7fdf6c37c980 20 add_watcher() i=7 2024-08-09T00:00:31.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.019+0000 7fdf6c37c980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:31.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.023+0000 7fde1bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:31.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.023+0000 7fdf6c37c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:31.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.023+0000 7fdf6c37c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.115+0000 7fde1affd640 20 reqs_thread_entry: start 2024-08-09T00:00:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.115+0000 7fdf6c37c980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.115+0000 7fdf6c37c980 20 Filter name: none 2024-08-09T00:00:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.115+0000 7fde18ff9640 20 reqs_thread_entry: start 2024-08-09T00:00:31.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.115+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:31.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.119+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.123+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.123+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.127+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:31.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.131+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.131+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.131+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.131+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:31.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.135+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.139+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.139+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.143+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:31.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.143+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.147+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.147+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.147+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:31.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.151+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.151+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.151+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.151+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:31.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.155+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.159+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.159+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.159+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.163+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.163+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.163+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.167+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.167+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.167+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.171+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.171+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:31.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.175+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.175+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.175+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.175+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:31.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.179+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.183+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.183+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.187+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:31.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.191+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.191+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.191+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.191+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.195+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.199+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.199+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.199+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.203+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.203+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.203+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.207+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:31.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.211+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.211+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.211+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.215+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:31.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.219+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.223+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.223+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.227+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.231+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.231+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.231+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.235+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:31.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.235+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.239+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.239+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.243+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:31.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.247+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.247+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.247+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.251+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:31.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.255+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.255+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.255+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.259+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.263+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.263+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.263+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.267+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:31.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.271+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.271+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.275+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.275+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:31.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.279+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.283+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.283+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.283+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:31.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.287+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.291+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.291+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.295+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.299+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.299+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.299+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.303+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:31.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.307+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.307+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.311+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.311+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:31.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.315+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.319+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.319+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.323+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:31.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.323+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.327+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.327+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.331+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:31.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.331+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.335+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.335+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.339+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:31.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.343+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.343+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.343+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.347+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:31.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.351+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.351+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.355+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.355+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:31.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.359+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.363+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.363+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.367+0000 7fdf6c37c980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:31.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.367+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.371+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.371+0000 7fdf6c37c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:31.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.375+0000 7fde1bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:31.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.379+0000 7fdf6c37c980 20 remove_watcher() i=0 2024-08-09T00:00:31.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.379+0000 7fdf6c37c980 2 removed watcher, disabling cache 2024-08-09T00:00:31.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.383+0000 7fdf6c37c980 20 remove_watcher() i=1 2024-08-09T00:00:31.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.387+0000 7fdf6c37c980 20 remove_watcher() i=2 2024-08-09T00:00:31.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.387+0000 7fdf6c37c980 20 remove_watcher() i=3 2024-08-09T00:00:31.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.391+0000 7fdf6c37c980 20 remove_watcher() i=4 2024-08-09T00:00:31.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.391+0000 7fdf6c37c980 20 remove_watcher() i=5 2024-08-09T00:00:31.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.395+0000 7fdf6c37c980 20 remove_watcher() i=6 2024-08-09T00:00:31.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.395+0000 7fdf6c37c980 20 remove_watcher() i=7 2024-08-09T00:00:31.414 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:31.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.931+0000 7fc8bcf6e640 0 --2- 172.21.15.83:0/4168131371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559508990df0 0x559508991270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-09T00:00:31.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:31.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 realm 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:31.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:31.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:31.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:31.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.947+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:31.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.951+0000 7fc8bf45a980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:31.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.951+0000 7fc8bf45a980 20 searching for the correct realm 2024-08-09T00:00:31.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:31.951+0000 7fc8bcf6e640 0 -- 172.21.15.83:0/4027041761 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7fc8b4020070 msgr2=0x7fc8b405a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:32.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.163+0000 7fc8bcf6e640 0 -- 172.21.15.83:0/4027041761 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x7fc8b4063e80 msgr2=0x7fc8b405ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:32.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:32.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:32.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:32.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:32.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:32.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:32.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.387+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 zone default found 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 4 Realm: () 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 zonegroup default 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 started sync module instance, tier type = 2024-08-09T00:00:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.391+0000 7fc8bf45a980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=0 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=1 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=2 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=3 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=4 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=5 2024-08-09T00:00:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.415+0000 7fc8bf45a980 20 add_watcher() i=6 2024-08-09T00:00:32.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.419+0000 7fc8bf45a980 20 add_watcher() i=7 2024-08-09T00:00:32.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.419+0000 7fc8bf45a980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:32.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.423+0000 7fc772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:32.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.423+0000 7fc8bf45a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:32.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.423+0000 7fc8bf45a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:32.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.511+0000 7fc771fe3640 20 reqs_thread_entry: start 2024-08-09T00:00:32.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.511+0000 7fc8bf45a980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:32.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.511+0000 7fc8bf45a980 20 Filter name: none 2024-08-09T00:00:32.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.511+0000 7fc6e37fe640 20 reqs_thread_entry: start 2024-08-09T00:00:32.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.511+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:32.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.515+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.515+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.515+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.519+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:32.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.523+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.523+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.523+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.527+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:32.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.531+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.531+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.531+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.535+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:32.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.539+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.539+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.539+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.539+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:32.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.543+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.543+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.547+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.547+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:32.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.551+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.551+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.551+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.551+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:32.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.555+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.555+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.559+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.559+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:32.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.563+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.567+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.567+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.571+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:32.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.575+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.575+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.575+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.575+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:32.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.579+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.583+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.583+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.587+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:32.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.587+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.587+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.591+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.591+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:32.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.595+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.595+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.595+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.599+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:32.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.603+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.603+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.603+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.607+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:32.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.611+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.611+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.611+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.615+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:32.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.619+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.619+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.623+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.623+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:32.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.627+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.631+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.631+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.635+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:32.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.635+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.639+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.639+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.643+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:32.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.643+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.647+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.647+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.651+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:32.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.655+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.655+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.655+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.659+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:32.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.663+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.663+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.663+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.667+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:32.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.671+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.671+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.671+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.675+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:32.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.679+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.679+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.679+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.683+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:32.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.687+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.687+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.691+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.691+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:32.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.695+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.695+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.699+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.699+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:32.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.703+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.707+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.707+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.707+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:32.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.711+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.715+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.715+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.719+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.723+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.723+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.727+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.727+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.731+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.735+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.735+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.739+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.739+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.743+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.743+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.747+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.755+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.755+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.755+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.759+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:32.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.763+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.763+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.763+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.767+0000 7fc8bf45a980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:32.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.767+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.771+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:32.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.771+0000 7fc8bf45a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:32.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.775+0000 7fc772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:32.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.779+0000 7fc8bf45a980 20 remove_watcher() i=0 2024-08-09T00:00:32.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.779+0000 7fc8bf45a980 2 removed watcher, disabling cache 2024-08-09T00:00:32.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.783+0000 7fc8bf45a980 20 remove_watcher() i=1 2024-08-09T00:00:32.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.783+0000 7fc8bf45a980 20 remove_watcher() i=2 2024-08-09T00:00:32.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.787+0000 7fc8bf45a980 20 remove_watcher() i=3 2024-08-09T00:00:32.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.791+0000 7fc8bf45a980 20 remove_watcher() i=4 2024-08-09T00:00:32.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.791+0000 7fc8bf45a980 20 remove_watcher() i=5 2024-08-09T00:00:32.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.791+0000 7fc8bf45a980 20 remove_watcher() i=6 2024-08-09T00:00:32.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.795+0000 7fc8bf45a980 20 remove_watcher() i=7 2024-08-09T00:00:32.813 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:32.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 realm 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:32.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:32.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.935+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.939+0000 7f63d7def980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:32.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.939+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:32.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.939+0000 7f63d7def980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:32.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.939+0000 7f63d7def980 20 searching for the correct realm 2024-08-09T00:00:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:32.943+0000 7f63d6104640 0 -- 172.21.15.83:0/98256544 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f63cc05bfd0 msgr2=0x7f63cc05ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:33.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.159+0000 7f63d5102640 0 -- 172.21.15.83:0/98256544 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f63d0067600 msgr2=0x7f63d005a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:33.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:33.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.375+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 zone default found 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 4 Realm: () 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 zonegroup default 2024-08-09T00:00:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:33.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:33.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados->read ofs=0 len=0 2024-08-09T00:00:33.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:33.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 started sync module instance, tier type = 2024-08-09T00:00:33.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.379+0000 7f63d7def980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=0 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=1 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=2 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=3 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=4 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=5 2024-08-09T00:00:33.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.415+0000 7f63d7def980 20 add_watcher() i=6 2024-08-09T00:00:33.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.419+0000 7f63d7def980 20 add_watcher() i=7 2024-08-09T00:00:33.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.419+0000 7f63d7def980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:33.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.423+0000 7f6287fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:33.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.423+0000 7f63d7def980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:33.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.423+0000 7f63d7def980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:33.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.515+0000 7f6286ffd640 20 reqs_thread_entry: start 2024-08-09T00:00:33.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.515+0000 7f63d7def980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:33.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.515+0000 7f63d7def980 20 Filter name: none 2024-08-09T00:00:33.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.515+0000 7f6284ff9640 20 reqs_thread_entry: start 2024-08-09T00:00:33.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.515+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:33.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.519+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.519+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.523+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.523+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:33.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.527+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.527+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.527+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.531+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:33.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.535+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.535+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.535+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.539+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:33.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.543+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.543+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.543+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.547+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:33.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.551+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.551+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.555+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.555+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:33.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.559+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.559+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.559+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.563+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:33.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.567+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.567+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.571+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.571+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:33.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.575+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.575+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.579+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.579+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:33.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.583+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.583+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.587+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.587+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:33.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.591+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.595+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.595+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.595+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:33.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.599+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.603+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.603+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.607+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:33.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.611+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.611+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.611+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.615+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:33.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.619+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.619+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.619+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.623+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:33.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.627+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.631+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.631+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.631+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:33.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.635+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.639+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.639+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.643+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:33.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.643+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.647+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.647+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.651+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:33.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.655+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.655+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.655+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.659+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:33.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.663+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.663+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.667+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.667+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:33.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.671+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.675+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.675+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.675+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:33.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.683+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.683+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.683+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.687+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:33.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.691+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.691+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.691+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.695+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:33.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.699+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.699+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.703+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.703+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:33.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.707+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.711+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.711+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.715+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:33.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.719+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.719+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.719+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.723+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:33.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.727+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.727+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.731+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.731+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:33.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.735+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.735+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.739+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.739+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.743+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.747+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.747+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.751+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:33.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.751+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.755+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.755+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.759+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:33.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.763+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.763+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.763+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.767+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:33.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.771+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.771+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.771+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.775+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:33.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.779+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.779+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.779+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.783+0000 7f63d7def980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:33.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.787+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.791+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:33.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.791+0000 7f63d7def980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:33.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.795+0000 7f6287fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:33.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.799+0000 7f63d7def980 20 remove_watcher() i=0 2024-08-09T00:00:33.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.799+0000 7f63d7def980 2 removed watcher, disabling cache 2024-08-09T00:00:33.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.803+0000 7f63d7def980 20 remove_watcher() i=1 2024-08-09T00:00:33.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.803+0000 7f63d7def980 20 remove_watcher() i=2 2024-08-09T00:00:33.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.807+0000 7f63d7def980 20 remove_watcher() i=3 2024-08-09T00:00:33.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.807+0000 7f63d7def980 20 remove_watcher() i=4 2024-08-09T00:00:33.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.811+0000 7f63d7def980 20 remove_watcher() i=5 2024-08-09T00:00:33.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.811+0000 7f63d7def980 20 remove_watcher() i=6 2024-08-09T00:00:33.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:33.815+0000 7f63d7def980 20 remove_watcher() i=7 2024-08-09T00:00:33.832 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-08-09T00:00:34.525 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean 2024-08-09T00:00:35.422 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-08-09T00:00:35.423 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-08-09T00:00:35.423 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-08-09T00:00:35.923 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:35.923 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-08-09T00:00:35.924 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-09T00:00:35.924 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-09T00:00:35.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:35.925 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-08-09T00:00:35.925 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests STANDARD_OUT 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09 00:00:37,258 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-08-09T00:00:37.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:37.925 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-08-09T00:00:38.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:38.023 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-08-09T00:00:38.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:38.422 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-08-09T00:00:38.522 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:38.523 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-08-09T00:00:39.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:39.022 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-08-09T00:00:39.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:39.322 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-08-09T00:00:39.522 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:39.522 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-08-09T00:00:39.822 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:39.822 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-08-09T00:00:40.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:40.323 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-08-09T00:00:40.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:40.422 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-08-09T00:00:40.522 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:40.522 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-08-09T00:00:40.922 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:40.922 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-08-09T00:00:41.722 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:41.723 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-08-09T00:00:41.923 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:41.923 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-08-09T00:00:42.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:42.422 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-08-09T00:00:42.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:42.423 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-08-09T00:00:42.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------- 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------- 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 8s 2024-08-09T00:00:42.591 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 5 executed 2024-08-09T00:00:42.598 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:42.624 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:42.624 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:42.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 realm 2024-08-09T00:00:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:42.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:42.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:42.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:42.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:42.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:42.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.667+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:42.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.671+0000 7f2a7bed1980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:42.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.671+0000 7f2a7bed1980 20 searching for the correct realm 2024-08-09T00:00:42.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:42.879+0000 7f2a7a1e6640 0 -- 172.21.15.83:0/1844380275 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f2a640c0020 msgr2=0x7f2a640ef290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:00:43.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.295+0000 7f2a791e4640 0 -- 172.21.15.83:0/1844380275 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f2a6c02c040 msgr2=0x7f2a6c036820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:43.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.307+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:43.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:43.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 zone default found 2024-08-09T00:00:43.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 4 Realm: () 2024-08-09T00:00:43.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:43.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:43.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:43.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 zonegroup default 2024-08-09T00:00:43.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 started sync module instance, tier type = 2024-08-09T00:00:43.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.311+0000 7f2a7bed1980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:43.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=0 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=1 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=2 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=3 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=4 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=5 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.335+0000 7f2a7bed1980 20 add_watcher() i=6 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.339+0000 7f2a7bed1980 20 add_watcher() i=7 2024-08-09T00:00:43.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.339+0000 7f2a7bed1980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:43.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.343+0000 7f292b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:43.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.343+0000 7f2a7bed1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:43.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.343+0000 7f2a7bed1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:43.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.443+0000 7f292a7fc640 20 reqs_thread_entry: start 2024-08-09T00:00:43.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.443+0000 7f2a7bed1980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:43.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.443+0000 7f2a7bed1980 20 Filter name: none 2024-08-09T00:00:43.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.443+0000 7f289bfff640 20 reqs_thread_entry: start 2024-08-09T00:00:43.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.443+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:43.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.447+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.451+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.451+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.451+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:43.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.455+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.455+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.455+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.459+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:43.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.463+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.463+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.463+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.467+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:43.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.471+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.471+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.471+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.475+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:43.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.475+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.475+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.479+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.479+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.483+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.483+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.483+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.487+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:43.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.491+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.491+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.491+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.495+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:43.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.499+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.499+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.499+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.499+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:43.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.503+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.507+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.507+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.511+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:43.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.511+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.511+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.515+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.515+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:43.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.519+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.519+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.519+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.523+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:43.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.527+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.527+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.527+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.531+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:43.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.535+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.535+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.535+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.539+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:43.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.543+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.543+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.543+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.547+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:43.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.551+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.551+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.551+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.551+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:43.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.559+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.559+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.559+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.563+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:43.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.567+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.567+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.567+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.571+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:43.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.575+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.575+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.575+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.579+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:43.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.583+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.583+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.583+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.587+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:43.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.591+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.591+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.591+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.595+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:43.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.599+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.599+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.599+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.603+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:43.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.607+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.611+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.611+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.611+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:43.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.615+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.619+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.619+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.623+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.627+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.627+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.627+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.631+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:43.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.635+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.635+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.635+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.639+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:43.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.643+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.643+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.643+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.647+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:43.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.651+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.655+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.655+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.659+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:43.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.663+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.663+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.663+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.667+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:43.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.671+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.671+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.671+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.675+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:43.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.679+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.679+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.683+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.683+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:43.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.687+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.691+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.691+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.691+0000 7f2a7bed1980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:43.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.699+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.699+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.699+0000 7f2a7bed1980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.707+0000 7f292b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:43.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.711+0000 7f2a7bed1980 20 remove_watcher() i=0 2024-08-09T00:00:43.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.711+0000 7f2a7bed1980 2 removed watcher, disabling cache 2024-08-09T00:00:43.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.715+0000 7f2a7bed1980 20 remove_watcher() i=1 2024-08-09T00:00:43.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.715+0000 7f2a7bed1980 20 remove_watcher() i=2 2024-08-09T00:00:43.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.719+0000 7f2a7bed1980 20 remove_watcher() i=3 2024-08-09T00:00:43.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.723+0000 7f2a7bed1980 20 remove_watcher() i=4 2024-08-09T00:00:43.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.723+0000 7f2a7bed1980 20 remove_watcher() i=5 2024-08-09T00:00:43.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.727+0000 7f2a7bed1980 20 remove_watcher() i=6 2024-08-09T00:00:43.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.731+0000 7f2a7bed1980 20 remove_watcher() i=7 2024-08-09T00:00:43.755 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:43.827 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:43.827 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:43.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.871+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 realm 2024-08-09T00:00:43.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:43.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:43.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:43.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.875+0000 7fc415397980 20 searching for the correct realm 2024-08-09T00:00:43.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.883+0000 7fc4136ac640 0 -- 172.21.15.83:0/1950895730 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x55c903551a40 msgr2=0x55c903553e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:43.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.887+0000 7fc4126aa640 0 -- 172.21.15.83:0/1950895730 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fc40407cb00 msgr2=0x7fc404053720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.895+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 zone default found 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 4 Realm: () 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 zonegroup default 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados->read ofs=0 len=0 2024-08-09T00:00:43.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:43.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 started sync module instance, tier type = 2024-08-09T00:00:43.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.899+0000 7fc415397980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:43.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=0 2024-08-09T00:00:43.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=1 2024-08-09T00:00:43.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=2 2024-08-09T00:00:43.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=3 2024-08-09T00:00:43.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=4 2024-08-09T00:00:43.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=5 2024-08-09T00:00:43.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=6 2024-08-09T00:00:43.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 20 add_watcher() i=7 2024-08-09T00:00:43.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.923+0000 7fc415397980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:43.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.927+0000 7fc2c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:43.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.927+0000 7fc415397980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:43.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.927+0000 7fc415397980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.995+0000 7fc243fff640 20 reqs_thread_entry: start 2024-08-09T00:00:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.995+0000 7fc415397980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.995+0000 7fc415397980 20 Filter name: none 2024-08-09T00:00:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.995+0000 7fc241ffb640 20 reqs_thread_entry: start 2024-08-09T00:00:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.995+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:43.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.999+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:43.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.999+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:43.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.999+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:43.999+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:44.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.003+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.003+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.003+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.007+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:44.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.011+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.011+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.015+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.015+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:44.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.023+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.023+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.023+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.027+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:44.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.031+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.031+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.031+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.035+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:44.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.035+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.039+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.039+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.043+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:44.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.043+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.043+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.047+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.047+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:44.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.051+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.051+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.055+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.055+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:44.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.059+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.059+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.059+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.063+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:44.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.067+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.067+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.067+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.067+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:44.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.071+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.075+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.075+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.079+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:44.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.079+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.079+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.083+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.083+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:44.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.087+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.087+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.087+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.091+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:44.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.095+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.095+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.095+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.095+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:44.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.099+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.103+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.103+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.107+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:44.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.107+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.111+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.111+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.111+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:44.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.115+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.115+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.119+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.119+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:44.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.123+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.123+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.123+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.123+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:44.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.127+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.127+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.131+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.131+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:44.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.135+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.135+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.139+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.139+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:44.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.143+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.143+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.143+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.147+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:44.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.147+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.151+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.151+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.151+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:44.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.155+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.155+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.155+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.159+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:44.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.163+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.163+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.163+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.167+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:44.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.171+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.171+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.171+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.171+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:44.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.175+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.179+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.179+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.183+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:44.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.183+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.183+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.187+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.187+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:44.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.191+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.191+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.195+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.195+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:44.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.199+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.199+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.203+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.203+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:44.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.207+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.211+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.211+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.215+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:44.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.215+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.215+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.219+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.219+0000 7fc415397980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:44.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.223+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.223+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.227+0000 7fc415397980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.231+0000 7fc2c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:44.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.235+0000 7fc415397980 20 remove_watcher() i=0 2024-08-09T00:00:44.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.235+0000 7fc415397980 2 removed watcher, disabling cache 2024-08-09T00:00:44.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.239+0000 7fc415397980 20 remove_watcher() i=1 2024-08-09T00:00:44.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.239+0000 7fc415397980 20 remove_watcher() i=2 2024-08-09T00:00:44.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.243+0000 7fc415397980 20 remove_watcher() i=3 2024-08-09T00:00:44.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.247+0000 7fc415397980 20 remove_watcher() i=4 2024-08-09T00:00:44.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.247+0000 7fc415397980 20 remove_watcher() i=5 2024-08-09T00:00:44.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.251+0000 7fc415397980 20 remove_watcher() i=6 2024-08-09T00:00:44.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.251+0000 7fc415397980 20 remove_watcher() i=7 2024-08-09T00:00:44.273 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:44.343 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:44.343 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:44.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 realm 2024-08-09T00:00:44.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:44.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.387+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:44.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:44.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.391+0000 7f4eebcb8980 20 searching for the correct realm 2024-08-09T00:00:44.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.395+0000 7f4ee9fcd640 0 -- 172.21.15.83:0/438252196 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f4ee010b070 msgr2=0x7f4ee010f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:44.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.403+0000 7f4ee8fcb640 0 -- 172.21.15.83:0/438252196 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f4ee4091b10 msgr2=0x7f4ee40891e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:44.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.619+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:44.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:44.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 zone default found 2024-08-09T00:00:44.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 4 Realm: () 2024-08-09T00:00:44.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:44.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:44.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:44.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 zonegroup default 2024-08-09T00:00:44.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados->read ofs=0 len=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:44.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 started sync module instance, tier type = 2024-08-09T00:00:44.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.623+0000 7f4eebcb8980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:44.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=0 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=1 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=2 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=3 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=4 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=5 2024-08-09T00:00:44.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.647+0000 7f4eebcb8980 20 add_watcher() i=6 2024-08-09T00:00:44.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.651+0000 7f4eebcb8980 20 add_watcher() i=7 2024-08-09T00:00:44.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.651+0000 7f4eebcb8980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:44.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.655+0000 7f4d9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.655+0000 7f4eebcb8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.655+0000 7f4eebcb8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:44.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.751+0000 7f4d9efe5640 20 reqs_thread_entry: start 2024-08-09T00:00:44.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.751+0000 7f4eebcb8980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:44.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.751+0000 7f4eebcb8980 20 Filter name: none 2024-08-09T00:00:44.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.751+0000 7f4d9cfe1640 20 reqs_thread_entry: start 2024-08-09T00:00:44.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.751+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:44.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.755+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.755+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.755+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.759+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:44.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.759+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.763+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.763+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.767+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:44.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.771+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.771+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.771+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.771+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:44.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.775+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.779+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.779+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.783+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:44.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.783+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.783+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.783+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.787+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:44.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.791+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.791+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.791+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.795+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:44.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.799+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.803+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.803+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.807+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:44.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.807+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.811+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.811+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.815+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:44.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.815+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.815+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.819+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.819+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:44.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.823+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.823+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.827+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.831+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:44.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.831+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.831+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.835+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.835+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:44.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.839+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.839+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.839+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.843+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:44.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.843+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.847+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.847+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.847+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:44.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.851+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.851+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.855+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.855+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:44.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.859+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.859+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.859+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.863+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:44.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.863+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.867+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.867+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.871+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:44.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.871+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.875+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.875+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.875+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:44.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.879+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.879+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.883+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.883+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:44.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.887+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.891+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.891+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.891+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:44.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.895+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.895+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.899+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.899+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:44.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.903+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.903+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.903+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.907+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:44.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.911+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.911+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.911+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.915+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:44.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.915+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.919+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.919+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.919+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:44.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.923+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.923+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.923+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.927+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:44.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.931+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.931+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.931+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.935+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:44.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.939+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.939+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.939+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.943+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.947+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.947+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.951+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.951+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:44.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.955+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.955+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.955+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.959+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:44.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.959+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.963+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.963+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.963+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:44.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.967+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.971+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.971+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.975+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:44.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.979+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.979+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.979+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.983+0000 7f4eebcb8980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:44.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.987+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.987+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:44.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.987+0000 7f4eebcb8980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:44.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.995+0000 7f4d9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:44.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.999+0000 7f4eebcb8980 20 remove_watcher() i=0 2024-08-09T00:00:44.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:44.999+0000 7f4eebcb8980 2 removed watcher, disabling cache 2024-08-09T00:00:45.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.003+0000 7f4eebcb8980 20 remove_watcher() i=1 2024-08-09T00:00:45.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.003+0000 7f4eebcb8980 20 remove_watcher() i=2 2024-08-09T00:00:45.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.007+0000 7f4eebcb8980 20 remove_watcher() i=3 2024-08-09T00:00:45.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.007+0000 7f4eebcb8980 20 remove_watcher() i=4 2024-08-09T00:00:45.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.011+0000 7f4eebcb8980 20 remove_watcher() i=5 2024-08-09T00:00:45.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.011+0000 7f4eebcb8980 20 remove_watcher() i=6 2024-08-09T00:00:45.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.015+0000 7f4eebcb8980 20 remove_watcher() i=7 2024-08-09T00:00:45.035 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:00:45.107 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:00:45.108 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:00:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 realm 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.155+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.159+0000 7f285ff94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:45.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.159+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.159+0000 7f285ff94980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:00:45.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.159+0000 7f285ff94980 20 searching for the correct realm 2024-08-09T00:00:45.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.159+0000 7f285daa8640 0 -- 172.21.15.83:0/1257153891 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f28580f8040 msgr2=0x7f28580ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:45.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.371+0000 7f285daa8640 0 -- 172.21.15.83:0/1257153891 >> [v2:172.21.15.196:6816/2486835189,v1:172.21.15.196:6818/2486835189] conn(0x7f28580c0070 msgr2=0x7f2858102a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:00:45.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:00:45.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:00:45.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 zone default found 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 4 Realm: () 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 zonegroup default 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.595+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.599+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.599+0000 7f285ff94980 20 rados->read ofs=0 len=0 2024-08-09T00:00:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.599+0000 7f285ff94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:00:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.599+0000 7f285ff94980 20 started sync module instance, tier type = 2024-08-09T00:00:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.599+0000 7f285ff94980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:00:45.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=0 2024-08-09T00:00:45.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=1 2024-08-09T00:00:45.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=2 2024-08-09T00:00:45.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=3 2024-08-09T00:00:45.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=4 2024-08-09T00:00:45.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=5 2024-08-09T00:00:45.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=6 2024-08-09T00:00:45.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 20 add_watcher() i=7 2024-08-09T00:00:45.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.623+0000 7f285ff94980 2 all 8 watchers are set, enabling cache 2024-08-09T00:00:45.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.627+0000 7f270f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:45.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.631+0000 7f285ff94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:00:45.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.631+0000 7f285ff94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:00:45.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.719+0000 7f270e7fc640 20 reqs_thread_entry: start 2024-08-09T00:00:45.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.723+0000 7f285ff94980 20 init_complete bucket index max shards: 1 2024-08-09T00:00:45.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.723+0000 7f285ff94980 20 Filter name: none 2024-08-09T00:00:45.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.723+0000 7f267ffff640 20 reqs_thread_entry: start 2024-08-09T00:00:45.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.723+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:00:45.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.723+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.727+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.727+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.727+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:00:45.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.731+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.731+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.731+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.735+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:00:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.735+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.739+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.739+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.739+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:00:45.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.743+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.743+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.743+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.747+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:00:45.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.751+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.755+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.755+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.755+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:00:45.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.759+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.763+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.763+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.767+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:00:45.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.767+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.767+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.767+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.771+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:00:45.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.775+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.775+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.775+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.779+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:00:45.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.783+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.783+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.783+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.783+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:00:45.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.787+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.791+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.791+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.791+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:00:45.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.795+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.799+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.799+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.799+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:00:45.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.803+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.807+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.807+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.811+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:00:45.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.815+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.819+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.819+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.823+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:00:45.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.823+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.827+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.827+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.835+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:00:45.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.839+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.839+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.839+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.843+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:00:45.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.847+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.847+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.851+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.851+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:00:45.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.855+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.859+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.859+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.859+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:00:45.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.863+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.867+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.867+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.867+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:00:45.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.871+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.875+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.875+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.879+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:00:45.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.883+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.883+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.883+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.887+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:00:45.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.891+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.891+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.891+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.895+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:00:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.899+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.899+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.899+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.903+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:00:45.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.907+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.907+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.911+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.911+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:00:45.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.915+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.919+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.919+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.923+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:00:45.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.927+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.927+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.927+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.931+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:00:45.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.935+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.935+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.935+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.939+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:00:45.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.943+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.943+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.943+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.947+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:00:45.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.951+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.955+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.955+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.959+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:00:45.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.963+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.963+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.963+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.967+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:00:45.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.971+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.971+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.971+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.975+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:00:45.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.979+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.979+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.983+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.983+0000 7f285ff94980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:00:45.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.987+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.991+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:00:45.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.991+0000 7f285ff94980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:00:45.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.995+0000 7f270f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:00:46.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.999+0000 7f285ff94980 20 remove_watcher() i=0 2024-08-09T00:00:46.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:45.999+0000 7f285ff94980 2 removed watcher, disabling cache 2024-08-09T00:00:46.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.003+0000 7f285ff94980 20 remove_watcher() i=1 2024-08-09T00:00:46.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.007+0000 7f285ff94980 20 remove_watcher() i=2 2024-08-09T00:00:46.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.007+0000 7f285ff94980 20 remove_watcher() i=3 2024-08-09T00:00:46.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.011+0000 7f285ff94980 20 remove_watcher() i=4 2024-08-09T00:00:46.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.011+0000 7f285ff94980 20 remove_watcher() i=5 2024-08-09T00:00:46.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.015+0000 7f285ff94980 20 remove_watcher() i=6 2024-08-09T00:00:46.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:00:46.015+0000 7f285ff94980 20 remove_watcher() i=7 2024-08-09T00:00:46.034 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-08-09T00:00:46.753 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean 2024-08-09T00:00:47.551 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-08-09T00:00:47.551 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-08-09T00:00:47.551 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-08-09T00:00:48.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:48.051 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-08-09T00:00:48.051 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-09T00:00:48.051 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-09T00:00:48.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:48.052 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-08-09T00:00:48.052 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-08-09T00:00:50.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.051 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-08-09T00:00:50.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.051 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests STANDARD_OUT 2024-08-09T00:00:50.053 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09 00:00:49,373 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-09T00:00:50.053 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.053 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-08-09T00:00:50.053 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.053 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-08-09T00:00:50.550 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.551 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-08-09T00:00:50.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:50.751 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-08-09T00:00:51.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:51.251 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-08-09T00:00:51.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:51.451 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-08-09T00:00:51.950 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:51.951 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-08-09T00:00:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:55.551 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-08-09T00:00:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:55.951 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-08-09T00:00:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-08-09T00:00:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:56.651 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-08-09T00:00:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-08-09T00:00:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-08-09T00:00:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-08-09T00:00:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:57.651 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-08-09T00:00:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:57.851 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-08-09T00:00:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:00:58.251 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-08-09T00:01:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:00.451 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-08-09T00:01:00.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:00.951 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-08-09T00:01:01.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:01.051 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-08-09T00:01:01.651 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:01.651 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-08-09T00:01:01.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:01.751 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-08-09T00:01:02.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:02.350 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-08-09T00:01:02.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:02.451 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-08-09T00:01:02.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:03.106 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-08-09T00:01:03.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:03.151 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-08-09T00:01:03.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:03.651 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-08-09T00:01:03.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:03.751 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-08-09T00:01:04.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:04.251 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-08-09T00:01:04.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:04.451 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-08-09T00:01:04.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:04.851 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-08-09T00:01:05.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:05.251 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-08-09T00:01:05.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:05.654 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-08-09T00:01:10.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:10.251 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-08-09T00:01:11.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:11.153 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-08-09T00:01:54.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:54.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-08-09T00:01:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:55.555 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-08-09T00:01:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:55.651 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-08-09T00:01:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-08-09T00:01:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-08-09T00:01:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:01:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-08-09T00:02:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:09.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-08-09T00:02:10.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:10.351 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-08-09T00:02:10.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:10.451 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-08-09T00:02:10.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:10.551 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-08-09T00:02:15.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:15.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-08-09T00:02:16.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:16.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests STANDARD_OUT 2024-08-09T00:02:16.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09 00:02:16,950 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-09T00:02:16.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09 00:02:16,952 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-09T00:02:17.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09 00:02:16,956 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-09T00:02:17.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:17.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-08-09T00:02:33.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:33.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-08-09T00:02:34.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:34.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-08-09T00:02:37.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:37.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-08-09T00:02:37.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:02:37.663 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-08-09T00:03:07.353 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:07.353 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-08-09T00:03:07.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:07.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-08-09T00:03:12.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:12.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-08-09T00:03:13.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:13.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-08-09T00:03:25.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:25.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-08-09T00:03:26.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:26.153 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-08-09T00:03:28.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:28.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-08-09T00:03:36.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:36.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-08-09T00:03:36.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:36.452 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-08-09T00:03:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:36.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-08-09T00:03:37.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:37.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-08-09T00:03:41.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:41.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-08-09T00:03:41.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:41.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-08-09T00:03:41.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:41.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-08-09T00:03:42.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:42.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-08-09T00:03:42.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:42.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-08-09T00:03:42.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:42.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-08-09T00:03:43.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:43.180 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-08-09T00:03:43.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:43.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-08-09T00:03:43.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:43.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-08-09T00:03:44.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:44.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-08-09T00:03:44.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:44.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-08-09T00:03:45.055 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:45.056 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-08-09T00:03:45.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:45.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-08-09T00:03:46.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:46.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-08-09T00:03:46.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:46.955 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-08-09T00:03:47.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:47.357 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-08-09T00:03:48.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:48.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-08-09T00:03:48.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:48.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-08-09T00:03:49.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:49.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-08-09T00:03:49.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:49.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-08-09T00:03:50.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:50.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-08-09T00:03:50.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:50.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-08-09T00:03:51.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:51.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-08-09T00:03:52.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:52.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-08-09T00:03:52.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:52.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-08-09T00:03:53.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:53.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-08-09T00:03:54.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:54.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-08-09T00:03:54.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:54.452 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-08-09T00:03:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:55.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-08-09T00:03:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:55.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-08-09T00:03:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:56.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-08-09T00:03:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:56.853 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-08-09T00:03:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-08-09T00:03:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:57.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-08-09T00:03:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:58.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-08-09T00:03:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:58.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-08-09T00:03:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:03:59.653 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-08-09T00:04:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:00.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-08-09T00:04:00.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:00.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-08-09T00:04:01.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:01.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-08-09T00:04:02.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:02.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-08-09T00:04:02.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:02.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-08-09T00:04:03.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:03.452 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-08-09T00:04:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:03.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-08-09T00:04:04.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-08-09T00:04:05.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:05.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-08-09T00:04:05.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:05.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-08-09T00:04:06.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:06.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-08-09T00:04:06.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:06.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-08-09T00:04:07.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:07.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-08-09T00:04:07.955 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:07.955 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-08-09T00:04:08.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:08.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-08-09T00:04:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:08.952 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-08-09T00:04:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-08-09T00:04:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:10.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-08-09T00:04:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:10.153 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-08-09T00:04:10.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:10.653 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-08-09T00:04:10.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:10.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-08-09T00:04:11.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:11.252 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-08-09T00:04:11.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:11.452 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-08-09T00:04:11.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:11.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-08-09T00:04:12.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:12.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-08-09T00:04:12.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:12.552 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-08-09T00:04:13.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:13.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-08-09T00:04:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:13.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-08-09T00:04:13.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:13.653 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-08-09T00:04:13.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:13.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-08-09T00:04:14.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:14.052 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-08-09T00:04:14.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:14.652 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-08-09T00:04:14.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:14.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-08-09T00:04:15.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:15.452 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-08-09T00:04:15.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:15.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-08-09T00:04:16.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:16.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-08-09T00:04:16.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:16.352 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-08-09T00:04:16.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:16.752 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-08-09T00:04:20.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:20.152 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-08-09T00:04:20.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:20.653 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-08-09T00:04:24.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:24.852 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-08-09T00:04:25.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:25.440 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-08-09T00:04:25.440 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-08-09T00:04:25.440 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 3m 39s 2024-08-09T00:04:25.441 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 5 executed 2024-08-09T00:04:25.452 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:04:25.479 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:25.480 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:25.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 realm 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:25.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.524+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.528+0000 7fe92bb7c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:25.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.528+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.528+0000 7fe92bb7c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:25.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.528+0000 7fe92bb7c980 20 searching for the correct realm 2024-08-09T00:04:25.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.532+0000 7fe929e91640 0 -- 172.21.15.83:0/360564451 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fe920089290 msgr2=0x7fe92005caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:25.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.748+0000 7fe928e8f640 0 -- 172.21.15.83:0/360564451 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fe92411c040 msgr2=0x7fe9240dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:25.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.964+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:25.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:25.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 zone default found 2024-08-09T00:04:25.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 4 Realm: () 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 zonegroup default 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:25.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:25.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 started sync module instance, tier type = 2024-08-09T00:04:25.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.968+0000 7fe92bb7c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=0 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=1 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=2 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=3 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=4 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=5 2024-08-09T00:04:25.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=6 2024-08-09T00:04:25.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 20 add_watcher() i=7 2024-08-09T00:04:25.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.988+0000 7fe92bb7c980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:25.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.992+0000 7fe7df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:25.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.992+0000 7fe92bb7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:25.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:25.992+0000 7fe92bb7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:26.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.088+0000 7fe7de7e4640 20 reqs_thread_entry: start 2024-08-09T00:04:26.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.088+0000 7fe92bb7c980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:26.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.088+0000 7fe92bb7c980 20 Filter name: none 2024-08-09T00:04:26.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.088+0000 7fe74ffff640 20 reqs_thread_entry: start 2024-08-09T00:04:26.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.088+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:04:26.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.092+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.096+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.096+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.100+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:04:26.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.100+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.100+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.104+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.104+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:04:26.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.108+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.108+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12060801322079298304', time=2024-08-09T02:02:55.146863+0000, chain.objs.size()=7 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.1 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.1_1 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.1_2 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.2 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.2_1 2024-08-09T00:04:26.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.2_2 2024-08-09T00:04:26.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.112+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~qVExPG9IXZVZTRDroiqA29Yj_FXtL4n.3 2024-08-09T00:04:26.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.116+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.124+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:04:26.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.814024634730090631', time=2024-08-09T02:02:10.011411+0000, chain.objs.size()=9 2024-08-09T00:04:26.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__multipart_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.1 2024-08-09T00:04:26.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__shadow_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.1_1 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__multipart_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.2 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__shadow_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.2_1 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__multipart_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.3 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__shadow_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.3_1 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__multipart_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.4 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__shadow_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.4_1 2024-08-09T00:04:26.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.128+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.88__multipart_key1.2~omTkF9-2GSJtM5Pf7dfmMkAt6nKFf1-.5 2024-08-09T00:04:26.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.140+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.144+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:04:26.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.144+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.148+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.148+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.148+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:04:26.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17592619809416043557', time=2024-08-09T02:01:44.543408+0000, chain.objs.size()=9 2024-08-09T00:04:26.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.1 2024-08-09T00:04:26.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.1_1 2024-08-09T00:04:26.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.2 2024-08-09T00:04:26.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.2_1 2024-08-09T00:04:26.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.3 2024-08-09T00:04:26.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.3_1 2024-08-09T00:04:26.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.4 2024-08-09T00:04:26.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.4_1 2024-08-09T00:04:26.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.152+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~BEh_irjsid2Q5oBcXeKaWIgpbUnMyWz.5 2024-08-09T00:04:26.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.164+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.168+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:04:26.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.756123179900143050', time=2024-08-09T02:01:10.438616+0000, chain.objs.size()=9 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.1_1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.2 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.2_1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.3 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.3_1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.4 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.4_1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.5 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2972645646225606402', time=2024-08-09T02:04:20.333734+0000, chain.objs.size()=9 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__multipart_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.1 2024-08-09T00:04:26.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__shadow_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.1_1 2024-08-09T00:04:26.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.172+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__multipart_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.2 2024-08-09T00:04:26.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.180+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__shadow_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.2_1 2024-08-09T00:04:26.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.184+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__multipart_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.3 2024-08-09T00:04:26.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.184+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__shadow_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.3_1 2024-08-09T00:04:26.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.184+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__multipart_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.4 2024-08-09T00:04:26.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.184+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__shadow_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.4_1 2024-08-09T00:04:26.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.184+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.133__multipart_key1.2~g1WbvnMi-7Ee0sljJEIoriYpfxKkYks.5 2024-08-09T00:04:26.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.192+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.192+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:04:26.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.196+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.196+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.196+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.200+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:04:26.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.200+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.200+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.200+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.204+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:04:26.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9977912302761047982', time=2024-08-09T02:03:25.840854+0000, chain.objs.size()=9 2024-08-09T00:04:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__multipart_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.1 2024-08-09T00:04:26.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__shadow_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.1_1 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__multipart_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.2 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__shadow_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.2_1 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__multipart_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.3 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__shadow_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.3_1 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__multipart_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.4 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__shadow_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.4_1 2024-08-09T00:04:26.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.208+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.94__multipart_key1.2~s4oI8unozkFYY_Qoe8h0blCfTBVjuqW.5 2024-08-09T00:04:26.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.216+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.220+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:04:26.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2603326367410201241', time=2024-08-09T02:02:44.315839+0000, chain.objs.size()=9 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.1 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.1_1 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.2 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.2_1 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.3 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.3_1 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.4 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.4_1 2024-08-09T00:04:26.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.224+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~8T0YwwQSN69idqNvESA6MP_TbBy8t8r.5 2024-08-09T00:04:26.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.232+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.236+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:04:26.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11680233450922893268', time=2024-08-09T02:01:00.567437+0000, chain.objs.size()=2 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.73__shadow_.jy1knofXNNr7O9d3yAR0GhXmQR2L8_9_1 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.73__shadow_.jy1knofXNNr7O9d3yAR0GhXmQR2L8_9_2 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1648325837741123273', time=2024-08-09T02:03:07.274264+0000, chain.objs.size()=7 2024-08-09T00:04:26.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.1 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.1_1 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.1_2 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.2 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.2_1 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.2_2 2024-08-09T00:04:26.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.240+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~0jMfRf0qGaeN3qZG52-PVNgjbEwvEkN.3 2024-08-09T00:04:26.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.248+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.252+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:04:26.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.256+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.256+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.256+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.260+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:04:26.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.260+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.260+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3324810966301463575', time=2024-08-09T02:01:54.841798+0000, chain.objs.size()=7 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.1 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.1_1 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.1_2 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.2 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.2_1 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.2_2 2024-08-09T00:04:26.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.264+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~FcATWke4_FH-t3v2mtx35LolL_nufua.3 2024-08-09T00:04:26.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.268+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.272+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:04:26.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.272+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.276+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.276+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.276+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:04:26.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.280+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.280+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.280+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:04:26.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3721370616197195741', time=2024-08-09T02:01:39.841589+0000, chain.objs.size()=9 2024-08-09T00:04:26.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.1 2024-08-09T00:04:26.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.1_1 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.284+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.2 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.2_1 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.3 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.3_1 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.4 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.4_1 2024-08-09T00:04:26.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.288+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~LFJtw9gx9wzKwqy1nuCMjO57XJ2RLdq.5 2024-08-09T00:04:26.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.296+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:04:26.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4283986262621431069', time=2024-08-09T02:01:33.972393+0000, chain.objs.size()=9 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.1 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.1_1 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.2 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.2_1 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.3 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.3_1 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.4 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.300+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.4_1 2024-08-09T00:04:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.304+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~jP1jI2BT61hReZTIpv6VA5W7XCVEzvB.5 2024-08-09T00:04:26.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.308+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.312+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:04:26.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.316+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.316+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.316+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.316+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:04:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.320+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.320+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.320+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.324+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:04:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.324+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5', time=2024-08-09T02:00:55.481897+0000, chain.objs.size()=9 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__multipart_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.1 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__shadow_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.1_1 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__multipart_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.2 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__shadow_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.2_1 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__multipart_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.3 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__shadow_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.3_1 2024-08-09T00:04:26.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__multipart_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.4 2024-08-09T00:04:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__shadow_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.4_1 2024-08-09T00:04:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.69__multipart_key1.2~AFwM4rhWCFUjD637dYGkfGP8tq7ejf5.5 2024-08-09T00:04:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11765671913218274809', time=2024-08-09T02:01:49.231149+0000, chain.objs.size()=7 2024-08-09T00:04:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.1 2024-08-09T00:04:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.1_1 2024-08-09T00:04:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.328+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.1_2 2024-08-09T00:04:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.2 2024-08-09T00:04:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.2_1 2024-08-09T00:04:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.2_2 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~lEoXbG4V8cKZEzXmR6z2-3yMmAnP09W.3 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7635657470948019314', time=2024-08-09T02:02:33.459280+0000, chain.objs.size()=9 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.1 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__shadow_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.1_1 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.2 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__shadow_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.2_1 2024-08-09T00:04:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.332+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.3 2024-08-09T00:04:26.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.340+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__shadow_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.3_1 2024-08-09T00:04:26.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.340+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.4 2024-08-09T00:04:26.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.344+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__shadow_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.4_1 2024-08-09T00:04:26.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.344+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file.mpg.2~G24ujmeQpEHdg8xYN7IpbmoK5GGDE3x.5 2024-08-09T00:04:26.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.348+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.352+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:04:26.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.352+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.352+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2992767459181387068', time=2024-08-09T02:01:10.791666+0000, chain.objs.size()=9 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.1 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.1_1 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.2 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.2_1 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.3 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.3_1 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.4 2024-08-09T00:04:26.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__shadow_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.4_1 2024-08-09T00:04:26.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.81__multipart_key1.2~aPk_-1vDOcaqIGS-UiaxcWq2s5LUyym.5 2024-08-09T00:04:26.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12739412768801634513', time=2024-08-09T02:03:12.891527+0000, chain.objs.size()=9 2024-08-09T00:04:26.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__multipart_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.1 2024-08-09T00:04:26.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__shadow_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.1_1 2024-08-09T00:04:26.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.356+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__multipart_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.2 2024-08-09T00:04:26.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.360+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__shadow_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.2_1 2024-08-09T00:04:26.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.360+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__multipart_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.3 2024-08-09T00:04:26.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.360+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__shadow_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.3_1 2024-08-09T00:04:26.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.364+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__multipart_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.4 2024-08-09T00:04:26.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.364+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__shadow_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.4_1 2024-08-09T00:04:26.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.364+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.93__multipart_key1.2~aHDUWyiwZwmOwwvYWcUbdHeB4RGIobh.5 2024-08-09T00:04:26.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.368+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.372+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:04:26.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.376+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.376+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.376+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.376+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:04:26.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.380+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.380+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.380+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.380+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:04:26.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.384+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.384+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.384+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.384+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:04:26.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14662262688425989954', time=2024-08-09T02:02:48.373702+0000, chain.objs.size()=9 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.1 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.1_1 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.2 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.2_1 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.3 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.3_1 2024-08-09T00:04:26.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.4 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.4_1 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~K7GPiINoku07cGOic2sG3k1d4tqQVQe.5 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10196767832065481920', time=2024-08-09T02:02:52.061215+0000, chain.objs.size()=9 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.1 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.1_1 2024-08-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.388+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.2 2024-08-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.392+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.2_1 2024-08-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.392+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.3 2024-08-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.392+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.3_1 2024-08-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.4 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.4_1 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~1y1o-ApvTE5i1tlwc2Y_Bd2hx1KTkx7.5 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7632713024486724336', time=2024-08-09T02:04:24.996607+0000, chain.objs.size()=9 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__multipart_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.1 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__shadow_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.1_1 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__multipart_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.2 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__shadow_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.2_1 2024-08-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.396+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__multipart_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.3 2024-08-09T00:04:26.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.400+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__shadow_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.3_1 2024-08-09T00:04:26.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.400+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__multipart_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.4 2024-08-09T00:04:26.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.404+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__shadow_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.4_1 2024-08-09T00:04:26.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.404+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.134__multipart_key1/data/file.mpg.2~fXGCD1Z-g4wG4lsXCyC280u_k8dpxJO.5 2024-08-09T00:04:26.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.408+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.412+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:04:26.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8123490642520350367', time=2024-08-09T02:01:55.216873+0000, chain.objs.size()=5 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.83__shadow_.0xw-PM1zvDjmzDRFmSV22e6S0XgUk2k_1 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.83__shadow_.0xw-PM1zvDjmzDRFmSV22e6S0XgUk2k_2 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.83__shadow_.0xw-PM1zvDjmzDRFmSV22e6S0XgUk2k_3 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.83__shadow_.0xw-PM1zvDjmzDRFmSV22e6S0XgUk2k_4 2024-08-09T00:04:26.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.416+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.83__shadow_.0xw-PM1zvDjmzDRFmSV22e6S0XgUk2k_5 2024-08-09T00:04:26.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.420+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.420+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:04:26.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10250464747298259583', time=2024-08-09T02:01:54.555057+0000, chain.objs.size()=7 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.1 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.1_1 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.1_2 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.2 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.2_1 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__shadow_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.2_2 2024-08-09T00:04:26.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.424+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.84__multipart_key1.2~dvrCLNjy-2RTM6NBFZ4pX6A2adFYzt0.3 2024-08-09T00:04:26.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.428+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.432+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:04:26.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.436+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.436+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.436+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.436+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:04:26.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:04:26.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4170919296456331856', time=2024-08-09T02:02:16.954155+0000, chain.objs.size()=9 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__multipart_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.1 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__shadow_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.1_1 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__multipart_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.2 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__shadow_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.2_1 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__multipart_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.3 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__shadow_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.3_1 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__multipart_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.4 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__shadow_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.4_1 2024-08-09T00:04:26.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.440+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.89__multipart_key1.2~g27Q17R1CevfupRxWa4TUTfUuunm3qm.5 2024-08-09T00:04:26.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.444+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.448+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:04:26.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.448+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4496615941149679374', time=2024-08-09T02:02:33.599858+0000, chain.objs.size()=5 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file2.mpg.2~dt6oYXYuoqjRfjwsBIF5bp0tZ38ww26.1 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file2.mpg.2~dt6oYXYuoqjRfjwsBIF5bp0tZ38ww26.2 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file2.mpg.2~dt6oYXYuoqjRfjwsBIF5bp0tZ38ww26.3 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file2.mpg.2~dt6oYXYuoqjRfjwsBIF5bp0tZ38ww26.4 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.90__multipart_file2.mpg.2~dt6oYXYuoqjRfjwsBIF5bp0tZ38ww26.5 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO', time=2024-08-09T02:02:37.454792+0000, chain.objs.size()=9 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__multipart_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.7 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__shadow_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.7_1 2024-08-09T00:04:26.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__multipart_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.8 2024-08-09T00:04:26.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__shadow_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.8_1 2024-08-09T00:04:26.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__multipart_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.9 2024-08-09T00:04:26.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__shadow_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.9_1 2024-08-09T00:04:26.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.452+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__multipart_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.10 2024-08-09T00:04:26.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__shadow_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.10_1 2024-08-09T00:04:26.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.91__multipart_key1.2~YLoqWeAPyFsHgZ0HBWlT4aQSW29qpvO.11 2024-08-09T00:04:26.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5695915787356957627', time=2024-08-09T02:03:07.547355+0000, chain.objs.size()=7 2024-08-09T00:04:26.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.1 2024-08-09T00:04:26.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.1_1 2024-08-09T00:04:26.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.1_2 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.2 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.2_1 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__shadow_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.2_2 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.92__multipart_key1.2~CYSCiQiGOoqf50C0sDPacmCJzWYwjDj.3 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0', time=2024-08-09T02:03:33.789665+0000, chain.objs.size()=1 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.17 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0', time=2024-08-09T02:03:33.927265+0000, chain.objs.size()=1 2024-08-09T00:04:26.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.456+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.19 2024-08-09T00:04:26.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.460+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0', time=2024-08-09T02:03:34.182569+0000, chain.objs.size()=1 2024-08-09T00:04:26.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.460+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.20 2024-08-09T00:04:26.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0', time=2024-08-09T02:03:34.269753+0000, chain.objs.size()=1 2024-08-09T00:04:26.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.21 2024-08-09T00:04:26.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 20 garbage collection: RGWGC::process iterating over entry tag='2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0', time=2024-08-09T02:03:34.421183+0000, chain.objs.size()=39 2024-08-09T00:04:26.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.1 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.2 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.3 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.4 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.5 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.6 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.7 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.8 2024-08-09T00:04:26.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.9 2024-08-09T00:04:26.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.464+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.10 2024-08-09T00:04:26.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.11 2024-08-09T00:04:26.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.12 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.13 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.14 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.15 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.16 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.Xa16wt2vciP3XVxj6h2qtCb1GTbPiWer.17 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.18 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.468+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.ecZYa150zinxgotjgU6bONld4piGdn-G.19 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.472+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.HndWrsSTE5nFIfSNNNlzpjqM3yUd5_EA.20 2024-08-09T00:04:26.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.472+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.Dy00qtK8eg9AwPDrr5W9pZtFPxzl_st7.21 2024-08-09T00:04:26.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.472+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.22 2024-08-09T00:04:26.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.472+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.23 2024-08-09T00:04:26.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.472+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.24 2024-08-09T00:04:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.25 2024-08-09T00:04:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.26 2024-08-09T00:04:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.27 2024-08-09T00:04:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.28 2024-08-09T00:04:26.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.29 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.30 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.31 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.32 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.33 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.34 2024-08-09T00:04:26.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.476+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.35 2024-08-09T00:04:26.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.480+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.36 2024-08-09T00:04:26.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.480+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.37 2024-08-09T00:04:26.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.480+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.38 2024-08-09T00:04:26.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.480+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.95__multipart_key1.2~B2bP9PzouzeuaZ1wwGFHehPe4p6IGZ0.39 2024-08-09T00:04:26.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.484+0000 7fe92bb7c980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:04:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.488+0000 7fe92bb7c980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:04:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.488+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.488+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.488+0000 7fe92bb7c980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.492+0000 7fe7df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:26.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.492+0000 7fe92bb7c980 20 remove_watcher() i=0 2024-08-09T00:04:26.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.492+0000 7fe92bb7c980 2 removed watcher, disabling cache 2024-08-09T00:04:26.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.496+0000 7fe92bb7c980 20 remove_watcher() i=1 2024-08-09T00:04:26.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.496+0000 7fe92bb7c980 20 remove_watcher() i=2 2024-08-09T00:04:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.496+0000 7fe92bb7c980 20 remove_watcher() i=3 2024-08-09T00:04:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.496+0000 7fe92bb7c980 20 remove_watcher() i=4 2024-08-09T00:04:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.500+0000 7fe92bb7c980 20 remove_watcher() i=5 2024-08-09T00:04:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.500+0000 7fe92bb7c980 20 remove_watcher() i=6 2024-08-09T00:04:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.500+0000 7fe92bb7c980 20 remove_watcher() i=7 2024-08-09T00:04:26.515 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-08-09T00:04:26.589 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:26.589 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:26.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 realm 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.632+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.636+0000 7f53e9f69980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:26.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.636+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.636+0000 7f53e9f69980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:26.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.636+0000 7f53e9f69980 20 searching for the correct realm 2024-08-09T00:04:26.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.640+0000 7f53e827e640 0 -- 172.21.15.83:0/402582951 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f53d0018070 msgr2=0x7f53d0048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:26.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.648+0000 7f53e727c640 0 -- 172.21.15.83:0/402582951 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f53d811b450 msgr2=0x7f53d80ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:26.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 zone default found 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 4 Realm: () 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:26.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 zonegroup default 2024-08-09T00:04:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.864+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 rados->read ofs=0 len=0 2024-08-09T00:04:26.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:26.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 started sync module instance, tier type = 2024-08-09T00:04:26.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.868+0000 7f53e9f69980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=0 2024-08-09T00:04:26.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=1 2024-08-09T00:04:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=2 2024-08-09T00:04:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=3 2024-08-09T00:04:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=4 2024-08-09T00:04:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=5 2024-08-09T00:04:26.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=6 2024-08-09T00:04:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 20 add_watcher() i=7 2024-08-09T00:04:26.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.892+0000 7f53e9f69980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.896+0000 7f529dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.896+0000 7f53e9f69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:26.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.896+0000 7f53e9f69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.984+0000 7f529cfe1640 20 reqs_thread_entry: start 2024-08-09T00:04:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.984+0000 7f53e9f69980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.984+0000 7f53e9f69980 20 Filter name: none 2024-08-09T00:04:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.984+0000 7f52167fc640 20 reqs_thread_entry: start 2024-08-09T00:04:26.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.984+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:04:26.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.988+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.988+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.988+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.992+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:04:26.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.996+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:26.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.996+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:26.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:26.996+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.000+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:04:27.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.004+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.004+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.004+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.004+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:04:27.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.008+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.012+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.012+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.016+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:04:27.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.016+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.016+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.016+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.020+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:04:27.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.024+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.024+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.024+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.028+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:04:27.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.032+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.032+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.032+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.036+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:04:27.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.040+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.040+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.040+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.044+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:04:27.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.048+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.048+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.048+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.052+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:04:27.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.056+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.056+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.056+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.060+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:04:27.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.064+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.064+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.064+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.068+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:04:27.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.068+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.072+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.072+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.072+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:04:27.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.076+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.080+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.080+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.080+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:04:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.084+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.088+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.088+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.092+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:04:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.092+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.096+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.096+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.096+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:04:27.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.100+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.100+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.104+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.104+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:04:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.108+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.108+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.112+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.112+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:04:27.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.116+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.116+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.120+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.120+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:04:27.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.124+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.128+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.128+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.128+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:04:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.132+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.132+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.136+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.136+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:04:27.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.140+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.140+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.144+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.144+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:04:27.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.148+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.152+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.152+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.156+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:04:27.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.156+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.160+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.160+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.160+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:04:27.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.164+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.164+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.168+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.168+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:04:27.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.172+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.176+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.176+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.180+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:04:27.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.180+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.180+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.184+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.184+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:04:27.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.188+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.188+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.188+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.192+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:04:27.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.196+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.196+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.196+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.200+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:04:27.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.200+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.204+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.204+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.204+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:04:27.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.208+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.208+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.208+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.212+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:04:27.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.216+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.216+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.216+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.216+0000 7f53e9f69980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:04:27.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.220+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.220+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:04:27.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.220+0000 7f53e9f69980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:04:27.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.224+0000 7f529dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:27.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.232+0000 7f53e9f69980 20 remove_watcher() i=0 2024-08-09T00:04:27.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.232+0000 7f53e9f69980 2 removed watcher, disabling cache 2024-08-09T00:04:27.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.232+0000 7f53e9f69980 20 remove_watcher() i=1 2024-08-09T00:04:27.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.236+0000 7f53e9f69980 20 remove_watcher() i=2 2024-08-09T00:04:27.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.236+0000 7f53e9f69980 20 remove_watcher() i=3 2024-08-09T00:04:27.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.240+0000 7f53e9f69980 20 remove_watcher() i=4 2024-08-09T00:04:27.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.240+0000 7f53e9f69980 20 remove_watcher() i=5 2024-08-09T00:04:27.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.244+0000 7f53e9f69980 20 remove_watcher() i=6 2024-08-09T00:04:27.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:27.244+0000 7f53e9f69980 20 remove_watcher() i=7 2024-08-09T00:04:27.263 INFO:teuthology.run_tasks:Running task s3tests... 2024-08-09T00:04:27.363 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-squid', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-08-09T00:04:27.364 INFO:tasks.s3tests:Downloading s3-tests... 2024-08-09T00:04:27.364 INFO:tasks.s3tests:Using branch 'ceph-squid' for s3tests 2024-08-09T00:04:27.364 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b ceph-squid https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-08-09T00:04:27.371 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-08-09T00:04:28.154 INFO:tasks.s3tests:Creating rgw users... 2024-08-09T00:04:28.155 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-08-09T00:04:28.155 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key UQMTEKXKZRXTTXLDXLVB --secret xnkES6dmehPn3O5FXepqWasQspBIEhl/IfsP50cnuQYF++4G9gGyVg== --cluster ceph 2024-08-09T00:04:28.240 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:28.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 realm 2024-08-09T00:04:28.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.280+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.284+0000 7f5c8ade1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:28.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.284+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.284+0000 7f5c8ade1980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.284+0000 7f5c8ade1980 20 searching for the correct realm 2024-08-09T00:04:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.288+0000 7f5c890f6640 0 -- 172.21.15.83:0/2817693119 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f5c70046040 msgr2=0x7f5c70035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:28.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.296+0000 7f5c880f4640 0 -- 172.21.15.83:0/2817693119 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f5c8008c3f0 msgr2=0x7f5c80067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:28.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:28.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.512+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 zone default found 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 4 Realm: () 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 zonegroup default 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 started sync module instance, tier type = 2024-08-09T00:04:28.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.516+0000 7f5c8ade1980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:28.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=0 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=1 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=2 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=3 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=4 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=5 2024-08-09T00:04:28.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.540+0000 7f5c8ade1980 20 add_watcher() i=6 2024-08-09T00:04:28.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.544+0000 7f5c8ade1980 20 add_watcher() i=7 2024-08-09T00:04:28.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.544+0000 7f5c8ade1980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5b3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 5 note: GC not initialized 2024-08-09T00:04:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5b3dfe3640 20 reqs_thread_entry: start 2024-08-09T00:04:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 Filter name: none 2024-08-09T00:04:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5aaf7fe640 20 reqs_thread_entry: start 2024-08-09T00:04:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-08-09T00:04:28.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-09T00:04:28.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 10 cache get: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB : miss 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.548+0000 7f5c8ade1980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB info.flags=0x0 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 adding default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB to cache LRU end 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 cache get: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB : hit (negative entry) 2024-08-09T00:04:28.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 cache get: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB : hit (negative entry) 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5c8ade1980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5b5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333606 cookie 94119047694848 notifier 7190 bl.length()=645 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5b5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-09T00:04:28.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.552+0000 7f5b5ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.556+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-08-09T00:04:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.556+0000 7f5c8ade1980 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-09T00:04:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.556+0000 7f5c8ade1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-08-09T00:04:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.560+0000 7f5b5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333607 cookie 94119047713280 notifier 7190 bl.length()=185 2024-08-09T00:04:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.560+0000 7f5b5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-08-09T00:04:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.560+0000 7f5b5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-09T00:04:28.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5c8ade1980 10 cache put: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB info.flags=0x7 2024-08-09T00:04:28.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5c8ade1980 10 moving default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB to cache LRU end 2024-08-09T00:04:28.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5c8ade1980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:UQMTEKXKZRXTTXLDXLVB, ofs0, ns] 2024-08-09T00:04:28.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5b5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94119047708416 notifier 7190 bl.length()=186 2024-08-09T00:04:28.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5b5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB info.flags=0x7 2024-08-09T00:04:28.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.564+0000 7f5b5ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UQMTEKXKZRXTTXLDXLVB to cache LRU end 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foo.client.0", 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.foo.client.0", 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foo+test@test.test", 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:28.566 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foo.client.0", 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "UQMTEKXKZRXTTXLDXLVB", 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "xnkES6dmehPn3O5FXepqWasQspBIEhl/IfsP50cnuQYF++4G9gGyVg==", 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:28.555198Z" 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:28.567 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:28.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:28.555166Z", 2024-08-09T00:04:28.569 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:28.570 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:28.570 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:28.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:28.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.568+0000 7f5b3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:28.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.572+0000 7f5c8ade1980 20 remove_watcher() i=0 2024-08-09T00:04:28.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.572+0000 7f5c8ade1980 2 removed watcher, disabling cache 2024-08-09T00:04:28.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.572+0000 7f5c8ade1980 20 remove_watcher() i=1 2024-08-09T00:04:28.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.576+0000 7f5c8ade1980 20 remove_watcher() i=2 2024-08-09T00:04:28.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.580+0000 7f5c8ade1980 20 remove_watcher() i=3 2024-08-09T00:04:28.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.580+0000 7f5c8ade1980 20 remove_watcher() i=4 2024-08-09T00:04:28.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.580+0000 7f5c8ade1980 20 remove_watcher() i=5 2024-08-09T00:04:28.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.584+0000 7f5c8ade1980 20 remove_watcher() i=6 2024-08-09T00:04:28.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.584+0000 7f5c8ade1980 20 remove_watcher() i=7 2024-08-09T00:04:28.601 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6835110335 --totp-seed GCJRPSNSPRZ3SZMA3TP6DL2WSNCMXNBKBY6JKYRWR7PRBMHXBTCQAONRAY5UK5DH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:28.644 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:28.644 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:28.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 realm 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:28.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.684+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.688+0000 7f347961f980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:28.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.688+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.688+0000 7f347961f980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:28.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.688+0000 7f347961f980 20 searching for the correct realm 2024-08-09T00:04:28.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.692+0000 7f3477934640 0 -- 172.21.15.83:0/3341468856 >> [v2:172.21.15.83:6802/3747846461,v1:172.21.15.83:6804/3747846461] conn(0x55d422153cf0 msgr2=0x55d4221560e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:28.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.700+0000 7f3476932640 0 -- 172.21.15.83:0/3341468856 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f3470079220 msgr2=0x7f3470058550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 zone default found 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 4 Realm: () 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:28.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 zonegroup default 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 started sync module instance, tier type = 2024-08-09T00:04:28.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.708+0000 7f347961f980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:28.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=0 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=1 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=2 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=3 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=4 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=5 2024-08-09T00:04:28.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=6 2024-08-09T00:04:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 20 add_watcher() i=7 2024-08-09T00:04:28.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.724+0000 7f347961f980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f332dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 5 note: GC not initialized 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f332cfe1640 20 reqs_thread_entry: start 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 Filter name: none 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f32a67fc640 20 reqs_thread_entry: start 2024-08-09T00:04:28.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-08-09T00:04:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 rados->read ofs=0 len=0 2024-08-09T00:04:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 20 rados_obj.operate() r=0 bl.length=460 2024-08-09T00:04:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-08-09T00:04:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:28.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:28.728+0000 7f347961f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:29.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.872+0000 7f347961f980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-09T00:04:29.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.872+0000 7f347961f980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:29.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.872+0000 7f347961f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-08-09T00:04:29.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.876+0000 7f335a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268200 cookie 94369593252864 notifier 7587 bl.length()=659 2024-08-09T00:04:29.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.876+0000 7f335a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-09T00:04:29.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.876+0000 7f335a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-09T00:04:29.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.884+0000 7f332dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:29.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.888+0000 7f347961f980 20 remove_watcher() i=0 2024-08-09T00:04:29.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.888+0000 7f347961f980 2 removed watcher, disabling cache 2024-08-09T00:04:29.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.892+0000 7f347961f980 20 remove_watcher() i=1 2024-08-09T00:04:29.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.892+0000 7f347961f980 20 remove_watcher() i=2 2024-08-09T00:04:29.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.896+0000 7f347961f980 20 remove_watcher() i=3 2024-08-09T00:04:29.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.900+0000 7f347961f980 20 remove_watcher() i=4 2024-08-09T00:04:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.900+0000 7f347961f980 20 remove_watcher() i=5 2024-08-09T00:04:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.904+0000 7f347961f980 20 remove_watcher() i=6 2024-08-09T00:04:29.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:29.908+0000 7f347961f980 20 remove_watcher() i=7 2024-08-09T00:04:29.928 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-08-09T00:04:29.928 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key OPRBSCHCOFZIJEVHAVUN --secret oOkUzCXj0fDr3wx2P+wdVPE1t4tNyQl7YlterGsWRcQ6y3jkC6LUEw== --cluster ceph 2024-08-09T00:04:30.014 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:30.015 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:30.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.052+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 realm 2024-08-09T00:04:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:30.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:30.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.056+0000 7f129fa49980 20 searching for the correct realm 2024-08-09T00:04:30.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.060+0000 7f129dd5e640 0 -- 172.21.15.83:0/3467658131 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f1288008050 msgr2=0x7f128805beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:30.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.276+0000 7f129cd5c640 0 -- 172.21.15.83:0/3467658131 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f12980aa3d0 msgr2=0x7f12980aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.492+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 zone default found 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 4 Realm: () 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 zonegroup default 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 started sync module instance, tier type = 2024-08-09T00:04:30.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.496+0000 7f129fa49980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=0 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=1 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=2 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=3 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=4 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=5 2024-08-09T00:04:30.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=6 2024-08-09T00:04:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 20 add_watcher() i=7 2024-08-09T00:04:30.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.524+0000 7f129fa49980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:30.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.528+0000 7f1153fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:30.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.528+0000 7f129fa49980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:30.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.528+0000 7f129fa49980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:30.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.528+0000 7f129fa49980 5 note: GC not initialized 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.528+0000 7f1152fe5640 20 reqs_thread_entry: start 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 Filter name: none 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f1150fe1640 20 reqs_thread_entry: start 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-08-09T00:04:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-08-09T00:04:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-08-09T00:04:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-08-09T00:04:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-09T00:04:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache get: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN : miss 2024-08-09T00:04:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN info.flags=0x0 2024-08-09T00:04:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 adding default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN to cache LRU end 2024-08-09T00:04:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache get: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN : hit (negative entry) 2024-08-09T00:04:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.532+0000 7f129fa49980 10 cache get: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN : hit (negative entry) 2024-08-09T00:04:30.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-09T00:04:30.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f129fa49980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:30.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f129fa49980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-08-09T00:04:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f1180ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268183 cookie 94834909622048 notifier 7608 bl.length()=645 2024-08-09T00:04:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f1180ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-09T00:04:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.536+0000 7f1180ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:30.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-08-09T00:04:30.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f129fa49980 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-09T00:04:30.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f129fa49980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-08-09T00:04:30.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f1180ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268181 cookie 94834909632288 notifier 7608 bl.length()=185 2024-08-09T00:04:30.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f1180ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-08-09T00:04:30.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.544+0000 7f1180ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-09T00:04:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f129fa49980 10 cache put: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN info.flags=0x7 2024-08-09T00:04:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f129fa49980 10 moving default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN to cache LRU end 2024-08-09T00:04:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f129fa49980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OPRBSCHCOFZIJEVHAVUN, ofs0, ns] 2024-08-09T00:04:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f1180ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268201 cookie 94834909617472 notifier 7608 bl.length()=186 2024-08-09T00:04:30.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f1180ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN info.flags=0x7 2024-08-09T00:04:30.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.548+0000 7f1180ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OPRBSCHCOFZIJEVHAVUN to cache LRU end 2024-08-09T00:04:30.552 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:30.552 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "bar.client.0", 2024-08-09T00:04:30.552 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.bar.client.0", 2024-08-09T00:04:30.552 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "bar+test@test.test", 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "bar.client.0", 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "OPRBSCHCOFZIJEVHAVUN", 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "oOkUzCXj0fDr3wx2P+wdVPE1t4tNyQl7YlterGsWRcQ6y3jkC6LUEw==", 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:30.537499Z" 2024-08-09T00:04:30.553 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:30.554 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:30.555 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-09T00:04:30.556 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:30.556 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-09T00:04:30.556 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:30.556 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:30.537472Z", 2024-08-09T00:04:30.557 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:30.557 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:30.557 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:30.557 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.552+0000 7f1153fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.556+0000 7f129fa49980 20 remove_watcher() i=0 2024-08-09T00:04:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.556+0000 7f129fa49980 2 removed watcher, disabling cache 2024-08-09T00:04:30.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.560+0000 7f129fa49980 20 remove_watcher() i=1 2024-08-09T00:04:30.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.560+0000 7f129fa49980 20 remove_watcher() i=2 2024-08-09T00:04:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.564+0000 7f129fa49980 20 remove_watcher() i=3 2024-08-09T00:04:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.564+0000 7f129fa49980 20 remove_watcher() i=4 2024-08-09T00:04:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.568+0000 7f129fa49980 20 remove_watcher() i=5 2024-08-09T00:04:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.568+0000 7f129fa49980 20 remove_watcher() i=6 2024-08-09T00:04:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.572+0000 7f129fa49980 20 remove_watcher() i=7 2024-08-09T00:04:30.588 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4700529239 --totp-seed 5XYQBH526UXZFBGM45AAX47BA6QIYSTEW3XUDZZZDFJ4BHC7DT4CV6PW6HNNOYCG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:30.678 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:30.678 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:30.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.716+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 realm 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:30.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:30.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.720+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:30.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.724+0000 7f6893121980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:30.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.724+0000 7f6893121980 20 searching for the correct realm 2024-08-09T00:04:30.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.724+0000 7f6891436640 0 -- 172.21.15.83:0/1814957369 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f688401d060 msgr2=0x7f6884092050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:30.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:30.972+0000 7f6890434640 0 -- 172.21.15.83:0/1814957369 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f68880d7960 msgr2=0x7f6888003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.196+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:31.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:31.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 zone default found 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 4 Realm: () 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 zonegroup default 2024-08-09T00:04:31.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.200+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.204+0000 7f6893121980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.204+0000 7f6893121980 20 started sync module instance, tier type = 2024-08-09T00:04:31.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.204+0000 7f6893121980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=0 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=1 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=2 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=3 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=4 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=5 2024-08-09T00:04:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.224+0000 7f6893121980 20 add_watcher() i=6 2024-08-09T00:04:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.228+0000 7f6893121980 20 add_watcher() i=7 2024-08-09T00:04:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.228+0000 7f6893121980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:31.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f67477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:31.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:31.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:31.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 5 note: GC not initialized 2024-08-09T00:04:31.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f67467e4640 20 reqs_thread_entry: start 2024-08-09T00:04:31.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:31.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 20 Filter name: none 2024-08-09T00:04:31.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f673ffff640 20 reqs_thread_entry: start 2024-08-09T00:04:31.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-08-09T00:04:31.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.232+0000 7f6893121980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.236+0000 7f6893121980 20 rados_obj.operate() r=0 bl.length=460 2024-08-09T00:04:31.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.236+0000 7f6893121980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-08-09T00:04:31.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.236+0000 7f6893121980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:31.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.236+0000 7f6893121980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6893121980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-09T00:04:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6893121980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6893121980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-08-09T00:04:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6767fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235480 cookie 94574068391856 notifier 7626 bl.length()=659 2024-08-09T00:04:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6767fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-09T00:04:31.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.240+0000 7f6767fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-09T00:04:31.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.244+0000 7f67477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:31.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.252+0000 7f6893121980 20 remove_watcher() i=0 2024-08-09T00:04:31.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.252+0000 7f6893121980 2 removed watcher, disabling cache 2024-08-09T00:04:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.256+0000 7f6893121980 20 remove_watcher() i=1 2024-08-09T00:04:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.256+0000 7f6893121980 20 remove_watcher() i=2 2024-08-09T00:04:31.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.260+0000 7f6893121980 20 remove_watcher() i=3 2024-08-09T00:04:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.260+0000 7f6893121980 20 remove_watcher() i=4 2024-08-09T00:04:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.264+0000 7f6893121980 20 remove_watcher() i=5 2024-08-09T00:04:31.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.264+0000 7f6893121980 20 remove_watcher() i=6 2024-08-09T00:04:31.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.268+0000 7f6893121980 20 remove_watcher() i=7 2024-08-09T00:04:31.284 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-08-09T00:04:31.285 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key YLCBMLZTWAEBFJVFQHLP --secret ILCCHO83cEHtwEvDmYBsdP5UmmrqhO83iToFOBxzTaiztqmc+qOJdw== --cluster ceph 2024-08-09T00:04:31.328 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:31.329 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:31.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.368+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.368+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.368+0000 7f9964d94980 20 realm 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.368+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:31.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:31.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:31.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.372+0000 7f9964d94980 20 searching for the correct realm 2024-08-09T00:04:31.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.380+0000 7f99628a8640 0 -- 172.21.15.83:0/3276254786 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f995402f480 msgr2=0x7f995402f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:31.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.384+0000 7f99620a7640 0 -- 172.21.15.83:0/3276254786 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f995403b970 msgr2=0x7f995402e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:31.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:31.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 zone default found 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 4 Realm: () 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 zonegroup default 2024-08-09T00:04:31.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.604+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.608+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.608+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.608+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.608+0000 7f9964d94980 20 started sync module instance, tier type = 2024-08-09T00:04:31.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.608+0000 7f9964d94980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:31.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=0 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=1 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=2 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=3 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=4 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=5 2024-08-09T00:04:31.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=6 2024-08-09T00:04:31.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 20 add_watcher() i=7 2024-08-09T00:04:31.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.632+0000 7f9964d94980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:31.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f98197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:31.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f9964d94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:31.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f9964d94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:31.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f9964d94980 5 note: GC not initialized 2024-08-09T00:04:31.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f9793fff640 20 reqs_thread_entry: start 2024-08-09T00:04:31.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.636+0000 7f9964d94980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:31.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 Filter name: none 2024-08-09T00:04:31.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9791ffb640 20 reqs_thread_entry: start 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:31.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache get: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP : miss 2024-08-09T00:04:31.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados->read ofs=0 len=0 2024-08-09T00:04:31.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:31.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP info.flags=0x0 2024-08-09T00:04:31.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 adding default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP to cache LRU end 2024-08-09T00:04:31.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache get: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP : hit (negative entry) 2024-08-09T00:04:31.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.640+0000 7f9964d94980 10 cache get: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP : hit (negative entry) 2024-08-09T00:04:31.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-09T00:04:31.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f9964d94980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:31.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f9964d94980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-08-09T00:04:31.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f98467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235478 cookie 94775807044624 notifier 7644 bl.length()=719 2024-08-09T00:04:31.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f98467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-09T00:04:31.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.644+0000 7f98467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:31.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-08-09T00:04:31.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f9964d94980 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-09T00:04:31.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f9964d94980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-08-09T00:04:31.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f98467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235402 cookie 94775807049248 notifier 7644 bl.length()=215 2024-08-09T00:04:31.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f98467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-08-09T00:04:31.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.648+0000 7f98467fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-09T00:04:31.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.652+0000 7f9964d94980 10 cache put: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP info.flags=0x7 2024-08-09T00:04:31.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.652+0000 7f9964d94980 10 moving default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP to cache LRU end 2024-08-09T00:04:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.652+0000 7f9964d94980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:YLCBMLZTWAEBFJVFQHLP, ofs0, ns] 2024-08-09T00:04:31.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.656+0000 7f98467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235498 cookie 94775807028672 notifier 7644 bl.length()=201 2024-08-09T00:04:31.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.656+0000 7f98467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP info.flags=0x7 2024-08-09T00:04:31.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.656+0000 7f98467fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YLCBMLZTWAEBFJVFQHLP to cache LRU end 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "testx$tenanteduser.client.0", 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "testx$tenanteduser+test@test.test", 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:31.658 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "testx$tenanteduser.client.0", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "YLCBMLZTWAEBFJVFQHLP", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "ILCCHO83cEHtwEvDmYBsdP5UmmrqhO83iToFOBxzTaiztqmc+qOJdw==", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:31.645592Z" 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:31.659 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:31.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:31.645532Z", 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:31.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:31.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.660+0000 7f98197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:31.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.664+0000 7f9964d94980 20 remove_watcher() i=0 2024-08-09T00:04:31.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.664+0000 7f9964d94980 2 removed watcher, disabling cache 2024-08-09T00:04:31.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.668+0000 7f9964d94980 20 remove_watcher() i=1 2024-08-09T00:04:31.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.668+0000 7f9964d94980 20 remove_watcher() i=2 2024-08-09T00:04:31.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.672+0000 7f9964d94980 20 remove_watcher() i=3 2024-08-09T00:04:31.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.676+0000 7f9964d94980 20 remove_watcher() i=4 2024-08-09T00:04:31.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.676+0000 7f9964d94980 20 remove_watcher() i=5 2024-08-09T00:04:31.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.676+0000 7f9964d94980 20 remove_watcher() i=6 2024-08-09T00:04:31.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.680+0000 7f9964d94980 20 remove_watcher() i=7 2024-08-09T00:04:31.696 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0657915084 --totp-seed C2E5ZUQU7AS3LOWFB4PO4BOOP7IGKKIOJ4SC3N7QXOLUBDGZKPPE6UE7RMMUKALV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:31.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:31.824+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 realm 2024-08-09T00:04:32.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.028+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.032+0000 7f3d3282c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:32.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.032+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.032+0000 7f3d3282c980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:32.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.032+0000 7f3d3282c980 20 searching for the correct realm 2024-08-09T00:04:32.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.040+0000 7f3d30b41640 0 -- 172.21.15.83:0/3495520415 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f3d240bf070 msgr2=0x7f3d240b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:32.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.456+0000 7f3d2fb3f640 0 -- 172.21.15.83:0/3495520415 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f3d2805ab20 msgr2=0x7f3d28091810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:32.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.672+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:32.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 zone default found 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 4 Realm: () 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 zonegroup default 2024-08-09T00:04:32.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 started sync module instance, tier type = 2024-08-09T00:04:32.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.676+0000 7f3d3282c980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=0 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=1 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=2 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=3 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=4 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=5 2024-08-09T00:04:32.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.700+0000 7f3d3282c980 20 add_watcher() i=6 2024-08-09T00:04:32.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.704+0000 7f3d3282c980 20 add_watcher() i=7 2024-08-09T00:04:32.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.704+0000 7f3d3282c980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3be6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 5 note: GC not initialized 2024-08-09T00:04:32.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3be5fdb640 20 reqs_thread_entry: start 2024-08-09T00:04:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 Filter name: none 2024-08-09T00:04:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3b577fe640 20 reqs_thread_entry: start 2024-08-09T00:04:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-08-09T00:04:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 20 rados_obj.operate() r=0 bl.length=519 2024-08-09T00:04:32.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-08-09T00:04:32.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:32.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.708+0000 7f3d3282c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3d3282c980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-09T00:04:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3d3282c980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3d3282c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-08-09T00:04:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3c077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235479 cookie 94605863546592 notifier 7277 bl.length()=733 2024-08-09T00:04:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3c077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-09T00:04:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.716+0000 7f3c077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-09T00:04:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.720+0000 7f3be6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.724+0000 7f3d3282c980 20 remove_watcher() i=0 2024-08-09T00:04:32.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.724+0000 7f3d3282c980 2 removed watcher, disabling cache 2024-08-09T00:04:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.728+0000 7f3d3282c980 20 remove_watcher() i=1 2024-08-09T00:04:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.728+0000 7f3d3282c980 20 remove_watcher() i=2 2024-08-09T00:04:32.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.732+0000 7f3d3282c980 20 remove_watcher() i=3 2024-08-09T00:04:32.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.732+0000 7f3d3282c980 20 remove_watcher() i=4 2024-08-09T00:04:32.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.736+0000 7f3d3282c980 20 remove_watcher() i=5 2024-08-09T00:04:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.736+0000 7f3d3282c980 20 remove_watcher() i=6 2024-08-09T00:04:32.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.736+0000 7f3d3282c980 20 remove_watcher() i=7 2024-08-09T00:04:32.753 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-08-09T00:04:32.753 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key DTSWJUIUUCHTKCKHEWQT --secret +pXdhbRuJs4iOQ+oMv7k6DWDOZiQQGf4DiQChL9hYJyzEyQKhYEU2Q== --cluster ceph 2024-08-09T00:04:32.840 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:32.840 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:32.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 realm 2024-08-09T00:04:32.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:32.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.884+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.888+0000 7fa7635c3980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:32.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.888+0000 7fa7635c3980 20 searching for the correct realm 2024-08-09T00:04:32.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:32.888+0000 7fa7618d8640 0 -- 172.21.15.83:0/70497819 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fa758111070 msgr2=0x7fa7581151e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:33.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.104+0000 7fa7608d6640 0 -- 172.21.15.83:0/70497819 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fa75407c360 msgr2=0x7fa754053760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:33.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:33.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:33.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.320+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:33.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 zone default found 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 4 Realm: () 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 zonegroup default 2024-08-09T00:04:33.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.324+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.328+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.328+0000 7fa7635c3980 20 started sync module instance, tier type = 2024-08-09T00:04:33.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.328+0000 7fa7635c3980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=0 2024-08-09T00:04:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=1 2024-08-09T00:04:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=2 2024-08-09T00:04:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=3 2024-08-09T00:04:33.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=4 2024-08-09T00:04:33.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=5 2024-08-09T00:04:33.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.352+0000 7fa7635c3980 20 add_watcher() i=6 2024-08-09T00:04:33.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.356+0000 7fa7635c3980 20 add_watcher() i=7 2024-08-09T00:04:33.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.356+0000 7fa7635c3980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:33.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa617fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:33.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:33.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:33.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 5 note: GC not initialized 2024-08-09T00:04:33.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa616fe5640 20 reqs_thread_entry: start 2024-08-09T00:04:33.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:33.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 Filter name: none 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa614fe1640 20 reqs_thread_entry: start 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-08-09T00:04:33.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-08-09T00:04:33.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-09T00:04:33.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 10 cache get: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT : miss 2024-08-09T00:04:33.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.360+0000 7fa7635c3980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT info.flags=0x0 2024-08-09T00:04:33.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 adding default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT to cache LRU end 2024-08-09T00:04:33.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 cache get: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT : hit (negative entry) 2024-08-09T00:04:33.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 cache get: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT : hit (negative entry) 2024-08-09T00:04:33.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:33.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa7635c3980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-09T00:04:33.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa644ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235403 cookie 94497546920000 notifier 7295 bl.length()=660 2024-08-09T00:04:33.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa644ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:33.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.364+0000 7fa644ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-08-09T00:04:33.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa7635c3980 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-09T00:04:33.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa7635c3980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-08-09T00:04:33.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa633fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235481 cookie 94497546902384 notifier 7295 bl.length()=191 2024-08-09T00:04:33.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa633fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-08-09T00:04:33.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.372+0000 7fa633fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-09T00:04:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.376+0000 7fa7635c3980 10 cache put: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT info.flags=0x7 2024-08-09T00:04:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.376+0000 7fa7635c3980 10 moving default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT to cache LRU end 2024-08-09T00:04:33.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.376+0000 7fa7635c3980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:DTSWJUIUUCHTKCKHEWQT, ofs0, ns] 2024-08-09T00:04:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.380+0000 7fa633fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235480 cookie 94497546904992 notifier 7295 bl.length()=189 2024-08-09T00:04:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.380+0000 7fa633fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT info.flags=0x7 2024-08-09T00:04:33.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.380+0000 7fa633fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DTSWJUIUUCHTKCKHEWQT to cache LRU end 2024-08-09T00:04:33.381 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foobar.client.0", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.foobar.client.0", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foobar+test@test.test", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foobar.client.0", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "DTSWJUIUUCHTKCKHEWQT", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "+pXdhbRuJs4iOQ+oMv7k6DWDOZiQQGf4DiQChL9hYJyzEyQKhYEU2Q==", 2024-08-09T00:04:33.382 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:33.367605Z" 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:33.383 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:33.384 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:33.367577Z", 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:33.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.384+0000 7fa617fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:33.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.388+0000 7fa7635c3980 20 remove_watcher() i=0 2024-08-09T00:04:33.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.388+0000 7fa7635c3980 2 removed watcher, disabling cache 2024-08-09T00:04:33.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.388+0000 7fa7635c3980 20 remove_watcher() i=1 2024-08-09T00:04:33.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.392+0000 7fa7635c3980 20 remove_watcher() i=2 2024-08-09T00:04:33.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.392+0000 7fa7635c3980 20 remove_watcher() i=3 2024-08-09T00:04:33.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.396+0000 7fa7635c3980 20 remove_watcher() i=4 2024-08-09T00:04:33.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.400+0000 7fa7635c3980 20 remove_watcher() i=5 2024-08-09T00:04:33.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.400+0000 7fa7635c3980 20 remove_watcher() i=6 2024-08-09T00:04:33.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.400+0000 7fa7635c3980 20 remove_watcher() i=7 2024-08-09T00:04:33.418 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9394892489 --totp-seed W4GFYKKIPSXZSON7YQQVUJ7XXVCVCFJYZJAFAZBQIJ4W7SF3NXNS37VAADBGQBLQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:33.463 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:33.463 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:33.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.500+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 realm 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:33.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.504+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.508+0000 7f04eed38980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:33.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.508+0000 7f04eed38980 20 searching for the correct realm 2024-08-09T00:04:33.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.512+0000 7f04ed04d640 0 -- 172.21.15.83:0/1091688666 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f04d4008040 msgr2=0x7f04d4017440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:33.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.516+0000 7f04ec04b640 0 -- 172.21.15.83:0/1091688666 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f04dc0aa8e0 msgr2=0x7f04dc0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:33.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:33.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:33.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.732+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 zone default found 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 4 Realm: () 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 zonegroup default 2024-08-09T00:04:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.736+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.740+0000 7f04eed38980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.740+0000 7f04eed38980 20 started sync module instance, tier type = 2024-08-09T00:04:33.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.740+0000 7f04eed38980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:33.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=0 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=1 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=2 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=3 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=4 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=5 2024-08-09T00:04:33.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.760+0000 7f04eed38980 20 add_watcher() i=6 2024-08-09T00:04:33.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.764+0000 7f04eed38980 20 add_watcher() i=7 2024-08-09T00:04:33.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.764+0000 7f04eed38980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:33.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f03a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:33.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:33.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:33.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 5 note: GC not initialized 2024-08-09T00:04:33.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f03a1fe3640 20 reqs_thread_entry: start 2024-08-09T00:04:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 20 Filter name: none 2024-08-09T00:04:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f03137fe640 20 reqs_thread_entry: start 2024-08-09T00:04:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-09T00:04:33.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.768+0000 7f04eed38980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.772+0000 7f04eed38980 20 rados_obj.operate() r=0 bl.length=472 2024-08-09T00:04:33.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.772+0000 7f04eed38980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-08-09T00:04:33.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.772+0000 7f04eed38980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.772+0000 7f04eed38980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f04eed38980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f04eed38980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f04eed38980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f03c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235404 cookie 94219931826448 notifier 7313 bl.length()=674 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f03c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:33.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.776+0000 7f03c3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:33.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.780+0000 7f03a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:33.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.784+0000 7f04eed38980 20 remove_watcher() i=0 2024-08-09T00:04:33.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.784+0000 7f04eed38980 2 removed watcher, disabling cache 2024-08-09T00:04:33.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.788+0000 7f04eed38980 20 remove_watcher() i=1 2024-08-09T00:04:33.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.788+0000 7f04eed38980 20 remove_watcher() i=2 2024-08-09T00:04:33.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.792+0000 7f04eed38980 20 remove_watcher() i=3 2024-08-09T00:04:33.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.792+0000 7f04eed38980 20 remove_watcher() i=4 2024-08-09T00:04:33.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.796+0000 7f04eed38980 20 remove_watcher() i=5 2024-08-09T00:04:33.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.796+0000 7f04eed38980 20 remove_watcher() i=6 2024-08-09T00:04:33.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.800+0000 7f04eed38980 20 remove_watcher() i=7 2024-08-09T00:04:33.815 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-08-09T00:04:33.896 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:33.897 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:33.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.936+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 realm 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:33.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:33.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:33.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.940+0000 7ff505428980 20 searching for the correct realm 2024-08-09T00:04:33.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.948+0000 7ff502f3c640 0 -- 172.21.15.83:0/527132994 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7ff4fc018070 msgr2=0x7ff4fc073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:33.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:33.952+0000 7ff50273b640 0 -- 172.21.15.83:0/527132994 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff4fc036bf0 msgr2=0x7ff4fc0430b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:34.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:34.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.168+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 zone default found 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 4 Realm: () 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 zonegroup default 2024-08-09T00:04:34.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 started sync module instance, tier type = 2024-08-09T00:04:34.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.172+0000 7ff505428980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=0 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=1 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=2 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=3 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=4 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=5 2024-08-09T00:04:34.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=6 2024-08-09T00:04:34.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 20 add_watcher() i=7 2024-08-09T00:04:34.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.200+0000 7ff505428980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.204+0000 7ff3b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:34.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.204+0000 7ff505428980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.204+0000 7ff505428980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.204+0000 7ff505428980 5 note: GC not initialized 2024-08-09T00:04:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.204+0000 7ff333fff640 20 reqs_thread_entry: start 2024-08-09T00:04:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:34.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 20 Filter name: none 2024-08-09T00:04:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff331ffb640 20 reqs_thread_entry: start 2024-08-09T00:04:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-09T00:04:34.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 20 rados_obj.operate() r=0 bl.length=486 2024-08-09T00:04:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-08-09T00:04:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.208+0000 7ff505428980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff505428980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff505428980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff505428980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-09T00:04:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff3e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235405 cookie 94241930975504 notifier 7719 bl.length()=727 2024-08-09T00:04:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff3e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-09T00:04:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.212+0000 7ff3e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-09T00:04:34.214 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:34.214 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foobar.client.0", 2024-08-09T00:04:34.214 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.foobar.client.0", 2024-08-09T00:04:34.214 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foobar+test@test.test", 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foobar.client.0", 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "DTSWJUIUUCHTKCKHEWQT", 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "+pXdhbRuJs4iOQ+oMv7k6DWDOZiQQGf4DiQChL9hYJyzEyQKhYEU2Q==", 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:33.367605Z" 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:34.215 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [ 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "oidc-provider", 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "roles", 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "user-policy", 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [ 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "9394892489" 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:33.367577Z", 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:34.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:34.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.216+0000 7ff3b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:34.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.220+0000 7ff505428980 20 remove_watcher() i=0 2024-08-09T00:04:34.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.220+0000 7ff505428980 2 removed watcher, disabling cache 2024-08-09T00:04:34.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.224+0000 7ff505428980 20 remove_watcher() i=1 2024-08-09T00:04:34.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.224+0000 7ff505428980 20 remove_watcher() i=2 2024-08-09T00:04:34.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.228+0000 7ff505428980 20 remove_watcher() i=3 2024-08-09T00:04:34.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.228+0000 7ff505428980 20 remove_watcher() i=4 2024-08-09T00:04:34.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.232+0000 7ff505428980 20 remove_watcher() i=5 2024-08-09T00:04:34.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.232+0000 7ff505428980 20 remove_watcher() i=6 2024-08-09T00:04:34.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.232+0000 7ff505428980 20 remove_watcher() i=7 2024-08-09T00:04:34.251 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-08-09T00:04:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:34.336 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:34.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 realm 2024-08-09T00:04:34.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:34.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.584+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.588+0000 7ff1aa5d8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:34.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.588+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.588+0000 7ff1aa5d8980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:34.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.588+0000 7ff1aa5d8980 20 searching for the correct realm 2024-08-09T00:04:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.592+0000 7ff1a78eb640 0 -- 172.21.15.83:0/999226255 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7ff19805dcd0 msgr2=0x7ff19805c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:34.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.804+0000 7ff1a80ec640 0 -- 172.21.15.83:0/999226255 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7ff0700777b0 msgr2=0x7ff070079be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:34.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.820+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 zone default found 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 4 Realm: () 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 zonegroup default 2024-08-09T00:04:34.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 started sync module instance, tier type = 2024-08-09T00:04:34.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.824+0000 7ff1aa5d8980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:34.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=0 2024-08-09T00:04:34.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=1 2024-08-09T00:04:34.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=2 2024-08-09T00:04:34.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=3 2024-08-09T00:04:34.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=4 2024-08-09T00:04:34.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=5 2024-08-09T00:04:34.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.847+0000 7ff1aa5d8980 20 add_watcher() i=6 2024-08-09T00:04:34.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.851+0000 7ff1aa5d8980 20 add_watcher() i=7 2024-08-09T00:04:34.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.851+0000 7ff1aa5d8980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:34.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff05efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:34.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:34.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:34.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 5 note: GC not initialized 2024-08-09T00:04:34.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff05dfdb640 20 reqs_thread_entry: start 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 Filter name: none 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7fefcf7fe640 20 reqs_thread_entry: start 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rados->read ofs=0 len=0 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-09T00:04:34.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.855+0000 7ff1aa5d8980 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-08-09T00:04:34.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff1aa5d8980 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-09T00:04:34.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff1aa5d8980 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:34.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff1aa5d8980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-08-09T00:04:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff07f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235482 cookie 94802219790448 notifier 7740 bl.length()=384 2024-08-09T00:04:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff07f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-09T00:04:34.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.859+0000 7ff07f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:34.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff1aa5d8980 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-08-09T00:04:34.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff1aa5d8980 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:34.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff1aa5d8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-08-09T00:04:34.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff07f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235499 cookie 94802219798480 notifier 7740 bl.length()=225 2024-08-09T00:04:34.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff07f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-08-09T00:04:34.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.867+0000 7ff07f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:34.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff1aa5d8980 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-08-09T00:04:34.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff1aa5d8980 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-09T00:04:34.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff1aa5d8980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-08-09T00:04:34.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff07effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235422 cookie 94802219794960 notifier 7740 bl.length()=234 2024-08-09T00:04:34.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff07effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-08-09T00:04:34.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.871+0000 7ff07effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-09T00:04:34.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.875+0000 7ff05efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:34.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.879+0000 7ff1aa5d8980 20 remove_watcher() i=0 2024-08-09T00:04:34.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.879+0000 7ff1aa5d8980 2 removed watcher, disabling cache 2024-08-09T00:04:34.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.883+0000 7ff1aa5d8980 20 remove_watcher() i=1 2024-08-09T00:04:34.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.883+0000 7ff1aa5d8980 20 remove_watcher() i=2 2024-08-09T00:04:34.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.887+0000 7ff1aa5d8980 20 remove_watcher() i=3 2024-08-09T00:04:34.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.891+0000 7ff1aa5d8980 20 remove_watcher() i=4 2024-08-09T00:04:34.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.891+0000 7ff1aa5d8980 20 remove_watcher() i=5 2024-08-09T00:04:34.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.891+0000 7ff1aa5d8980 20 remove_watcher() i=6 2024-08-09T00:04:34.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:34.895+0000 7ff1aa5d8980 20 remove_watcher() i=7 2024-08-09T00:04:34.909 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:34.909 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW88888888888888888", 2024-08-09T00:04:34.909 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "", 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW88888888888888888", 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW88888888888888888+test@test.test", 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:34.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:34.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-08-09T00:04:34.912 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:34.914 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-08-09T00:04:34.914 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key JMDKYUQJQMVQBWNWHMMX --secret sJDBxhljo9huHOJM9xvd88vjEP0+RWt88d6X0GdIVaOWzzXbTk6/HQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-08-09T00:04:35.002 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:35.002 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.039+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 realm 2024-08-09T00:04:35.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:35.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:35.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:35.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.043+0000 7f2f1109b980 20 searching for the correct realm 2024-08-09T00:04:35.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.047+0000 7f2f0f3b0640 0 -- 172.21.15.83:0/2043827084 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7f2f040c9070 msgr2=0x7f2f040f5b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:35.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.055+0000 7f2f0e3ae640 0 -- 172.21.15.83:0/2043827084 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f2f08055b70 msgr2=0x7f2f0807c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:35.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.271+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:35.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 zone default found 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 4 Realm: () 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:35.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 zonegroup default 2024-08-09T00:04:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.275+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.279+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.279+0000 7f2f1109b980 20 started sync module instance, tier type = 2024-08-09T00:04:35.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.279+0000 7f2f1109b980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=0 2024-08-09T00:04:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=1 2024-08-09T00:04:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=2 2024-08-09T00:04:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=3 2024-08-09T00:04:35.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=4 2024-08-09T00:04:35.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=5 2024-08-09T00:04:35.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.299+0000 7f2f1109b980 20 add_watcher() i=6 2024-08-09T00:04:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.303+0000 7f2f1109b980 20 add_watcher() i=7 2024-08-09T00:04:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.303+0000 7f2f1109b980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:35.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 5 note: GC not initialized 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2dc4fe1640 20 reqs_thread_entry: start 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 20 Filter name: none 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2dbdffb640 20 reqs_thread_entry: start 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-08-09T00:04:35.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.307+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX : miss 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX info.flags=0x0 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 adding default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX to cache LRU end 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-08-09T00:04:35.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 20 rados_obj.operate() r=0 bl.length=184 2024-08-09T00:04:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-09T00:04:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-09T00:04:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:35.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX : hit (negative entry) 2024-08-09T00:04:35.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.311+0000 7f2f1109b980 10 cache get: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX : hit (negative entry) 2024-08-09T00:04:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-09T00:04:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2f1109b980 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2f1109b980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-08-09T00:04:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2df27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235483 cookie 94270080189168 notifier 7361 bl.length()=681 2024-08-09T00:04:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2df27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-09T00:04:35.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.315+0000 7f2df27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-08-09T00:04:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2f1109b980 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-09T00:04:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2f1109b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-08-09T00:04:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2df1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235481 cookie 94270080207344 notifier 7361 bl.length()=189 2024-08-09T00:04:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2df1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-08-09T00:04:35.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.319+0000 7f2df1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-09T00:04:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.323+0000 7f2f1109b980 10 cache put: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX info.flags=0x7 2024-08-09T00:04:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.323+0000 7f2f1109b980 10 moving default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX to cache LRU end 2024-08-09T00:04:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.323+0000 7f2f1109b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:JMDKYUQJQMVQBWNWHMMX, ofs0, ns] 2024-08-09T00:04:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.327+0000 7f2df27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235500 cookie 94270080191648 notifier 7361 bl.length()=188 2024-08-09T00:04:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.327+0000 7f2df27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX info.flags=0x7 2024-08-09T00:04:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.327+0000 7f2df27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JMDKYUQJQMVQBWNWHMMX to cache LRU end 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.331+0000 7f2f1109b980 20 linked user root1.client.0 to account RGW88888888888888888 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "root1.client.0", 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW88888888888888888", 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "root1+test@test.test", 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:35.332 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "root1.client.0", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "JMDKYUQJQMVQBWNWHMMX", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "sJDBxhljo9huHOJM9xvd88vjEP0+RWt88d6X0GdIVaOWzzXbTk6/HQ==", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:35.317850Z" 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:35.333 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:35.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW88888888888888888", 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:35.317821Z", 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:35.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:35.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.331+0000 7f2dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.335+0000 7f2f1109b980 20 remove_watcher() i=0 2024-08-09T00:04:35.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.335+0000 7f2f1109b980 2 removed watcher, disabling cache 2024-08-09T00:04:35.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.339+0000 7f2f1109b980 20 remove_watcher() i=1 2024-08-09T00:04:35.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.339+0000 7f2f1109b980 20 remove_watcher() i=2 2024-08-09T00:04:35.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.343+0000 7f2f1109b980 20 remove_watcher() i=3 2024-08-09T00:04:35.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.347+0000 7f2f1109b980 20 remove_watcher() i=4 2024-08-09T00:04:35.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.347+0000 7f2f1109b980 20 remove_watcher() i=5 2024-08-09T00:04:35.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.347+0000 7f2f1109b980 20 remove_watcher() i=6 2024-08-09T00:04:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.351+0000 7f2f1109b980 20 remove_watcher() i=7 2024-08-09T00:04:35.375 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8309945201 --totp-seed T3YO7V75WYQMB5RHFBWBT3FYAQGGFDRRPOEPZPAKAGEXAGYYRPAFQJTXPQJRDAEY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:35.421 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:35.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.459+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 realm 2024-08-09T00:04:35.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:35.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:35.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:35.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.463+0000 7f3e0afba980 20 searching for the correct realm 2024-08-09T00:04:35.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.467+0000 7f3e082cd640 0 -- 172.21.15.83:0/2732075394 >> [v2:172.21.15.83:6800/3944119729,v1:172.21.15.83:6801/3944119729] conn(0x7f3e00033030 msgr2=0x7f3e00041960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:35.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.683+0000 7f3e08ace640 0 -- 172.21.15.83:0/2732075394 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f3df801f050 msgr2=0x7f3df801f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:35.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:35.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 zone default found 2024-08-09T00:04:35.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 4 Realm: () 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 zonegroup default 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.699+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.703+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.703+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.703+0000 7f3e0afba980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.703+0000 7f3e0afba980 20 started sync module instance, tier type = 2024-08-09T00:04:35.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.703+0000 7f3e0afba980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=0 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=1 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=2 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=3 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=4 2024-08-09T00:04:35.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=5 2024-08-09T00:04:35.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.727+0000 7f3e0afba980 20 add_watcher() i=6 2024-08-09T00:04:35.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.731+0000 7f3e0afba980 20 add_watcher() i=7 2024-08-09T00:04:35.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.731+0000 7f3e0afba980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:35.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:35.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:35.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:35.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 5 note: GC not initialized 2024-08-09T00:04:35.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3cbdfe3640 20 reqs_thread_entry: start 2024-08-09T00:04:35.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 20 Filter name: none 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3c2f7fe640 20 reqs_thread_entry: start 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.735+0000 7f3e0afba980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.739+0000 7f3e0afba980 20 rados_obj.operate() r=0 bl.length=494 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.739+0000 7f3e0afba980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.739+0000 7f3e0afba980 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.739+0000 7f3e0afba980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:35.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3e0afba980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-09T00:04:35.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3e0afba980 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3e0afba980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-08-09T00:04:35.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3cdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235484 cookie 94657955889264 notifier 7376 bl.length()=695 2024-08-09T00:04:35.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3cdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-09T00:04:35.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.743+0000 7f3cdffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-09T00:04:35.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.747+0000 7f3cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:35.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.751+0000 7f3e0afba980 20 remove_watcher() i=0 2024-08-09T00:04:35.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.751+0000 7f3e0afba980 2 removed watcher, disabling cache 2024-08-09T00:04:35.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.755+0000 7f3e0afba980 20 remove_watcher() i=1 2024-08-09T00:04:35.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.755+0000 7f3e0afba980 20 remove_watcher() i=2 2024-08-09T00:04:35.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.759+0000 7f3e0afba980 20 remove_watcher() i=3 2024-08-09T00:04:35.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.759+0000 7f3e0afba980 20 remove_watcher() i=4 2024-08-09T00:04:35.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.763+0000 7f3e0afba980 20 remove_watcher() i=5 2024-08-09T00:04:35.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.763+0000 7f3e0afba980 20 remove_watcher() i=6 2024-08-09T00:04:35.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.767+0000 7f3e0afba980 20 remove_watcher() i=7 2024-08-09T00:04:35.783 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-08-09T00:04:35.867 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:35.867 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:35.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 realm 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:35.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.907+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.911+0000 7fb1b0481980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:35.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.911+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:35.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.911+0000 7fb1b0481980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:35.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.911+0000 7fb1b0481980 20 searching for the correct realm 2024-08-09T00:04:35.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.915+0000 7fb1ae796640 0 -- 172.21.15.83:0/185586704 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fb19801e060 msgr2=0x7fb19805c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:35.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:35.923+0000 7fb1ad794640 0 -- 172.21.15.83:0/185586704 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fb1a811d780 msgr2=0x7fb1a80c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.139+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:36.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:36.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 zone default found 2024-08-09T00:04:36.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 4 Realm: () 2024-08-09T00:04:36.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:36.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 zonegroup default 2024-08-09T00:04:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 started sync module instance, tier type = 2024-08-09T00:04:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.143+0000 7fb1b0481980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=0 2024-08-09T00:04:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=1 2024-08-09T00:04:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=2 2024-08-09T00:04:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=3 2024-08-09T00:04:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=4 2024-08-09T00:04:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=5 2024-08-09T00:04:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.167+0000 7fb1b0481980 20 add_watcher() i=6 2024-08-09T00:04:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.171+0000 7fb1b0481980 20 add_watcher() i=7 2024-08-09T00:04:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.171+0000 7fb1b0481980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb05f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 5 note: GC not initialized 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb05e7fc640 20 reqs_thread_entry: start 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 Filter name: none 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fafcffff640 20 reqs_thread_entry: start 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-08-09T00:04:36.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-08-09T00:04:36.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.175+0000 7fb1b0481980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-09T00:04:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-08-09T00:04:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-09T00:04:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.179+0000 7fb1b0481980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-08-09T00:04:36.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.183+0000 7fb0917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235485 cookie 94766719505712 notifier 7800 bl.length()=384 2024-08-09T00:04:36.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.183+0000 7fb0917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-09T00:04:36.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.183+0000 7fb0917fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb1b0481980 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-08-09T00:04:36.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb1b0481980 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb1b0481980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-08-09T00:04:36.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb090ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235501 cookie 94766719518784 notifier 7800 bl.length()=225 2024-08-09T00:04:36.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb090ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-08-09T00:04:36.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.187+0000 7fb090ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb1b0481980 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-08-09T00:04:36.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb1b0481980 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-09T00:04:36.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb1b0481980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-08-09T00:04:36.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb090ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235423 cookie 94766719517664 notifier 7800 bl.length()=234 2024-08-09T00:04:36.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb090ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-08-09T00:04:36.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.195+0000 7fb090ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-09T00:04:36.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.199+0000 7fb05f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:36.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.203+0000 7fb1b0481980 20 remove_watcher() i=0 2024-08-09T00:04:36.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.203+0000 7fb1b0481980 2 removed watcher, disabling cache 2024-08-09T00:04:36.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.207+0000 7fb1b0481980 20 remove_watcher() i=1 2024-08-09T00:04:36.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.207+0000 7fb1b0481980 20 remove_watcher() i=2 2024-08-09T00:04:36.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.211+0000 7fb1b0481980 20 remove_watcher() i=3 2024-08-09T00:04:36.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.211+0000 7fb1b0481980 20 remove_watcher() i=4 2024-08-09T00:04:36.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.215+0000 7fb1b0481980 20 remove_watcher() i=5 2024-08-09T00:04:36.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.215+0000 7fb1b0481980 20 remove_watcher() i=6 2024-08-09T00:04:36.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.219+0000 7fb1b0481980 20 remove_watcher() i=7 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW99999999999999999", 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "", 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW99999999999999999", 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW99999999999999999+test@test.test", 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:36.233 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:36.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-08-09T00:04:36.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-08-09T00:04:36.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-08-09T00:04:36.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:36.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-08-09T00:04:36.235 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:36.236 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-08-09T00:04:36.236 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WYJUNHBZKASETQHCJTJY --secret iWW+P3T4Qd6v49exXw3w1FO3EIyw1fFEmYzWN4oxaQKxWZ6zjmPesw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-08-09T00:04:36.326 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:36.326 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:36.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.363+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 realm 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:36.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:36.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.367+0000 7fe570035980 20 searching for the correct realm 2024-08-09T00:04:36.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.371+0000 7fe56e34a640 0 -- 172.21.15.83:0/3223519234 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fe5580b63f0 msgr2=0x7fe5580b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:36.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.587+0000 7fe56e34a640 0 -- 172.21.15.83:0/3223519234 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fe4380777b0 msgr2=0x7fe438079be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:04:36.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:36.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:36.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 zone default found 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 4 Realm: () 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:36.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:36.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 zonegroup default 2024-08-09T00:04:36.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.807+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 started sync module instance, tier type = 2024-08-09T00:04:36.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.811+0000 7fe570035980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:36.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=0 2024-08-09T00:04:36.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=1 2024-08-09T00:04:36.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=2 2024-08-09T00:04:36.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=3 2024-08-09T00:04:36.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=4 2024-08-09T00:04:36.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=5 2024-08-09T00:04:36.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=6 2024-08-09T00:04:36.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 20 add_watcher() i=7 2024-08-09T00:04:36.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.835+0000 7fe570035980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.839+0000 7fe41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.839+0000 7fe570035980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.839+0000 7fe570035980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:36.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.839+0000 7fe570035980 5 note: GC not initialized 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe41e7fc640 20 reqs_thread_entry: start 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 Filter name: none 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe38ffff640 20 reqs_thread_entry: start 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-08-09T00:04:36.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-08-09T00:04:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:36.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY : miss 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY info.flags=0x0 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 adding default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY to cache LRU end 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-08-09T00:04:36.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados->read ofs=0 len=0 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 20 rados_obj.operate() r=0 bl.length=184 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY : hit (negative entry) 2024-08-09T00:04:36.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.843+0000 7fe570035980 10 cache get: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY : hit (negative entry) 2024-08-09T00:04:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-09T00:04:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe570035980 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:36.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe570035980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-08-09T00:04:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe4517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235486 cookie 93979187674240 notifier 7409 bl.length()=681 2024-08-09T00:04:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe4517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-09T00:04:36.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.847+0000 7fe4517fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:36.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-08-09T00:04:36.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe570035980 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-09T00:04:36.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe570035980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-08-09T00:04:36.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe4517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235482 cookie 93979187681888 notifier 7409 bl.length()=189 2024-08-09T00:04:36.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe4517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-08-09T00:04:36.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.855+0000 7fe4517fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-09T00:04:36.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe570035980 10 cache put: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY info.flags=0x7 2024-08-09T00:04:36.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe570035980 10 moving default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY to cache LRU end 2024-08-09T00:04:36.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe570035980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:WYJUNHBZKASETQHCJTJY, ofs0, ns] 2024-08-09T00:04:36.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe4517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235440 cookie 93979187676544 notifier 7409 bl.length()=188 2024-08-09T00:04:36.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe4517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY info.flags=0x7 2024-08-09T00:04:36.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.859+0000 7fe4517fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WYJUNHBZKASETQHCJTJY to cache LRU end 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.863+0000 7fe570035980 20 linked user root2.client.0 to account RGW99999999999999999 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "root2.client.0", 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW99999999999999999", 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "root2+test@test.test", 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-08-09T00:04:36.867 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "root2.client.0", 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "WYJUNHBZKASETQHCJTJY", 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "iWW+P3T4Qd6v49exXw3w1FO3EIyw1fFEmYzWN4oxaQKxWZ6zjmPesw==", 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:36.850575Z" 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-08-09T00:04:36.868 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-08-09T00:04:36.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW99999999999999999", 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-08-09T00:04:36.850551Z", 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-08-09T00:04:36.870 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:04:36.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:04:36.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.867+0000 7fe41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:36.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.871+0000 7fe570035980 20 remove_watcher() i=0 2024-08-09T00:04:36.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.871+0000 7fe570035980 2 removed watcher, disabling cache 2024-08-09T00:04:36.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.875+0000 7fe570035980 20 remove_watcher() i=1 2024-08-09T00:04:36.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.875+0000 7fe570035980 20 remove_watcher() i=2 2024-08-09T00:04:36.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.879+0000 7fe570035980 20 remove_watcher() i=3 2024-08-09T00:04:36.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.879+0000 7fe570035980 20 remove_watcher() i=4 2024-08-09T00:04:36.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.883+0000 7fe570035980 20 remove_watcher() i=5 2024-08-09T00:04:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.883+0000 7fe570035980 20 remove_watcher() i=6 2024-08-09T00:04:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:36.887+0000 7fe570035980 20 remove_watcher() i=7 2024-08-09T00:04:36.902 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 0809217570 --totp-seed HL7MMLS7I7L4F4E5VD5KMTACQPFIQHHISHK67VPPVWF7AMQ3GF7Z33JFE2U3T637 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-09T00:04:36.988 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:04:36.988 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:04:37.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.027+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.027+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.027+0000 7f0580696980 20 realm 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.027+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:37.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:04:37.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.031+0000 7f0580696980 20 searching for the correct realm 2024-08-09T00:04:37.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.035+0000 7f057e1aa640 0 -- 172.21.15.83:0/2740418759 >> [v2:172.21.15.196:6817/921234627,v1:172.21.15.196:6819/921234627] conn(0x7f0578016050 msgr2=0x7f0578011990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:37.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.043+0000 7f057d9a9640 0 -- 172.21.15.83:0/2740418759 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7f05780243d0 msgr2=0x7f0578024830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-09T00:04:37.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:04:37.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:04:37.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.259+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 zone default found 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 4 Realm: () 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 zonegroup default 2024-08-09T00:04:37.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:04:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 started sync module instance, tier type = 2024-08-09T00:04:37.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.263+0000 7f0580696980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:04:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=0 2024-08-09T00:04:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=1 2024-08-09T00:04:37.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=2 2024-08-09T00:04:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=3 2024-08-09T00:04:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=4 2024-08-09T00:04:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=5 2024-08-09T00:04:37.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.287+0000 7f0580696980 20 add_watcher() i=6 2024-08-09T00:04:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.291+0000 7f0580696980 20 add_watcher() i=7 2024-08-09T00:04:37.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.291+0000 7f0580696980 2 all 8 watchers are set, enabling cache 2024-08-09T00:04:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0434fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:04:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:04:37.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 5 note: GC not initialized 2024-08-09T00:04:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f03af7fe640 20 reqs_thread_entry: start 2024-08-09T00:04:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 20 init_complete bucket index max shards: 1 2024-08-09T00:04:37.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 20 Filter name: none 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f03ad7fa640 20 reqs_thread_entry: start 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.295+0000 7f0580696980 20 rados->read ofs=0 len=0 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.299+0000 7f0580696980 20 rados_obj.operate() r=0 bl.length=494 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.299+0000 7f0580696980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.299+0000 7f0580696980 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:37.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.299+0000 7f0580696980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:04:37.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0580696980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-09T00:04:37.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0580696980 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:37.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0580696980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-08-09T00:04:37.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0461ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235487 cookie 94059840496272 notifier 7836 bl.length()=695 2024-08-09T00:04:37.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0461ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-09T00:04:37.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.303+0000 7f0461ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-09T00:04:37.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.307+0000 7f0434fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:04:37.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.311+0000 7f0580696980 20 remove_watcher() i=0 2024-08-09T00:04:37.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.311+0000 7f0580696980 2 removed watcher, disabling cache 2024-08-09T00:04:37.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.315+0000 7f0580696980 20 remove_watcher() i=1 2024-08-09T00:04:37.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.315+0000 7f0580696980 20 remove_watcher() i=2 2024-08-09T00:04:37.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.319+0000 7f0580696980 20 remove_watcher() i=3 2024-08-09T00:04:37.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.323+0000 7f0580696980 20 remove_watcher() i=4 2024-08-09T00:04:37.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.323+0000 7f0580696980 20 remove_watcher() i=5 2024-08-09T00:04:37.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.323+0000 7f0580696980 20 remove_watcher() i=6 2024-08-09T00:04:37.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:04:37.327+0000 7f0580696980 20 remove_watcher() i=7 2024-08-09T00:04:37.343 INFO:tasks.s3tests:Configuring s3-tests... 2024-08-09T00:04:37.344 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-09T00:04:37.344 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-08-09T00:04:37.349 INFO:tasks.s3tests:Configuring boto... 2024-08-09T00:04:37.349 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-08-09T00:04:37.349 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-08-09T00:04:37.396 DEBUG:teuthology.orchestra.run.smithi083:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-08-09T00:04:37.570 INFO:teuthology.orchestra.run.smithi083.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-08-09T00:04:37.764 INFO:teuthology.orchestra.run.smithi083.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-08-09T00:04:38.048 INFO:teuthology.orchestra.run.smithi083.stdout:py installdeps: -rrequirements.txt 2024-08-09T00:06:35.211 INFO:teuthology.orchestra.run.smithi083.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-08-09T00:06:36.977 INFO:teuthology.orchestra.run.smithi083.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.4.0,certifi==2024.7.4,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.15.4,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.7,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.2.2,munch==4.0.0,packaging==24.1,platformdirs==4.2.2,pluggy==1.5.0,pyparsing==3.1.2,pyproject-api==1.7.1,pytest==8.3.2,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=d2d1b3bf02d0ca10c2f55996d90b5f443314b5c391c181cdefcd9a662886bcb9,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.17.1,urllib3==1.26.19,virtualenv==20.26.3,zope.event==5.0,zope.interface==7.0.1 2024-08-09T00:06:36.978 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test-pre: PYTHONHASHSEED='755786088' 2024-08-09T00:06:36.978 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-08-09T00:06:37.158 INFO:teuthology.orchestra.run.smithi083.stdout:============================= test session starts ============================== 2024-08-09T00:06:37.158 INFO:teuthology.orchestra.run.smithi083.stdout:platform linux -- Python 3.10.6, pytest-8.3.2, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-08-09T00:06:37.158 INFO:teuthology.orchestra.run.smithi083.stdout:cachedir: .tox/py/.pytest_cache 2024-08-09T00:06:37.158 INFO:teuthology.orchestra.run.smithi083.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-08-09T00:06:37.159 INFO:teuthology.orchestra.run.smithi083.stdout:configfile: pytest.ini 2024-08-09T00:06:38.948 INFO:teuthology.orchestra.run.smithi083.stdout:collecting ... collected 860 items / 127 deselected / 733 selected 2024-08-09T00:06:38.948 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:06:39.569 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-08-09T00:06:40.059 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-08-09T00:06:40.651 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-08-09T00:06:41.250 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-08-09T00:06:41.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-08-09T00:06:42.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-08-09T00:06:42.963 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-08-09T00:06:43.426 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-08-09T00:06:43.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-08-09T00:06:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-08-09T00:06:44.250 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-08-09T00:06:44.755 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-08-09T00:06:45.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-08-09T00:06:45.743 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-08-09T00:06:45.923 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-08-09T00:06:46.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-08-09T00:06:46.220 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-08-09T00:06:46.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-08-09T00:06:46.493 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-08-09T00:06:46.610 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-08-09T00:06:46.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-08-09T00:06:46.841 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-08-09T00:06:46.965 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.200 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.433 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.553 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.671 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-08-09T00:06:47.790 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-08-09T00:06:47.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.024 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.140 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.488 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-08-09T00:06:48.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-08-09T00:06:48.724 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-08-09T00:06:48.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-08-09T00:06:48.964 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-08-09T00:06:49.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-08-09T00:06:49.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-08-09T00:06:49.313 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-08-09T00:06:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-08-09T00:06:49.558 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-08-09T00:06:49.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-08-09T00:06:49.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-08-09T00:06:49.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-08-09T00:06:50.034 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-08-09T00:06:50.152 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-08-09T00:06:50.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-08-09T00:06:50.386 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-08-09T00:06:50.502 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-08-09T00:06:51.595 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-08-09T00:06:56.644 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-08-09T00:07:03.591 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-08-09T00:07:13.176 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-08-09T00:07:27.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-08-09T00:07:31.537 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-08-09T00:07:36.505 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-08-09T00:07:37.890 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-08-09T00:07:38.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-08-09T00:07:39.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-08-09T00:07:40.681 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-08-09T00:07:42.258 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-08-09T00:07:43.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-08-09T00:07:43.925 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-08-09T00:07:43.930 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-08-09T00:07:43.933 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-08-09T00:07:43.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-08-09T00:07:43.938 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-08-09T00:07:43.940 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-08-09T00:07:43.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-08-09T00:07:43.945 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.947 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.950 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.956 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-08-09T00:07:43.959 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-08-09T00:07:43.961 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.963 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.966 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.968 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.970 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-08-09T00:07:43.974 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-08-09T00:07:43.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 12%] 2024-08-09T00:07:43.978 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 12%] 2024-08-09T00:07:43.980 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-08-09T00:07:43.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-08-09T00:07:43.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-08-09T00:07:43.986 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-08-09T00:07:43.987 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-08-09T00:07:44.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-08-09T00:07:44.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 13%] 2024-08-09T00:07:45.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-08-09T00:07:53.323 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-08-09T00:07:54.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-08-09T00:07:55.595 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-08-09T00:07:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-08-09T00:07:58.104 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-08-09T00:07:59.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 14%] 2024-08-09T00:08:00.259 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 14%] 2024-08-09T00:08:01.475 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-08-09T00:08:02.643 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-08-09T00:08:03.819 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-08-09T00:08:04.811 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-08-09T00:08:05.723 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-08-09T00:08:06.639 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 15%] 2024-08-09T00:08:07.231 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 15%] 2024-08-09T00:08:08.247 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-08-09T00:08:09.427 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-08-09T00:08:10.723 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-08-09T00:08:11.723 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-08-09T00:08:12.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-08-09T00:08:13.211 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-08-09T00:08:14.170 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-08-09T00:08:15.123 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 16%] 2024-08-09T00:08:16.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-08-09T00:08:16.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-08-09T00:08:17.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-08-09T00:08:18.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-08-09T00:08:18.686 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-08-09T00:08:19.283 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 17%] 2024-08-09T00:08:19.883 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-08-09T00:08:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-08-09T00:08:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-08-09T00:08:22.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-08-09T00:08:23.287 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-08-09T00:08:24.206 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-08-09T00:08:24.811 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 18%] 2024-08-09T00:08:25.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 18%] 2024-08-09T00:08:26.631 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 18%] 2024-08-09T00:08:27.926 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-08-09T00:08:28.730 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-08-09T00:08:29.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-08-09T00:08:30.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-08-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-08-09T00:08:33.507 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:34.722 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:36.183 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:37.887 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:40.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:42.575 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:44.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-08-09T00:08:45.987 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 20%] 2024-08-09T00:08:47.243 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 20%] 2024-08-09T00:08:48.782 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 20%] 2024-08-09T00:08:49.806 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-08-09T00:08:52.411 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-08-09T00:08:53.987 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-08-09T00:08:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-08-09T00:08:59.887 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 21%] 2024-08-09T00:09:05.236 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 21%] 2024-08-09T00:09:08.279 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 21%] 2024-08-09T00:09:10.923 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-08-09T00:09:12.959 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-08-09T00:09:14.339 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-08-09T00:09:16.763 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-08-09T00:09:18.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-08-09T00:09:20.715 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 22%] 2024-08-09T00:09:22.280 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 22%] 2024-08-09T00:09:25.223 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 22%] 2024-08-09T00:09:27.695 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-08-09T00:09:30.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-08-09T00:09:34.251 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-08-09T00:09:36.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-08-09T00:09:38.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 23%] 2024-08-09T00:09:40.231 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 23%] 2024-08-09T00:09:44.167 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 23%] 2024-08-09T00:09:47.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-08-09T00:09:50.276 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-08-09T00:09:53.303 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-08-09T00:09:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-08-09T00:09:59.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 24%] 2024-08-09T00:10:01.796 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 24%] 2024-08-09T00:10:03.575 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 24%] 2024-08-09T00:10:05.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 24%] 2024-08-09T00:10:09.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-08-09T00:10:13.755 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-08-09T00:10:15.720 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-08-09T00:10:18.756 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-08-09T00:10:21.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 25%] 2024-08-09T00:10:24.636 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 25%] 2024-08-09T00:10:27.696 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 25%] 2024-08-09T00:10:31.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-08-09T00:10:34.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-08-09T00:10:37.096 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-08-09T00:10:39.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-08-09T00:10:41.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-08-09T00:10:44.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-08-09T00:10:47.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-08-09T00:10:50.612 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-08-09T00:10:53.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-08-09T00:10:56.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-08-09T00:10:59.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-08-09T00:11:02.108 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 27%] 2024-08-09T00:11:04.964 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-08-09T00:11:07.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-08-09T00:11:10.776 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-08-09T00:11:13.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-08-09T00:11:15.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-08-09T00:11:17.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-08-09T00:11:19.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-08-09T00:11:20.818 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-08-09T00:11:22.076 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-08-09T00:11:23.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-08-09T00:11:25.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-08-09T00:11:26.804 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-08-09T00:11:28.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-08-09T00:11:30.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-08-09T00:11:31.700 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 29%] 2024-08-09T00:11:33.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-08-09T00:11:34.875 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-08-09T00:11:37.140 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-08-09T00:11:39.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-08-09T00:11:40.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-08-09T00:11:41.859 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-08-09T00:11:43.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 30%] 2024-08-09T00:11:45.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-08-09T00:11:47.264 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-08-09T00:11:49.596 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-08-09T00:11:51.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-08-09T00:11:52.740 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-08-09T00:11:54.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-08-09T00:11:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-08-09T00:11:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 31%] 2024-08-09T00:11:59.083 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-08-09T00:12:00.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-08-09T00:12:02.179 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-08-09T00:12:03.719 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-08-09T00:12:05.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-08-09T00:12:06.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-08-09T00:12:08.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 32%] 2024-08-09T00:12:09.999 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-08-09T00:12:11.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-08-09T00:12:12.903 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-08-09T00:12:14.484 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-08-09T00:12:16.068 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-08-09T00:14:18.848 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-08-09T00:14:20.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 33%] 2024-08-09T00:14:21.680 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 33%] 2024-08-09T00:14:23.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-08-09T00:14:24.632 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-08-09T00:14:26.108 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-08-09T00:14:27.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-08-09T00:14:29.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-08-09T00:14:30.443 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-08-09T00:14:31.904 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 34%] 2024-08-09T00:14:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-08-09T00:14:34.860 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-08-09T00:14:36.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-08-09T00:14:37.868 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-08-09T00:14:39.420 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-08-09T00:14:41.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-08-09T00:14:42.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 35%] 2024-08-09T00:14:44.150 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-08-09T00:14:45.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-08-09T00:14:47.300 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-08-09T00:14:48.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-08-09T00:14:50.632 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-08-09T00:14:52.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-08-09T00:14:53.967 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 36%] 2024-08-09T00:14:55.596 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 36%] 2024-08-09T00:14:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-08-09T00:14:58.756 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-08-09T00:15:00.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-08-09T00:15:01.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-08-09T00:15:02.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-08-09T00:15:03.728 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-08-09T00:15:08.420 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 37%] 2024-08-09T00:15:13.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 37%] 2024-08-09T00:15:14.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-08-09T00:15:16.264 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-08-09T00:15:17.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-08-09T00:15:19.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-08-09T00:15:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-08-09T00:15:22.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 38%] 2024-08-09T00:15:24.348 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 38%] 2024-08-09T00:15:25.888 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-08-09T00:15:27.464 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-08-09T00:15:29.068 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-08-09T00:15:30.604 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-08-09T00:15:32.196 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-08-09T00:15:34.204 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 39%] 2024-08-09T00:15:36.828 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 39%] 2024-08-09T00:15:37.916 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-08-09T00:15:39.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-08-09T00:15:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-08-09T00:15:40.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-08-09T00:15:41.616 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-08-09T00:15:42.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-08-09T00:15:42.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 40%] 2024-08-09T00:15:44.096 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 40%] 2024-08-09T00:15:48.032 INFO:tasks.rgw.client.0.smithi083.stdout:2024-08-09T00:15:48.030+0000 6fcb2640 -1 req 634549811967657688 0.115996882s s3:delete_bucket ERROR: could not remove bucket test-te4uw1ntd2x64apj9utpbj9g-156 2024-08-09T00:15:48.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-08-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-08-09T00:15:48.889 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket ERROR [ 40%] 2024-08-09T00:15:49.723 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-08-09T00:15:49.723 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding ERROR [ 40%] 2024-08-09T00:15:50.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-08-09T00:15:50.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete ERROR [ 40%] 2024-08-09T00:15:50.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-08-09T00:15:50.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist ERROR [ 40%] 2024-08-09T00:15:51.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 41%] 2024-08-09T00:15:51.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error ERROR [ 41%] 2024-08-09T00:15:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 41%] 2024-08-09T00:15:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete ERROR [ 41%] 2024-08-09T00:15:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-08-09T00:15:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete ERROR [ 41%] 2024-08-09T00:15:59.308 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-08-09T00:15:59.308 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete ERROR [ 41%] 2024-08-09T00:18:01.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-08-09T00:18:01.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit ERROR [ 41%] 2024-08-09T00:20:04.266 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-08-09T00:20:04.266 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit ERROR [ 41%] 2024-08-09T00:20:05.130 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-08-09T00:20:05.131 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes ERROR [ 41%] 2024-08-09T00:20:05.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 42%] 2024-08-09T00:20:05.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag ERROR [ 42%] 2024-08-09T00:20:06.806 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 42%] 2024-08-09T00:20:06.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control ERROR [ 42%] 2024-08-09T00:20:07.772 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 42%] 2024-08-09T00:20:07.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires ERROR [ 42%] 2024-08-09T00:20:08.857 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-08-09T00:20:08.857 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete ERROR [ 42%] 2024-08-09T00:20:09.750 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-08-09T00:20:09.751 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good ERROR [ 42%] 2024-08-09T00:20:10.639 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-08-09T00:20:10.639 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty ERROR [ 42%] 2024-08-09T00:20:11.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-08-09T00:20:11.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty ERROR [ 42%] 2024-08-09T00:20:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-08-09T00:20:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put ERROR [ 42%] 2024-08-09T00:20:13.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 43%] 2024-08-09T00:20:13.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file ERROR [ 43%] 2024-08-09T00:20:14.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 43%] 2024-08-09T00:20:14.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request ERROR [ 43%] 2024-08-09T00:20:15.726 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-08-09T00:20:15.727 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request ERROR [ 43%] 2024-08-09T00:20:16.596 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-08-09T00:20:16.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type ERROR [ 43%] 2024-08-09T00:20:17.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-08-09T00:20:17.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key ERROR [ 43%] 2024-08-09T00:20:18.042 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-08-09T00:20:18.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code ERROR [ 43%] 2024-08-09T00:20:18.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-08-09T00:20:18.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code ERROR [ 43%] 2024-08-09T00:20:20.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 44%] 2024-08-09T00:20:20.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk ERROR [ 44%] 2024-08-09T00:20:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 44%] 2024-08-09T00:20:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename ERROR [ 44%] 2024-08-09T00:20:21.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 44%] 2024-08-09T00:20:21.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header ERROR [ 44%] 2024-08-09T00:20:22.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-08-09T00:20:22.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields ERROR [ 44%] 2024-08-09T00:20:23.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-08-09T00:20:23.468 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values ERROR [ 44%] 2024-08-09T00:20:24.398 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-08-09T00:20:24.399 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action ERROR [ 44%] 2024-08-09T00:20:25.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-08-09T00:20:25.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature ERROR [ 44%] 2024-08-09T00:20:25.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 45%] 2024-08-09T00:20:25.734 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key ERROR [ 45%] 2024-08-09T00:20:26.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 45%] 2024-08-09T00:20:26.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format ERROR [ 45%] 2024-08-09T00:20:27.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 45%] 2024-08-09T00:20:27.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified ERROR [ 45%] 2024-08-09T00:20:27.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-08-09T00:20:27.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature ERROR [ 45%] 2024-08-09T00:20:28.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-08-09T00:20:28.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition ERROR [ 45%] 2024-08-09T00:20:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-08-09T00:20:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header ERROR [ 45%] 2024-08-09T00:20:29.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-08-09T00:20:29.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field ERROR [ 45%] 2024-08-09T00:20:30.481 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-08-09T00:20:30.481 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive ERROR [ 45%] 2024-08-09T00:20:31.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 46%] 2024-08-09T00:20:31.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive ERROR [ 46%] 2024-08-09T00:20:31.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 46%] 2024-08-09T00:20:31.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy ERROR [ 46%] 2024-08-09T00:20:32.873 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 46%] 2024-08-09T00:20:32.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket ERROR [ 46%] 2024-08-09T00:20:33.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-08-09T00:20:33.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value ERROR [ 46%] 2024-08-09T00:20:34.237 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-08-09T00:20:34.237 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition ERROR [ 46%] 2024-08-09T00:20:34.894 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-08-09T00:20:34.895 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list ERROR [ 46%] 2024-08-09T00:20:35.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-08-09T00:20:35.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded ERROR [ 46%] 2024-08-09T00:20:36.193 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 47%] 2024-08-09T00:20:36.193 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument ERROR [ 47%] 2024-08-09T00:20:36.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 47%] 2024-08-09T00:20:36.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument ERROR [ 47%] 2024-08-09T00:20:37.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 47%] 2024-08-09T00:20:37.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum ERROR [ 47%] 2024-08-09T00:20:39.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-08-09T00:20:39.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug ERROR [ 47%] 2024-08-09T00:20:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-08-09T00:20:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions ERROR [ 47%] 2024-08-09T00:20:40.958 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-08-09T00:20:40.958 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good ERROR [ 47%] 2024-08-09T00:20:42.358 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-08-09T00:20:42.358 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed ERROR [ 47%] 2024-08-09T00:20:43.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 48%] 2024-08-09T00:20:43.282 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good ERROR [ 48%] 2024-08-09T00:20:44.196 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 48%] 2024-08-09T00:20:44.197 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed ERROR [ 48%] 2024-08-09T00:20:45.120 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 48%] 2024-08-09T00:20:45.120 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good ERROR [ 48%] 2024-08-09T00:20:47.147 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 48%] 2024-08-09T00:20:47.147 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed ERROR [ 48%] 2024-08-09T00:20:48.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-08-09T00:20:48.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good ERROR [ 48%] 2024-08-09T00:20:49.036 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-08-09T00:20:49.036 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed ERROR [ 48%] 2024-08-09T00:20:50.227 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-08-09T00:20:50.227 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good ERROR [ 48%] 2024-08-09T00:20:51.447 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-08-09T00:20:51.448 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed ERROR [ 48%] 2024-08-09T00:20:52.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 49%] 2024-08-09T00:20:52.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good ERROR [ 49%] 2024-08-09T00:20:53.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 49%] 2024-08-09T00:20:53.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed ERROR [ 49%] 2024-08-09T00:20:54.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 49%] 2024-08-09T00:20:54.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good ERROR [ 49%] 2024-08-09T00:20:55.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-08-09T00:20:55.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed ERROR [ 49%] 2024-08-09T00:20:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-08-09T00:20:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good ERROR [ 49%] 2024-08-09T00:20:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-08-09T00:20:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed ERROR [ 49%] 2024-08-09T00:20:58.721 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-08-09T00:20:58.721 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get ERROR [ 49%] 2024-08-09T00:20:59.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 50%] 2024-08-09T00:20:59.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone ERROR [ 50%] 2024-08-09T00:21:00.124 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 50%] 2024-08-09T00:21:00.124 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone ERROR [ 50%] 2024-08-09T00:21:01.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 50%] 2024-08-09T00:21:01.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone ERROR [ 50%] 2024-08-09T00:21:01.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-08-09T00:21:01.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head ERROR [ 50%] 2024-08-09T00:21:01.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-08-09T00:21:01.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist ERROR [ 50%] 2024-08-09T00:21:03.207 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-08-09T00:21:03.207 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended ERROR [ 50%] 2024-08-09T00:21:04.062 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-08-09T00:21:04.062 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl ERROR [ 50%] 2024-08-09T00:21:04.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 51%] 2024-08-09T00:21:04.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl ERROR [ 51%] 2024-08-09T00:21:08.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 51%] 2024-08-09T00:21:08.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime ERROR [ 51%] 2024-08-09T00:21:09.623 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 51%] 2024-08-09T00:21:09.623 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated ERROR [ 51%] 2024-08-09T00:21:10.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 51%] 2024-08-09T00:21:10.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers ERROR [ 51%] 2024-08-09T00:21:11.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-08-09T00:21:11.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl ERROR [ 51%] 2024-08-09T00:21:12.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-08-09T00:21:12.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl ERROR [ 51%] 2024-08-09T00:21:13.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-08-09T00:21:13.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone ERROR [ 51%] 2024-08-09T00:21:14.056 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-08-09T00:21:14.056 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone ERROR [ 51%] 2024-08-09T00:21:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 52%] 2024-08-09T00:21:15.062 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired ERROR [ 52%] 2024-08-09T00:21:15.741 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 52%] 2024-08-09T00:21:15.742 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant ERROR [ 52%] 2024-08-09T00:21:16.570 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 52%] 2024-08-09T00:21:16.570 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero ERROR [ 52%] 2024-08-09T00:21:17.398 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-08-09T00:21:17.398 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range ERROR [ 52%] 2024-08-09T00:21:18.273 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-08-09T00:21:18.273 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range ERROR [ 52%] 2024-08-09T00:21:19.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-08-09T00:21:19.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put ERROR [ 52%] 2024-08-09T00:21:19.965 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-08-09T00:21:19.965 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access ERROR [ 52%] 2024-08-09T00:21:20.785 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 53%] 2024-08-09T00:21:20.785 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated ERROR [ 53%] 2024-08-09T00:21:21.695 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 53%] 2024-08-09T00:21:21.695 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl ERROR [ 53%] 2024-08-09T00:21:22.218 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 53%] 2024-08-09T00:21:22.218 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant ERROR [ 53%] 2024-08-09T00:21:23.086 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 53%] 2024-08-09T00:21:23.086 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired ERROR [ 53%] 2024-08-09T00:21:23.380 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-08-09T00:21:23.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha ERROR [ 53%] 2024-08-09T00:21:23.673 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-08-09T00:21:23.673 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one ERROR [ 53%] 2024-08-09T00:21:23.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-08-09T00:21:23.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two ERROR [ 53%] 2024-08-09T00:21:24.576 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 54%] 2024-08-09T00:21:24.576 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 ERROR [ 54%] 2024-08-09T00:21:25.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 54%] 2024-08-09T00:21:25.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 ERROR [ 54%] 2024-08-09T00:21:25.889 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 54%] 2024-08-09T00:21:25.890 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 ERROR [ 54%] 2024-08-09T00:21:26.474 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 54%] 2024-08-09T00:21:26.474 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 ERROR [ 54%] 2024-08-09T00:21:27.187 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-08-09T00:21:27.187 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name ERROR [ 54%] 2024-08-09T00:21:27.470 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-08-09T00:21:27.470 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip ERROR [ 54%] 2024-08-09T00:21:27.775 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-08-09T00:21:27.775 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore ERROR [ 54%] 2024-08-09T00:21:28.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-08-09T00:21:28.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long ERROR [ 54%] 2024-08-09T00:21:28.713 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 55%] 2024-08-09T00:21:28.713 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end ERROR [ 55%] 2024-08-09T00:21:29.018 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 55%] 2024-08-09T00:21:29.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot ERROR [ 55%] 2024-08-09T00:21:29.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 55%] 2024-08-09T00:21:29.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash ERROR [ 55%] 2024-08-09T00:21:29.637 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 55%] 2024-08-09T00:21:29.637 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot ERROR [ 55%] 2024-08-09T00:21:30.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-08-09T00:21:30.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists ERROR [ 55%] 2024-08-09T00:21:31.118 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-08-09T00:21:31.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location ERROR [ 55%] 2024-08-09T00:21:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-08-09T00:21:31.805 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner ERROR [ 55%] 2024-08-09T00:21:32.568 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 56%] 2024-08-09T00:21:32.568 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl ERROR [ 56%] 2024-08-09T00:21:33.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 56%] 2024-08-09T00:21:33.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl ERROR [ 56%] 2024-08-09T00:21:33.904 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 56%] 2024-08-09T00:21:33.904 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default ERROR [ 56%] 2024-08-09T00:21:34.630 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 56%] 2024-08-09T00:21:34.630 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create ERROR [ 56%] 2024-08-09T00:21:35.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-08-09T00:21:35.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned ERROR [ 56%] 2024-08-09T00:21:36.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-08-09T00:21:36.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite ERROR [ 56%] 2024-08-09T00:21:37.022 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-08-09T00:21:37.022 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread ERROR [ 56%] 2024-08-09T00:21:37.954 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 57%] 2024-08-09T00:21:37.954 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default ERROR [ 57%] 2024-08-09T00:21:38.890 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 57%] 2024-08-09T00:21:38.890 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create ERROR [ 57%] 2024-08-09T00:21:40.075 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 57%] 2024-08-09T00:21:40.075 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned ERROR [ 57%] 2024-08-09T00:21:41.034 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 57%] 2024-08-09T00:21:41.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite ERROR [ 57%] 2024-08-09T00:21:41.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 57%] 2024-08-09T00:21:41.952 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread ERROR [ 57%] 2024-08-09T00:21:43.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-08-09T00:21:43.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread ERROR [ 57%] 2024-08-09T00:21:44.141 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-08-09T00:21:44.141 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol ERROR [ 57%] 2024-08-09T00:21:45.286 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-08-09T00:21:45.286 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner ERROR [ 57%] 2024-08-09T00:21:46.514 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 58%] 2024-08-09T00:21:46.514 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes ERROR [ 58%] 2024-08-09T00:21:47.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 58%] 2024-08-09T00:21:47.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private ERROR [ 58%] 2024-08-09T00:21:48.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 58%] 2024-08-09T00:21:48.365 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl ERROR [ 58%] 2024-08-09T00:21:49.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 58%] 2024-08-09T00:21:49.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write ERROR [ 58%] 2024-08-09T00:21:50.596 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-08-09T00:21:50.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp ERROR [ 58%] 2024-08-09T00:21:51.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-08-09T00:21:51.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read ERROR [ 58%] 2024-08-09T00:21:52.936 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-08-09T00:21:52.936 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp ERROR [ 58%] 2024-08-09T00:21:54.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 59%] 2024-08-09T00:21:54.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol ERROR [ 59%] 2024-08-09T00:21:55.396 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 59%] 2024-08-09T00:21:55.396 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read ERROR [ 59%] 2024-08-09T00:21:56.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 59%] 2024-08-09T00:21:56.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp ERROR [ 59%] 2024-08-09T00:21:57.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 59%] 2024-08-09T00:21:57.810 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write ERROR [ 59%] 2024-08-09T00:21:58.994 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 59%] 2024-08-09T00:21:58.994 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp ERROR [ 59%] 2024-08-09T00:21:59.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-08-09T00:21:59.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user ERROR [ 59%] 2024-08-09T00:22:00.754 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-08-09T00:22:00.754 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants ERROR [ 59%] 2024-08-09T00:22:01.754 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 60%] 2024-08-09T00:22:01.754 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants ERROR [ 60%] 2024-08-09T00:22:02.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 60%] 2024-08-09T00:22:02.597 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email ERROR [ 60%] 2024-08-09T00:22:03.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 60%] 2024-08-09T00:22:03.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist ERROR [ 60%] 2024-08-09T00:22:04.488 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 60%] 2024-08-09T00:22:04.488 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all ERROR [ 60%] 2024-08-09T00:22:06.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 60%] 2024-08-09T00:22:06.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private ERROR [ 60%] 2024-08-09T00:22:07.768 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-08-09T00:22:07.769 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private ERROR [ 60%] 2024-08-09T00:22:09.425 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-08-09T00:22:09.425 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread ERROR [ 60%] 2024-08-09T00:22:11.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-08-09T00:22:11.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread ERROR [ 60%] 2024-08-09T00:22:12.757 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 61%] 2024-08-09T00:22:12.757 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite ERROR [ 61%] 2024-08-09T00:22:14.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 61%] 2024-08-09T00:22:14.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite ERROR [ 61%] 2024-08-09T00:22:16.062 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 61%] 2024-08-09T00:22:16.063 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private ERROR [ 61%] 2024-08-09T00:22:17.755 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 61%] 2024-08-09T00:22:17.755 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread ERROR [ 61%] 2024-08-09T00:22:19.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 61%] 2024-08-09T00:22:19.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite ERROR [ 61%] 2024-08-09T00:22:21.127 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-08-09T00:22:21.127 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private ERROR [ 61%] 2024-08-09T00:22:22.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-08-09T00:22:22.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread ERROR [ 61%] 2024-08-09T00:22:24.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 62%] 2024-08-09T00:22:24.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite ERROR [ 62%] 2024-08-09T00:22:26.904 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 62%] 2024-08-09T00:22:26.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list ERROR [ 62%] 2024-08-09T00:22:29.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 62%] 2024-08-09T00:22:29.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime ERROR [ 62%] 2024-08-09T00:22:29.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 62%] 2024-08-09T00:22:29.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous ERROR [ 62%] 2024-08-09T00:22:29.701 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 62%] 2024-08-09T00:22:29.701 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth ERROR [ 62%] 2024-08-09T00:22:29.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-08-09T00:22:29.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth ERROR [ 62%] 2024-08-09T00:22:30.761 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-08-09T00:22:30.762 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha ERROR [ 62%] 2024-08-09T00:22:31.584 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 63%] 2024-08-09T00:22:31.585 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit ERROR [ 63%] 2024-08-09T00:22:32.257 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 63%] 2024-08-09T00:22:32.257 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period ERROR [ 63%] 2024-08-09T00:22:32.866 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 63%] 2024-08-09T00:22:32.866 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen ERROR [ 63%] 2024-08-09T00:22:34.083 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 63%] 2024-08-09T00:22:34.083 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding ERROR [ 63%] 2024-08-09T00:22:38.796 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 63%] 2024-08-09T00:22:38.797 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names ERROR [ 63%] 2024-08-09T00:22:40.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-08-09T00:22:40.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix ERROR [ 63%] 2024-08-09T00:22:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-08-09T00:22:41.575 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size ERROR [ 63%] 2024-08-09T00:22:45.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-08-09T00:22:45.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m ERROR [ 63%] 2024-08-09T00:22:46.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 64%] 2024-08-09T00:22:46.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket ERROR [ 64%] 2024-08-09T00:22:47.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 64%] 2024-08-09T00:22:47.553 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype ERROR [ 64%] 2024-08-09T00:22:48.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 64%] 2024-08-09T00:22:48.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself ERROR [ 64%] 2024-08-09T00:22:49.645 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 64%] 2024-08-09T00:22:49.645 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata ERROR [ 64%] 2024-08-09T00:22:51.244 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 64%] 2024-08-09T00:22:51.244 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket ERROR [ 64%] 2024-08-09T00:22:52.293 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-08-09T00:22:52.294 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket ERROR [ 64%] 2024-08-09T00:22:53.708 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-08-09T00:22:53.708 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket ERROR [ 64%] 2024-08-09T00:22:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 65%] 2024-08-09T00:22:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl ERROR [ 65%] 2024-08-09T00:22:57.247 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 65%] 2024-08-09T00:22:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata ERROR [ 65%] 2024-08-09T00:22:59.359 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 65%] 2024-08-09T00:22:59.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata ERROR [ 65%] 2024-08-09T00:23:00.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 65%] 2024-08-09T00:23:00.008 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found ERROR [ 65%] 2024-08-09T00:23:00.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 65%] 2024-08-09T00:23:00.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found ERROR [ 65%] 2024-08-09T00:23:04.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-08-09T00:23:04.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket ERROR [ 65%] 2024-08-09T00:23:06.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-08-09T00:23:06.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding ERROR [ 65%] 2024-08-09T00:23:22.618 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 66%] 2024-08-09T00:23:22.618 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload ERROR [ 66%] 2024-08-09T00:23:23.372 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 66%] 2024-08-09T00:23:23.372 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty ERROR [ 66%] 2024-08-09T00:23:24.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 66%] 2024-08-09T00:23:24.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small ERROR [ 66%] 2024-08-09T00:23:27.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 66%] 2024-08-09T00:23:27.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small ERROR [ 66%] 2024-08-09T00:23:28.983 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 66%] 2024-08-09T00:23:28.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range ERROR [ 66%] 2024-08-09T00:23:31.149 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 66%] 2024-08-09T00:23:31.149 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range ERROR [ 66%] 2024-08-09T00:23:42.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-08-09T00:23:42.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names ERROR [ 66%] 2024-08-09T00:23:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-08-09T00:23:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload ERROR [ 66%] 2024-08-09T00:24:18.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 67%] 2024-08-09T00:24:18.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned ERROR [ 67%] 2024-08-09T00:25:41.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 67%] 2024-08-09T00:25:41.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part ERROR [ 67%] 2024-08-09T00:25:52.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 67%] 2024-08-09T00:25:52.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes ERROR [ 67%] 2024-08-09T00:26:12.290 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 67%] 2024-08-09T00:26:12.290 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes ERROR [ 67%] 2024-08-09T00:26:14.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 67%] 2024-08-09T00:26:14.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small ERROR [ 67%] 2024-08-09T00:26:19.055 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-08-09T00:26:19.056 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents ERROR [ 67%] 2024-08-09T00:26:24.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-08-09T00:26:24.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object ERROR [ 67%] 2024-08-09T00:26:26.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 68%] 2024-08-09T00:26:26.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload ERROR [ 68%] 2024-08-09T00:26:27.413 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 68%] 2024-08-09T00:26:27.413 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found ERROR [ 68%] 2024-08-09T00:26:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 68%] 2024-08-09T00:26:31.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload ERROR [ 68%] 2024-08-09T00:26:33.223 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 68%] 2024-08-09T00:26:33.224 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner ERROR [ 68%] 2024-08-09T00:26:34.234 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 68%] 2024-08-09T00:26:34.234 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part ERROR [ 68%] 2024-08-09T00:26:35.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 68%] 2024-08-09T00:26:35.248 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag ERROR [ 68%] 2024-08-09T00:26:56.657 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-08-09T00:26:56.658 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part ERROR [ 68%] 2024-08-09T00:27:00.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 69%] 2024-08-09T00:27:00.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part ERROR [ 69%] 2024-08-09T00:27:01.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 69%] 2024-08-09T00:27:01.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part ERROR [ 69%] 2024-08-09T00:27:02.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 69%] 2024-08-09T00:27:02.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue ERROR [ 69%] 2024-08-09T00:27:03.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 69%] 2024-08-09T00:27:03.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors ERROR [ 69%] 2024-08-09T00:27:08.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 69%] 2024-08-09T00:27:08.354 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response ERROR [ 69%] 2024-08-09T00:27:12.192 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 69%] 2024-08-09T00:27:12.192 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard ERROR [ 69%] 2024-08-09T00:27:16.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-08-09T00:27:16.020 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option ERROR [ 69%] 2024-08-09T00:27:17.052 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-08-09T00:27:17.052 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object ERROR [ 69%] 2024-08-09T00:27:17.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 70%] 2024-08-09T00:27:17.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant ERROR [ 70%] 2024-08-09T00:27:18.702 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 70%] 2024-08-09T00:27:18.702 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object ERROR [ 70%] 2024-08-09T00:27:19.706 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 70%] 2024-08-09T00:27:19.707 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl ERROR [ 70%] 2024-08-09T00:27:20.423 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 70%] 2024-08-09T00:27:20.423 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant ERROR [ 70%] 2024-08-09T00:27:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 70%] 2024-08-09T00:27:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl ERROR [ 70%] 2024-08-09T00:27:22.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 70%] 2024-08-09T00:27:22.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging ERROR [ 70%] 2024-08-09T00:27:23.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-08-09T00:27:23.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb ERROR [ 70%] 2024-08-09T00:27:26.314 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 71%] 2024-08-09T00:27:26.314 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb ERROR [ 71%] 2024-08-09T00:27:31.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 71%] 2024-08-09T00:27:31.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 71%] 2024-08-09T00:27:33.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 71%] 2024-08-09T00:27:33.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 71%] 2024-08-09T00:27:36.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 71%] 2024-08-09T00:27:36.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 71%] 2024-08-09T00:27:41.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 71%] 2024-08-09T00:27:41.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 71%] 2024-08-09T00:27:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 71%] 2024-08-09T00:27:43.658 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 71%] 2024-08-09T00:27:47.686 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-08-09T00:27:47.686 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 71%] 2024-08-09T00:27:54.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 72%] 2024-08-09T00:27:54.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 72%] 2024-08-09T00:27:56.700 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 72%] 2024-08-09T00:27:56.700 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 72%] 2024-08-09T00:27:57.971 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 72%] 2024-08-09T00:27:57.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 72%] 2024-08-09T00:27:59.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 72%] 2024-08-09T00:27:59.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 72%] 2024-08-09T00:28:00.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 72%] 2024-08-09T00:28:00.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 72%] 2024-08-09T00:28:07.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 72%] 2024-08-09T00:28:07.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 72%] 2024-08-09T00:28:08.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 72%] 2024-08-09T00:28:08.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 72%] 2024-08-09T00:28:09.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-08-09T00:28:09.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 72%] 2024-08-09T00:28:09.985 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 73%] 2024-08-09T00:28:09.986 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 73%] 2024-08-09T00:28:10.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 73%] 2024-08-09T00:28:10.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 73%] 2024-08-09T00:28:12.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 73%] 2024-08-09T00:28:12.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 73%] 2024-08-09T00:28:34.324 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 73%] 2024-08-09T00:28:34.324 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 73%] 2024-08-09T00:28:36.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 73%] 2024-08-09T00:28:36.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 73%] 2024-08-09T00:28:38.094 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 73%] 2024-08-09T00:28:38.094 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 73%] 2024-08-09T00:28:39.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-08-09T00:28:39.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 73%] 2024-08-09T00:28:41.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 74%] 2024-08-09T00:28:41.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 74%] 2024-08-09T00:28:50.923 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 74%] 2024-08-09T00:28:50.923 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 74%] 2024-08-09T00:28:53.041 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 74%] 2024-08-09T00:28:53.041 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy ERROR [ 74%] 2024-08-09T00:29:03.660 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 74%] 2024-08-09T00:29:03.660 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 74%] 2024-08-09T00:29:43.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 74%] 2024-08-09T00:29:43.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 74%] 2024-08-09T00:30:01.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 74%] 2024-08-09T00:30:01.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 74%] 2024-08-09T00:30:06.181 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 74%] 2024-08-09T00:30:06.181 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 74%] 2024-08-09T00:30:10.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 75%] 2024-08-09T00:30:10.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 75%] 2024-08-09T00:30:12.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 75%] 2024-08-09T00:30:12.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 75%] 2024-08-09T00:30:14.279 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 75%] 2024-08-09T00:30:14.279 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 75%] 2024-08-09T00:30:15.427 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 75%] 2024-08-09T00:30:15.428 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 75%] 2024-08-09T00:30:17.685 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 75%] 2024-08-09T00:30:17.685 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 75%] 2024-08-09T00:30:19.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 75%] 2024-08-09T00:30:19.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 75%] 2024-08-09T00:30:23.339 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 75%] 2024-08-09T00:30:23.339 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 75%] 2024-08-09T00:30:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-08-09T00:30:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 75%] 2024-08-09T00:30:24.956 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 76%] 2024-08-09T00:30:24.956 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 76%] 2024-08-09T00:30:25.764 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 76%] 2024-08-09T00:30:25.765 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 76%] 2024-08-09T00:30:26.497 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 76%] 2024-08-09T00:30:26.497 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 76%] 2024-08-09T00:30:27.151 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 76%] 2024-08-09T00:30:27.151 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 76%] 2024-08-09T00:30:28.047 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 76%] 2024-08-09T00:30:28.047 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 76%] 2024-08-09T00:30:28.778 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 76%] 2024-08-09T00:30:28.778 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 76%] 2024-08-09T00:30:29.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-08-09T00:30:29.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 76%] 2024-08-09T00:30:30.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 77%] 2024-08-09T00:30:30.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 77%] 2024-08-09T00:30:31.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 77%] 2024-08-09T00:30:31.269 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 77%] 2024-08-09T00:30:31.993 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 77%] 2024-08-09T00:30:31.993 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 77%] 2024-08-09T00:30:32.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 77%] 2024-08-09T00:30:32.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 77%] 2024-08-09T00:30:33.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 77%] 2024-08-09T00:30:33.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 77%] 2024-08-09T00:30:34.196 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 77%] 2024-08-09T00:30:34.196 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 77%] 2024-08-09T00:30:35.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 77%] 2024-08-09T00:30:35.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 77%] 2024-08-09T00:30:36.162 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 78%] 2024-08-09T00:30:36.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 78%] 2024-08-09T00:30:37.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 78%] 2024-08-09T00:30:37.464 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 78%] 2024-08-09T00:30:38.418 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 78%] 2024-08-09T00:30:38.419 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 78%] 2024-08-09T00:30:39.433 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 78%] 2024-08-09T00:30:39.433 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 78%] 2024-08-09T00:30:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 78%] 2024-08-09T00:30:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 78%] 2024-08-09T00:30:41.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 78%] 2024-08-09T00:30:41.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 78%] 2024-08-09T00:30:42.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 78%] 2024-08-09T00:30:42.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 78%] 2024-08-09T00:30:42.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-08-09T00:30:42.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 78%] 2024-08-09T00:30:43.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 79%] 2024-08-09T00:30:43.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 79%] 2024-08-09T00:30:44.342 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 79%] 2024-08-09T00:30:44.342 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 79%] 2024-08-09T00:31:23.829 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 79%] 2024-08-09T00:31:23.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 79%] 2024-08-09T00:32:02.896 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 79%] 2024-08-09T00:32:02.896 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 79%] 2024-08-09T00:32:12.993 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 79%] 2024-08-09T00:32:12.993 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 79%] 2024-08-09T00:32:13.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 79%] 2024-08-09T00:32:13.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 79%] 2024-08-09T00:32:14.917 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-08-09T00:32:14.917 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 79%] 2024-08-09T00:32:15.864 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 80%] 2024-08-09T00:32:15.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 80%] 2024-08-09T00:32:16.609 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 80%] 2024-08-09T00:32:16.609 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 80%] 2024-08-09T00:32:17.280 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 80%] 2024-08-09T00:32:17.280 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 80%] 2024-08-09T00:32:46.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 80%] 2024-08-09T00:32:46.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 80%] 2024-08-09T00:32:54.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 80%] 2024-08-09T00:32:54.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 80%] 2024-08-09T00:33:03.576 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-08-09T00:33:03.576 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 80%] 2024-08-09T00:33:04.459 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-08-09T00:33:04.459 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 80%] 2024-08-09T00:33:05.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 81%] 2024-08-09T00:33:05.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 81%] 2024-08-09T00:33:06.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 81%] 2024-08-09T00:33:06.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 81%] 2024-08-09T00:33:07.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 81%] 2024-08-09T00:33:07.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 81%] 2024-08-09T00:33:08.727 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 81%] 2024-08-09T00:33:08.727 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 81%] 2024-08-09T00:33:09.673 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 81%] 2024-08-09T00:33:09.673 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 81%] 2024-08-09T00:33:10.681 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 81%] 2024-08-09T00:33:10.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 81%] 2024-08-09T00:33:11.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-08-09T00:33:11.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 81%] 2024-08-09T00:33:12.930 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-08-09T00:33:12.930 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2024-08-09T00:33:14.203 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 82%] 2024-08-09T00:33:14.203 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 82%] 2024-08-09T00:33:16.038 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 82%] 2024-08-09T00:33:16.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 82%] 2024-08-09T00:33:17.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 82%] 2024-08-09T00:33:17.873 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 82%] 2024-08-09T00:33:19.931 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-08-09T00:33:19.931 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 82%] 2024-08-09T00:33:22.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-08-09T00:33:22.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 82%] 2024-08-09T00:33:24.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-08-09T00:33:24.120 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 82%] 2024-08-09T00:33:26.237 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-08-09T00:33:26.237 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2024-08-09T00:33:28.770 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 83%] 2024-08-09T00:33:28.770 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 83%] 2024-08-09T00:33:30.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 83%] 2024-08-09T00:33:30.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 83%] 2024-08-09T00:33:32.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 83%] 2024-08-09T00:33:32.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 83%] 2024-08-09T00:33:35.073 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 83%] 2024-08-09T00:33:35.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 83%] 2024-08-09T00:33:37.299 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-08-09T00:33:37.299 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 83%] 2024-08-09T00:33:38.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-08-09T00:33:38.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2024-08-09T00:33:39.236 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-08-09T00:33:39.236 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2024-08-09T00:33:40.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 84%] 2024-08-09T00:33:40.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 84%] 2024-08-09T00:33:42.383 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 84%] 2024-08-09T00:33:42.383 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 84%] 2024-08-09T00:33:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 84%] 2024-08-09T00:33:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 84%] 2024-08-09T00:33:46.810 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 84%] 2024-08-09T00:33:46.811 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 84%] 2024-08-09T00:33:49.416 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-08-09T00:33:49.416 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 84%] 2024-08-09T00:34:10.717 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-08-09T00:34:10.717 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2024-08-09T00:34:12.518 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-08-09T00:34:12.518 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2024-08-09T00:34:14.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-08-09T00:34:14.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2024-08-09T00:34:16.438 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 85%] 2024-08-09T00:34:16.438 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 85%] 2024-08-09T00:34:18.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 85%] 2024-08-09T00:34:18.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 85%] 2024-08-09T00:34:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 85%] 2024-08-09T00:34:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 85%] 2024-08-09T00:34:22.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 85%] 2024-08-09T00:34:22.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2024-08-09T00:34:23.938 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-08-09T00:34:23.938 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2024-08-09T00:34:24.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-08-09T00:34:24.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2024-08-09T00:34:25.345 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-08-09T00:34:25.345 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2024-08-09T00:34:26.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 86%] 2024-08-09T00:34:26.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 86%] 2024-08-09T00:34:26.748 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 86%] 2024-08-09T00:34:26.748 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 86%] 2024-08-09T00:34:27.741 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 86%] 2024-08-09T00:34:27.741 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 86%] 2024-08-09T00:34:28.501 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 86%] 2024-08-09T00:34:28.502 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2024-08-09T00:34:30.569 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-08-09T00:34:30.569 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2024-08-09T00:34:31.453 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-08-09T00:34:31.453 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2024-08-09T00:34:32.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-08-09T00:34:32.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2024-08-09T00:34:32.862 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 87%] 2024-08-09T00:34:32.862 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 87%] 2024-08-09T00:34:33.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 87%] 2024-08-09T00:34:33.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 87%] 2024-08-09T00:34:34.341 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 87%] 2024-08-09T00:34:34.341 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 87%] 2024-08-09T00:34:35.145 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 87%] 2024-08-09T00:34:35.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2024-08-09T00:34:35.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 87%] 2024-08-09T00:34:35.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2024-08-09T00:34:36.560 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-08-09T00:34:36.560 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2024-08-09T00:34:37.436 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-08-09T00:34:37.436 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2024-08-09T00:34:38.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-08-09T00:34:38.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2024-08-09T00:34:39.325 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 88%] 2024-08-09T00:34:39.325 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 88%] 2024-08-09T00:34:40.297 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-08-09T00:34:40.297 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2024-08-09T00:34:41.561 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 88%] 2024-08-09T00:34:41.561 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2024-08-09T00:34:42.703 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 88%] 2024-08-09T00:34:42.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2024-08-09T00:34:43.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-08-09T00:34:43.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2024-08-09T00:34:44.728 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-08-09T00:34:44.729 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2024-08-09T00:34:46.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-08-09T00:34:46.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2024-08-09T00:34:47.461 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 89%] 2024-08-09T00:34:47.461 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 89%] 2024-08-09T00:34:48.668 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-08-09T00:34:48.668 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2024-08-09T00:34:49.804 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 89%] 2024-08-09T00:34:49.804 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2024-08-09T00:34:51.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 89%] 2024-08-09T00:34:51.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2024-08-09T00:34:52.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-08-09T00:34:52.190 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2024-08-09T00:34:53.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-08-09T00:34:53.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention ERROR [ 89%] 2024-08-09T00:34:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-08-09T00:34:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2024-08-09T00:34:56.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 90%] 2024-08-09T00:34:56.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 90%] 2024-08-09T00:34:57.534 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-08-09T00:34:57.534 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2024-08-09T00:34:58.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-08-09T00:34:58.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2024-08-09T00:34:59.516 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 90%] 2024-08-09T00:34:59.516 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2024-08-09T00:35:00.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 90%] 2024-08-09T00:35:00.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2024-08-09T00:35:01.887 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-08-09T00:35:01.888 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2024-08-09T00:35:03.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-08-09T00:35:03.127 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2024-08-09T00:35:04.610 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-08-09T00:35:04.610 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on ERROR [ 90%] 2024-08-09T00:35:05.721 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 91%] 2024-08-09T00:35:05.722 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 91%] 2024-08-09T00:35:07.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-08-09T00:35:07.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2024-08-09T00:35:08.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-08-09T00:35:08.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2024-08-09T00:35:18.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 91%] 2024-08-09T00:35:18.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2024-08-09T00:35:20.110 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-08-09T00:35:20.110 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2024-08-09T00:35:30.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-08-09T00:35:30.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2024-08-09T00:35:31.743 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-08-09T00:35:31.744 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2024-08-09T00:35:32.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-08-09T00:35:32.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 92%] 2024-08-09T00:35:33.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:33.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:34.241 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:34.241 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:35.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:35.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:35.887 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:35.887 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:36.750 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:36.750 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:37.640 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 92%] 2024-08-09T00:35:37.640 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2024-08-09T00:35:38.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 93%] 2024-08-09T00:35:38.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block ERROR [ 93%] 2024-08-09T00:35:39.555 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 93%] 2024-08-09T00:35:39.555 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy ERROR [ 93%] 2024-08-09T00:35:40.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-08-09T00:35:40.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2024-08-09T00:35:41.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-08-09T00:35:41.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2024-08-09T00:35:42.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-08-09T00:35:42.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2024-08-09T00:35:43.342 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-08-09T00:35:43.342 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2024-08-09T00:35:44.720 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-08-09T00:35:44.720 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2024-08-09T00:35:54.612 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-08-09T00:35:54.612 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2024-08-09T00:35:55.368 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-08-09T00:35:55.368 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2024-08-09T00:35:56.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-08-09T00:35:56.271 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2024-08-09T00:35:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-08-09T00:35:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2024-08-09T00:35:58.185 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-08-09T00:35:58.185 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2024-08-09T00:36:00.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-08-09T00:36:00.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2024-08-09T00:36:13.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-08-09T00:36:24.764 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 94%] 2024-08-09T00:36:25.804 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-08-09T00:36:27.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-08-09T00:36:41.980 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-08-09T00:36:59.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-08-09T00:37:04.140 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-08-09T00:37:06.897 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-08-09T00:37:09.548 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-08-09T00:37:15.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-08-09T00:37:16.664 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-08-09T00:37:21.744 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-08-09T00:37:27.377 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-08-09T00:37:46.021 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-08-09T00:37:50.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-08-09T00:37:52.616 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-08-09T00:37:55.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 96%] 2024-08-09T00:37:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-08-09T00:38:03.892 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-08-09T00:38:07.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-08-09T00:38:09.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-08-09T00:38:11.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-08-09T00:38:19.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-08-09T00:38:23.564 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-08-09T00:38:29.768 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-08-09T00:38:32.156 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-08-09T00:38:32.692 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-08-09T00:38:37.537 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-08-09T00:38:54.652 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-08-09T00:38:57.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-08-09T00:39:09.104 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-08-09T00:39:11.285 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-08-09T00:39:47.857 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-08-09T00:39:48.433 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-08-09T00:39:50.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-08-09T00:39:51.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-08-09T00:39:53.140 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-08-09T00:39:54.965 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:==================================== ERRORS ==================================== 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_object_write_to_nonexist_bucket ___________ 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.007 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.008 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.009 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.010 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.012 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.013 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.014 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_write_with_chunked_transfer_encoding _____ 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.015 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.016 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.017 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.019 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.020 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.022 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucket_create_delete ________________ 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.023 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.024 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.028 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.030 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.031 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.032 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.033 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_object_read_not_exist ________________ 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.034 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.035 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.036 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.037 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.038 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.039 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.041 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_requestid_matches_header_on_error ______ 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.042 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.043 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.044 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.046 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.047 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.048 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.049 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioning_concurrent_multi_object_delete ______ 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.050 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.054 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.055 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.056 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_multi_object_delete _________________ 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.057 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.058 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.059 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.060 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.061 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.062 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.064 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_multi_objectv2_delete ________________ 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.066 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.067 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.068 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.069 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.070 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.071 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.072 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_multi_object_delete_key_limit ____________ 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.073 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.074 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.075 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.077 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.078 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.079 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_multi_objectv2_delete_key_limit ___________ 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.081 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.082 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.083 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.085 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.086 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.087 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_object_head_zero_bytes _______________ 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.088 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.089 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.090 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.092 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.093 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.094 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.096 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_write_check_etag _______________ 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.097 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.098 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.099 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.100 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.101 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.102 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.102 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.102 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.102 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.102 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.103 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.103 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.104 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_write_cache_control _____________ 2024-08-09T00:39:55.105 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.107 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.108 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.109 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.110 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.110 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.110 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.111 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.112 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_object_write_expires ________________ 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.114 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.116 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.117 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.119 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.120 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.122 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.123 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_write_read_update_read_delete ________ 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.124 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.125 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.126 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.127 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.128 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.131 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_set_get_metadata_none_to_good ________ 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.132 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.133 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.134 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.135 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.137 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.139 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.140 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_object_set_get_metadata_none_to_empty ________ 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.142 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.143 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.145 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.146 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.150 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.151 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.152 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_set_get_metadata_overwrite_to_empty _____ 2024-08-09T00:39:55.153 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.154 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.155 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.156 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.157 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.159 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.161 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_object_metadata_replaced_on_put ___________ 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.162 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.165 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.166 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.167 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.168 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.169 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_object_write_file __________________ 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.170 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.171 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.172 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.175 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.176 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.177 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.178 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_post_object_anonymous_request ____________ 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.179 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.180 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.181 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.183 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.184 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.186 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.187 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_post_object_authenticated_request __________ 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.190 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.191 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.192 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.193 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.194 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.195 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_post_object_authenticated_no_content_type ______ 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.197 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.198 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.200 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.201 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.202 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.203 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_post_object_authenticated_request_bad_access_key __ 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.204 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.206 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.208 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.209 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.210 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.211 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_post_object_set_success_code ____________ 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.212 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.214 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.215 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.217 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.218 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.219 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_post_object_set_invalid_success_code ________ 2024-08-09T00:39:55.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.221 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.222 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.225 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.226 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.227 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.228 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_post_object_upload_larger_than_chunk ________ 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.231 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.234 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.235 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.236 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_post_object_set_key_from_filename __________ 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.237 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.238 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.239 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.240 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_post_object_ignored_header _____________ 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.250 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.251 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_post_object_case_insensitive_condition_fields ____ 2024-08-09T00:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.260 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.261 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_post_object_escaped_field_values __________ 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.262 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.263 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.264 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.265 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.267 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.268 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.269 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_post_object_success_redirect_action _________ 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.271 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.272 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.274 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.275 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.276 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_post_object_invalid_signature ____________ 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.277 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.302 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.302 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.303 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.306 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.307 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.308 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.309 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_post_object_invalid_access_key ___________ 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.310 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.311 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.312 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.313 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.314 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.315 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.316 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_post_object_invalid_date_format ___________ 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.318 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.319 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.320 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.322 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.323 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.324 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.325 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_post_object_no_key_specified ____________ 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.326 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.327 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.328 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.329 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.330 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.331 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.332 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.333 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_post_object_missing_signature ____________ 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.334 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.335 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.336 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.337 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.339 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.340 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.341 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_post_object_missing_policy_condition ________ 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.344 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.345 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.346 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.347 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.349 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.351 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.351 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_post_object_user_specified_header __________ 2024-08-09T00:39:55.354 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.354 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.356 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.357 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.358 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.359 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.360 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.361 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_post_object_request_missing_policy_specified_field _ 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.362 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.363 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.364 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.365 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.367 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_post_object_condition_is_case_sensitive _______ 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.369 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.370 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.371 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.372 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.373 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.374 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.375 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.376 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_post_object_expires_is_case_sensitive ________ 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.377 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.380 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.381 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.382 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.383 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_post_object_expired_policy _____________ 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.385 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.386 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.387 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.388 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.389 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.390 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_post_object_wrong_bucket ______________ 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.391 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.392 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.393 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.395 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.396 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.397 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.398 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_post_object_invalid_request_field_value _______ 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.400 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.401 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.402 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.403 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.405 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_post_object_missing_expires_condition ________ 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.407 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.408 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.409 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.412 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_post_object_missing_conditions_list _________ 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.414 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.415 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.417 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.418 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.419 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.419 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.419 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.420 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.421 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.422 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_post_object_upload_size_limit_exceeded _______ 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.423 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.425 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.428 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.429 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.430 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_post_object_missing_content_length_argument _____ 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.431 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.432 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.433 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.434 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.435 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.436 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.437 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.438 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_post_object_invalid_content_length_argument _____ 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.439 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.440 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.441 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.442 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.443 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.444 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.445 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.446 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.447 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_post_object_upload_size_below_minimum ________ 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.448 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.449 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.450 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.451 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.452 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.453 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.454 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.455 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.456 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_post_object_upload_size_rgw_chunk_size_bug _____ 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.457 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.458 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.459 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.460 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.462 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.463 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.464 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.465 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_post_object_empty_conditions ____________ 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.466 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.467 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.469 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.470 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.473 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_get_object_ifmatch_good _______________ 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.475 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.476 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.476 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.476 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.477 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.478 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.480 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.481 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.482 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.483 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_get_object_ifmatch_failed ______________ 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.484 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.486 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.487 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.488 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.489 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.490 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_get_object_ifnonematch_good _____________ 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.492 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.493 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.494 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.495 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.496 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.497 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_get_object_ifnonematch_failed ____________ 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.498 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.499 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.500 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.501 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.502 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.503 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_get_object_ifmodifiedsince_good ___________ 2024-08-09T00:39:55.504 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.505 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.506 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.507 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.508 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.509 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.510 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_get_object_ifmodifiedsince_failed __________ 2024-08-09T00:39:55.511 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.513 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.514 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.515 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.516 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.517 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_get_object_ifunmodifiedsince_good __________ 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.520 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.521 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.522 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.523 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.524 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_get_object_ifunmodifiedsince_failed _________ 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.527 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.528 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.529 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.530 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.531 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_put_object_ifmatch_good _______________ 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.534 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.535 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.537 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.538 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_put_object_ifmatch_failed ______________ 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.541 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.542 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.543 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.544 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.545 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_put_object_ifmatch_overwrite_existed_good ______ 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.547 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.548 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.549 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.551 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.552 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_put_object_ifmatch_nonexisted_failed ________ 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.553 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.554 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.555 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.556 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.557 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.558 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.562 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.562 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.562 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.562 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.562 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.563 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_put_object_ifnonmatch_good _____________ 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.564 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.565 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.566 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.568 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.569 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.570 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_put_object_ifnonmatch_failed ____________ 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.572 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.575 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.576 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.577 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_put_object_ifnonmatch_nonexisted_good ________ 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.578 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.579 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.580 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.583 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.584 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_put_object_ifnonmatch_overwrite_existed_failed ___ 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.585 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.586 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.589 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.590 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.591 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:___________________ ERROR at teardown of test_object_raw_get ___________________ 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.592 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.593 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.594 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.595 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.596 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.597 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.598 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_raw_get_bucket_gone _____________ 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.599 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.600 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.601 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.602 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.603 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.604 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.605 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_delete_key_bucket_gone ____________ 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.607 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.608 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.610 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.611 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_raw_get_object_gone _____________ 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.612 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.613 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.614 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.615 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.616 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.618 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout:____________________ ERROR at teardown of test_bucket_head _____________________ 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.621 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.622 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.624 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.625 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucket_head_notexist ________________ 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.626 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.628 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.630 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.631 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.632 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucket_head_extended ________________ 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.633 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.634 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.635 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.637 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.638 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.639 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_raw_get_bucket_acl ______________ 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.640 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.641 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.642 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.643 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.644 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.645 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.646 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_raw_get_object_acl ______________ 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.647 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_object_put_acl_mtime ________________ 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.654 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.655 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.656 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.658 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.659 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.660 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_raw_authenticated ______________ 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.661 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.662 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.663 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.665 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.666 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.667 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_raw_response_headers _____________ 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.668 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.669 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.670 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.672 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.673 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.674 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_raw_authenticated_bucket_acl _________ 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.676 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.677 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.679 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.681 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_raw_authenticated_object_acl _________ 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.683 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.684 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.686 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.687 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.688 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_raw_authenticated_bucket_gone ________ 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.689 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.690 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.691 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.692 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.694 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.695 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_raw_authenticated_object_gone ________ 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.696 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.697 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.698 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.699 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.701 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.702 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_raw_get_x_amz_expires_not_expired ______ 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.703 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.704 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.705 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.707 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.708 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_object_raw_get_x_amz_expires_not_expired_tenant ___ 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.710 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.711 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.714 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.715 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.716 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_raw_get_x_amz_expires_out_range_zero _____ 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.717 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.718 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.719 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.720 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.721 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.722 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.723 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_raw_get_x_amz_expires_out_max_range _____ 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.724 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.725 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.726 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.727 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.728 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.730 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_object_raw_get_x_amz_expires_out_positive_range ___ 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.731 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.732 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.733 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.736 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.737 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_object_anon_put ___________________ 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.738 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.739 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.741 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.742 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.743 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.744 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_anon_put_write_access ____________ 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.746 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.747 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.748 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.749 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.750 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_put_authenticated ______________ 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.753 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.754 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.755 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.756 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.757 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.758 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_presigned_put_object_with_acl ________ 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.760 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.761 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.762 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.763 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.764 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_presigned_put_object_with_acl_tenant _____ 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.766 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.767 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.768 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.769 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.770 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.771 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_raw_put_authenticated_expired ________ 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.772 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.775 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.776 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.777 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.778 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_bucket_create_naming_bad_starts_nonalpha ______ 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.779 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.780 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.781 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.783 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.784 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.785 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_bad_short_one _________ 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.786 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.787 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.788 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.790 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.791 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.792 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_bad_short_two _________ 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.794 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.796 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.797 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.798 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.799 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_good_long_60 __________ 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.801 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.804 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_good_long_61 __________ 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.807 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.808 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.809 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.811 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.812 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_good_long_62 __________ 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.814 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.815 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.817 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.818 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.819 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.820 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_good_long_63 __________ 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.821 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.822 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.823 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.825 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.826 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.827 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_bucket_list_long_name ________________ 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.828 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.829 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.830 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.832 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.833 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_bucket_create_naming_bad_ip _____________ 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.835 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.836 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.837 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.839 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.840 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_bucket_create_naming_dns_underscore _________ 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.841 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.843 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.844 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.846 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_create_naming_dns_long ____________ 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.848 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.849 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.850 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.851 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.853 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.854 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_bucket_create_naming_dns_dash_at_end ________ 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.855 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.856 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.857 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.858 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.859 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.860 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.861 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_create_naming_dns_dot_dot __________ 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.862 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.863 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.864 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.866 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.867 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.868 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_dns_dot_dash __________ 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.870 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.871 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.873 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.874 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.875 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_create_naming_dns_dash_dot __________ 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.876 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.877 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.878 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.879 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.880 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.881 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.882 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucket_create_exists ________________ 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.883 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.884 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.885 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.886 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.887 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.888 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.889 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucket_get_location _________________ 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.890 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.891 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.892 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.893 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.894 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.895 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.896 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_create_exists_nonowner ____________ 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.898 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.899 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.900 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.901 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.902 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.903 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_recreate_overwrite_acl ____________ 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.904 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.905 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.906 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.907 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.908 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.909 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.910 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_bucket_recreate_new_acl _______________ 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.911 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.912 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.913 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.914 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.915 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.916 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.917 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_bucket_acl_default _________________ 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.918 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.920 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.921 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.922 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.923 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.924 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_acl_canned_during_create ___________ 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.925 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.926 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.927 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.928 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.929 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.930 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.931 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_bucket_acl_canned __________________ 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.932 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.933 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.937 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.938 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_acl_canned_publicreadwrite __________ 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.939 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.940 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.941 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.942 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.943 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.944 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_bucket_acl_canned_authenticatedread _________ 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.945 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.946 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.947 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.948 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.949 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.950 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.951 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_object_acl_default _________________ 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.952 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.953 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.954 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.955 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.956 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.957 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.958 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_object_acl_canned_during_create ___________ 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.959 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.961 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.962 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.963 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.964 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.965 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_object_acl_canned __________________ 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.967 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.970 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.970 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.970 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.970 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.970 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.972 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.973 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.974 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.975 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_object_acl_canned_publicreadwrite __________ 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.976 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.977 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.979 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.980 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.981 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.982 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_acl_canned_authenticatedread _________ 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.985 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.986 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.988 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.989 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_object_acl_canned_bucketownerread __________ 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.990 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.992 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.993 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:55.994 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:55.995 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:55.996 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_acl_canned_bucketownerfullcontrol ______ 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:55.997 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:55.998 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:55.999 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.002 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_acl_full_control_verify_owner ________ 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.004 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.005 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.010 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_acl_full_control_verify_attributes ______ 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.017 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_bucket_acl_canned_private_to_private ________ 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.018 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.019 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.021 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.022 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.023 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.024 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:_____________________ ERROR at teardown of test_object_acl _____________________ 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.025 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.026 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.027 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.028 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.029 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.030 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_object_acl_write __________________ 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.033 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.035 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.038 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_object_acl_writeacp _________________ 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.039 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.040 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.041 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.042 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.043 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.044 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_object_acl_read ___________________ 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.045 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.049 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.050 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.051 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_object_acl_readacp _________________ 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.052 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.053 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.054 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.056 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.057 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.058 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_bucket_acl_grant_userid_fullcontrol _________ 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.061 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.063 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.064 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.065 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_bucket_acl_grant_userid_read ____________ 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.066 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.068 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.072 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_acl_grant_userid_readacp ___________ 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.073 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.074 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.075 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.076 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.077 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.078 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.079 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_acl_grant_userid_write ____________ 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.080 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.082 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.083 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.084 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.085 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.086 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_acl_grant_userid_writeacp __________ 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.088 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.089 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.090 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.091 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.092 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.093 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_acl_grant_nonexist_user ___________ 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.094 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.095 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.096 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.097 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.098 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.099 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.100 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_header_acl_grants ______________ 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.101 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.102 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.103 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.104 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.105 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.106 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.107 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_bucket_header_acl_grants ______________ 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.108 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.109 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.111 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.112 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.113 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.114 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_bucket_acl_grant_email _______________ 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.115 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.117 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.118 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.120 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_acl_grant_email_not_exist __________ 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.121 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.122 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.123 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.124 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.125 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.126 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.127 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_bucket_acl_revoke_all ________________ 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.129 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.130 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.131 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.132 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.134 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_access_bucket_private_object_private ________ 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.136 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.137 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.138 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.139 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.140 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.141 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_access_bucket_private_objectv2_private _______ 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.142 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.145 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.147 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.148 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_access_bucket_private_object_publicread _______ 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.149 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.150 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.152 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.153 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.154 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.155 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_access_bucket_private_objectv2_publicread ______ 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.156 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.157 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.158 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.159 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.160 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.161 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.162 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_access_bucket_private_object_publicreadwrite ____ 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.165 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.166 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.167 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_access_bucket_private_objectv2_publicreadwrite ___ 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.170 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.171 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.172 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.173 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.174 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.175 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.176 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_access_bucket_publicread_object_private _______ 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.177 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.178 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.179 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.180 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.181 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.182 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_access_bucket_publicread_object_publicread _____ 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.183 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.184 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.185 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.186 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.187 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.188 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.189 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_access_bucket_publicread_object_publicreadwrite ___ 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.190 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.191 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.192 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.193 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.194 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.195 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.196 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_access_bucket_publicreadwrite_object_private ____ 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.197 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.198 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.199 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.200 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.201 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.202 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.203 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_access_bucket_publicreadwrite_object_publicread ___ 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.205 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.206 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.207 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.208 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.209 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.210 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_access_bucket_publicreadwrite_object_publicreadwrite _ 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.212 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.213 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.214 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.215 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.216 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.217 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_buckets_create_then_list ______________ 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.218 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.219 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.220 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.221 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.222 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.223 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_buckets_list_ctime _________________ 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.224 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.225 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.226 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.227 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.228 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.229 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.230 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_list_buckets_anonymous _______________ 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.231 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.233 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.234 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.236 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.237 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_list_buckets_invalid_auth ______________ 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.238 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.239 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.240 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.241 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.242 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.243 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_list_buckets_bad_auth ________________ 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.245 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.246 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.247 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.248 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.249 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.250 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.251 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_bucket_create_naming_good_starts_alpha _______ 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.253 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.254 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.255 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.256 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.258 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:Done with cleanup of buckets in tests. 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:Done with cleanup of buckets in tests. 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_bucket_create_naming_good_starts_digit _______ 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.259 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.260 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.261 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.262 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.263 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.264 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.265 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:Done with cleanup of buckets in tests. 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:Done with cleanup of buckets in tests. 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_bucket_create_naming_good_contains_period ______ 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.267 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.268 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.269 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.270 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.271 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_bucket_create_naming_good_contains_hyphen ______ 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.273 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.275 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.276 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.277 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.278 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.279 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucket_recreate_not_overriding ___________ 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.280 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.282 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.283 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.284 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.285 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.286 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_create_special_key_names ___________ 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.287 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.288 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.289 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.290 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.291 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.292 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.293 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_bucket_list_special_prefix _____________ 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.295 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.296 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.297 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.298 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.299 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.300 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_object_copy_zero_size ________________ 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.302 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.303 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.304 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.305 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.306 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.307 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_object_copy_16m ___________________ 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.308 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.309 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.310 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.311 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.312 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.314 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_copy_same_bucket _______________ 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.315 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.316 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.317 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.318 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.319 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.320 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.321 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_copy_verify_contenttype ___________ 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.322 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.323 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.325 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.326 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.327 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.328 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_object_copy_to_itself ________________ 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.329 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.330 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.331 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.333 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.334 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.335 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_copy_to_itself_with_metadata _________ 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.336 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.337 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.338 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.339 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.340 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.341 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.342 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_copy_diff_bucket _______________ 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.344 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.345 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.346 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.347 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.348 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.349 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_copy_not_owned_bucket ____________ 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.351 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.352 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.353 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.354 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.355 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_object_copy_not_owned_object_bucket _________ 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.356 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.357 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.358 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.359 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.360 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.361 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_object_copy_canned_acl _______________ 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.364 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.365 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.366 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.367 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.369 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_copy_retaining_metadata ___________ 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.371 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.372 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.373 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.374 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.377 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.378 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.379 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.380 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_copy_replacing_metadata ___________ 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.381 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.382 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.384 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.385 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.386 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.387 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_copy_bucket_not_found ____________ 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.388 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.389 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.390 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.391 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.392 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.393 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_copy_key_not_found ______________ 2024-08-09T00:39:56.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.395 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.396 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.397 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.398 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.400 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_copy_versioned_bucket ____________ 2024-08-09T00:39:56.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.402 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.403 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.404 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.405 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.406 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.407 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_object_copy_versioned_url_encoding _________ 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.408 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.410 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.411 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.412 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.413 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.414 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.415 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_copy_versioning_multipart_upload _______ 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.416 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.417 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.418 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.419 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.420 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.421 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.422 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_multipart_upload_empty _______________ 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.423 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.424 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.425 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.426 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.427 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.428 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.429 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_multipart_upload_small _______________ 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.430 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.431 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.432 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.433 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.435 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_multipart_copy_small ________________ 2024-08-09T00:39:56.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.437 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.439 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.440 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.441 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.442 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_multipart_copy_invalid_range ____________ 2024-08-09T00:39:56.443 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.444 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.445 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.446 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.447 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.448 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.449 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_multipart_copy_without_range ____________ 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.452 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.454 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.455 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.456 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_multipart_copy_special_names ____________ 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.457 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.459 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.460 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.461 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.462 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.463 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_multipart_upload __________________ 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.464 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.466 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.467 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.468 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.469 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_multipart_copy_versioned ______________ 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.471 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.472 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.473 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.475 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.476 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.477 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.478 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_multipart_upload_resend_part ____________ 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.479 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.480 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.482 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.483 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.484 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.485 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_multipart_upload_multiple_sizes ___________ 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.486 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.487 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.488 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.489 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.490 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.492 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_multipart_copy_multiple_sizes ____________ 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.493 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.495 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.496 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.497 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.498 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.499 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_multipart_upload_size_too_small ___________ 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.500 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.501 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.502 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.503 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.504 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.505 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.506 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_multipart_upload_contents ______________ 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.507 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.508 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.509 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.510 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.511 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.512 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.513 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_multipart_upload_overwrite_existing_object _____ 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.514 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.515 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.516 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.517 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.518 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.520 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_abort_multipart_upload _______________ 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.521 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.524 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.525 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.526 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_abort_multipart_upload_not_found __________ 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.528 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.529 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.530 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.531 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.532 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.533 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_list_multipart_upload ________________ 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.536 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.537 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.538 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.539 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.540 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.541 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_list_multipart_upload_owner _____________ 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.542 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.543 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.544 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.545 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.546 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.547 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.548 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_multipart_upload_missing_part ____________ 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.549 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.550 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.551 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.552 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.553 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.554 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.555 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_multipart_upload_incorrect_etag ___________ 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.556 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.557 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.558 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.559 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.562 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_multipart_get_part _________________ 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.565 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.566 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.567 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.568 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.569 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_multipart_single_get_part ______________ 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.570 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.571 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.572 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.573 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.575 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_non_multipart_get_part _______________ 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.576 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.577 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.578 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.579 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.580 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.580 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.581 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.582 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.583 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.584 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:____________________ ERROR at teardown of test_100_continue ____________________ 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.585 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.586 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.587 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.589 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.591 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:______________________ ERROR at teardown of test_set_cors ______________________ 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.593 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.594 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.596 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.597 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.598 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_cors_origin_response ________________ 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.599 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.600 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.601 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.603 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.604 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.605 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_cors_origin_wildcard ________________ 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.607 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.608 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.609 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.610 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.611 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.612 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_cors_header_option _________________ 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.613 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.615 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.616 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.617 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.618 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.619 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_cors_presigned_get_object ______________ 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.620 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.621 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.622 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.623 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.624 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.625 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_cors_presigned_get_object_tenant __________ 2024-08-09T00:39:56.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.629 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.630 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.631 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.632 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_cors_presigned_put_object ______________ 2024-08-09T00:39:56.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.635 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.636 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.637 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.638 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_cors_presigned_put_object_with_acl _________ 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.642 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.644 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.645 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.646 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.647 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_cors_presigned_put_object_tenant __________ 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.648 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.649 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.650 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.651 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.652 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.653 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.654 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_cors_presigned_put_object_tenant_with_acl ______ 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.655 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.656 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.657 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.658 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.659 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.660 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_set_bucket_tagging _________________ 2024-08-09T00:39:56.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.662 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.664 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.665 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.666 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.667 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_read_1mb ___________________ 2024-08-09T00:39:56.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.669 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.670 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.671 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.672 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.674 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_read_4mb ___________________ 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.675 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.676 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.677 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.678 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.679 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.681 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.682 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_read_8mb ___________________ 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.683 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.684 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.685 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.686 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.688 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.689 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_write_1mb __________________ 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.691 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.692 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.693 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.694 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.695 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.696 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_write_4mb __________________ 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.697 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.698 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.699 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.700 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.701 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.702 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.703 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_atomic_write_8mb __________________ 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.704 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.705 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.707 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.708 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.709 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_atomic_dual_write_1mb ________________ 2024-08-09T00:39:56.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.711 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.712 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.713 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.714 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.716 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_atomic_dual_write_4mb ________________ 2024-08-09T00:39:56.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.718 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.719 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.720 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.721 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.722 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.723 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_atomic_dual_write_8mb ________________ 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.726 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.727 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.728 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.729 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.730 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_atomic_conditional_write_1mb ____________ 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.731 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.732 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.736 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_atomic_multipart_upload_write ____________ 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.739 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.742 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_multipart_resend_first_finishes_last ________ 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.746 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.749 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.750 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.751 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_ranged_request_response_code ____________ 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.752 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.753 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.755 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.756 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.757 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.758 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_ranged_big_request_response_code __________ 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.760 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.762 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.763 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.765 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:__ ERROR at teardown of test_ranged_request_skip_leading_bytes_response_code ___ 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.766 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.767 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.768 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.769 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.770 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.771 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_ranged_request_return_trailing_bytes_response_code _ 2024-08-09T00:39:56.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.775 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.776 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.777 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.778 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_ranged_request_invalid_range ____________ 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.779 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.780 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.781 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.782 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.783 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.785 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.786 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_ranged_request_empty_object _____________ 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.787 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.788 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.791 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.792 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.793 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_versioning_bucket_create_suspend __________ 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.794 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.795 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.796 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.797 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.798 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.799 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_versioning_obj_create_read_remove __________ 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.801 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.803 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.806 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.807 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_versioning_obj_create_read_remove_head _______ 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.808 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.810 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.811 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.812 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.813 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.814 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioning_obj_plain_null_version_removal ______ 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.815 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.816 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.817 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.818 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.819 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.820 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.821 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite _____ 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.822 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.823 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.824 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.825 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.826 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.827 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.828 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite_suspended _ 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.829 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.830 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.831 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.832 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.833 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_versioning_obj_suspend_versions ___________ 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.836 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.837 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.838 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.839 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.840 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.841 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.842 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_versioning_obj_suspended_copy ____________ 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.844 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.846 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.847 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.848 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.849 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioning_obj_create_versions_remove_all ______ 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.850 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.851 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.852 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.853 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.854 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.855 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.856 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_versioning_obj_create_versions_remove_special_names _ 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.859 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.860 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.861 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.862 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.863 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioning_obj_create_overwrite_multipart ______ 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.864 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.865 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.866 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.867 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.868 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.869 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.870 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_versioning_obj_list_marker _____________ 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.871 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.872 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.873 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.874 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.875 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.877 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_versioning_copy_obj_version _____________ 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.878 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.879 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.880 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.881 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.882 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.883 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.884 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_versioning_multi_object_delete ___________ 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.887 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.888 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.889 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.891 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioning_multi_object_delete_with_marker _____ 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.893 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.894 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.895 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.896 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_versioning_multi_object_delete_with_marker_create __ 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.905 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_versioned_object_acl ________________ 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.911 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.912 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_versioned_object_acl_no_version_specified ______ 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.913 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.915 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.916 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.917 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.918 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.919 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_versioned_concurrent_object_create_and_remove ____ 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.920 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.921 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.922 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.923 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.924 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.925 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.926 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:___________________ ERROR at teardown of test_lifecycle_set ____________________ 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.927 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.928 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.929 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.930 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.931 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.932 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.933 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:___________________ ERROR at teardown of test_lifecycle_get ____________________ 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.934 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.935 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.936 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.938 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.939 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.940 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_lifecycle_get_no_id _________________ 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.942 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.944 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.945 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.946 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_lifecycle_id_too_long ________________ 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.948 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.949 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.950 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.951 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.952 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.953 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_lifecycle_same_id __________________ 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.954 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.955 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.956 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.957 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.958 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.959 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.960 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_lifecycle_invalid_status ______________ 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.962 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.963 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.964 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.965 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.966 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.967 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_lifecycle_set_date _________________ 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.968 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.969 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.970 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.971 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.972 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.973 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.974 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_lifecycle_set_invalid_date _____________ 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.976 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.977 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.979 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.980 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_lifecycle_set_noncurrent ______________ 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.981 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.982 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.983 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.987 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_lifecycle_set_deletemarker _____________ 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.988 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.989 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.990 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.991 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.992 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.993 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:56.994 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_lifecycle_set_filter ________________ 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:56.997 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:56.998 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:56.999 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.000 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.001 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_lifecycle_set_empty_filter _____________ 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.002 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.003 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.005 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.007 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_lifecycle_set_multipart _______________ 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.008 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.009 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.010 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.011 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.012 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.013 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.014 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_lifecycle_transition_set_invalid_date ________ 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.015 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.017 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.018 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.019 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.020 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.021 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1b ________________ 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.022 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.023 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.024 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.025 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.026 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.027 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.028 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1kb _______________ 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.029 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.030 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.031 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.032 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.033 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.034 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.035 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1MB _______________ 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.036 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.037 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.038 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.039 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.040 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.041 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.042 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_encrypted_transfer_13b _______________ 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.043 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.044 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.045 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.046 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.047 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.048 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_encryption_sse_c_method_head ____________ 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.049 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.050 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.051 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.052 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.053 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.054 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_encryption_sse_c_present ______________ 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.056 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.057 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.058 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.059 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.060 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.061 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.062 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_encryption_sse_c_other_key _____________ 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.063 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.064 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.065 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.066 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.067 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.068 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.069 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_encryption_sse_c_invalid_md5 ____________ 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.071 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.073 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.074 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.075 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.076 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_md5 _______________ 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.078 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.079 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.080 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.081 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.082 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_key _______________ 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.083 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.085 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.086 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.087 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.088 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_encryption_key_no_sse_c _______________ 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.090 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.091 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.093 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.094 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.095 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.096 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_encryption_sse_c_multipart_upload __________ 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.097 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.099 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.100 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.102 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.103 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_encryption_sse_c_unaligned_multipart_upload _____ 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.104 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.105 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.106 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.107 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.108 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.109 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.110 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_encryption_sse_c_multipart_bad_download _______ 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.111 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.112 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.113 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.114 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.115 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.116 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.117 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_encryption_sse_c_post_object_authenticated_request _ 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.118 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.119 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.120 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.121 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.123 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.124 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_method_head _________________ 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.125 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.126 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.127 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.128 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.129 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.130 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_sse_kms_present ___________________ 2024-08-09T00:39:57.131 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.132 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.133 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.134 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.135 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:___________________ ERROR at teardown of test_sse_kms_no_key ___________________ 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.138 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.140 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.141 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.142 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.144 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_not_declared ________________ 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.145 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.146 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.147 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.148 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.149 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.150 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.151 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_sse_kms_multipart_upload ______________ 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.152 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.153 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.154 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.155 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.156 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.157 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_1 _________ 2024-08-09T00:39:57.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.160 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.161 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.162 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.163 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.164 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_2 _________ 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.165 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.166 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.167 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.168 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.169 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.170 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.171 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_sse_kms_post_object_authenticated_request ______ 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.172 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.173 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.174 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.175 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.176 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.177 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.178 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1b _________________ 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.179 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.180 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.181 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.182 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.183 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.184 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.185 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1kb ________________ 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.186 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.187 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.188 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.189 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.190 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.191 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.192 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1MB ________________ 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.193 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.194 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.195 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.196 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.197 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.198 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.199 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_transfer_13b ________________ 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.200 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.201 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.202 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.203 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.204 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.205 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.206 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_sse_kms_read_declare ________________ 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.207 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.208 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.209 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.210 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.211 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.212 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.213 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:___________________ ERROR at teardown of test_bucket_policy ____________________ 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.215 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.216 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.217 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.218 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.219 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_bucketv2_policy ___________________ 2024-08-09T00:39:57.220 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.221 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.222 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.224 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.225 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.226 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_bucket_policy_acl __________________ 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.227 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.228 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.229 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.230 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.233 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_bucketv2_policy_acl _________________ 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.234 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.236 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.237 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.238 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.239 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.240 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_bucket_policy_another_bucket ____________ 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.241 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.242 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.243 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.244 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.245 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.247 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_bucketv2_policy_another_bucket ___________ 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.248 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.249 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.250 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.251 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.252 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.253 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.254 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_get_obj_tagging ___________________ 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.256 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.257 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.258 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.259 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.260 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.261 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_get_obj_head_tagging ________________ 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.262 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.263 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.264 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.265 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.266 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.267 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout:____________________ ERROR at teardown of test_put_max_tags ____________________ 2024-08-09T00:39:57.268 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.269 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.270 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.271 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.272 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.274 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.275 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_put_excess_tags ___________________ 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.276 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.277 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.278 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.279 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.281 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.282 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_put_max_kvsize_tags _________________ 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.283 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.284 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.285 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.286 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.287 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.288 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.289 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_put_excess_key_tags _________________ 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.290 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.291 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.292 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.293 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.294 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.295 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.296 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_put_excess_val_tags _________________ 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.297 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.298 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.299 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.302 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.303 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_put_modify_tags ___________________ 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.305 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.306 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.307 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.308 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.309 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.310 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_put_delete_tags ___________________ 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.311 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.312 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.314 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.315 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.316 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_post_object_tags_anonymous_request _________ 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.318 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.319 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.320 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.321 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.322 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.323 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.324 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_post_object_tags_authenticated_request _______ 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.325 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.327 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.328 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.329 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.330 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.331 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_put_obj_with_tags __________________ 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.332 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.333 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.334 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.335 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.336 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.337 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.338 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_get_tags_acl_public _________________ 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.339 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.340 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.341 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.342 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.343 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.345 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_put_tags_acl_public _________________ 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.346 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.347 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.348 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.351 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout:_______________ ERROR at teardown of test_delete_tags_obj_public _______________ 2024-08-09T00:39:57.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.354 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.355 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.357 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.358 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_versioning_bucket_atomic_upload_return_version_id __ 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.359 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.360 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.361 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.362 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.363 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.364 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_versioning_bucket_multipart_upload_return_version_id _ 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.367 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.368 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.369 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.370 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_policy_get_obj_existing_tag _________ 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.373 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.374 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.375 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.376 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.377 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.379 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_bucket_policy_get_obj_tagging_existing_tag _____ 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.381 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.382 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.383 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.384 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.385 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.386 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_bucket_policy_put_obj_tagging_existing_tag _____ 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.388 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.389 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.390 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.391 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.392 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout:_________ ERROR at teardown of test_bucket_policy_put_obj_copy_source __________ 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.393 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.394 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.395 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.396 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.397 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.398 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.399 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_bucket_policy_put_obj_copy_source_meta _______ 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.400 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.402 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.403 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.404 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.405 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.406 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_bucket_policy_put_obj_acl ______________ 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.407 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.408 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.409 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.410 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.411 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.412 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.413 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_grant _____________ 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.414 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.415 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.416 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.418 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.419 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.420 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_s3 ______________ 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.421 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.422 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.423 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.424 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.426 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.427 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_kms _____________ 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.428 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.429 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.430 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.431 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_put_obj_enc_conflict_s3_kms _____________ 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.434 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.435 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.436 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.437 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.438 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.439 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_put_obj_enc_conflict_bad_enc_kms __________ 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.441 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.442 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.443 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.444 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.445 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.446 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.447 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_bucket_policy_put_obj_kms_noenc ___________ 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.448 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.449 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.450 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.451 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.452 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.453 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.454 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_kms_s3 ____________ 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.455 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.456 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.458 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.459 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.460 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.461 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_bucket_policy_get_obj_acl_existing_tag _______ 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.462 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.463 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.465 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.466 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_lock_put_obj_lock ______________ 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.468 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.469 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.470 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.471 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.472 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.473 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.474 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_bucket _______ 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.475 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.476 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.477 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.478 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.479 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.480 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_lock_put_obj_lock_with_days_and_years ____ 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.483 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.484 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.485 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.486 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.487 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.488 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_days ________ 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.489 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_years _______ 2024-08-09T00:39:57.495 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.496 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.497 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.498 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.499 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.500 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.501 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_mode ________ 2024-08-09T00:39:57.502 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.503 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.504 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.505 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.506 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.507 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.508 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_status _______ 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.509 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.510 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.511 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.512 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.513 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.514 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.515 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_lock_suspend_versioning ___________ 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.516 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.518 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.519 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.520 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.521 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.522 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_object_lock_get_obj_lock ______________ 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.525 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.526 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.527 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.528 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_lock_get_obj_lock_invalid_bucket _______ 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.530 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.532 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.533 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.535 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.536 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_lock_put_obj_retention ____________ 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.537 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.538 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.539 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.540 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.541 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.542 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.543 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_bucket ____ 2024-08-09T00:39:57.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.546 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.547 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.548 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.549 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.550 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_mode _____ 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.552 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.553 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.554 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.555 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.556 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_object_lock_get_obj_retention ____________ 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.559 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.560 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.561 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.562 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.563 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.564 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout:_______ ERROR at teardown of test_object_lock_get_obj_retention_iso8601 ________ 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.566 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.567 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_lock_get_obj_retention_invalid_bucket ____ 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.572 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.573 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.574 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.575 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.577 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_lock_put_obj_retention_versionid _______ 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.579 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.581 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.582 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.583 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.584 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.585 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_override_default_retention _ 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.586 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.587 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.588 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.591 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.592 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_object_lock_put_obj_retention_increase_period ____ 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.594 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.595 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.596 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.597 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.598 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.599 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period ____ 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.600 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.601 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.602 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.606 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period_bypass _ 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.607 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.608 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.609 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.610 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.611 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.612 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.613 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_object_lock_delete_object_with_retention ______ 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.614 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.615 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.616 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.617 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.618 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.619 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_delete_multipart_object_with_retention _ 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.621 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.622 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.623 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.624 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.625 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.626 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_delete_object_with_retention_and_marker _ 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.627 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.628 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.629 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_object_lock_multi_delete_object_with_retention ___ 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.634 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.635 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.636 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.637 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.638 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.639 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.640 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_lock_put_legal_hold _____________ 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.641 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.642 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.643 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.644 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.645 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.646 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_bucket ______ 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.648 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.649 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.651 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.652 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.653 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.654 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_status ______ 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.655 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.656 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.657 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.658 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.659 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.660 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.661 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_lock_get_legal_hold _____________ 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.662 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.663 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.664 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.665 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.666 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.668 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_lock_get_legal_hold_invalid_bucket ______ 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.669 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.670 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.671 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.672 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.673 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.674 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.675 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_on ____ 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.677 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.678 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.679 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.680 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.681 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.682 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_delete_multipart_object_with_legal_hold_on _ 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.683 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.684 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.685 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.686 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.688 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.689 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_off ____ 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.690 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.691 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.692 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.693 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.694 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_object_lock_get_obj_metadata ____________ 2024-08-09T00:39:57.696 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.697 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.698 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.699 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.700 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.701 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.702 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_object_lock_uploading_obj ______________ 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.703 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.705 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.706 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.707 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.708 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.709 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_with_bypass _ 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.710 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.711 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.712 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.713 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.714 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.715 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.716 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:nuke_bucket test-te4uw1ntd2x64apj9utpbj9g-551 waiting 9.278428 seconds for object locks to expire 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_without_bypass _ 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.718 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.719 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.720 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.721 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.722 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.723 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_object_lock_changing_mode_from_compliance ______ 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.724 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.725 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.726 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.727 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.728 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.729 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.730 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:nuke_bucket test-te4uw1ntd2x64apj9utpbj9g-553 waiting 8.959481 seconds for object locks to expire 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_copy_object_ifmatch_good ______________ 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.732 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.733 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.734 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.735 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:___________ ERROR at teardown of test_copy_object_ifnonematch_failed ___________ 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.738 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.739 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.740 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.741 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.743 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout:______________ ERROR at teardown of test_get_bucket_policy_status ______________ 2024-08-09T00:39:57.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.746 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.747 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.748 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.749 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_get_public_acl_bucket_policy_status _________ 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.752 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.753 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.754 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.755 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.756 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.757 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_get_authpublic_acl_bucket_policy_status _______ 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.760 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.761 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.762 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.763 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.764 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:_____ ERROR at teardown of test_get_publicpolicy_acl_bucket_policy_status ______ 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.765 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.766 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.767 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.768 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.769 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.770 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.771 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:____ ERROR at teardown of test_get_nonpublicpolicy_acl_bucket_policy_status ____ 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.772 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.773 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.775 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.776 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.777 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout:___ ERROR at teardown of test_get_nonpublicpolicy_deny_bucket_policy_status ____ 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.778 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.779 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.780 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.781 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.782 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.783 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_get_undefined_public_block _____________ 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.785 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.787 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.788 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.789 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.790 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.791 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout:________ ERROR at teardown of test_get_public_block_deny_bucket_policy _________ 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.792 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.794 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.795 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.796 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.797 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.798 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:__________________ ERROR at teardown of test_put_public_block __________________ 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.799 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.800 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.801 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.804 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_block_public_put_bucket_acls ____________ 2024-08-09T00:39:57.805 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.806 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.808 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.809 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.810 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.811 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.812 INFO:teuthology.orchestra.run.smithi083.stdout:__________ ERROR at teardown of test_block_public_object_canned_acls ___________ 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.813 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.814 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.815 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.816 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.817 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.818 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout:________________ ERROR at teardown of test_block_public_policy _________________ 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.819 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.820 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.821 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.822 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.823 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.824 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.825 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_ignore_public_acls _________________ 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.827 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.828 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.829 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.830 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.831 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.832 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:______ ERROR at teardown of test_multipart_upload_on_a_bucket_with_policy ______ 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.833 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.835 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.836 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.837 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.838 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.839 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_put_bucket_encryption_kms ______________ 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.840 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.841 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.842 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.844 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.845 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout:_____________ ERROR at teardown of test_get_bucket_encryption_kms ______________ 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.846 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.847 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.848 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.849 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.850 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.851 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.852 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:____________ ERROR at teardown of test_delete_bucket_encryption_kms ____________ 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.853 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.854 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.855 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.856 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.857 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.858 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.859 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:_ ERROR at teardown of test_sse_kms_default_post_object_authenticated_request __ 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.860 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.862 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.863 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.864 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.865 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.866 INFO:teuthology.orchestra.run.smithi083.stdout:_________________ ERROR at teardown of test_get_object_torrent _________________ 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:configfile = 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.fixture(autouse=True) 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: def setup_teardown(configfile): 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: yield 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:> teardown() 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:332: 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:302: in teardown 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_prefixed_buckets(prefix=prefix) 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:159: in nuke_prefixed_buckets 2024-08-09T00:39:57.867 INFO:teuthology.orchestra.run.smithi083.stdout: raise err 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:150: in nuke_prefixed_buckets 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout: nuke_bucket(client, bucket_name) 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:103: in nuke_bucket 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout: for objects in list_versions(client, bucket, batch_size): 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/__init__.py:88: in list_versions 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout: listing = client.list_object_versions(**kwargs) 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:514: in _api_call 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout: return self._make_api_call(operation_name, kwargs) 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:self = 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:operation_name = 'ListObjectVersions' 2024-08-09T00:39:57.868 INFO:teuthology.orchestra.run.smithi083.stdout:api_params = {'Bucket': 'test-te4uw1ntd2x64apj9utpbj9g-156', 'EncodingType': 'url', 'MaxKeys': 128} 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: def _make_api_call(self, operation_name, api_params): 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model = self._service_model.operation_model(operation_name) 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: service_name = self._service_model.service_name 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: history_recorder.record( 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: 'API_CALL', 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: 'service': service_name, 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: 'operation': operation_name, 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: 'params': api_params, 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: if operation_model.deprecated: 2024-08-09T00:39:57.869 INFO:teuthology.orchestra.run.smithi083.stdout: logger.debug( 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: request_context = { 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_region': self.meta.region_name, 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'client_config': self.meta.config, 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 'auth_type': operation_model.auth_type, 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: request_dict = self._convert_to_request_dict( 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: api_params, operation_model, context=request_context 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2024-08-09T00:39:57.870 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: service_id = self._service_model.service_id.hyphenize() 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: handler, event_response = self.meta.events.emit_until_response( 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: 'before-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: params=request_dict, 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: request_signer=self._request_signer, 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: if event_response is not None: 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = event_response 2024-08-09T00:39:57.871 INFO:teuthology.orchestra.run.smithi083.stdout: else: 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: apply_request_checksum(request_dict) 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: http, parsed_response = self._make_request( 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: operation_model, request_dict, request_context 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: self.meta.events.emit( 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: 'after-call.{service_id}.{operation_name}'.format( 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: service_id=service_id, operation_name=operation_name 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: ), 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: http_response=http, 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: parsed=parsed_response, 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: model=operation_model, 2024-08-09T00:39:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: context=request_context, 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: ) 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: if http.status_code >= 300: 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: error_class = self.exceptions.from_code(error_code) 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:> raise error_class(parsed_response, operation_name) 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:E botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectVersions operation: None 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/botocore/client.py:938: NoSuchBucket 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:=============================== warnings summary =============================== 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: import imp 2024-08-09T00:39:57.873 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py:120 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: if boto_type is 'S3Connection': 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py:124 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: elif boto_type is 'HTTPRequest': 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py:359 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.874 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:176 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: if k is 'BucketName': 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:253 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.mark.timeout(10) 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:1077 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.mark.s3website_routing_rules 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2213 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2213: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.875 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2228 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2228: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2234 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2234: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2291 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2291: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.876 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2306 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2306: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2324 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2324: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2339 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2339: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2357 2024-08-09T00:39:57.877 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2357: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2372 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2372: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2422 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2422: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2454 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2454: DeprecationWarning: invalid escape sequence '\$' 2024-08-09T00:39:57.878 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:=========================== short test summary info ============================ 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_delete - botoco... 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_read_not_exist - botoc... 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_object_delete - botocor... 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete - botoc... 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit 2024-08-09T00:39:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes - boto... 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_check_etag - bot... 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_cache_control - ... 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_expires - botoco... 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_write_file - botocore.... 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type 2024-08-09T00:39:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header - ... 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature 2024-08-09T00:39:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy - ... 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket - bo... 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument 2024-08-09T00:39:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good - bot... 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed - b... 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good - bot... 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed - b... 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good 2024-08-09T00:39:57.883 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good - ... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get - botocore.err... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone - ... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone - ... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head - botocore.errorf... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist - botoco... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_head_extended - botoco... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl - b... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl - b... 2024-08-09T00:39:57.884 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime - botoco... 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated - bo... 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_anon_put - botocore.er... 2024-08-09T00:39:57.885 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_put_authenticated - bo... 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name - botoc... 2024-08-09T00:39:57.886 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_exists - botoco... 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_get_location - botocor... 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl - bot... 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_default - botocore... 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create 2024-08-09T00:39:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned - botocore.... 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_default - botocore... 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned - botocore.... 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl - botocore.errorfa... 2024-08-09T00:39:57.888 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_write - botocore.e... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp - botocor... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_read - botocore.er... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_acl_readacp - botocore... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants - bo... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants - bo... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email - boto... 2024-08-09T00:39:57.889 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all - botoc... 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite 2024-08-09T00:39:57.890 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list - bo... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime - botocore... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous - boto... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth - b... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth - botoc... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix - ... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size - botoc... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_16m - botocore.er... 2024-08-09T00:39:57.891 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket - bot... 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself - botoc... 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket - bot... 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl - boto... 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found - b... 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket 2024-08-09T00:39:57.892 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - boto... 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - boto... 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoco... 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.e... 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - bo... 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2024-08-09T00:39:57.893 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - b... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - boto... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - botoc... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocore... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part - b... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - boto... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.error... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.errorfact... 2024-08-09T00:39:57.894 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoco... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoco... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocore... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - b... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object - b... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocore... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.er... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.er... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.er... 2024-08-09T00:39:57.895 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.e... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.e... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.e... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - botoc... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - botoc... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - botoc... 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2024-08-09T00:39:57.896 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2024-08-09T00:39:57.897 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoco... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.erro... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.erro... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botocor... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - botoc... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore.... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - bo... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocore... 2024-08-09T00:39:57.898 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - bo... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoco... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bot... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - botoc... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - boto... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - boto... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - boto... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - bo... 2024-08-09T00:39:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bot... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bot... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bot... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botocor... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.er... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.err... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoco... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - bo... 2024-08-09T00:39:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botocor... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoco... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoco... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoco... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoco... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.erro... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.er... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore.... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botocor... 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2024-08-09T00:39:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.er... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoco... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.error... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.er... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botocor... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botocor... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botocor... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.er... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.er... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore.... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botocor... 2024-08-09T00:39:57.902 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botocor... 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - boto... 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - b... 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - b... 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2024-08-09T00:39:57.903 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - bo... 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - bo... 2024-08-09T00:39:57.904 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention 2024-08-09T00:39:57.905 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - b... 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2024-08-09T00:39:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - bo... 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - bo... 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block - ... 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.e... 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2024-08-09T00:39:57.907 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - botocor... 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocore... 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - b... 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - b... 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocore... 2024-08-09T00:39:57.908 INFO:teuthology.orchestra.run.smithi083.stdout:= 667 passed, 65 skipped, 127 deselected, 1 xfailed, 18 warnings, 398 errors in 1998.01s (0:33:18) = 2024-08-09T00:39:57.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-09T00:39:57.910 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-08-09T00:39:57.910 INFO:teuthology.orchestra.run.smithi083.stdout:___________________________________ summary ____________________________________ 2024-08-09T00:39:57.910 INFO:teuthology.orchestra.run.smithi083.stdout:ERROR: py: commands failed 2024-08-09T00:39:57.910 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi083 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-08-09T00:39:57.912 INFO:tasks.s3tests:Cleaning up boto... 2024-08-09T00:39:57.912 DEBUG:teuthology.orchestra.run.smithi083:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-08-09T00:39:57.919 INFO:tasks.s3tests:Removing s3-tests... 2024-08-09T00:39:57.920 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-08-09T00:39:58.110 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi083 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-08-09T00:39:58.348 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=eb118e183b994bbc870d1d72a3db68f5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi083 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-08-09T00:39:58.351 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-08-09T00:39:58.362 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-08-09T00:39:58.381 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-08-09T00:39:58.381 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-08-09T00:39:58.381 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-08-09T00:39:58.437 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-08-09T00:39:58.437 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-08-09T00:39:58.513 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:39:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:39:58.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 realm 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.551+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.555+0000 7fd445631980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:39:58.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.555+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.555+0000 7fd445631980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:39:58.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.555+0000 7fd445631980 20 searching for the correct realm 2024-08-09T00:39:58.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.559+0000 7fd443946640 0 -- 172.21.15.83:0/1760484951 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7fd42c0bfbb0 msgr2=0x7fd42c0b2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:39:58.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.567+0000 7fd442944640 0 -- 172.21.15.83:0/1760484951 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7fd43c03d900 msgr2=0x7fd43c0543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:39:58.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.783+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:39:58.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:39:58.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 zone default found 2024-08-09T00:39:58.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 4 Realm: () 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 zonegroup default 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:39:58.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 started sync module instance, tier type = 2024-08-09T00:39:58.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.787+0000 7fd445631980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=0 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=1 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=2 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=3 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=4 2024-08-09T00:39:58.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=5 2024-08-09T00:39:58.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.811+0000 7fd445631980 20 add_watcher() i=6 2024-08-09T00:39:58.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.815+0000 7fd445631980 20 add_watcher() i=7 2024-08-09T00:39:58.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.815+0000 7fd445631980 2 all 8 watchers are set, enabling cache 2024-08-09T00:39:58.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.819+0000 7fd2f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:39:58.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.819+0000 7fd445631980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:39:58.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.819+0000 7fd445631980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd2f8fe1640 20 reqs_thread_entry: start 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd445631980 20 init_complete bucket index max shards: 1 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd445631980 20 Filter name: none 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd2727fc640 20 reqs_thread_entry: start 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd445631980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-08-09T00:39:58.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.911+0000 7fd445631980 20 rados->read ofs=0 len=0 2024-08-09T00:39:58.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.915+0000 7fd445631980 20 rados_obj.operate() r=0 bl.length=482 2024-08-09T00:39:58.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.915+0000 7fd445631980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-08-09T00:39:58.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.915+0000 7fd445631980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-09T00:39:58.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.915+0000 7fd445631980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-09T00:39:58.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.915+0000 7fd445631980 10 removing key index: BMCJCERFABHVFMOAIFYI 2024-08-09T00:39:58.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.919+0000 7fd445631980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:BMCJCERFABHVFMOAIFYI, ofs0, ns] 2024-08-09T00:39:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.919+0000 7fd326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235693 cookie 94257423484256 notifier 7448 bl.length()=170 2024-08-09T00:39:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.919+0000 7fd445631980 10 removing email index: tester.client.0_test@test.test 2024-08-09T00:39:58.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.923+0000 7fd445631980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-08-09T00:39:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.923+0000 7fd326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235527 cookie 94257423486752 notifier 7448 bl.length()=181 2024-08-09T00:39:58.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.923+0000 7fd445631980 10 removing user buckets index 2024-08-09T00:39:58.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.927+0000 7fd445631980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-08-09T00:39:58.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.927+0000 7fd326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051236590 cookie 94257423501392 notifier 7448 bl.length()=172 2024-08-09T00:39:58.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.931+0000 7fd445631980 10 removing user index: tester.client.0 2024-08-09T00:39:58.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.931+0000 7fd445631980 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-08-09T00:39:58.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.931+0000 7fd445631980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-08-09T00:39:58.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.935+0000 7fd326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235801 cookie 94257423491584 notifier 7448 bl.length()=164 2024-08-09T00:39:58.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.939+0000 7fd2f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:39:58.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.943+0000 7fd445631980 20 remove_watcher() i=0 2024-08-09T00:39:58.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.943+0000 7fd445631980 2 removed watcher, disabling cache 2024-08-09T00:39:58.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.943+0000 7fd445631980 20 remove_watcher() i=1 2024-08-09T00:39:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.947+0000 7fd445631980 20 remove_watcher() i=2 2024-08-09T00:39:58.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.951+0000 7fd445631980 20 remove_watcher() i=3 2024-08-09T00:39:58.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.951+0000 7fd445631980 20 remove_watcher() i=4 2024-08-09T00:39:58.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.955+0000 7fd445631980 20 remove_watcher() i=5 2024-08-09T00:39:58.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.955+0000 7fd445631980 20 remove_watcher() i=6 2024-08-09T00:39:58.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:39:58.955+0000 7fd445631980 20 remove_watcher() i=7 2024-08-09T00:39:58.976 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-08-09T00:39:58.987 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-08-09T00:39:58.997 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-08-09T00:39:59.061 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-08-09T00:39:59.072 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-08-09T00:39:59.072 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:39:59.119 INFO:tasks.rgw.client.0.smithi083.stdout:2024-08-09T00:39:59.111+0000 e54f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37003) UID: 0 2024-08-09T00:39:59.124 INFO:tasks.rgw.client.0.smithi083.stdout:2024-08-09T00:39:59.115+0000 8eb7e80 -1 shutting down 2024-08-09T00:40:28.706 INFO:tasks.rgw.client.0.smithi083.stderr:==00:01:11:51.142 37007== could not unlink /tmp/vgdb-pipe-from-vgdb-to-37007-by-root-on-??? 2024-08-09T00:40:28.707 INFO:tasks.rgw.client.0.smithi083.stderr:==00:01:11:51.142 37007== could not unlink /tmp/vgdb-pipe-to-vgdb-from-37007-by-root-on-??? 2024-08-09T00:40:28.707 INFO:tasks.rgw.client.0.smithi083.stderr:==00:01:11:51.142 37007== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-37007-by-root-on-??? 2024-08-09T00:40:29.581 INFO:tasks.rgw.client.0:Stopped 2024-08-09T00:40:29.582 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-08-09T00:40:29.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/vault-root-token 2024-08-09T00:40:29.646 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-08-09T00:40:29.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-08-09T00:40:29.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-08-09T00:40:29.703 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-08-09T00:40:29.785 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-08-09T00:40:29.785 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-08-09T00:40:29.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 realm 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:29.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:29.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:29.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:40:29.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.823+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:29.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.827+0000 7ff4512f3980 20 rados_obj.operate() r=0 bl.length=1139 2024-08-09T00:40:29.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.827+0000 7ff4512f3980 20 searching for the correct realm 2024-08-09T00:40:29.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.831+0000 7ff44f608640 0 -- 172.21.15.83:0/1822185020 >> [v2:172.21.15.196:6800/4290006386,v1:172.21.15.196:6803/4290006386] conn(0x7ff44402f410 msgr2=0x7ff4440615a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:40:29.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:29.839+0000 7ff44e606640 0 -- 172.21.15.83:0/1822185020 >> [v2:172.21.15.83:6824/3132935563,v1:172.21.15.83:6825/3132935563] conn(0x7ff4480f08e0 msgr2=0x7ff4480b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got zone_info.24080a39-07c5-4cbe-824a-f1c4e0c023f7 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got zonegroup_info.a017e114-3560-4fe6-8446-8696d463b34c 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got default.zone. 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-08-09T00:40:30.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-09T00:40:30.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:30.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.055+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados_obj.operate() r=0 bl.length=46 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados_obj.operate() r=0 bl.length=470 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 zone default found 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 4 Realm: () 2024-08-09T00:40:30.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 4 ZoneGroup: default (a017e114-3560-4fe6-8446-8696d463b34c) 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 4 Zone: default (24080a39-07c5-4cbe-824a-f1c4e0c023f7) 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 zonegroup default 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:30.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:30.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados->read ofs=0 len=0 2024-08-09T00:40:30.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-08-09T00:40:30.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 started sync module instance, tier type = 2024-08-09T00:40:30.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.059+0000 7ff4512f3980 20 started zone id=24080a39-07c5-4cbe-824a-f1c4e0c023f7 (name=default) with tier type = 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=0 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=1 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=2 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=3 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=4 2024-08-09T00:40:30.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=5 2024-08-09T00:40:30.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.087+0000 7ff4512f3980 20 add_watcher() i=6 2024-08-09T00:40:30.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.091+0000 7ff4512f3980 20 add_watcher() i=7 2024-08-09T00:40:30.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.091+0000 7ff4512f3980 2 all 8 watchers are set, enabling cache 2024-08-09T00:40:30.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.095+0000 7ff3057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:40:30.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.095+0000 7ff4512f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-09T00:40:30.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.095+0000 7ff4512f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-09T00:40:30.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.187+0000 7ff27ffff640 20 reqs_thread_entry: start 2024-08-09T00:40:30.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.187+0000 7ff4512f3980 20 init_complete bucket index max shards: 1 2024-08-09T00:40:30.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.187+0000 7ff4512f3980 20 Filter name: none 2024-08-09T00:40:30.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.191+0000 7ff27dffb640 20 reqs_thread_entry: start 2024-08-09T00:40:30.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.191+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-09T00:40:30.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-08-09T00:40:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_1SG3E9Z3SUyhosZrQIFDE2ZL2edbblm', time=2024-08-09T02:07:12.827348+0000, chain.objs.size()=3 2024-08-09T00:40:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.Nk5DaXdmPwQfLYvoQH1jRpvyRuF22Pz_0 2024-08-09T00:40:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.Nk5DaXdmPwQfLYvoQH1jRpvyRuF22Pz_1 2024-08-09T00:40:30.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.Nk5DaXdmPwQfLYvoQH1jRpvyRuF22Pz_2 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_PrQFR5dQQk4SXbjAcuCRqSyOtGBqFjb', time=2024-08-09T02:07:27.357913+0000, chain.objs.size()=3 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.96Un589liR-D6MnneQ4j2p8rmrI7npN_0 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.96Un589liR-D6MnneQ4j2p8rmrI7npN_1 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.96Un589liR-D6MnneQ4j2p8rmrI7npN_2 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_l0qveP0PbNBcifBjW_eC0FUc55EwkPr', time=2024-08-09T02:07:27.412701+0000, chain.objs.size()=3 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.YBeFcgIR_f-WBAe-Ha04FYSHGB6de_F_0 2024-08-09T00:40:30.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.YBeFcgIR_f-WBAe-Ha04FYSHGB6de_F_1 2024-08-09T00:40:30.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.YBeFcgIR_f-WBAe-Ha04FYSHGB6de_F_2 2024-08-09T00:40:30.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu', time=2024-08-09T02:24:24.417069+0000, chain.objs.size()=1 2024-08-09T00:40:30.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.195+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.1 2024-08-09T00:40:30.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.199+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9613712465308372006', time=2024-08-09T02:25:52.217781+0000, chain.objs.size()=3 2024-08-09T00:40:30.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.199+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~DoqzvXBqVPgJ2CB8g8j7iJigzHZQ_tl.1 2024-08-09T00:40:30.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.199+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~DoqzvXBqVPgJ2CB8g8j7iJigzHZQ_tl.2 2024-08-09T00:40:30.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.199+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~DoqzvXBqVPgJ2CB8g8j7iJigzHZQ_tl.3 2024-08-09T00:40:30.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.203+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11592493806599476046', time=2024-08-09T02:26:18.789004+0000, chain.objs.size()=4 2024-08-09T00:40:30.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.203+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.517__multipart_mymultipart.2~SCxIi2xFDNqHsTZlT_3cSIVwZLvYHLH.1 2024-08-09T00:40:30.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.203+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.517__multipart_mymultipart.2~SCxIi2xFDNqHsTZlT_3cSIVwZLvYHLH.2 2024-08-09T00:40:30.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.203+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.517__multipart_mymultipart.2~SCxIi2xFDNqHsTZlT_3cSIVwZLvYHLH.3 2024-08-09T00:40:30.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.207+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.517__multipart_mymultipart.2~SCxIi2xFDNqHsTZlT_3cSIVwZLvYHLH.4 2024-08-09T00:40:30.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.207+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5996437234845729574', time=2024-08-09T02:26:23.751843+0000, chain.objs.size()=2 2024-08-09T00:40:30.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.207+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.518__multipart_mymultipart.2~IMxfZzk6QS7i_NNA3gnEUZqoV_bFU3p.1 2024-08-09T00:40:30.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.207+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.518__multipart_mymultipart.2~IMxfZzk6QS7i_NNA3gnEUZqoV_bFU3p.2 2024-08-09T00:40:30.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.215+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.223+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-09T00:40:30.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.223+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.223+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-09T00:40:30.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6556574377982007752', time=2024-08-09T02:25:52.621461+0000, chain.objs.size()=2 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~I3za5YCHWwOWgdS8LoCfVNZMYGLXer7.1 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~I3za5YCHWwOWgdS8LoCfVNZMYGLXer7.2 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15569853907161519166', time=2024-08-09T02:26:11.606536+0000, chain.objs.size()=2 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.514__shadow_.pZiR4F_Wdc7l-70FdDJ8WVnAatJFOW4_1 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.514__shadow_.pZiR4F_Wdc7l-70FdDJ8WVnAatJFOW4_2 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1108338306954006652', time=2024-08-09T02:27:59.643987+0000, chain.objs.size()=1 2024-08-09T00:40:30.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.551__multipart_mymultipart.-3xY5xuFeCdLF3YCqFDGFoni50m7n20g.1 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5254113366719810645', time=2024-08-09T02:32:12.730378+0000, chain.objs.size()=12 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.1 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.1_1 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.2 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.2_1 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.3 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.3_1 2024-08-09T00:40:30.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.227+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.4 2024-08-09T00:40:30.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.231+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.4_1 2024-08-09T00:40:30.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.235+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.5 2024-08-09T00:40:30.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.239+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.5_1 2024-08-09T00:40:30.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.239+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__multipart_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.6 2024-08-09T00:40:30.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.239+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.605__shadow_multipart_enc.2~WM-lHxa0GjgpNe_uv2g87Kz0D5lfNK8.6_1 2024-08-09T00:40:30.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.239+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3009075163154889999', time=2024-08-09T02:33:25.971719+0000, chain.objs.size()=1 2024-08-09T00:40:30.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.239+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.631__shadow_._xC2HA03H_5S-6PA7IpIMHD8v41lgwG_1 2024-08-09T00:40:30.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.247+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.255+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-09T00:40:30.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.255+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.255+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9367419147354450420', time=2024-08-09T02:07:16.465983+0000, chain.objs.size()=5 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-STANDARD.2~ZE0oTXUcRAgcu2kp-pCTgdVMYt_B9Fv.1 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-STANDARD.2~ZE0oTXUcRAgcu2kp-pCTgdVMYt_B9Fv.1_1 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-STANDARD.2~ZE0oTXUcRAgcu2kp-pCTgdVMYt_B9Fv.2 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-STANDARD.2~ZE0oTXUcRAgcu2kp-pCTgdVMYt_B9Fv.2_1 2024-08-09T00:40:30.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.259+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-STANDARD.2~ZE0oTXUcRAgcu2kp-pCTgdVMYt_B9Fv.3 2024-08-09T00:40:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.263+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.271+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-09T00:40:30.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.271+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.271+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_ejFLVh44fsdWHSySnd0I8bDshkzzuXz', time=2024-08-09T02:07:12.887360+0000, chain.objs.size()=3 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.ItsiUk5fuSSs88AH58jiGyAMKJ0Qk5s_0 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.ItsiUk5fuSSs88AH58jiGyAMKJ0Qk5s_1 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.ItsiUk5fuSSs88AH58jiGyAMKJ0Qk5s_2 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_XUqtkX1Qia5vGhXL-Q2mRb_ROgQkqui', time=2024-08-09T02:07:31.320520+0000, chain.objs.size()=1 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.153__shadow_.73hHLiyw4HF8j5ysS2V1qY8EtOHzhpJ_0 2024-08-09T00:40:30.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18076639479748708268', time=2024-08-09T02:24:17.542519+0000, chain.objs.size()=3 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.510__shadow:nq2WUnliDJ8eDIPyPZucV6QS3yiXwVK_.lunvDGkOumSl_OprMN90QOYSBhvUKsp_1 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.510__shadow:nq2WUnliDJ8eDIPyPZucV6QS3yiXwVK_.lunvDGkOumSl_OprMN90QOYSBhvUKsp_2 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.510__shadow:nq2WUnliDJ8eDIPyPZucV6QS3yiXwVK_.lunvDGkOumSl_OprMN90QOYSBhvUKsp_3 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC', time=2024-08-09T02:26:14.232339+0000, chain.objs.size()=10 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.1 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.2 2024-08-09T00:40:30.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.3 2024-08-09T00:40:30.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.4 2024-08-09T00:40:30.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.275+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.5 2024-08-09T00:40:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.279+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.6 2024-08-09T00:40:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.279+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.7 2024-08-09T00:40:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.279+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.8 2024-08-09T00:40:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.279+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.9 2024-08-09T00:40:30.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.283+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.516__multipart_mymultipart.2~dZeQ0KPZeYnMRIslsiFsJF_RIlwkjEC.10 2024-08-09T00:40:30.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.287+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.291+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-09T00:40:30.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.291+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6221366022134143971', time=2024-08-09T02:07:03.210650+0000, chain.objs.size()=5 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-FROZEN.2~GOga-BHoyTscdvTmZqqBtkoAVLxjtoc.1 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-FROZEN.2~GOga-BHoyTscdvTmZqqBtkoAVLxjtoc.1_1 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-FROZEN.2~GOga-BHoyTscdvTmZqqBtkoAVLxjtoc.2 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-FROZEN.2~GOga-BHoyTscdvTmZqqBtkoAVLxjtoc.2_1 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-FROZEN.2~GOga-BHoyTscdvTmZqqBtkoAVLxjtoc.3 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_S9XNQGtJKEfODBRi3EQMW_OBVZzFQmL', time=2024-08-09T02:07:08.941513+0000, chain.objs.size()=2 2024-08-09T00:40:30.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.06A8zBtRugxtO8p1oE3gGIrQ8Ai91ML_1 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.06A8zBtRugxtO8p1oE3gGIrQ8Ai91ML_2 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~OsD5YPY3T0-0q69VV55Lys98MIgj-3P', time=2024-08-09T02:08:39.410123+0000, chain.objs.size()=2 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.191__multipart_mymultipart.2~OsD5YPY3T0-0q69VV55Lys98MIgj-3P.1 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.191__shadow_mymultipart.2~OsD5YPY3T0-0q69VV55Lys98MIgj-3P.1_1 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14828610281156020074', time=2024-08-09T02:25:50.229497+0000, chain.objs.size()=3 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~CqOREgM-O_tFq5kxhTFzk9iPAXcl_gF.1 2024-08-09T00:40:30.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~CqOREgM-O_tFq5kxhTFzk9iPAXcl_gF.2 2024-08-09T00:40:30.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.295+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~CqOREgM-O_tFq5kxhTFzk9iPAXcl_gF.3 2024-08-09T00:40:30.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.299+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3128239598224076793', time=2024-08-09T02:31:23.599357+0000, chain.objs.size()=12 2024-08-09T00:40:30.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.299+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.1 2024-08-09T00:40:30.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.299+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.1_1 2024-08-09T00:40:30.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.2 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.2_1 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.3 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.3_1 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.4 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.4_1 2024-08-09T00:40:30.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.5 2024-08-09T00:40:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.5_1 2024-08-09T00:40:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__multipart_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.6 2024-08-09T00:40:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.603__shadow_multipart_enc.2~OccscGj7eAHVWAsDtvCfEmPz1m3ob_Y.6_1 2024-08-09T00:40:30.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.531469152409704091', time=2024-08-09T02:33:32.541852+0000, chain.objs.size()=1 2024-08-09T00:40:30.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.303+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.634__shadow_.V6jBZStG4N9rT2fCsDa3Rh36LT7apiX_1 2024-08-09T00:40:30.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.311+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13639605839886123151', time=2024-08-09T02:34:09.629743+0000, chain.objs.size()=6 2024-08-09T00:40:30.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.311+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.1 2024-08-09T00:40:30.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.315+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.2 2024-08-09T00:40:30.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.315+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.3 2024-08-09T00:40:30.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.315+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.4 2024-08-09T00:40:30.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.315+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.5 2024-08-09T00:40:30.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.315+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.646__multipart_bar.2~sgUPxVXeqsQepF6JiGqC4x1AwunzQTi.6 2024-08-09T00:40:30.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.323+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.327+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-09T00:40:30.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.327+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-08-09T00:40:30.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13602665754724121998', time=2024-08-09T02:07:11.317878+0000, chain.objs.size()=3 2024-08-09T00:40:30.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.6XjL4cuUBuCMz_AFIB8LNcCfbrfmWSp_0 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.6XjL4cuUBuCMz_AFIB8LNcCfbrfmWSp_1 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.6XjL4cuUBuCMz_AFIB8LNcCfbrfmWSp_2 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.777665+0000, chain.objs.size()=2 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.1 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.1_1 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.789365+0000, chain.objs.size()=2 2024-08-09T00:40:30.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.2 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.2_1 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.800648+0000, chain.objs.size()=2 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.3 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.3_1 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.812038+0000, chain.objs.size()=2 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.4 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.4_1 2024-08-09T00:40:30.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.823885+0000, chain.objs.size()=2 2024-08-09T00:40:30.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.331+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.5 2024-08-09T00:40:30.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.335+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.5_1 2024-08-09T00:40:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR', time=2024-08-09T02:25:31.834947+0000, chain.objs.size()=2 2024-08-09T00:40:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.6 2024-08-09T00:40:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.2~8Y8_KMBBBbym2RtPinCYF3AtNj0LViR.6_1 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.157218168868688264', time=2024-08-09T02:27:53.178459+0000, chain.objs.size()=1 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.548__shadow_.2O9MmkxbEpQQcsGrtToK_IBcOQz6NcK_1 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39', time=2024-08-09T02:33:03.372159+0000, chain.objs.size()=12 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.1 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.1_1 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.2 2024-08-09T00:40:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.2_1 2024-08-09T00:40:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.3 2024-08-09T00:40:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.3_1 2024-08-09T00:40:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.339+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.4 2024-08-09T00:40:30.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.347+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.4_1 2024-08-09T00:40:30.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.347+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.5 2024-08-09T00:40:30.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.347+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.5_1 2024-08-09T00:40:30.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.347+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__multipart_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.6 2024-08-09T00:40:30.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.347+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.613__shadow_multipart_enc.2~J5DX1dKJKwMPHkJ5TDRAi42Ddc54A39.6_1 2024-08-09T00:40:30.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.351+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.355+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-09T00:40:30.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.355+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_gV-hTjgVPgB48KgqDuTfiJHSy6QKLlc', time=2024-08-09T02:07:31.245945+0000, chain.objs.size()=1 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.153__shadow_.oaM_9SgfpSWzvlLQg4smltkeMPRYLX4_0 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17426568651206061004', time=2024-08-09T02:25:10.723189+0000, chain.objs.size()=6 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.1 2024-08-09T00:40:30.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.2 2024-08-09T00:40:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.vhyC08EQJwqOL6koL4IelFMWwea5zorW.3 2024-08-09T00:40:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.4 2024-08-09T00:40:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.5 2024-08-09T00:40:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.6 2024-08-09T00:40:30.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.7894599130628292017', time=2024-08-09T02:25:47.904989+0000, chain.objs.size()=2 2024-08-09T00:40:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~TvhwQQrS13vyIs2lNXyF-xlY_MJL7xX.1 2024-08-09T00:40:30.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.359+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~TvhwQQrS13vyIs2lNXyF-xlY_MJL7xX.2 2024-08-09T00:40:30.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.363+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-09T00:40:30.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:40:30.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5939814728205651079', time=2024-08-09T02:23:21.310144+0000, chain.objs.size()=6 2024-08-09T00:40:30.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3147158057153451232', time=2024-08-09T02:24:18.012010+0000, chain.objs.size()=3 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~-YSUHv1yP2LTXFqvfNWNFfnX2E9qhBt.1 2024-08-09T00:40:30.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~-YSUHv1yP2LTXFqvfNWNFfnX2E9qhBt.2 2024-08-09T00:40:30.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.367+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~-YSUHv1yP2LTXFqvfNWNFfnX2E9qhBt.3 2024-08-09T00:40:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.371+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.375+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-09T00:40:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9273837552320845369', time=2024-08-09T02:25:31.895967+0000, chain.objs.size()=6 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.1 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.1QkSCMxDlDIsBpJAIcwlT81Yb08AcrzU.2 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.wdcJJoeRhhCKu8LRLW1XxFKL2z6T38OZ.3 2024-08-09T00:40:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.4 2024-08-09T00:40:30.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.5 2024-08-09T00:40:30.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.379+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.6 2024-08-09T00:40:30.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.383+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.383+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-09T00:40:30.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-09T00:40:30.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16589517404212258015', time=2024-08-09T02:23:22.279644+0000, chain.objs.size()=6 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6641347323444436010', time=2024-08-09T02:23:41.798822+0000, chain.objs.size()=1 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.507__shadow_.OgD1nINdFOK2C9wKDcvGC8gYA0kjNEN_1 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr', time=2024-08-09T02:25:10.652759+0000, chain.objs.size()=1 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.2 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr', time=2024-08-09T02:25:10.661901+0000, chain.objs.size()=1 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~KK8C0OxQ08nlrdt4bgvJCDMBDzT2kVr.3 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~rKZXyZSkqj61supGgYo2m20zf8lj-io', time=2024-08-09T02:26:31.267068+0000, chain.objs.size()=2 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.521__multipart_mymultipart.2~rKZXyZSkqj61supGgYo2m20zf8lj-io.1 2024-08-09T00:40:30.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.387+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.521__multipart_mymultipart.2~rKZXyZSkqj61supGgYo2m20zf8lj-io.2 2024-08-09T00:40:30.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.391+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.399+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-09T00:40:30.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.399+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.399+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-09T00:40:30.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.610536214938197471', time=2024-08-09T02:07:03.291447+0000, chain.objs.size()=5 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-LUKEWARM.2~_gk0nmyF7_ukyeaaoQ9Kl4gKAE_RnNR.1 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-LUKEWARM.2~_gk0nmyF7_ukyeaaoQ9Kl4gKAE_RnNR.1_1 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-LUKEWARM.2~_gk0nmyF7_ukyeaaoQ9Kl4gKAE_RnNR.2 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-LUKEWARM.2~_gk0nmyF7_ukyeaaoQ9Kl4gKAE_RnNR.2_1 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-LUKEWARM.2~_gk0nmyF7_ukyeaaoQ9Kl4gKAE_RnNR.3 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4787339976171185198', time=2024-08-09T02:07:08.212815+0000, chain.objs.size()=3 2024-08-09T00:40:30.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.hlTXwdBqStHQD4RMZjtoiI8cqGEbjNa_0 2024-08-09T00:40:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.hlTXwdBqStHQD4RMZjtoiI8cqGEbjNa_1 2024-08-09T00:40:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.hlTXwdBqStHQD4RMZjtoiI8cqGEbjNa_2 2024-08-09T00:40:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_uoMll8whPyMSE2XvDEyDg7aRs0nY5mp', time=2024-08-09T02:07:26.698347+0000, chain.objs.size()=2 2024-08-09T00:40:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.u42qjijWLyIVGBIaUV-wRfXVOEjPXUH_1 2024-08-09T00:40:30.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.u42qjijWLyIVGBIaUV-wRfXVOEjPXUH_2 2024-08-09T00:40:30.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13566878684030391493', time=2024-08-09T02:24:37.167174+0000, chain.objs.size()=6 2024-08-09T00:40:30.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.OXswcZ2X0moVX6Mj3DG7kt6EmIsBpmj1.1 2024-08-09T00:40:30.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.403+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.2 2024-08-09T00:40:30.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.3 2024-08-09T00:40:30.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.4 2024-08-09T00:40:30.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.5 2024-08-09T00:40:30.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~9fJabtulsJNZhL55jRXyx0fWfqRLYcu.6 2024-08-09T00:40:30.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Jb4gVV7CzuDDMpZgf7hWSlRt1RFOLym', time=2024-08-09T02:26:25.832863+0000, chain.objs.size()=2 2024-08-09T00:40:30.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.519__multipart_mymultipart.2~Jb4gVV7CzuDDMpZgf7hWSlRt1RFOLym.1 2024-08-09T00:40:30.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.519__multipart_mymultipart.2~Jb4gVV7CzuDDMpZgf7hWSlRt1RFOLym.2 2024-08-09T00:40:30.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12987233526517859527', time=2024-08-09T02:32:45.749678+0000, chain.objs.size()=12 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.1 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.1_1 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.2 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.2_1 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.3 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.3_1 2024-08-09T00:40:30.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.407+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.4 2024-08-09T00:40:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.415+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.4_1 2024-08-09T00:40:30.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.415+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.5 2024-08-09T00:40:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.415+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.5_1 2024-08-09T00:40:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.415+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__multipart_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.6 2024-08-09T00:40:30.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.415+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.611__shadow_multipart_enc.2~U9A82_UkbhrnCHIv2--U-BvsOMieP3r.6_1 2024-08-09T00:40:30.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.419+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.423+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-09T00:40:30.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.423+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.423+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:40:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18199094059459629427', time=2024-08-09T02:23:24.356087+0000, chain.objs.size()=1 2024-08-09T00:40:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.501__multipart_mymultipart.2~UaSyiWw3sUq__uoltLvFcTvYVwQ0pQD.1 2024-08-09T00:40:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~FocLNa_7fMZp3F0TsEhIzRuiJhK6txW', time=2024-08-09T02:26:34.034352+0000, chain.objs.size()=1 2024-08-09T00:40:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.523__multipart_mymultipart.2~FocLNa_7fMZp3F0TsEhIzRuiJhK6txW.1 2024-08-09T00:40:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.427+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-09T00:40:30.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:40:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.308939387269997667', time=2024-08-09T02:23:40.535452+0000, chain.objs.size()=1 2024-08-09T00:40:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.508__multipart_mymultipart.2~xazSrP10wGUeum5kTE3eaJ-524tdObt.1 2024-08-09T00:40:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12178071857171379485', time=2024-08-09T02:26:06.395900+0000, chain.objs.size()=3 2024-08-09T00:40:30.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~F8ygvKBE6qhJXRfAmrw24c3Pq7TrB7w.1 2024-08-09T00:40:30.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~F8ygvKBE6qhJXRfAmrw24c3Pq7TrB7w.2 2024-08-09T00:40:30.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.431+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~F8ygvKBE6qhJXRfAmrw24c3Pq7TrB7w.3 2024-08-09T00:40:30.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.435+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-09T00:40:30.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:40:30.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.18074239516994801881', time=2024-08-09T02:23:41.783469+0000, chain.objs.size()=1 2024-08-09T00:40:30.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.507__shadow_.MVOvZXyZFqtba0bX_bIbPfpnmEqsb_R_1 2024-08-09T00:40:30.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~vUPUFwmgT_knun8a5Wtx1_xQLZ2CIFc', time=2024-08-09T02:27:58.990185+0000, chain.objs.size()=1 2024-08-09T00:40:30.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.443+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.551__multipart_mymultipart.2~vUPUFwmgT_knun8a5Wtx1_xQLZ2CIFc.1 2024-08-09T00:40:30.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.447+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.447+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-09T00:40:30.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.757966104659012608', time=2024-08-09T02:24:53.017050+0000, chain.objs.size()=6 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.1 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.3Xukt71TggBR8QF-RELzXNCJgXsh7tL7.2 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.3 2024-08-09T00:40:30.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.4 2024-08-09T00:40:30.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.5 2024-08-09T00:40:30.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.451+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.6 2024-08-09T00:40:30.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.455+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.459+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-09T00:40:30.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.459+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.459+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6787296079955232564', time=2024-08-09T02:23:30.886470+0000, chain.objs.size()=1 2024-08-09T00:40:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.506__multipart_mymultipartcopy.2~QiZMzD9oE6AnyoS6NnH6eq9nFdyZFot.1 2024-08-09T00:40:30.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5822242054832319163', time=2024-08-09T02:23:35.879129+0000, chain.objs.size()=1 2024-08-09T00:40:30.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.508__multipart_mymultipart.2~mPpHVY5W7BLjP-xgInKkg6c_lyt4Zc4.1 2024-08-09T00:40:30.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.913309271554564853', time=2024-08-09T02:29:58.453406+0000, chain.objs.size()=4 2024-08-09T00:40:30.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~j3ykvGr4-ytUDUuVD9_jIA8NDMyyKCj.1 2024-08-09T00:40:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~j3ykvGr4-ytUDUuVD9_jIA8NDMyyKCj.2 2024-08-09T00:40:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~j3ykvGr4-ytUDUuVD9_jIA8NDMyyKCj.3 2024-08-09T00:40:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~j3ykvGr4-ytUDUuVD9_jIA8NDMyyKCj.4 2024-08-09T00:40:30.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.463+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.467+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-09T00:40:30.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.467+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9635609148733666660', time=2024-08-09T02:25:40.767816+0000, chain.objs.size()=12 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.ZoQkg2oXOpxFB803YNMKIiS9dNkcpVRa.1 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.ZoQkg2oXOpxFB803YNMKIiS9dNkcpVRa.1_1 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.z1Ov4Kfk_Nwm5W1_778BIf74SmzG-Fe0.2 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.z1Ov4Kfk_Nwm5W1_778BIf74SmzG-Fe0.2_1 2024-08-09T00:40:30.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.d-8at3JtU9nbnoU0ruePIA9vurDTVvDc.3 2024-08-09T00:40:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.d-8at3JtU9nbnoU0ruePIA9vurDTVvDc.3_1 2024-08-09T00:40:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.-frgEbKDgPcJjEhBkazQAU4lZWSdgGLG.4 2024-08-09T00:40:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.-frgEbKDgPcJjEhBkazQAU4lZWSdgGLG.4_1 2024-08-09T00:40:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.wSzYLuzdAPXTCPAiNNahEoKow2bVDEnX.5 2024-08-09T00:40:30.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.wSzYLuzdAPXTCPAiNNahEoKow2bVDEnX.5_1 2024-08-09T00:40:30.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.MMmr6SaolvvHKvt5adZHwHJnC2b6-i0m.6 2024-08-09T00:40:30.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.471+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__shadow_mymultipart.MMmr6SaolvvHKvt5adZHwHJnC2b6-i0m.6_1 2024-08-09T00:40:30.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.6969876211995410162', time=2024-08-09T02:34:10.028226+0000, chain.objs.size()=6 2024-08-09T00:40:30.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.1 2024-08-09T00:40:30.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.2 2024-08-09T00:40:30.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.3 2024-08-09T00:40:30.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.4 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.5 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.647__multipart_baz.2~KribrCtQW7vyBcThCk-_m4Yhe-FceEf.6 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3268137651948150747', time=2024-08-09T02:34:10.420781+0000, chain.objs.size()=6 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.1 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.2 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.3 2024-08-09T00:40:30.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.4 2024-08-09T00:40:30.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.475+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.5 2024-08-09T00:40:30.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.479+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.648__multipart_foo.2~0zZOSIuhdNhhY8nkqqSixvUFLNHcn_Q.6 2024-08-09T00:40:30.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.483+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-09T00:40:30.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-09T00:40:30.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8274318485700658181', time=2024-08-09T02:07:20.896322+0000, chain.objs.size()=5 2024-08-09T00:40:30.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-LUKEWARM.2~L33KQK6Fi8nQ3hMzmBI-z43n2Ij0_rd.1 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-LUKEWARM.2~L33KQK6Fi8nQ3hMzmBI-z43n2Ij0_rd.1_1 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-LUKEWARM.2~L33KQK6Fi8nQ3hMzmBI-z43n2Ij0_rd.2 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-LUKEWARM.2~L33KQK6Fi8nQ3hMzmBI-z43n2Ij0_rd.2_1 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-LUKEWARM.2~L33KQK6Fi8nQ3hMzmBI-z43n2Ij0_rd.3 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz', time=2024-08-09T02:24:37.105481+0000, chain.objs.size()=1 2024-08-09T00:40:30.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~IwBmGKrXIjjLDX-x9dzbKgzhrTL9sxz.2 2024-08-09T00:40:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11233638646799541254', time=2024-08-09T02:26:00.283654+0000, chain.objs.size()=2 2024-08-09T00:40:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~dMUZtdrafk3I4PNJrCD3qc32GP0RYgm.1 2024-08-09T00:40:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~dMUZtdrafk3I4PNJrCD3qc32GP0RYgm.2 2024-08-09T00:40:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.15482673579331102600', time=2024-08-09T02:27:30.823940+0000, chain.objs.size()=1 2024-08-09T00:40:30.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.487+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.542__shadow_.jaWOaZa6BhBGFKEwfm8_VvwGS-pyVNf_1 2024-08-09T00:40:30.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.491+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.495+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-09T00:40:30.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.495+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_K1tufNq3jtT_pzxdg_1eJ1ih2UYF_cA', time=2024-08-09T02:07:12.955933+0000, chain.objs.size()=1 2024-08-09T00:40:30.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.Uwry_BpthDNExkcSIsH2qDChgm_hox2_0 2024-08-09T00:40:30.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.499+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-09T00:40:30.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_-kqZ-pbYLaitBHUI3OTpTSeHfY0n-fj', time=2024-08-09T02:07:27.482329+0000, chain.objs.size()=3 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.ndR4PnTH3mRTr0WZR5Mky6rOOWCI7YK_0 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.ndR4PnTH3mRTr0WZR5Mky6rOOWCI7YK_1 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.ndR4PnTH3mRTr0WZR5Mky6rOOWCI7YK_2 2024-08-09T00:40:30.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.4535919795092952052', time=2024-08-09T02:25:43.652583+0000, chain.objs.size()=2 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~aqNH1KEeRXpvFkEgKh2LFm9dZ1lRuwc.1 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__shadow_mymultipart.2~aqNH1KEeRXpvFkEgKh2LFm9dZ1lRuwc.1_1 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~RAfPzl6VQwYB0bT27fy4b1XWhKakPMV', time=2024-08-09T02:26:39.525578+0000, chain.objs.size()=1 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.525__multipart_mymultipart.2~RAfPzl6VQwYB0bT27fy4b1XWhKakPMV.3 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13880615086945104926', time=2024-08-09T02:35:04.323581+0000, chain.objs.size()=1 2024-08-09T00:40:30.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.503+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.697__multipart_file1.2~rO5n12R_ujXgdjMSqGjQ4TV9SrNLWl2.1 2024-08-09T00:40:30.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.507+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-09T00:40:30.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-09T00:40:30.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~4lbvXzcyM7LXw7d2Tk7UqcbQOd1ERXm', time=2024-08-09T02:08:41.786360+0000, chain.objs.size()=1 2024-08-09T00:40:30.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.192__multipart_mymultipart.2~4lbvXzcyM7LXw7d2Tk7UqcbQOd1ERXm.1 2024-08-09T00:40:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17834140064945318946', time=2024-08-09T02:26:22.934081+0000, chain.objs.size()=1 2024-08-09T00:40:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.518__shadow_.WQRYVeUR2SmuNs8STmLNNuW9Z7udL2m_1 2024-08-09T00:40:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~doVg4aH84a5IgTpkzTtn02u8JSNTZoA', time=2024-08-09T02:26:31.167508+0000, chain.objs.size()=1 2024-08-09T00:40:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.521__multipart_mymultipart.2~doVg4aH84a5IgTpkzTtn02u8JSNTZoA.1 2024-08-09T00:40:30.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5800657244307845499', time=2024-08-09T02:27:58.524638+0000, chain.objs.size()=1 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.551__multipart_mymultipart.2~haFmN-5s9eBFP6dBUF-xHWXtppvCs40.1 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8042212736865377657', time=2024-08-09T02:30:00.852154+0000, chain.objs.size()=4 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~R8AiLY1RWXe3q-Y_j2abYixYm0yycGq.1 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~R8AiLY1RWXe3q-Y_j2abYixYm0yycGq.2 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~R8AiLY1RWXe3q-Y_j2abYixYm0yycGq.3 2024-08-09T00:40:30.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~R8AiLY1RWXe3q-Y_j2abYixYm0yycGq.4 2024-08-09T00:40:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL', time=2024-08-09T02:32:54.656885+0000, chain.objs.size()=12 2024-08-09T00:40:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.1 2024-08-09T00:40:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.1_1 2024-08-09T00:40:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.2 2024-08-09T00:40:30.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.511+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.2_1 2024-08-09T00:40:30.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.515+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.3 2024-08-09T00:40:30.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.515+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.3_1 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.4 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.4_1 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.5 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.5_1 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__multipart_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.6 2024-08-09T00:40:30.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.519+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.612__shadow_multipart_enc.2~xJqVkDTKR17X6w7yHvFrRmAXtz6JOhL.6_1 2024-08-09T00:40:30.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.523+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.527+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-09T00:40:30.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.527+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-09T00:40:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.3428393853200375276', time=2024-08-09T02:23:42.174843+0000, chain.objs.size()=1 2024-08-09T00:40:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.508__multipart_mymultipart.2~1rydmEHVZV-sVDhmJtVk2zPtuvwRlJ9.1 2024-08-09T00:40:30.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13364557295442242518', time=2024-08-09T02:25:58.265725+0000, chain.objs.size()=1 2024-08-09T00:40:30.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~BuCQcG3Q3Cqek18qNIb9k1Ico6c0xhQ.1 2024-08-09T00:40:30.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.531+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-09T00:40:30.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy', time=2024-08-09T02:24:52.956131+0000, chain.objs.size()=1 2024-08-09T00:40:30.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.535+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.512__multipart_mymultipart.2~yNuax9kxt07AUuEi3hAAncRXKSJbQjy.3 2024-08-09T00:40:30.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.539+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-09T00:40:30.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9894205829646134925', time=2024-08-09T02:23:21.347251+0000, chain.objs.size()=6 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12789324403098198707', time=2024-08-09T02:24:12.175129+0000, chain.objs.size()=3 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~x5Rre0wQQk6Um-zTg3XQGIpaED1SiNS.1 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~x5Rre0wQQk6Um-zTg3XQGIpaED1SiNS.2 2024-08-09T00:40:30.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~x5Rre0wQQk6Um-zTg3XQGIpaED1SiNS.3 2024-08-09T00:40:30.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10435972407791146619', time=2024-08-09T02:26:12.031568+0000, chain.objs.size()=2 2024-08-09T00:40:30.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~ycZGrbbiWhL9_1HSKSHr2WckqxTD_4M.1 2024-08-09T00:40:30.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.543+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~ycZGrbbiWhL9_1HSKSHr2WckqxTD_4M.2 2024-08-09T00:40:30.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.547+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.551+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-09T00:40:30.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.551+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14954161026087757014', time=2024-08-09T02:07:25.627353+0000, chain.objs.size()=5 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-FROZEN.2~WbeKINv-HQHGWbEzFcvER4wWYExvKrz.1 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-FROZEN.2~WbeKINv-HQHGWbEzFcvER4wWYExvKrz.1_1 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-FROZEN.2~WbeKINv-HQHGWbEzFcvER4wWYExvKrz.2 2024-08-09T00:40:30.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_foo-FROZEN.2~WbeKINv-HQHGWbEzFcvER4wWYExvKrz.2_1 2024-08-09T00:40:30.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__multipart_foo-FROZEN.2~WbeKINv-HQHGWbEzFcvER4wWYExvKrz.3 2024-08-09T00:40:30.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.555+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.559+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-09T00:40:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.12226415214837026003', time=2024-08-09T02:06:56.343800+0000, chain.objs.size()=3 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.4nbb_6frSEPu8EWAu1zkEvkUovSfRBZ_0 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.4nbb_6frSEPu8EWAu1zkEvkUovSfRBZ_1 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.4nbb_6frSEPu8EWAu1zkEvkUovSfRBZ_2 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_vQiqXyrD0vEGpT2_F8DYlTqHFovNruh', time=2024-08-09T02:07:36.219498+0000, chain.objs.size()=3 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.bV-uJOuX3FWFEwLelkjreY8AZeNFbJw_0 2024-08-09T00:40:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.bV-uJOuX3FWFEwLelkjreY8AZeNFbJw_1 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.bV-uJOuX3FWFEwLelkjreY8AZeNFbJw_2 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13593913766952414416', time=2024-08-09T02:26:10.092111+0000, chain.objs.size()=3 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~lpQC_y1efFExlZSD3iJFgMyjalmuHZa.1 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~lpQC_y1efFExlZSD3iJFgMyjalmuHZa.2 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~lpQC_y1efFExlZSD3iJFgMyjalmuHZa.3 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2547773260160772192', time=2024-08-09T02:28:06.913625+0000, chain.objs.size()=1 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.553__shadow_.laqcBHaaY7S0vAR83MXzF53V2nDP623_1 2024-08-09T00:40:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.775280118754839945', time=2024-08-09T02:32:02.643561+0000, chain.objs.size()=12 2024-08-09T00:40:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.1 2024-08-09T00:40:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.563+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.1_1 2024-08-09T00:40:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.2 2024-08-09T00:40:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.2_1 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.3 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.3_1 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.4 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.4_1 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.5 2024-08-09T00:40:30.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.5_1 2024-08-09T00:40:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__multipart_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.6 2024-08-09T00:40:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.567+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.604__shadow_multipart_enc.2~J7wQ0bs7oCUk0daSXRJYmBlPwiI-MRH.6_1 2024-08-09T00:40:30.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.575+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.575+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-09T00:40:30.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16298391537495988644', time=2024-08-09T02:24:15.949168+0000, chain.objs.size()=3 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~RzfOpKCD8GbEtr7P1tHLuIlv0M6jrnu.1 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~RzfOpKCD8GbEtr7P1tHLuIlv0M6jrnu.2 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.511__multipart_mymultipart.2~RzfOpKCD8GbEtr7P1tHLuIlv0M6jrnu.3 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1128991643451942054', time=2024-08-09T02:26:56.355548+0000, chain.objs.size()=4 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.525__multipart_mymultipart.2~RAfPzl6VQwYB0bT27fy4b1XWhKakPMV.1 2024-08-09T00:40:30.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.525__multipart_mymultipart.2~RAfPzl6VQwYB0bT27fy4b1XWhKakPMV.2 2024-08-09T00:40:30.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.525__multipart_mymultipart.W__wOt03ZdlUxjEuYPeX8ntSjUYNOMkP.3 2024-08-09T00:40:30.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.525__multipart_mymultipart.2~RAfPzl6VQwYB0bT27fy4b1XWhKakPMV.4 2024-08-09T00:40:30.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.17450284224565138434', time=2024-08-09T02:27:00.143634+0000, chain.objs.size()=1 2024-08-09T00:40:30.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.579+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.526__multipart_mymultipart.2~uYkfhm57lMUxLV7kt-3rO85EqIC4mxf.1 2024-08-09T00:40:30.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.583+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-09T00:40:30.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-09T00:40:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_55XeMtdezECZ7cHz5D53X2sSsNh0LFW', time=2024-08-09T02:07:06.054479+0000, chain.objs.size()=1 2024-08-09T00:40:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.ayBIdPXM8XgayjJdzn_5X9l_tleKT9-_0 2024-08-09T00:40:30.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.587+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.591+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-09T00:40:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_ogLIhFmFzG4L4CiPLCYtYDhxP24ST-R', time=2024-08-09T02:07:21.945230+0000, chain.objs.size()=2 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.2aBrmw4P-uSS_DadFrxThNyOw0jeR27_1 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.2aBrmw4P-uSS_DadFrxThNyOw0jeR27_2 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.2076759937059994128', time=2024-08-09T02:23:21.356926+0000, chain.objs.size()=6 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16626020571817077700', time=2024-08-09T02:23:21.823214+0000, chain.objs.size()=6 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.595+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.671593449601519307', time=2024-08-09T02:23:38.407419+0000, chain.objs.size()=1 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.508__multipart_mymultipart.2~gCVVOUHbGSao_X9wBBxReG2U95_z5v6.1 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.9003833894466433507', time=2024-08-09T02:23:55.363134+0000, chain.objs.size()=6 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.1 2024-08-09T00:40:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.2 2024-08-09T00:40:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.3 2024-08-09T00:40:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.4 2024-08-09T00:40:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.5 2024-08-09T00:40:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.509__multipart_mymultipart.2~JVtJivLCxLAyvTRw_mTR2RnS8lhv44U.6 2024-08-09T00:40:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.5992896285773572986', time=2024-08-09T02:29:59.800361+0000, chain.objs.size()=7 2024-08-09T00:40:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.1 2024-08-09T00:40:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__shadow_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.1_1 2024-08-09T00:40:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.599+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.2 2024-08-09T00:40:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.603+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__shadow_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.2_1 2024-08-09T00:40:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.603+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.3 2024-08-09T00:40:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.603+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__shadow_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.3_1 2024-08-09T00:40:30.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.603+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.568__multipart_testobj.2~N6DuJtHSBUoDDMwq04eDWyq_aJsvRsG.4 2024-08-09T00:40:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.8870918603823260890', time=2024-08-09T02:34:52.962113+0000, chain.objs.size()=1 2024-08-09T00:40:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.688__multipart_file1.2~0aw1BR8GYH7FReSxanLCHdKa5-3mIcb.1 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10418867066314337292', time=2024-08-09T02:35:54.351410+0000, chain.objs.size()=10 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.1 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.2 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.3 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.4 2024-08-09T00:40:30.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.5 2024-08-09T00:40:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.6 2024-08-09T00:40:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.7 2024-08-09T00:40:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.8 2024-08-09T00:40:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.9 2024-08-09T00:40:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.607+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.719__multipart_foo.2~LhNUykIYKp6vaWYtwt8J01mL2NMt-0q.10 2024-08-09T00:40:30.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.615+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-09T00:40:30.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.1873109138316331473', time=2024-08-09T02:07:35.931647+0000, chain.objs.size()=3 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.154__multipart_foo.2~3DabOA9euaqglROaWXMKh7PDHm3J-rL.1 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.154__shadow_foo.2~3DabOA9euaqglROaWXMKh7PDHm3J-rL.1_1 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.154__multipart_foo.2~3DabOA9euaqglROaWXMKh7PDHm3J-rL.2 2024-08-09T00:40:30.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.16941305041235912013', time=2024-08-09T02:23:27.537272+0000, chain.objs.size()=1 2024-08-09T00:40:30.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.503__multipart_mymultipart.2~NoTVivpP6HOgW6rtF1hhcIFx0_0NfrA.1 2024-08-09T00:40:30.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.10672378232076249672', time=2024-08-09T02:26:03.123110+0000, chain.objs.size()=2 2024-08-09T00:40:30.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~GU_2vsS554_p91dqy5yJ4so2R92IVZT.1 2024-08-09T00:40:30.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.619+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.515__multipart_mymultipart.2~GU_2vsS554_p91dqy5yJ4so2R92IVZT.2 2024-08-09T00:40:30.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.623+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-09T00:40:30.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.11797854093013843845', time=2024-08-09T02:06:56.269504+0000, chain.objs.size()=3 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.jA9OO1CgLajR07dEVn-r3DUkgklPZaR_0 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.jA9OO1CgLajR07dEVn-r3DUkgklPZaR_1 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.148__shadow_.jA9OO1CgLajR07dEVn-r3DUkgklPZaR_2 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_rHohIePaCWvZpZPYsweyyys-jFvs_qe', time=2024-08-09T02:07:12.137667+0000, chain.objs.size()=2 2024-08-09T00:40:30.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.xCOhb4ZufY-RQRbo9GHX9qZuGaMMvU3_1 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.150__shadow_.xCOhb4ZufY-RQRbo9GHX9qZuGaMMvU3_2 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_jodCa1ub6fkKao2O2RzHd9gBqvEbAsq', time=2024-08-09T02:07:17.369673+0000, chain.objs.size()=3 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.Z7aT2gRDW1xu8DHvkQwOso_C03M5XWt_0 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.Z7aT2gRDW1xu8DHvkQwOso_C03M5XWt_1 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.151__shadow_.Z7aT2gRDW1xu8DHvkQwOso_C03M5XWt_2 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.13456583043577551857', time=2024-08-09T02:25:44.973491+0000, chain.objs.size()=2 2024-08-09T00:40:30.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~B6XShodAC_teqNNqBQD8NL4zivRHHPt.1 2024-08-09T00:40:30.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.627+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.513__multipart_mymultipart.2~B6XShodAC_teqNNqBQD8NL4zivRHHPt.2 2024-08-09T00:40:30.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.631+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.635+0000 7ff4512f3980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-09T00:40:30.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.635+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-09T00:40:30.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-09T00:40:30.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.14309291744292658484', time=2024-08-09T02:07:03.369348+0000, chain.objs.size()=5 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-STANDARD.2~_HAPAbzr9zH-rh0JkcEIcOYiJiM79yo.1 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-STANDARD.2~_HAPAbzr9zH-rh0JkcEIcOYiJiM79yo.1_1 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-STANDARD.2~_HAPAbzr9zH-rh0JkcEIcOYiJiM79yo.2 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__shadow_mymultipart-STANDARD.2~_HAPAbzr9zH-rh0JkcEIcOYiJiM79yo.2_1 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.149__multipart_mymultipart-STANDARD.2~_HAPAbzr9zH-rh0JkcEIcOYiJiM79yo.3 2024-08-09T00:40:30.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='_DSbjpbhJQMaByrx0hA5MW-MNetSX1m6', time=2024-08-09T02:07:36.286187+0000, chain.objs.size()=3 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.SyA4b6Ad6QoXoRwgTxe9JiK6Q164D7k_0 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.SyA4b6Ad6QoXoRwgTxe9JiK6Q164D7k_1 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.155__shadow_.SyA4b6Ad6QoXoRwgTxe9JiK6Q164D7k_2 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.29353915256298617', time=2024-08-09T02:23:22.302396+0000, chain.objs.size()=6 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.1 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.2 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.3 2024-08-09T00:40:30.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.4 2024-08-09T00:40:30.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.5 2024-08-09T00:40:30.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.639+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.497__multipart_srcmultipart.2~fm---dFUnZhSmCtN_SK7T-lKmjTLGFD.6 2024-08-09T00:40:30.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.643+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~MF0iQd0Fpo83OBk9S_BT-78Qa_-6u9I', time=2024-08-09T02:26:31.365737+0000, chain.objs.size()=2 2024-08-09T00:40:30.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.643+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.521__multipart_mymultipart2.2~MF0iQd0Fpo83OBk9S_BT-78Qa_-6u9I.1 2024-08-09T00:40:30.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.643+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.521__shadow_mymultipart2.2~MF0iQd0Fpo83OBk9S_BT-78Qa_-6u9I.1_1 2024-08-09T00:40:30.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.643+0000 7ff4512f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~cvDJTJNzgjEbgORjACgs-d4nuxMhhQZ', time=2024-08-09T02:26:35.058395+0000, chain.objs.size()=1 2024-08-09T00:40:30.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.643+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:24080a39-07c5-4cbe-824a-f1c4e0c023f7.4475.524__multipart_mymultipart.2~cvDJTJNzgjEbgORjACgs-d4nuxMhhQZ.1 2024-08-09T00:40:30.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.647+0000 7ff4512f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-09T00:40:30.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.651+0000 7ff3057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-09T00:40:30.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.651+0000 7ff4512f3980 20 remove_watcher() i=0 2024-08-09T00:40:30.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.651+0000 7ff4512f3980 2 removed watcher, disabling cache 2024-08-09T00:40:30.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.655+0000 7ff4512f3980 20 remove_watcher() i=1 2024-08-09T00:40:30.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.655+0000 7ff4512f3980 20 remove_watcher() i=2 2024-08-09T00:40:30.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.655+0000 7ff4512f3980 20 remove_watcher() i=3 2024-08-09T00:40:30.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.655+0000 7ff4512f3980 20 remove_watcher() i=4 2024-08-09T00:40:30.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.659+0000 7ff4512f3980 20 remove_watcher() i=5 2024-08-09T00:40:30.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.659+0000 7ff4512f3980 20 remove_watcher() i=6 2024-08-09T00:40:30.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-08-09T00:40:30.659+0000 7ff4512f3980 20 remove_watcher() i=7 2024-08-09T00:40:30.676 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-08-09T00:40:30.687 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-09T00:40:30.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-09T00:40:30.702 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:40:31.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:31.105 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:40:31.107 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2431,"stamp":"2024-08-09T00:40:29.302323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655923416,"num_objects":964,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":149375,"num_read_kb":2759222,"num_write":129679,"num_write_kb":2369685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13348,"ondisk_log_size":13348,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2375356,"kb_used_data":1080764,"kb_used_omap":12,"kb_used_meta":1294515,"kb_avail":752599364,"statfs":{"total":773094113280,"available":770661748736,"internally_reserved":0,"allocated":1106702336,"data_stored":1089438614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1325583920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007645"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059551+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:37:03.059551+0000","last_peered":"2024-08-09T00:37:03.059551+0000","last_clean":"2024-08-09T00:37:03.059551+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:37:03.059551+0000","last_undegraded":"2024-08-09T00:37:03.059551+0000","last_fullsized":"2024-08-09T00:37:03.059551+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:30:02.130065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048604+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:36:13.048604+0000","last_peered":"2024-08-09T00:36:13.048604+0000","last_clean":"2024-08-09T00:36:13.048604+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:36:13.048604+0000","last_undegraded":"2024-08-09T00:36:13.048604+0000","last_fullsized":"2024-08-09T00:36:13.048604+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:23.793811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644232+0000","last_change":"2024-08-08T23:48:38.082677+0000","last_active":"2024-08-09T00:36:07.644232+0000","last_peered":"2024-08-09T00:36:07.644232+0000","last_clean":"2024-08-09T00:36:07.644232+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:36:07.644232+0000","last_undegraded":"2024-08-09T00:36:07.644232+0000","last_fullsized":"2024-08-09T00:36:07.644232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:45.392917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.826049+0000","last_change":"2024-08-08T23:44:47.428900+0000","last_active":"2024-08-09T00:36:52.826049+0000","last_peered":"2024-08-09T00:36:52.826049+0000","last_clean":"2024-08-09T00:36:52.826049+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:36:52.826049+0000","last_undegraded":"2024-08-09T00:36:52.826049+0000","last_fullsized":"2024-08-09T00:36:52.826049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:21:21.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834206+0000","last_change":"2024-08-09T00:04:29.843428+0000","last_active":"2024-08-09T00:37:02.834206+0000","last_peered":"2024-08-09T00:37:02.834206+0000","last_clean":"2024-08-09T00:37:02.834206+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:37:02.834206+0000","last_undegraded":"2024-08-09T00:37:02.834206+0000","last_fullsized":"2024-08-09T00:37:02.834206+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.089851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818932+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:36:12.818932+0000","last_peered":"2024-08-09T00:36:12.818932+0000","last_clean":"2024-08-09T00:36:12.818932+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:36:12.818932+0000","last_undegraded":"2024-08-09T00:36:12.818932+0000","last_fullsized":"2024-08-09T00:36:12.818932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.411299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9218,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830256+0000","last_change":"2024-08-08T23:48:38.092226+0000","last_active":"2024-08-09T00:36:07.830256+0000","last_peered":"2024-08-09T00:36:07.830256+0000","last_clean":"2024-08-09T00:36:07.830256+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:36:07.830256+0000","last_undegraded":"2024-08-09T00:36:07.830256+0000","last_fullsized":"2024-08-09T00:36:07.830256+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:37.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":18,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":216,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833279+0000","last_change":"2024-08-08T23:44:47.413408+0000","last_active":"2024-08-09T00:36:57.833279+0000","last_peered":"2024-08-09T00:36:57.833279+0000","last_clean":"2024-08-09T00:36:57.833279+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:36:57.833279+0000","last_undegraded":"2024-08-09T00:36:57.833279+0000","last_fullsized":"2024-08-09T00:36:57.833279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:17.443794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815930+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:35:57.815930+0000","last_peered":"2024-08-09T00:35:57.815930+0000","last_clean":"2024-08-09T00:35:57.815930+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:35:57.815930+0000","last_undegraded":"2024-08-09T00:35:57.815930+0000","last_fullsized":"2024-08-09T00:35:57.815930+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:26:55.553956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822731+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:36:37.822731+0000","last_peered":"2024-08-09T00:36:37.822731+0000","last_clean":"2024-08-09T00:36:37.822731+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:36:37.822731+0000","last_undegraded":"2024-08-09T00:36:37.822731+0000","last_fullsized":"2024-08-09T00:36:37.822731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:03:58.706204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":4,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.831734+0000","last_change":"2024-08-08T23:48:38.096960+0000","last_active":"2024-08-09T00:36:47.831734+0000","last_peered":"2024-08-09T00:36:47.831734+0000","last_clean":"2024-08-09T00:36:47.831734+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:36:47.831734+0000","last_undegraded":"2024-08-09T00:36:47.831734+0000","last_fullsized":"2024-08-09T00:36:47.831734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:44:59.425002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831661+0000","last_change":"2024-08-08T23:44:47.415903+0000","last_active":"2024-08-09T00:37:17.831661+0000","last_peered":"2024-08-09T00:37:17.831661+0000","last_clean":"2024-08-09T00:37:17.831661+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:37:17.831661+0000","last_undegraded":"2024-08-09T00:37:17.831661+0000","last_fullsized":"2024-08-09T00:37:17.831661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:31.219458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644103+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:36:07.644103+0000","last_peered":"2024-08-09T00:36:07.644103+0000","last_clean":"2024-08-09T00:36:07.644103+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:36:07.644103+0000","last_undegraded":"2024-08-09T00:36:07.644103+0000","last_fullsized":"2024-08-09T00:36:07.644103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:47.348267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654897+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:36:52.654897+0000","last_peered":"2024-08-09T00:36:52.654897+0000","last_clean":"2024-08-09T00:36:52.654897+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:36:52.654897+0000","last_undegraded":"2024-08-09T00:36:52.654897+0000","last_fullsized":"2024-08-09T00:36:52.654897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:15.853173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823587+0000","last_change":"2024-08-08T23:48:38.064262+0000","last_active":"2024-08-09T00:36:32.823587+0000","last_peered":"2024-08-09T00:36:32.823587+0000","last_clean":"2024-08-09T00:36:32.823587+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:36:32.823587+0000","last_undegraded":"2024-08-09T00:36:32.823587+0000","last_fullsized":"2024-08-09T00:36:32.823587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:08.321374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660513+0000","last_change":"2024-08-08T23:44:47.404876+0000","last_active":"2024-08-09T00:37:17.660513+0000","last_peered":"2024-08-09T00:37:17.660513+0000","last_clean":"2024-08-09T00:37:17.660513+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:37:17.660513+0000","last_undegraded":"2024-08-09T00:37:17.660513+0000","last_fullsized":"2024-08-09T00:37:17.660513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:44.526394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652649+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:36:42.652649+0000","last_peered":"2024-08-09T00:36:42.652649+0000","last_clean":"2024-08-09T00:36:42.652649+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:36:42.652649+0000","last_undegraded":"2024-08-09T00:36:42.652649+0000","last_fullsized":"2024-08-09T00:36:42.652649+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:16:17.115238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061679+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:37:13.061679+0000","last_peered":"2024-08-09T00:37:13.061679+0000","last_clean":"2024-08-09T00:37:13.061679+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:37:13.061679+0000","last_undegraded":"2024-08-09T00:37:13.061679+0000","last_fullsized":"2024-08-09T00:37:13.061679+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:31.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096989,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":17458,"num_write":14,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'5","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.826910+0000","last_change":"2024-08-08T23:48:38.059017+0000","last_active":"2024-08-09T00:36:57.826910+0000","last_peered":"2024-08-09T00:36:57.826910+0000","last_clean":"2024-08-09T00:36:57.826910+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:36:57.826910+0000","last_undegraded":"2024-08-09T00:36:57.826910+0000","last_fullsized":"2024-08-09T00:36:57.826910+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:57.310351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660430+0000","last_change":"2024-08-08T23:44:47.424336+0000","last_active":"2024-08-09T00:37:17.660430+0000","last_peered":"2024-08-09T00:37:17.660430+0000","last_clean":"2024-08-09T00:37:17.660430+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:37:17.660430+0000","last_undegraded":"2024-08-09T00:37:17.660430+0000","last_fullsized":"2024-08-09T00:37:17.660430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:30:34.660972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.851421+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:37:52.851421+0000","last_peered":"2024-08-09T00:37:52.851421+0000","last_clean":"2024-08-09T00:37:52.851421+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:37:52.851421+0000","last_undegraded":"2024-08-09T00:37:52.851421+0000","last_fullsized":"2024-08-09T00:37:52.851421+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:40:37.743717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831092+0000","last_change":"2024-08-08T23:48:42.099507+0000","last_active":"2024-08-09T00:37:02.831092+0000","last_peered":"2024-08-09T00:37:02.831092+0000","last_clean":"2024-08-09T00:37:02.831092+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:37:02.831092+0000","last_undegraded":"2024-08-09T00:37:02.831092+0000","last_fullsized":"2024-08-09T00:37:02.831092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:58:00.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833107+0000","last_change":"2024-08-08T23:48:38.063345+0000","last_active":"2024-08-09T00:37:12.833107+0000","last_peered":"2024-08-09T00:37:12.833107+0000","last_clean":"2024-08-09T00:37:12.833107+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:37:12.833107+0000","last_undegraded":"2024-08-09T00:37:12.833107+0000","last_fullsized":"2024-08-09T00:37:12.833107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:22:39.743227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834919+0000","last_change":"2024-08-08T23:44:47.415691+0000","last_active":"2024-08-09T00:37:17.834919+0000","last_peered":"2024-08-09T00:37:17.834919+0000","last_clean":"2024-08-09T00:37:17.834919+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:37:17.834919+0000","last_undegraded":"2024-08-09T00:37:17.834919+0000","last_fullsized":"2024-08-09T00:37:17.834919+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:32.215875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857873+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:37:02.857873+0000","last_peered":"2024-08-09T00:37:02.857873+0000","last_clean":"2024-08-09T00:37:02.857873+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:37:02.857873+0000","last_undegraded":"2024-08-09T00:37:02.857873+0000","last_fullsized":"2024-08-09T00:37:02.857873+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:42.897370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819450+0000","last_change":"2024-08-08T23:48:42.104797+0000","last_active":"2024-08-09T00:36:12.819450+0000","last_peered":"2024-08-09T00:36:12.819450+0000","last_clean":"2024-08-09T00:36:12.819450+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:36:12.819450+0000","last_undegraded":"2024-08-09T00:36:12.819450+0000","last_fullsized":"2024-08-09T00:36:12.819450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:25:12.169302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817685+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:36:07.817685+0000","last_peered":"2024-08-09T00:36:07.817685+0000","last_clean":"2024-08-09T00:36:07.817685+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:36:07.817685+0000","last_undegraded":"2024-08-09T00:36:07.817685+0000","last_fullsized":"2024-08-09T00:36:07.817685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:13.656553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:42.809243+0000","last_change":"2024-08-08T23:44:47.418893+0000","last_active":"2024-08-09T00:35:42.809243+0000","last_peered":"2024-08-09T00:35:42.809243+0000","last_clean":"2024-08-09T00:35:42.809243+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:35:42.809243+0000","last_undegraded":"2024-08-09T00:35:42.809243+0000","last_fullsized":"2024-08-09T00:35:42.809243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:10.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857956+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:37:02.857956+0000","last_peered":"2024-08-09T00:37:02.857956+0000","last_clean":"2024-08-09T00:37:02.857956+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:37:02.857956+0000","last_undegraded":"2024-08-09T00:37:02.857956+0000","last_fullsized":"2024-08-09T00:37:02.857956+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:54.964878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645398+0000","last_change":"2024-08-08T23:48:42.093531+0000","last_active":"2024-08-09T00:36:12.645398+0000","last_peered":"2024-08-09T00:36:12.645398+0000","last_clean":"2024-08-09T00:36:12.645398+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:36:12.645398+0000","last_undegraded":"2024-08-09T00:36:12.645398+0000","last_fullsized":"2024-08-09T00:36:12.645398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:15:00.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'1","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815669+0000","last_change":"2024-08-08T23:48:38.070086+0000","last_active":"2024-08-09T00:36:07.815669+0000","last_peered":"2024-08-09T00:36:07.815669+0000","last_clean":"2024-08-09T00:36:07.815669+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:36:07.815669+0000","last_undegraded":"2024-08-09T00:36:07.815669+0000","last_fullsized":"2024-08-09T00:36:07.815669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:09.001506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.852322+0000","last_change":"2024-08-08T23:44:47.401774+0000","last_active":"2024-08-09T00:37:57.852322+0000","last_peered":"2024-08-09T00:37:57.852322+0000","last_clean":"2024-08-09T00:37:57.852322+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:37:57.852322+0000","last_undegraded":"2024-08-09T00:37:57.852322+0000","last_fullsized":"2024-08-09T00:37:57.852322+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:30.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843286+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:37:12.843286+0000","last_peered":"2024-08-09T00:37:12.843286+0000","last_clean":"2024-08-09T00:37:12.843286+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:37:12.843286+0000","last_undegraded":"2024-08-09T00:37:12.843286+0000","last_fullsized":"2024-08-09T00:37:12.843286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:35.805429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657057+0000","last_change":"2024-08-08T23:48:42.569594+0000","last_active":"2024-08-09T00:37:02.657057+0000","last_peered":"2024-08-09T00:37:02.657057+0000","last_clean":"2024-08-09T00:37:02.657057+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:37:02.657057+0000","last_undegraded":"2024-08-09T00:37:02.657057+0000","last_fullsized":"2024-08-09T00:37:02.657057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:05:00.915075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:48.069350+0000","last_change":"2024-08-08T23:48:38.078390+0000","last_active":"2024-08-09T00:37:48.069350+0000","last_peered":"2024-08-09T00:37:48.069350+0000","last_clean":"2024-08-09T00:37:48.069350+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:37:48.069350+0000","last_undegraded":"2024-08-09T00:37:48.069350+0000","last_fullsized":"2024-08-09T00:37:48.069350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:32.220322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.840117+0000","last_change":"2024-08-08T23:44:47.428042+0000","last_active":"2024-08-09T00:37:57.840117+0000","last_peered":"2024-08-09T00:37:57.840117+0000","last_clean":"2024-08-09T00:37:57.840117+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:37:57.840117+0000","last_undegraded":"2024-08-09T00:37:57.840117+0000","last_fullsized":"2024-08-09T00:37:57.840117+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:18.129270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836193+0000","last_change":"2024-08-09T00:04:29.838090+0000","last_active":"2024-08-09T00:37:12.836193+0000","last_peered":"2024-08-09T00:37:12.836193+0000","last_clean":"2024-08-09T00:37:12.836193+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:37:12.836193+0000","last_undegraded":"2024-08-09T00:37:12.836193+0000","last_fullsized":"2024-08-09T00:37:12.836193+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:20.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.668499+0000","last_change":"2024-08-08T23:48:42.571114+0000","last_active":"2024-08-09T00:37:52.668499+0000","last_peered":"2024-08-09T00:37:52.668499+0000","last_clean":"2024-08-09T00:37:52.668499+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:37:52.668499+0000","last_undegraded":"2024-08-09T00:37:52.668499+0000","last_fullsized":"2024-08-09T00:37:52.668499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:19:04.633722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856729+0000","last_change":"2024-08-08T23:48:38.081638+0000","last_active":"2024-08-09T00:36:57.856729+0000","last_peered":"2024-08-09T00:36:57.856729+0000","last_clean":"2024-08-09T00:36:57.856729+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:36:57.856729+0000","last_undegraded":"2024-08-09T00:36:57.856729+0000","last_fullsized":"2024-08-09T00:36:57.856729+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:56.987204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.669657+0000","last_change":"2024-08-08T23:44:47.418443+0000","last_active":"2024-08-09T00:37:57.669657+0000","last_peered":"2024-08-09T00:37:57.669657+0000","last_clean":"2024-08-09T00:37:57.669657+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:37:57.669657+0000","last_undegraded":"2024-08-09T00:37:57.669657+0000","last_fullsized":"2024-08-09T00:37:57.669657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:00.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.859886+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:37:12.859886+0000","last_peered":"2024-08-09T00:37:12.859886+0000","last_clean":"2024-08-09T00:37:12.859886+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:37:12.859886+0000","last_undegraded":"2024-08-09T00:37:12.859886+0000","last_fullsized":"2024-08-09T00:37:12.859886+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:54.135762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657135+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:37:02.657135+0000","last_peered":"2024-08-09T00:37:02.657135+0000","last_clean":"2024-08-09T00:37:02.657135+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:37:02.657135+0000","last_undegraded":"2024-08-09T00:37:02.657135+0000","last_fullsized":"2024-08-09T00:37:02.657135+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:37:02.420547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833259+0000","last_change":"2024-08-08T23:48:38.069892+0000","last_active":"2024-08-09T00:36:57.833259+0000","last_peered":"2024-08-09T00:36:57.833259+0000","last_clean":"2024-08-09T00:36:57.833259+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:36:57.833259+0000","last_undegraded":"2024-08-09T00:36:57.833259+0000","last_fullsized":"2024-08-09T00:36:57.833259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:56:09.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.845044+0000","last_change":"2024-08-08T23:44:47.403895+0000","last_active":"2024-08-09T00:37:57.845044+0000","last_peered":"2024-08-09T00:37:57.845044+0000","last_clean":"2024-08-09T00:37:57.845044+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:37:57.845044+0000","last_undegraded":"2024-08-09T00:37:57.845044+0000","last_fullsized":"2024-08-09T00:37:57.845044+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:20:56.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061641+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:37:13.061641+0000","last_peered":"2024-08-09T00:37:13.061641+0000","last_clean":"2024-08-09T00:37:13.061641+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:37:13.061641+0000","last_undegraded":"2024-08-09T00:37:13.061641+0000","last_fullsized":"2024-08-09T00:37:13.061641+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:35.438575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.830657+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:37:02.830657+0000","last_peered":"2024-08-09T00:37:02.830657+0000","last_clean":"2024-08-09T00:37:02.830657+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:37:02.830657+0000","last_undegraded":"2024-08-09T00:37:02.830657+0000","last_fullsized":"2024-08-09T00:37:02.830657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:31.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.827150+0000","last_change":"2024-08-08T23:48:38.073422+0000","last_active":"2024-08-09T00:36:57.827150+0000","last_peered":"2024-08-09T00:36:57.827150+0000","last_clean":"2024-08-09T00:36:57.827150+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:36:57.827150+0000","last_undegraded":"2024-08-09T00:36:57.827150+0000","last_fullsized":"2024-08-09T00:36:57.827150+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:06.420714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846240+0000","last_change":"2024-08-08T23:44:47.416042+0000","last_active":"2024-08-09T00:36:12.846240+0000","last_peered":"2024-08-09T00:36:12.846240+0000","last_clean":"2024-08-09T00:36:12.846240+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:36:12.846240+0000","last_undegraded":"2024-08-09T00:36:12.846240+0000","last_fullsized":"2024-08-09T00:36:12.846240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:18.630574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641678+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:35:57.641678+0000","last_peered":"2024-08-09T00:35:57.641678+0000","last_clean":"2024-08-09T00:35:57.641678+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:35:57.641678+0000","last_undegraded":"2024-08-09T00:35:57.641678+0000","last_fullsized":"2024-08-09T00:35:57.641678+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:48:51.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849230+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:37:42.849230+0000","last_peered":"2024-08-09T00:37:42.849230+0000","last_clean":"2024-08-09T00:37:42.849230+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:37:42.849230+0000","last_undegraded":"2024-08-09T00:37:42.849230+0000","last_fullsized":"2024-08-09T00:37:42.849230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:37.725025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840154+0000","last_change":"2024-08-08T23:48:38.068093+0000","last_active":"2024-08-09T00:37:37.840154+0000","last_peered":"2024-08-09T00:37:37.840154+0000","last_clean":"2024-08-09T00:37:37.840154+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:37:37.840154+0000","last_undegraded":"2024-08-09T00:37:37.840154+0000","last_fullsized":"2024-08-09T00:37:37.840154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:31:07.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844757+0000","last_change":"2024-08-08T23:44:47.417665+0000","last_active":"2024-08-09T00:36:07.844757+0000","last_peered":"2024-08-09T00:36:07.844757+0000","last_clean":"2024-08-09T00:36:07.844757+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:36:07.844757+0000","last_undegraded":"2024-08-09T00:36:07.844757+0000","last_fullsized":"2024-08-09T00:36:07.844757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:54.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813256+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:35:57.813256+0000","last_peered":"2024-08-09T00:35:57.813256+0000","last_clean":"2024-08-09T00:35:57.813256+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:35:57.813256+0000","last_undegraded":"2024-08-09T00:35:57.813256+0000","last_fullsized":"2024-08-09T00:35:57.813256+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:53.142711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849163+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:37:42.849163+0000","last_peered":"2024-08-09T00:37:42.849163+0000","last_clean":"2024-08-09T00:37:42.849163+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:37:42.849163+0000","last_undegraded":"2024-08-09T00:37:42.849163+0000","last_fullsized":"2024-08-09T00:37:42.849163+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.916828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'1","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.664886+0000","last_change":"2024-08-08T23:48:38.082209+0000","last_active":"2024-08-09T00:37:37.664886+0000","last_peered":"2024-08-09T00:37:37.664886+0000","last_clean":"2024-08-09T00:37:37.664886+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:37:37.664886+0000","last_undegraded":"2024-08-09T00:37:37.664886+0000","last_fullsized":"2024-08-09T00:37:37.664886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:19.106154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815548+0000","last_change":"2024-08-08T23:44:47.414517+0000","last_active":"2024-08-09T00:36:07.815548+0000","last_peered":"2024-08-09T00:36:07.815548+0000","last_clean":"2024-08-09T00:36:07.815548+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:36:07.815548+0000","last_undegraded":"2024-08-09T00:36:07.815548+0000","last_fullsized":"2024-08-09T00:36:07.815548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:24.856912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.832729+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:37:22.832729+0000","last_peered":"2024-08-09T00:37:22.832729+0000","last_clean":"2024-08-09T00:37:22.832729+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:37:22.832729+0000","last_undegraded":"2024-08-09T00:37:22.832729+0000","last_fullsized":"2024-08-09T00:37:22.832729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:11.805690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.841067+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:38:02.841067+0000","last_peered":"2024-08-09T00:38:02.841067+0000","last_clean":"2024-08-09T00:38:02.841067+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:38:02.841067+0000","last_undegraded":"2024-08-09T00:38:02.841067+0000","last_fullsized":"2024-08-09T00:38:02.841067+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:17.911780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840304+0000","last_change":"2024-08-08T23:48:38.094796+0000","last_active":"2024-08-09T00:37:37.840304+0000","last_peered":"2024-08-09T00:37:37.840304+0000","last_clean":"2024-08-09T00:37:37.840304+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:37:37.840304+0000","last_undegraded":"2024-08-09T00:37:37.840304+0000","last_fullsized":"2024-08-09T00:37:37.840304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:24.637100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817622+0000","last_change":"2024-08-08T23:44:47.394560+0000","last_active":"2024-08-09T00:36:07.817622+0000","last_peered":"2024-08-09T00:36:07.817622+0000","last_clean":"2024-08-09T00:36:07.817622+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:36:07.817622+0000","last_undegraded":"2024-08-09T00:36:07.817622+0000","last_fullsized":"2024-08-09T00:36:07.817622+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:27:00.732298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641490+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:35:57.641490+0000","last_peered":"2024-08-09T00:35:57.641490+0000","last_clean":"2024-08-09T00:35:57.641490+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:35:57.641490+0000","last_undegraded":"2024-08-09T00:35:57.641490+0000","last_fullsized":"2024-08-09T00:35:57.641490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:42.318744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.841717+0000","last_change":"2024-08-08T23:48:42.119272+0000","last_active":"2024-08-09T00:37:42.841717+0000","last_peered":"2024-08-09T00:37:42.841717+0000","last_clean":"2024-08-09T00:37:42.841717+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:37:42.841717+0000","last_undegraded":"2024-08-09T00:37:42.841717+0000","last_fullsized":"2024-08-09T00:37:42.841717+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:12.818880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:38.066987+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:37:38.066987+0000","last_peered":"2024-08-09T00:37:38.066987+0000","last_clean":"2024-08-09T00:37:38.066987+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:37:38.066987+0000","last_undegraded":"2024-08-09T00:37:38.066987+0000","last_fullsized":"2024-08-09T00:37:38.066987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:13.879567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.643947+0000","last_change":"2024-08-08T23:44:47.404724+0000","last_active":"2024-08-09T00:36:07.643947+0000","last_peered":"2024-08-09T00:36:07.643947+0000","last_clean":"2024-08-09T00:36:07.643947+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:36:07.643947+0000","last_undegraded":"2024-08-09T00:36:07.643947+0000","last_fullsized":"2024-08-09T00:36:07.643947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:52:50.706903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:07.835155+0000","last_change":"2024-08-09T00:04:29.835767+0000","last_active":"2024-08-09T00:37:07.835155+0000","last_peered":"2024-08-09T00:37:07.835155+0000","last_clean":"2024-08-09T00:37:07.835155+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:37:07.835155+0000","last_undegraded":"2024-08-09T00:37:07.835155+0000","last_fullsized":"2024-08-09T00:37:07.835155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.738421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672519+0000","last_change":"2024-08-08T23:48:42.111533+0000","last_active":"2024-08-09T00:38:12.672519+0000","last_peered":"2024-08-09T00:38:12.672519+0000","last_clean":"2024-08-09T00:38:12.672519+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:38:12.672519+0000","last_undegraded":"2024-08-09T00:38:12.672519+0000","last_fullsized":"2024-08-09T00:38:12.672519+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:24.814125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.872421+0000","last_change":"2024-08-08T23:48:38.087296+0000","last_active":"2024-08-09T00:38:07.872421+0000","last_peered":"2024-08-09T00:38:07.872421+0000","last_clean":"2024-08-09T00:38:07.872421+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:38:07.872421+0000","last_undegraded":"2024-08-09T00:38:07.872421+0000","last_fullsized":"2024-08-09T00:38:07.872421+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:01:04.545816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652733+0000","last_change":"2024-08-08T23:44:47.428169+0000","last_active":"2024-08-09T00:36:42.652733+0000","last_peered":"2024-08-09T00:36:42.652733+0000","last_clean":"2024-08-09T00:36:42.652733+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:36:42.652733+0000","last_undegraded":"2024-08-09T00:36:42.652733+0000","last_fullsized":"2024-08-09T00:36:42.652733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:49.375073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843416+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:36:02.843416+0000","last_peered":"2024-08-09T00:36:02.843416+0000","last_clean":"2024-08-09T00:36:02.843416+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:36:02.843416+0000","last_undegraded":"2024-08-09T00:36:02.843416+0000","last_fullsized":"2024-08-09T00:36:02.843416+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:32.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672470+0000","last_change":"2024-08-08T23:48:42.099382+0000","last_active":"2024-08-09T00:38:12.672470+0000","last_peered":"2024-08-09T00:38:12.672470+0000","last_clean":"2024-08-09T00:38:12.672470+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:38:12.672470+0000","last_undegraded":"2024-08-09T00:38:12.672470+0000","last_fullsized":"2024-08-09T00:38:12.672470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:20.657160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12631331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":21602,"num_write":16,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.847395+0000","last_change":"2024-08-08T23:48:38.060640+0000","last_active":"2024-08-09T00:38:07.847395+0000","last_peered":"2024-08-09T00:38:07.847395+0000","last_clean":"2024-08-09T00:38:07.847395+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:38:07.847395+0000","last_undegraded":"2024-08-09T00:38:07.847395+0000","last_fullsized":"2024-08-09T00:38:07.847395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:37.913237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:33.053185+0000","last_change":"2024-08-08T23:44:47.403129+0000","last_active":"2024-08-09T00:36:33.053185+0000","last_peered":"2024-08-09T00:36:33.053185+0000","last_clean":"2024-08-09T00:36:33.053185+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:36:33.053185+0000","last_undegraded":"2024-08-09T00:36:33.053185+0000","last_fullsized":"2024-08-09T00:36:33.053185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:39.986809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831148+0000","last_change":"2024-08-09T00:04:29.861378+0000","last_active":"2024-08-09T00:37:02.831148+0000","last_peered":"2024-08-09T00:37:02.831148+0000","last_clean":"2024-08-09T00:37:02.831148+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:37:02.831148+0000","last_undegraded":"2024-08-09T00:37:02.831148+0000","last_fullsized":"2024-08-09T00:37:02.831148+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:00.665233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830335+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:36:07.830335+0000","last_peered":"2024-08-09T00:36:07.830335+0000","last_clean":"2024-08-09T00:36:07.830335+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:36:07.830335+0000","last_undegraded":"2024-08-09T00:36:07.830335+0000","last_fullsized":"2024-08-09T00:36:07.830335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:27:45.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'1","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.842246+0000","last_change":"2024-08-08T23:48:38.085232+0000","last_active":"2024-08-09T00:38:07.842246+0000","last_peered":"2024-08-09T00:38:07.842246+0000","last_clean":"2024-08-09T00:38:07.842246+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:38:07.842246+0000","last_undegraded":"2024-08-09T00:38:07.842246+0000","last_fullsized":"2024-08-09T00:38:07.842246+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:15.159124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824087+0000","last_change":"2024-08-08T23:44:47.399086+0000","last_active":"2024-08-09T00:36:32.824087+0000","last_peered":"2024-08-09T00:36:32.824087+0000","last_clean":"2024-08-09T00:36:32.824087+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:36:32.824087+0000","last_undegraded":"2024-08-09T00:36:32.824087+0000","last_fullsized":"2024-08-09T00:36:32.824087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:59.479905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857757+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:37:02.857757+0000","last_peered":"2024-08-09T00:37:02.857757+0000","last_clean":"2024-08-09T00:37:02.857757+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:37:02.857757+0000","last_undegraded":"2024-08-09T00:37:02.857757+0000","last_fullsized":"2024-08-09T00:37:02.857757+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:37:09.466033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672556+0000","last_change":"2024-08-08T23:48:42.109080+0000","last_active":"2024-08-09T00:38:12.672556+0000","last_peered":"2024-08-09T00:38:12.672556+0000","last_clean":"2024-08-09T00:38:12.672556+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:38:12.672556+0000","last_undegraded":"2024-08-09T00:38:12.672556+0000","last_fullsized":"2024-08-09T00:38:12.672556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:13.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.829079+0000","last_change":"2024-08-08T23:48:38.092262+0000","last_active":"2024-08-09T00:36:02.829079+0000","last_peered":"2024-08-09T00:36:02.829079+0000","last_clean":"2024-08-09T00:36:02.829079+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:36:02.829079+0000","last_undegraded":"2024-08-09T00:36:02.829079+0000","last_fullsized":"2024-08-09T00:36:02.829079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:52:00.439329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.828951+0000","last_change":"2024-08-08T23:44:47.399289+0000","last_active":"2024-08-09T00:36:32.828951+0000","last_peered":"2024-08-09T00:36:32.828951+0000","last_clean":"2024-08-09T00:36:32.828951+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:36:32.828951+0000","last_undegraded":"2024-08-09T00:36:32.828951+0000","last_fullsized":"2024-08-09T00:36:32.828951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:04.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.643044+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:36:02.643044+0000","last_peered":"2024-08-09T00:36:02.643044+0000","last_clean":"2024-08-09T00:36:02.643044+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:36:02.643044+0000","last_undegraded":"2024-08-09T00:36:02.643044+0000","last_fullsized":"2024-08-09T00:36:02.643044+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:08.530056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821001+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:36:22.821001+0000","last_peered":"2024-08-09T00:36:22.821001+0000","last_clean":"2024-08-09T00:36:22.821001+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:36:22.821001+0000","last_undegraded":"2024-08-09T00:36:22.821001+0000","last_fullsized":"2024-08-09T00:36:22.821001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:18:01.697005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818021+0000","last_change":"2024-08-08T23:48:38.084236+0000","last_active":"2024-08-09T00:36:17.818021+0000","last_peered":"2024-08-09T00:36:17.818021+0000","last_clean":"2024-08-09T00:36:17.818021+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:36:17.818021+0000","last_undegraded":"2024-08-09T00:36:17.818021+0000","last_fullsized":"2024-08-09T00:36:17.818021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:54.693443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":9,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.821527+0000","last_change":"2024-08-08T23:44:47.408356+0000","last_active":"2024-08-09T00:36:32.821527+0000","last_peered":"2024-08-09T00:36:32.821527+0000","last_clean":"2024-08-09T00:36:32.821527+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:36:32.821527+0000","last_undegraded":"2024-08-09T00:36:32.821527+0000","last_fullsized":"2024-08-09T00:36:32.821527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:09.358087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845039+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:36:07.845039+0000","last_peered":"2024-08-09T00:36:07.845039+0000","last_clean":"2024-08-09T00:36:07.845039+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:36:07.845039+0000","last_undegraded":"2024-08-09T00:36:07.845039+0000","last_fullsized":"2024-08-09T00:36:07.845039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:02:05.119656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848531+0000","last_change":"2024-08-08T23:48:42.570789+0000","last_active":"2024-08-09T00:36:22.848531+0000","last_peered":"2024-08-09T00:36:22.848531+0000","last_clean":"2024-08-09T00:36:22.848531+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:36:22.848531+0000","last_undegraded":"2024-08-09T00:36:22.848531+0000","last_fullsized":"2024-08-09T00:36:22.848531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:34.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'7","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.832336+0000","last_change":"2024-08-08T23:48:38.092188+0000","last_active":"2024-08-09T00:36:17.832336+0000","last_peered":"2024-08-09T00:36:17.832336+0000","last_clean":"2024-08-09T00:36:17.832336+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:36:17.832336+0000","last_undegraded":"2024-08-09T00:36:17.832336+0000","last_fullsized":"2024-08-09T00:36:17.832336+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:33.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855435+0000","last_change":"2024-08-08T23:44:47.396027+0000","last_active":"2024-08-09T00:36:52.855435+0000","last_peered":"2024-08-09T00:36:52.855435+0000","last_clean":"2024-08-09T00:36:52.855435+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:36:52.855435+0000","last_undegraded":"2024-08-09T00:36:52.855435+0000","last_fullsized":"2024-08-09T00:36:52.855435+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:49:52.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843458+0000","last_change":"2024-08-09T00:04:29.877623+0000","last_active":"2024-08-09T00:36:02.843458+0000","last_peered":"2024-08-09T00:36:02.843458+0000","last_clean":"2024-08-09T00:36:02.843458+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:36:02.843458+0000","last_undegraded":"2024-08-09T00:36:02.843458+0000","last_fullsized":"2024-08-09T00:36:02.843458+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:58.415040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855444+0000","last_change":"2024-08-08T23:48:42.117970+0000","last_active":"2024-08-09T00:38:12.855444+0000","last_peered":"2024-08-09T00:38:12.855444+0000","last_clean":"2024-08-09T00:38:12.855444+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:38:12.855444+0000","last_undegraded":"2024-08-09T00:38:12.855444+0000","last_fullsized":"2024-08-09T00:38:12.855444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:08.226037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.820427+0000","last_change":"2024-08-08T23:48:38.070526+0000","last_active":"2024-08-09T00:36:27.820427+0000","last_peered":"2024-08-09T00:36:27.820427+0000","last_clean":"2024-08-09T00:36:27.820427+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:36:27.820427+0000","last_undegraded":"2024-08-09T00:36:27.820427+0000","last_fullsized":"2024-08-09T00:36:27.820427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:04.766563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.653651+0000","last_change":"2024-08-08T23:44:47.397051+0000","last_active":"2024-08-09T00:36:47.653651+0000","last_peered":"2024-08-09T00:36:47.653651+0000","last_clean":"2024-08-09T00:36:47.653651+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:36:47.653651+0000","last_undegraded":"2024-08-09T00:36:47.653651+0000","last_fullsized":"2024-08-09T00:36:47.653651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:05:19.891906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814357+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:36:02.814357+0000","last_peered":"2024-08-09T00:36:02.814357+0000","last_clean":"2024-08-09T00:36:02.814357+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:36:02.814357+0000","last_undegraded":"2024-08-09T00:36:02.814357+0000","last_fullsized":"2024-08-09T00:36:02.814357+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:18:12.990248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849765+0000","last_change":"2024-08-08T23:48:42.107127+0000","last_active":"2024-08-09T00:36:27.849765+0000","last_peered":"2024-08-09T00:36:27.849765+0000","last_clean":"2024-08-09T00:36:27.849765+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:36:27.849765+0000","last_undegraded":"2024-08-09T00:36:27.849765+0000","last_fullsized":"2024-08-09T00:36:27.849765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:54:09.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.848661+0000","last_change":"2024-08-08T23:48:38.063944+0000","last_active":"2024-08-09T00:38:07.848661+0000","last_peered":"2024-08-09T00:38:07.848661+0000","last_clean":"2024-08-09T00:38:07.848661+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:38:07.848661+0000","last_undegraded":"2024-08-09T00:38:07.848661+0000","last_fullsized":"2024-08-09T00:38:07.848661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:06:32.473872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827506+0000","last_change":"2024-08-08T23:44:47.398875+0000","last_active":"2024-08-09T00:36:47.827506+0000","last_peered":"2024-08-09T00:36:47.827506+0000","last_clean":"2024-08-09T00:36:47.827506+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:36:47.827506+0000","last_undegraded":"2024-08-09T00:36:47.827506+0000","last_fullsized":"2024-08-09T00:36:47.827506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:26.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868969+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:37:52.868969+0000","last_peered":"2024-08-09T00:37:52.868969+0000","last_clean":"2024-08-09T00:37:52.868969+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:37:52.868969+0000","last_undegraded":"2024-08-09T00:37:52.868969+0000","last_fullsized":"2024-08-09T00:37:52.868969+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:57:10.837360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'5","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824916+0000","last_change":"2024-08-08T23:48:42.101066+0000","last_active":"2024-08-09T00:36:47.824916+0000","last_peered":"2024-08-09T00:36:47.824916+0000","last_clean":"2024-08-09T00:36:47.824916+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:36:47.824916+0000","last_undegraded":"2024-08-09T00:36:47.824916+0000","last_fullsized":"2024-08-09T00:36:47.824916+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:06.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850986+0000","last_change":"2024-08-08T23:48:38.078556+0000","last_active":"2024-08-09T00:36:32.850986+0000","last_peered":"2024-08-09T00:36:32.850986+0000","last_clean":"2024-08-09T00:36:32.850986+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:36:32.850986+0000","last_undegraded":"2024-08-09T00:36:32.850986+0000","last_fullsized":"2024-08-09T00:36:32.850986+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:01.058350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.825020+0000","last_change":"2024-08-08T23:44:47.428182+0000","last_active":"2024-08-09T00:36:47.825020+0000","last_peered":"2024-08-09T00:36:47.825020+0000","last_clean":"2024-08-09T00:36:47.825020+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:36:47.825020+0000","last_undegraded":"2024-08-09T00:36:47.825020+0000","last_fullsized":"2024-08-09T00:36:47.825020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:23.238421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070601+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:37:53.070601+0000","last_peered":"2024-08-09T00:37:53.070601+0000","last_clean":"2024-08-09T00:37:53.070601+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:37:53.070601+0000","last_undegraded":"2024-08-09T00:37:53.070601+0000","last_fullsized":"2024-08-09T00:37:53.070601+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:59:54.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822637+0000","last_change":"2024-08-08T23:48:42.574733+0000","last_active":"2024-08-09T00:36:37.822637+0000","last_peered":"2024-08-09T00:36:37.822637+0000","last_clean":"2024-08-09T00:36:37.822637+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:36:37.822637+0000","last_undegraded":"2024-08-09T00:36:37.822637+0000","last_fullsized":"2024-08-09T00:36:37.822637+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:12.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830892+0000","last_change":"2024-08-08T23:48:38.060729+0000","last_active":"2024-08-09T00:36:42.830892+0000","last_peered":"2024-08-09T00:36:42.830892+0000","last_clean":"2024-08-09T00:36:42.830892+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:36:42.830892+0000","last_undegraded":"2024-08-09T00:36:42.830892+0000","last_fullsized":"2024-08-09T00:36:42.830892+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:21.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'85","reported_seq":328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827642+0000","last_change":"2024-08-08T23:44:47.407071+0000","last_active":"2024-08-09T00:36:47.827642+0000","last_peered":"2024-08-09T00:36:47.827642+0000","last_clean":"2024-08-09T00:36:47.827642+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:36:47.827642+0000","last_undegraded":"2024-08-09T00:36:47.827642+0000","last_fullsized":"2024-08-09T00:36:47.827642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:20.171645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836281+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:36:37.836281+0000","last_peered":"2024-08-09T00:36:37.836281+0000","last_clean":"2024-08-09T00:36:37.836281+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:36:37.836281+0000","last_undegraded":"2024-08-09T00:36:37.836281+0000","last_fullsized":"2024-08-09T00:36:37.836281+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:00.019365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848808+0000","last_change":"2024-08-08T23:48:42.574649+0000","last_active":"2024-08-09T00:36:22.848808+0000","last_peered":"2024-08-09T00:36:22.848808+0000","last_clean":"2024-08-09T00:36:22.848808+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:36:22.848808+0000","last_undegraded":"2024-08-09T00:36:22.848808+0000","last_fullsized":"2024-08-09T00:36:22.848808+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:27.719355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'6","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:18.049822+0000","last_change":"2024-08-08T23:48:38.074200+0000","last_active":"2024-08-09T00:36:18.049822+0000","last_peered":"2024-08-09T00:36:18.049822+0000","last_clean":"2024-08-09T00:36:18.049822+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:36:18.049822+0000","last_undegraded":"2024-08-09T00:36:18.049822+0000","last_fullsized":"2024-08-09T00:36:18.049822+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:00.327462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14338,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856642+0000","last_change":"2024-08-08T23:44:47.409012+0000","last_active":"2024-08-09T00:36:57.856642+0000","last_peered":"2024-08-09T00:36:57.856642+0000","last_clean":"2024-08-09T00:36:57.856642+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:36:57.856642+0000","last_undegraded":"2024-08-09T00:36:57.856642+0000","last_fullsized":"2024-08-09T00:36:57.856642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:41:17.851838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844591+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:37:52.844591+0000","last_peered":"2024-08-09T00:37:52.844591+0000","last_clean":"2024-08-09T00:37:52.844591+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:37:52.844591+0000","last_undegraded":"2024-08-09T00:37:52.844591+0000","last_fullsized":"2024-08-09T00:37:52.844591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:53.664350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821249+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:36:22.821249+0000","last_peered":"2024-08-09T00:36:22.821249+0000","last_clean":"2024-08-09T00:36:22.821249+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:36:22.821249+0000","last_undegraded":"2024-08-09T00:36:22.821249+0000","last_fullsized":"2024-08-09T00:36:22.821249+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:57.922645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7184,"num_write":5,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847687+0000","last_change":"2024-08-08T23:48:38.078416+0000","last_active":"2024-08-09T00:36:17.847687+0000","last_peered":"2024-08-09T00:36:17.847687+0000","last_clean":"2024-08-09T00:36:17.847687+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:36:17.847687+0000","last_undegraded":"2024-08-09T00:36:17.847687+0000","last_fullsized":"2024-08-09T00:36:17.847687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:01:01.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.839733+0000","last_change":"2024-08-08T23:44:47.401342+0000","last_active":"2024-08-09T00:36:52.839733+0000","last_peered":"2024-08-09T00:36:52.839733+0000","last_clean":"2024-08-09T00:36:52.839733+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:36:52.839733+0000","last_undegraded":"2024-08-09T00:36:52.839733+0000","last_fullsized":"2024-08-09T00:36:52.839733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:44.529457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834315+0000","last_change":"2024-08-09T00:04:29.863724+0000","last_active":"2024-08-09T00:37:02.834315+0000","last_peered":"2024-08-09T00:37:02.834315+0000","last_clean":"2024-08-09T00:37:02.834315+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:37:02.834315+0000","last_undegraded":"2024-08-09T00:37:02.834315+0000","last_fullsized":"2024-08-09T00:37:02.834315+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:29.579952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'7","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836323+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:36:37.836323+0000","last_peered":"2024-08-09T00:36:37.836323+0000","last_clean":"2024-08-09T00:36:37.836323+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:36:37.836323+0000","last_undegraded":"2024-08-09T00:36:37.836323+0000","last_fullsized":"2024-08-09T00:36:37.836323+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:10.329411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.853121+0000","last_change":"2024-08-08T23:48:38.072020+0000","last_active":"2024-08-09T00:36:42.853121+0000","last_peered":"2024-08-09T00:36:42.853121+0000","last_clean":"2024-08-09T00:36:42.853121+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:36:42.853121+0000","last_undegraded":"2024-08-09T00:36:42.853121+0000","last_fullsized":"2024-08-09T00:36:42.853121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.841674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057480+0000","last_change":"2024-08-08T23:44:47.415563+0000","last_active":"2024-08-09T00:36:53.057480+0000","last_peered":"2024-08-09T00:36:53.057480+0000","last_clean":"2024-08-09T00:36:53.057480+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:36:53.057480+0000","last_undegraded":"2024-08-09T00:36:53.057480+0000","last_fullsized":"2024-08-09T00:36:53.057480+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:14.499630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.828240+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:37:02.828240+0000","last_peered":"2024-08-09T00:37:02.828240+0000","last_clean":"2024-08-09T00:37:02.828240+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:37:02.828240+0000","last_undegraded":"2024-08-09T00:37:02.828240+0000","last_fullsized":"2024-08-09T00:37:02.828240+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:48.269801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057343+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:36:53.057343+0000","last_peered":"2024-08-09T00:36:53.057343+0000","last_clean":"2024-08-09T00:36:53.057343+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:36:53.057343+0000","last_undegraded":"2024-08-09T00:36:53.057343+0000","last_fullsized":"2024-08-09T00:36:53.057343+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:22.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'3","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850843+0000","last_change":"2024-08-08T23:48:38.073918+0000","last_active":"2024-08-09T00:36:32.850843+0000","last_peered":"2024-08-09T00:36:32.850843+0000","last_clean":"2024-08-09T00:36:32.850843+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:36:32.850843+0000","last_undegraded":"2024-08-09T00:36:32.850843+0000","last_fullsized":"2024-08-09T00:36:32.850843+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:36.717576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828053+0000","last_change":"2024-08-08T23:44:47.396682+0000","last_active":"2024-08-09T00:36:52.828053+0000","last_peered":"2024-08-09T00:36:52.828053+0000","last_clean":"2024-08-09T00:36:52.828053+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:36:52.828053+0000","last_undegraded":"2024-08-09T00:36:52.828053+0000","last_fullsized":"2024-08-09T00:36:52.828053+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:54.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.838905+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:37:52.838905+0000","last_peered":"2024-08-09T00:37:52.838905+0000","last_clean":"2024-08-09T00:37:52.838905+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:37:52.838905+0000","last_undegraded":"2024-08-09T00:37:52.838905+0000","last_fullsized":"2024-08-09T00:37:52.838905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:40.806416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825081+0000","last_change":"2024-08-08T23:48:42.101703+0000","last_active":"2024-08-09T00:36:37.825081+0000","last_peered":"2024-08-09T00:36:37.825081+0000","last_clean":"2024-08-09T00:36:37.825081+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:36:37.825081+0000","last_undegraded":"2024-08-09T00:36:37.825081+0000","last_fullsized":"2024-08-09T00:36:37.825081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:28:20.232434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.835642+0000","last_change":"2024-08-08T23:48:38.094574+0000","last_active":"2024-08-09T00:36:32.835642+0000","last_peered":"2024-08-09T00:36:32.835642+0000","last_clean":"2024-08-09T00:36:32.835642+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:36:32.835642+0000","last_undegraded":"2024-08-09T00:36:32.835642+0000","last_fullsized":"2024-08-09T00:36:32.835642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:54:58.203802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828719+0000","last_change":"2024-08-08T23:44:47.406106+0000","last_active":"2024-08-09T00:36:52.828719+0000","last_peered":"2024-08-09T00:36:52.828719+0000","last_clean":"2024-08-09T00:36:52.828719+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:36:52.828719+0000","last_undegraded":"2024-08-09T00:36:52.828719+0000","last_fullsized":"2024-08-09T00:36:52.828719+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:06.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870272+0000","last_change":"2024-08-09T00:04:29.876240+0000","last_active":"2024-08-09T00:37:57.870272+0000","last_peered":"2024-08-09T00:37:57.870272+0000","last_clean":"2024-08-09T00:37:57.870272+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:37:57.870272+0000","last_undegraded":"2024-08-09T00:37:57.870272+0000","last_fullsized":"2024-08-09T00:37:57.870272+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:16.600617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.824528+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:36:37.824528+0000","last_peered":"2024-08-09T00:36:37.824528+0000","last_clean":"2024-08-09T00:36:37.824528+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:36:37.824528+0000","last_undegraded":"2024-08-09T00:36:37.824528+0000","last_fullsized":"2024-08-09T00:36:37.824528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:25:48.483740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824034+0000","last_change":"2024-08-08T23:48:38.075180+0000","last_active":"2024-08-09T00:36:32.824034+0000","last_peered":"2024-08-09T00:36:32.824034+0000","last_clean":"2024-08-09T00:36:32.824034+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:36:32.824034+0000","last_undegraded":"2024-08-09T00:36:32.824034+0000","last_fullsized":"2024-08-09T00:36:32.824034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:33:20.643494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'75","reported_seq":297,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855332+0000","last_change":"2024-08-08T23:44:47.393129+0000","last_active":"2024-08-09T00:36:52.855332+0000","last_peered":"2024-08-09T00:36:52.855332+0000","last_clean":"2024-08-09T00:36:52.855332+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:36:52.855332+0000","last_undegraded":"2024-08-09T00:36:52.855332+0000","last_fullsized":"2024-08-09T00:36:52.855332+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:52.154862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'158","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.029188+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:39:28.029188+0000","last_peered":"2024-08-09T00:39:28.029188+0000","last_clean":"2024-08-09T00:39:28.029188+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:39:28.029188+0000","last_undegraded":"2024-08-09T00:39:28.029188+0000","last_fullsized":"2024-08-09T00:39:28.029188+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:02:46.763933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6911130,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":12258,"num_write":949,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045046+0000","last_change":"2024-08-08T23:28:26.788360+0000","last_active":"2024-08-09T00:35:58.045046+0000","last_peered":"2024-08-09T00:35:58.045046+0000","last_clean":"2024-08-09T00:35:58.045046+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:35:58.045046+0000","last_undegraded":"2024-08-09T00:35:58.045046+0000","last_fullsized":"2024-08-09T00:35:58.045046+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:04.030286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'178","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843501+0000","last_change":"2024-08-08T23:28:24.771874+0000","last_active":"2024-08-09T00:37:12.843501+0000","last_peered":"2024-08-09T00:37:12.843501+0000","last_clean":"2024-08-09T00:37:12.843501+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:37:12.843501+0000","last_undegraded":"2024-08-09T00:37:12.843501+0000","last_fullsized":"2024-08-09T00:37:12.843501+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:05.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7444278,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":346,"num_read_kb":3378,"num_write":891,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'233","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.842052+0000","last_change":"2024-08-08T23:28:26.783710+0000","last_active":"2024-08-09T00:35:57.842052+0000","last_peered":"2024-08-09T00:35:57.842052+0000","last_clean":"2024-08-09T00:35:57.842052+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:35:57.842052+0000","last_undegraded":"2024-08-09T00:35:57.842052+0000","last_fullsized":"2024-08-09T00:35:57.842052+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:28.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830506+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:37:12.830506+0000","last_peered":"2024-08-09T00:37:12.830506+0000","last_clean":"2024-08-09T00:37:12.830506+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:37:12.830506+0000","last_undegraded":"2024-08-09T00:37:12.830506+0000","last_fullsized":"2024-08-09T00:37:12.830506+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:18.881767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15339219,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":22668,"num_write":1170,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815161+0000","last_change":"2024-08-08T23:28:26.764063+0000","last_active":"2024-08-09T00:35:57.815161+0000","last_peered":"2024-08-09T00:35:57.815161+0000","last_clean":"2024-08-09T00:35:57.815161+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:35:57.815161+0000","last_undegraded":"2024-08-09T00:35:57.815161+0000","last_fullsized":"2024-08-09T00:35:57.815161+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:02.226948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'195","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.742763+0000","last_change":"2024-08-08T23:28:24.820523+0000","last_active":"2024-08-09T00:37:55.742763+0000","last_peered":"2024-08-09T00:37:55.742763+0000","last_clean":"2024-08-09T00:37:55.742763+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:37:55.742763+0000","last_undegraded":"2024-08-09T00:37:55.742763+0000","last_fullsized":"2024-08-09T00:37:55.742763+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:09.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311815,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":443,"num_read_kb":38040,"num_write":1150,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:54.879381+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:38:54.879381+0000","last_peered":"2024-08-09T00:38:54.879381+0000","last_clean":"2024-08-09T00:38:54.879381+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:38:54.879381+0000","last_undegraded":"2024-08-09T00:38:54.879381+0000","last_fullsized":"2024-08-09T00:38:54.879381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:03.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'212","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032599+0000","last_change":"2024-08-08T23:29:01.888800+0000","last_active":"2024-08-09T00:39:28.032599+0000","last_peered":"2024-08-09T00:39:28.032599+0000","last_clean":"2024-08-09T00:39:28.032599+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:39:28.032599+0000","last_undegraded":"2024-08-09T00:39:28.032599+0000","last_fullsized":"2024-08-09T00:39:28.032599+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:13.683511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8773046,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":506,"num_read_kb":21778,"num_write":1214,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825152+0000","last_change":"2024-08-08T23:28:26.768598+0000","last_active":"2024-08-09T00:36:37.825152+0000","last_peered":"2024-08-09T00:36:37.825152+0000","last_clean":"2024-08-09T00:36:37.825152+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:36:37.825152+0000","last_undegraded":"2024-08-09T00:36:37.825152+0000","last_fullsized":"2024-08-09T00:36:37.825152+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.114726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'186","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.189372+0000","last_change":"2024-08-08T23:28:24.817326+0000","last_active":"2024-08-09T00:36:25.189372+0000","last_peered":"2024-08-09T00:36:25.189372+0000","last_clean":"2024-08-09T00:36:25.189372+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:36:25.189372+0000","last_undegraded":"2024-08-09T00:36:25.189372+0000","last_fullsized":"2024-08-09T00:36:25.189372+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:00.886762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120656,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":427,"num_read_kb":54098,"num_write":1116,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833361+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:37:12.833361+0000","last_peered":"2024-08-09T00:37:12.833361+0000","last_clean":"2024-08-09T00:37:12.833361+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:37:12.833361+0000","last_undegraded":"2024-08-09T00:37:12.833361+0000","last_fullsized":"2024-08-09T00:37:12.833361+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:31.362319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'194","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032872+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:39:28.032872+0000","last_peered":"2024-08-09T00:39:28.032872+0000","last_clean":"2024-08-09T00:39:28.032872+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:39:28.032872+0000","last_undegraded":"2024-08-09T00:39:28.032872+0000","last_fullsized":"2024-08-09T00:39:28.032872+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:11.097799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4771500,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":11259,"num_write":1110,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'106","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:23.806748+0000","last_change":"2024-08-08T23:28:26.777046+0000","last_active":"2024-08-09T00:38:23.806748+0000","last_peered":"2024-08-09T00:38:23.806748+0000","last_clean":"2024-08-09T00:38:23.806748+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:38:23.806748+0000","last_undegraded":"2024-08-09T00:38:23.806748+0000","last_fullsized":"2024-08-09T00:38:23.806748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:14.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'152","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641086+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:35:57.641086+0000","last_peered":"2024-08-09T00:35:57.641086+0000","last_clean":"2024-08-09T00:35:57.641086+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:35:57.641086+0000","last_undegraded":"2024-08-09T00:35:57.641086+0000","last_fullsized":"2024-08-09T00:35:57.641086+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:02:01.420135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7223405,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":32780,"num_write":884,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'208","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836345+0000","last_change":"2024-08-08T23:28:26.768844+0000","last_active":"2024-08-09T00:37:12.836345+0000","last_peered":"2024-08-09T00:37:12.836345+0000","last_clean":"2024-08-09T00:37:12.836345+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:37:12.836345+0000","last_undegraded":"2024-08-09T00:37:12.836345+0000","last_fullsized":"2024-08-09T00:37:12.836345+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:09.349357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'33","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817514+0000","last_change":"2024-08-08T23:28:26.764534+0000","last_active":"2024-08-09T00:36:07.817514+0000","last_peered":"2024-08-09T00:36:07.817514+0000","last_clean":"2024-08-09T00:36:07.817514+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:36:07.817514+0000","last_undegraded":"2024-08-09T00:36:07.817514+0000","last_fullsized":"2024-08-09T00:36:07.817514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:18.335354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'170","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847733+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:36:17.847733+0000","last_peered":"2024-08-09T00:36:17.847733+0000","last_clean":"2024-08-09T00:36:17.847733+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:36:17.847733+0000","last_undegraded":"2024-08-09T00:36:17.847733+0000","last_fullsized":"2024-08-09T00:36:17.847733+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:16.221071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5065774,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":348,"num_read_kb":8171,"num_write":1045,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844698+0000","last_change":"2024-08-08T23:28:26.784260+0000","last_active":"2024-08-09T00:36:07.844698+0000","last_peered":"2024-08-09T00:36:07.844698+0000","last_clean":"2024-08-09T00:36:07.844698+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:36:07.844698+0000","last_undegraded":"2024-08-09T00:36:07.844698+0000","last_fullsized":"2024-08-09T00:36:07.844698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:39:01.299632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'194","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830951+0000","last_change":"2024-08-08T23:29:01.887779+0000","last_active":"2024-08-09T00:36:42.830951+0000","last_peered":"2024-08-09T00:36:42.830951+0000","last_clean":"2024-08-09T00:36:42.830951+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:36:42.830951+0000","last_undegraded":"2024-08-09T00:36:42.830951+0000","last_fullsized":"2024-08-09T00:36:42.830951+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:42.436187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120347,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":375,"num_read_kb":6729,"num_write":995,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.006860+0000","last_change":"2024-08-08T23:28:26.788985+0000","last_active":"2024-08-09T00:38:30.006860+0000","last_peered":"2024-08-09T00:38:30.006860+0000","last_clean":"2024-08-09T00:38:30.006860+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:38:30.006860+0000","last_undegraded":"2024-08-09T00:38:30.006860+0000","last_fullsized":"2024-08-09T00:38:30.006860+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:17:32.725693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818345+0000","last_change":"2024-08-08T23:28:24.818699+0000","last_active":"2024-08-09T00:36:07.818345+0000","last_peered":"2024-08-09T00:36:07.818345+0000","last_clean":"2024-08-09T00:36:07.818345+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:36:07.818345+0000","last_undegraded":"2024-08-09T00:36:07.818345+0000","last_fullsized":"2024-08-09T00:36:07.818345+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:59:40.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437226,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":911,"num_read_kb":13197,"num_write":1119,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'21","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823766+0000","last_change":"2024-08-08T23:28:26.768040+0000","last_active":"2024-08-09T00:36:07.823766+0000","last_peered":"2024-08-09T00:36:07.823766+0000","last_clean":"2024-08-09T00:36:07.823766+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:36:07.823766+0000","last_undegraded":"2024-08-09T00:36:07.823766+0000","last_fullsized":"2024-08-09T00:36:07.823766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:37.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'171","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830837+0000","last_change":"2024-08-08T23:29:01.581302+0000","last_active":"2024-08-09T00:36:42.830837+0000","last_peered":"2024-08-09T00:36:42.830837+0000","last_clean":"2024-08-09T00:36:42.830837+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:36:42.830837+0000","last_undegraded":"2024-08-09T00:36:42.830837+0000","last_fullsized":"2024-08-09T00:36:42.830837+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:24.899484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586044,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":349,"num_read_kb":29619,"num_write":947,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823828+0000","last_change":"2024-08-08T23:28:26.771260+0000","last_active":"2024-08-09T00:36:07.823828+0000","last_peered":"2024-08-09T00:36:07.823828+0000","last_clean":"2024-08-09T00:36:07.823828+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:36:07.823828+0000","last_undegraded":"2024-08-09T00:36:07.823828+0000","last_fullsized":"2024-08-09T00:36:07.823828+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:20:43.254989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'162","reported_seq":794,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644186+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:36:07.644186+0000","last_peered":"2024-08-09T00:36:07.644186+0000","last_clean":"2024-08-09T00:36:07.644186+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:36:07.644186+0000","last_undegraded":"2024-08-09T00:36:07.644186+0000","last_fullsized":"2024-08-09T00:36:07.644186+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:25:13.214512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714729,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":381,"num_read_kb":37287,"num_write":961,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817822+0000","last_change":"2024-08-08T23:28:26.767880+0000","last_active":"2024-08-09T00:36:07.817822+0000","last_peered":"2024-08-09T00:36:07.817822+0000","last_clean":"2024-08-09T00:36:07.817822+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:36:07.817822+0000","last_undegraded":"2024-08-09T00:36:07.817822+0000","last_fullsized":"2024-08-09T00:36:07.817822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:43:28.316031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'216","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819246+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:36:22.819246+0000","last_peered":"2024-08-09T00:36:22.819246+0000","last_clean":"2024-08-09T00:36:22.819246+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:36:22.819246+0000","last_undegraded":"2024-08-09T00:36:22.819246+0000","last_fullsized":"2024-08-09T00:36:22.819246+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:57:29.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120629,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":738,"num_write":1166,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.385719+0000","last_change":"2024-08-08T23:28:34.831960+0000","last_active":"2024-08-09T00:39:54.385719+0000","last_peered":"2024-08-09T00:39:54.385719+0000","last_clean":"2024-08-09T00:39:54.385719+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:39:54.385719+0000","last_undegraded":"2024-08-09T00:39:54.385719+0000","last_fullsized":"2024-08-09T00:39:54.385719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:01:36.286772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.137781+0000","last_change":"2024-08-08T23:29:01.588729+0000","last_active":"2024-08-09T00:37:28.137781+0000","last_peered":"2024-08-09T00:37:28.137781+0000","last_clean":"2024-08-09T00:37:28.137781+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:37:28.137781+0000","last_undegraded":"2024-08-09T00:37:28.137781+0000","last_fullsized":"2024-08-09T00:37:28.137781+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:04.343684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'174","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844794+0000","last_change":"2024-08-08T23:29:01.582685+0000","last_active":"2024-08-09T00:36:07.844794+0000","last_peered":"2024-08-09T00:36:07.844794+0000","last_clean":"2024-08-09T00:36:07.844794+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:36:07.844794+0000","last_undegraded":"2024-08-09T00:36:07.844794+0000","last_fullsized":"2024-08-09T00:36:07.844794+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:29:26.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6576285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":22191,"num_write":1034,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048658+0000","last_change":"2024-08-08T23:28:28.771835+0000","last_active":"2024-08-09T00:36:13.048658+0000","last_peered":"2024-08-09T00:36:13.048658+0000","last_clean":"2024-08-09T00:36:13.048658+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:36:13.048658+0000","last_undegraded":"2024-08-09T00:36:13.048658+0000","last_fullsized":"2024-08-09T00:36:13.048658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'216","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.965960+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:39:08.965960+0000","last_peered":"2024-08-09T00:39:08.965960+0000","last_clean":"2024-08-09T00:39:08.965960+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:39:08.965960+0000","last_undegraded":"2024-08-09T00:39:08.965960+0000","last_fullsized":"2024-08-09T00:39:08.965960+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:08:57.234564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":275,"num_write":166,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846496+0000","last_change":"2024-08-08T23:28:32.817763+0000","last_active":"2024-08-09T00:36:12.846496+0000","last_peered":"2024-08-09T00:36:12.846496+0000","last_clean":"2024-08-09T00:36:12.846496+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:36:12.846496+0000","last_undegraded":"2024-08-09T00:36:12.846496+0000","last_fullsized":"2024-08-09T00:36:12.846496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:21:08.427418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2399","reported_seq":4282,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.107418+0000","last_change":"2024-08-08T23:28:34.824612+0000","last_active":"2024-08-09T00:39:54.107418+0000","last_peered":"2024-08-09T00:39:54.107418+0000","last_clean":"2024-08-09T00:39:54.107418+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:39:54.107418+0000","last_undegraded":"2024-08-09T00:39:54.107418+0000","last_fullsized":"2024-08-09T00:39:54.107418+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":2300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:14:35.095843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047473+0000","last_change":"2024-08-08T23:28:26.791324+0000","last_active":"2024-08-09T00:36:08.047473+0000","last_peered":"2024-08-09T00:36:08.047473+0000","last_clean":"2024-08-09T00:36:08.047473+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:36:08.047473+0000","last_undegraded":"2024-08-09T00:36:08.047473+0000","last_fullsized":"2024-08-09T00:36:08.047473+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:56.405552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'181","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815607+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:36:07.815607+0000","last_peered":"2024-08-09T00:36:07.815607+0000","last_clean":"2024-08-09T00:36:07.815607+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:36:07.815607+0000","last_undegraded":"2024-08-09T00:36:07.815607+0000","last_fullsized":"2024-08-09T00:36:07.815607+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:48.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155271,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":389,"num_read_kb":16280,"num_write":967,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.649204+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:36:27.649204+0000","last_peered":"2024-08-09T00:36:27.649204+0000","last_clean":"2024-08-09T00:36:27.649204+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:36:27.649204+0000","last_undegraded":"2024-08-09T00:36:27.649204+0000","last_fullsized":"2024-08-09T00:36:27.649204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:59.953494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.254771+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:39:11.254771+0000","last_peered":"2024-08-09T00:39:11.254771+0000","last_clean":"2024-08-09T00:39:11.254771+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:39:11.254771+0000","last_undegraded":"2024-08-09T00:39:11.254771+0000","last_fullsized":"2024-08-09T00:39:11.254771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:58:11.384265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819027+0000","last_change":"2024-08-08T23:28:32.826736+0000","last_active":"2024-08-09T00:36:12.819027+0000","last_peered":"2024-08-09T00:36:12.819027+0000","last_clean":"2024-08-09T00:36:12.819027+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:36:12.819027+0000","last_undegraded":"2024-08-09T00:36:12.819027+0000","last_fullsized":"2024-08-09T00:36:12.819027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:45:43.822368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'134","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.448507+0000","last_change":"2024-08-08T23:28:34.836179+0000","last_active":"2024-08-09T00:39:52.448507+0000","last_peered":"2024-08-09T00:39:52.448507+0000","last_clean":"2024-08-09T00:39:52.448507+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:39:52.448507+0000","last_undegraded":"2024-08-09T00:39:52.448507+0000","last_fullsized":"2024-08-09T00:39:52.448507+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:42.899329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:24.902450+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:36:24.902450+0000","last_peered":"2024-08-09T00:36:24.902450+0000","last_clean":"2024-08-09T00:36:24.902450+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:36:24.902450+0000","last_undegraded":"2024-08-09T00:36:24.902450+0000","last_fullsized":"2024-08-09T00:36:24.902450+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:07:42.497596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'224","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:58.387270+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:38:58.387270+0000","last_peered":"2024-08-09T00:38:58.387270+0000","last_clean":"2024-08-09T00:38:58.387270+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:38:58.387270+0000","last_undegraded":"2024-08-09T00:38:58.387270+0000","last_fullsized":"2024-08-09T00:38:58.387270+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:42:05.542806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895562,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":26852,"num_write":1136,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645614+0000","last_change":"2024-08-08T23:28:28.771848+0000","last_active":"2024-08-09T00:36:12.645614+0000","last_peered":"2024-08-09T00:36:12.645614+0000","last_clean":"2024-08-09T00:36:12.645614+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:36:12.645614+0000","last_undegraded":"2024-08-09T00:36:12.645614+0000","last_fullsized":"2024-08-09T00:36:12.645614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:28.078906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'147","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.365433+0000","last_change":"2024-08-08T23:28:30.779574+0000","last_active":"2024-08-09T00:39:11.365433+0000","last_peered":"2024-08-09T00:39:11.365433+0000","last_clean":"2024-08-09T00:39:11.365433+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:39:11.365433+0000","last_undegraded":"2024-08-09T00:39:11.365433+0000","last_fullsized":"2024-08-09T00:39:11.365433+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:33:41.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'510","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.953210+0000","last_change":"2024-08-08T23:28:32.809653+0000","last_active":"2024-08-09T00:39:58.953210+0000","last_peered":"2024-08-09T00:39:58.953210+0000","last_clean":"2024-08-09T00:39:58.953210+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:39:58.953210+0000","last_undegraded":"2024-08-09T00:39:58.953210+0000","last_fullsized":"2024-08-09T00:39:58.953210+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:24:46.048044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'202","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.763064+0000","last_change":"2024-08-08T23:28:34.809979+0000","last_active":"2024-08-09T00:39:52.763064+0000","last_peered":"2024-08-09T00:39:52.763064+0000","last_clean":"2024-08-09T00:39:52.763064+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:39:52.763064+0000","last_undegraded":"2024-08-09T00:39:52.763064+0000","last_fullsized":"2024-08-09T00:39:52.763064+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:31.899889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'197","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644339+0000","last_change":"2024-08-08T23:28:26.776218+0000","last_active":"2024-08-09T00:36:07.644339+0000","last_peered":"2024-08-09T00:36:07.644339+0000","last_clean":"2024-08-09T00:36:07.644339+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:36:07.644339+0000","last_undegraded":"2024-08-09T00:36:07.644339+0000","last_fullsized":"2024-08-09T00:36:07.644339+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:48.787304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'178","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818116+0000","last_change":"2024-08-08T23:28:24.782432+0000","last_active":"2024-08-09T00:36:07.818116+0000","last_peered":"2024-08-09T00:36:07.818116+0000","last_clean":"2024-08-09T00:36:07.818116+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:36:07.818116+0000","last_undegraded":"2024-08-09T00:36:07.818116+0000","last_fullsized":"2024-08-09T00:36:07.818116+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:18.496718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2433240,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":343,"num_read_kb":11144,"num_write":992,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048748+0000","last_change":"2024-08-08T23:28:28.772715+0000","last_active":"2024-08-09T00:36:13.048748+0000","last_peered":"2024-08-09T00:36:13.048748+0000","last_clean":"2024-08-09T00:36:13.048748+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:36:13.048748+0000","last_undegraded":"2024-08-09T00:36:13.048748+0000","last_fullsized":"2024-08-09T00:36:13.048748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:38.667154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'143","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.384877+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:39:11.384877+0000","last_peered":"2024-08-09T00:39:11.384877+0000","last_clean":"2024-08-09T00:39:11.384877+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:39:11.384877+0000","last_undegraded":"2024-08-09T00:39:11.384877+0000","last_fullsized":"2024-08-09T00:39:11.384877+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:25:51.738224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":250,"num_write":102,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'522","reported_seq":2423,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.960804+0000","last_change":"2024-08-08T23:28:32.811070+0000","last_active":"2024-08-09T00:39:58.960804+0000","last_peered":"2024-08-09T00:39:58.960804+0000","last_clean":"2024-08-09T00:39:58.960804+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:39:58.960804+0000","last_undegraded":"2024-08-09T00:39:58.960804+0000","last_fullsized":"2024-08-09T00:39:58.960804+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:13.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.775798+0000","last_change":"2024-08-08T23:28:26.793556+0000","last_active":"2024-08-09T00:38:37.775798+0000","last_peered":"2024-08-09T00:38:37.775798+0000","last_clean":"2024-08-09T00:38:37.775798+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:38:37.775798+0000","last_undegraded":"2024-08-09T00:38:37.775798+0000","last_fullsized":"2024-08-09T00:38:37.775798+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:58:15.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'199","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845093+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:36:07.845093+0000","last_peered":"2024-08-09T00:36:07.845093+0000","last_clean":"2024-08-09T00:36:07.845093+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:36:07.845093+0000","last_undegraded":"2024-08-09T00:36:07.845093+0000","last_fullsized":"2024-08-09T00:36:07.845093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:39.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265532,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":38000,"num_write":1172,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868934+0000","last_change":"2024-08-08T23:28:28.785365+0000","last_active":"2024-08-09T00:37:52.868934+0000","last_peered":"2024-08-09T00:37:52.868934+0000","last_clean":"2024-08-09T00:37:52.868934+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:37:52.868934+0000","last_undegraded":"2024-08-09T00:37:52.868934+0000","last_fullsized":"2024-08-09T00:37:52.868934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:37.826252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'263","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.888477+0000","last_change":"2024-08-08T23:28:31.043616+0000","last_active":"2024-08-09T00:39:58.888477+0000","last_peered":"2024-08-09T00:39:58.888477+0000","last_clean":"2024-08-09T00:39:58.888477+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:39:58.888477+0000","last_undegraded":"2024-08-09T00:39:58.888477+0000","last_fullsized":"2024-08-09T00:39:58.888477+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:10:22.767945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8771,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":410,"num_write":220,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828810+0000","last_change":"2024-08-08T23:28:32.806513+0000","last_active":"2024-08-09T00:36:02.828810+0000","last_peered":"2024-08-09T00:36:02.828810+0000","last_clean":"2024-08-09T00:36:02.828810+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:36:02.828810+0000","last_undegraded":"2024-08-09T00:36:02.828810+0000","last_fullsized":"2024-08-09T00:36:02.828810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:46.925794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'551","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.923595+0000","last_change":"2024-08-08T23:28:34.840230+0000","last_active":"2024-08-09T00:39:58.923595+0000","last_peered":"2024-08-09T00:39:58.923595+0000","last_clean":"2024-08-09T00:39:58.923595+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:39:58.923595+0000","last_undegraded":"2024-08-09T00:39:58.923595+0000","last_fullsized":"2024-08-09T00:39:58.923595+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:31:37.941097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4315","reported_seq":4942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.368667+0000","last_change":"2024-08-08T23:28:26.754321+0000","last_active":"2024-08-09T00:39:09.368667+0000","last_peered":"2024-08-09T00:39:09.368667+0000","last_clean":"2024-08-09T00:39:09.368667+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:39:09.368667+0000","last_undegraded":"2024-08-09T00:39:09.368667+0000","last_fullsized":"2024-08-09T00:39:09.368667+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:13.192471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'228","reported_seq":1088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873654+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:38:12.873654+0000","last_peered":"2024-08-09T00:38:12.873654+0000","last_clean":"2024-08-09T00:38:12.873654+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:38:12.873654+0000","last_undegraded":"2024-08-09T00:38:12.873654+0000","last_fullsized":"2024-08-09T00:38:12.873654+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:53.700576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":40415,"num_write":1267,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843723+0000","last_change":"2024-08-08T23:28:28.772465+0000","last_active":"2024-08-09T00:37:52.843723+0000","last_peered":"2024-08-09T00:37:52.843723+0000","last_clean":"2024-08-09T00:37:52.843723+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:37:52.843723+0000","last_undegraded":"2024-08-09T00:37:52.843723+0000","last_fullsized":"2024-08-09T00:37:52.843723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:08.165167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'142","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.329872+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:39:11.329872+0000","last_peered":"2024-08-09T00:39:11.329872+0000","last_clean":"2024-08-09T00:39:11.329872+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:39:11.329872+0000","last_undegraded":"2024-08-09T00:39:11.329872+0000","last_fullsized":"2024-08-09T00:39:11.329872+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:47.333462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":237,"num_write":98,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.671591+0000","last_change":"2024-08-08T23:28:32.799931+0000","last_active":"2024-08-09T00:38:07.671591+0000","last_peered":"2024-08-09T00:38:07.671591+0000","last_clean":"2024-08-09T00:38:07.671591+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:38:07.671591+0000","last_undegraded":"2024-08-09T00:38:07.671591+0000","last_fullsized":"2024-08-09T00:38:07.671591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:18.351011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'95","reported_seq":601,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839035+0000","last_change":"2024-08-08T23:28:34.829500+0000","last_active":"2024-08-09T00:37:32.839035+0000","last_peered":"2024-08-09T00:37:32.839035+0000","last_clean":"2024-08-09T00:37:32.839035+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:37:32.839035+0000","last_undegraded":"2024-08-09T00:37:32.839035+0000","last_fullsized":"2024-08-09T00:37:32.839035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:50.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'226","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:09.757893+0000","last_change":"2024-08-08T23:28:26.774608+0000","last_active":"2024-08-09T00:38:09.757893+0000","last_peered":"2024-08-09T00:38:09.757893+0000","last_clean":"2024-08-09T00:38:09.757893+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:38:09.757893+0000","last_undegraded":"2024-08-09T00:38:09.757893+0000","last_fullsized":"2024-08-09T00:38:09.757893+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:00:42.181061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'156","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873595+0000","last_change":"2024-08-08T23:28:24.823026+0000","last_active":"2024-08-09T00:38:12.873595+0000","last_peered":"2024-08-09T00:38:12.873595+0000","last_clean":"2024-08-09T00:38:12.873595+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:38:12.873595+0000","last_undegraded":"2024-08-09T00:38:12.873595+0000","last_fullsized":"2024-08-09T00:38:12.873595+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:44.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3698921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":142181,"num_write":940,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822571+0000","last_change":"2024-08-08T23:28:28.775239+0000","last_active":"2024-08-09T00:36:02.822571+0000","last_peered":"2024-08-09T00:36:02.822571+0000","last_clean":"2024-08-09T00:36:02.822571+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:36:02.822571+0000","last_undegraded":"2024-08-09T00:36:02.822571+0000","last_fullsized":"2024-08-09T00:36:02.822571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:13:33.333304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'207","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.894182+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:39:58.894182+0000","last_peered":"2024-08-09T00:39:58.894182+0000","last_clean":"2024-08-09T00:39:58.894182+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:39:58.894182+0000","last_undegraded":"2024-08-09T00:39:58.894182+0000","last_fullsized":"2024-08-09T00:39:58.894182+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:08.571641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16354,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":341,"num_write":170,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'506","reported_seq":4394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.734428+0000","last_change":"2024-08-08T23:28:32.823537+0000","last_active":"2024-08-09T00:40:02.734428+0000","last_peered":"2024-08-09T00:40:02.734428+0000","last_clean":"2024-08-09T00:40:02.734428+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:02.734428+0000","last_undegraded":"2024-08-09T00:40:02.734428+0000","last_fullsized":"2024-08-09T00:40:02.734428+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:05.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'109","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.861091+0000","last_change":"2024-08-08T23:28:34.837367+0000","last_active":"2024-08-09T00:39:19.861091+0000","last_peered":"2024-08-09T00:39:19.861091+0000","last_clean":"2024-08-09T00:39:19.861091+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:39:19.861091+0000","last_undegraded":"2024-08-09T00:39:19.861091+0000","last_fullsized":"2024-08-09T00:39:19.861091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:08.993869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843304+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:38:12.843304+0000","last_peered":"2024-08-09T00:38:12.843304+0000","last_clean":"2024-08-09T00:38:12.843304+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:38:12.843304+0000","last_undegraded":"2024-08-09T00:38:12.843304+0000","last_fullsized":"2024-08-09T00:38:12.843304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:37:06.665341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.075069+0000","last_change":"2024-08-08T23:28:24.819082+0000","last_active":"2024-08-09T00:38:13.075069+0000","last_peered":"2024-08-09T00:38:13.075069+0000","last_clean":"2024-08-09T00:38:13.075069+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:38:13.075069+0000","last_undegraded":"2024-08-09T00:38:13.075069+0000","last_fullsized":"2024-08-09T00:38:13.075069+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:51:31.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6865694,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":514,"num_read_kb":20328,"num_write":1158,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"37'3","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.791480+0000","last_change":"2024-08-08T23:28:28.779663+0000","last_active":"2024-08-09T00:39:58.791480+0000","last_peered":"2024-08-09T00:39:58.791480+0000","last_clean":"2024-08-09T00:39:58.791480+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:39:58.791480+0000","last_undegraded":"2024-08-09T00:39:58.791480+0000","last_fullsized":"2024-08-09T00:39:58.791480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:47:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":485,"num_read_kb":483,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'244","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.899361+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:39:58.899361+0000","last_peered":"2024-08-09T00:39:58.899361+0000","last_clean":"2024-08-09T00:39:58.899361+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:39:58.899361+0000","last_undegraded":"2024-08-09T00:39:58.899361+0000","last_fullsized":"2024-08-09T00:39:58.899361+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:59.690242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52900,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":576,"num_write":196,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843661+0000","last_change":"2024-08-08T23:28:32.808451+0000","last_active":"2024-08-09T00:37:52.843661+0000","last_peered":"2024-08-09T00:37:52.843661+0000","last_clean":"2024-08-09T00:37:52.843661+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:37:52.843661+0000","last_undegraded":"2024-08-09T00:37:52.843661+0000","last_fullsized":"2024-08-09T00:37:52.843661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:52:53.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'102","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.011905+0000","last_change":"2024-08-08T23:28:34.833803+0000","last_active":"2024-08-09T00:38:30.011905+0000","last_peered":"2024-08-09T00:38:30.011905+0000","last_clean":"2024-08-09T00:38:30.011905+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:38:30.011905+0000","last_undegraded":"2024-08-09T00:38:30.011905+0000","last_fullsized":"2024-08-09T00:38:30.011905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:59:23.748669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849839+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:38:12.849839+0000","last_peered":"2024-08-09T00:38:12.849839+0000","last_clean":"2024-08-09T00:38:12.849839+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:38:12.849839+0000","last_undegraded":"2024-08-09T00:38:12.849839+0000","last_fullsized":"2024-08-09T00:38:12.849839+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:09.973740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'167","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:31.364791+0000","last_change":"2024-08-08T23:30:01.784156+0000","last_active":"2024-08-09T00:38:31.364791+0000","last_peered":"2024-08-09T00:38:31.364791+0000","last_clean":"2024-08-09T00:38:31.364791+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:38:31.364791+0000","last_undegraded":"2024-08-09T00:38:31.364791+0000","last_fullsized":"2024-08-09T00:38:31.364791+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:26.083283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444614,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":5320,"num_write":978,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822697+0000","last_change":"2024-08-08T23:28:28.780395+0000","last_active":"2024-08-09T00:36:02.822697+0000","last_peered":"2024-08-09T00:36:02.822697+0000","last_clean":"2024-08-09T00:36:02.822697+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:36:02.822697+0000","last_undegraded":"2024-08-09T00:36:02.822697+0000","last_fullsized":"2024-08-09T00:36:02.822697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:52.579128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'170","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.450349+0000","last_change":"2024-08-08T23:28:30.784352+0000","last_active":"2024-08-09T00:39:11.450349+0000","last_peered":"2024-08-09T00:39:11.450349+0000","last_clean":"2024-08-09T00:39:11.450349+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:39:11.450349+0000","last_undegraded":"2024-08-09T00:39:11.450349+0000","last_fullsized":"2024-08-09T00:39:11.450349+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:59:35.310017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":298,"num_write":188,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818266+0000","last_change":"2024-08-08T23:28:32.827076+0000","last_active":"2024-08-09T00:36:17.818266+0000","last_peered":"2024-08-09T00:36:17.818266+0000","last_clean":"2024-08-09T00:36:17.818266+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:36:17.818266+0000","last_undegraded":"2024-08-09T00:36:17.818266+0000","last_fullsized":"2024-08-09T00:36:17.818266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.028693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'134","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.323973+0000","last_change":"2024-08-08T23:28:34.836409+0000","last_active":"2024-08-09T00:39:09.323973+0000","last_peered":"2024-08-09T00:39:09.323973+0000","last_clean":"2024-08-09T00:39:09.323973+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:39:09.323973+0000","last_undegraded":"2024-08-09T00:39:09.323973+0000","last_fullsized":"2024-08-09T00:39:09.323973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:52:23.979940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'185","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849875+0000","last_change":"2024-08-08T23:28:26.768527+0000","last_active":"2024-08-09T00:38:12.849875+0000","last_peered":"2024-08-09T00:38:12.849875+0000","last_clean":"2024-08-09T00:38:12.849875+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:38:12.849875+0000","last_undegraded":"2024-08-09T00:38:12.849875+0000","last_fullsized":"2024-08-09T00:38:12.849875+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:57.863036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'204","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.846177+0000","last_change":"2024-08-08T23:28:24.767491+0000","last_active":"2024-08-09T00:37:57.846177+0000","last_peered":"2024-08-09T00:37:57.846177+0000","last_clean":"2024-08-09T00:37:57.846177+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:37:57.846177+0000","last_undegraded":"2024-08-09T00:37:57.846177+0000","last_fullsized":"2024-08-09T00:37:57.846177+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:24:23.880570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456498,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":34331,"num_write":1086,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828882+0000","last_change":"2024-08-08T23:28:28.777081+0000","last_active":"2024-08-09T00:36:02.828882+0000","last_peered":"2024-08-09T00:36:02.828882+0000","last_clean":"2024-08-09T00:36:02.828882+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:36:02.828882+0000","last_undegraded":"2024-08-09T00:36:02.828882+0000","last_fullsized":"2024-08-09T00:36:02.828882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:29.639169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'194","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.566053+0000","last_change":"2024-08-08T23:28:30.783664+0000","last_active":"2024-08-09T00:39:11.566053+0000","last_peered":"2024-08-09T00:39:11.566053+0000","last_clean":"2024-08-09T00:39:11.566053+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:39:11.566053+0000","last_undegraded":"2024-08-09T00:39:11.566053+0000","last_fullsized":"2024-08-09T00:39:11.566053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:08.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":264,"num_read_kb":353,"num_write":156,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'490","reported_seq":2254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.955189+0000","last_change":"2024-08-08T23:28:32.806321+0000","last_active":"2024-08-09T00:39:58.955189+0000","last_peered":"2024-08-09T00:39:58.955189+0000","last_clean":"2024-08-09T00:39:58.955189+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:39:58.955189+0000","last_undegraded":"2024-08-09T00:39:58.955189+0000","last_fullsized":"2024-08-09T00:39:58.955189+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:35:07.612864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.871072+0000","last_change":"2024-08-08T23:28:34.837840+0000","last_active":"2024-08-09T00:39:27.871072+0000","last_peered":"2024-08-09T00:39:27.871072+0000","last_clean":"2024-08-09T00:39:27.871072+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:39:27.871072+0000","last_undegraded":"2024-08-09T00:39:27.871072+0000","last_fullsized":"2024-08-09T00:39:27.871072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:51.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849903+0000","last_change":"2024-08-08T23:28:26.779476+0000","last_active":"2024-08-09T00:38:12.849903+0000","last_peered":"2024-08-09T00:38:12.849903+0000","last_clean":"2024-08-09T00:38:12.849903+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:38:12.849903+0000","last_undegraded":"2024-08-09T00:38:12.849903+0000","last_fullsized":"2024-08-09T00:38:12.849903+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:31:06.993378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'201","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:10.488115+0000","last_change":"2024-08-08T23:28:24.790265+0000","last_active":"2024-08-09T00:38:10.488115+0000","last_peered":"2024-08-09T00:38:10.488115+0000","last_clean":"2024-08-09T00:38:10.488115+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:38:10.488115+0000","last_undegraded":"2024-08-09T00:38:10.488115+0000","last_fullsized":"2024-08-09T00:38:10.488115+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:21.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443685,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":23703,"num_write":1087,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.559910+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:39:58.559910+0000","last_peered":"2024-08-09T00:39:58.559910+0000","last_clean":"2024-08-09T00:39:58.559910+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:39:58.559910+0000","last_undegraded":"2024-08-09T00:39:58.559910+0000","last_fullsized":"2024-08-09T00:39:58.559910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:45.142309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":634,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'105","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.103522+0000","last_change":"2024-08-08T23:28:31.048124+0000","last_active":"2024-08-09T00:39:11.103522+0000","last_peered":"2024-08-09T00:39:11.103522+0000","last_clean":"2024-08-09T00:39:11.103522+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:39:11.103522+0000","last_undegraded":"2024-08-09T00:39:11.103522+0000","last_fullsized":"2024-08-09T00:39:11.103522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:47:38.686500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'497","reported_seq":2257,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.958326+0000","last_change":"2024-08-08T23:28:32.814344+0000","last_active":"2024-08-09T00:39:58.958326+0000","last_peered":"2024-08-09T00:39:58.958326+0000","last_clean":"2024-08-09T00:39:58.958326+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:39:58.958326+0000","last_undegraded":"2024-08-09T00:39:58.958326+0000","last_fullsized":"2024-08-09T00:39:58.958326+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:20.130194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836068+0000","last_change":"2024-08-08T23:28:34.832392+0000","last_active":"2024-08-09T00:37:22.836068+0000","last_peered":"2024-08-09T00:37:22.836068+0000","last_clean":"2024-08-09T00:37:22.836068+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:37:22.836068+0000","last_undegraded":"2024-08-09T00:37:22.836068+0000","last_fullsized":"2024-08-09T00:37:22.836068+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:53:39.542207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'461","reported_seq":1174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831471+0000","last_change":"2024-08-08T23:28:26.762100+0000","last_active":"2024-08-09T00:36:12.831471+0000","last_peered":"2024-08-09T00:36:12.831471+0000","last_clean":"2024-08-09T00:36:12.831471+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:36:12.831471+0000","last_undegraded":"2024-08-09T00:36:12.831471+0000","last_fullsized":"2024-08-09T00:36:12.831471+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:31:41.700529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'177","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667019+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:37:47.667019+0000","last_peered":"2024-08-09T00:37:47.667019+0000","last_clean":"2024-08-09T00:37:47.667019+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:37:47.667019+0000","last_undegraded":"2024-08-09T00:37:47.667019+0000","last_fullsized":"2024-08-09T00:37:47.667019+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:55.568959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":4543,"num_write":1041,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816540+0000","last_change":"2024-08-08T23:28:28.778804+0000","last_active":"2024-08-09T00:36:02.816540+0000","last_peered":"2024-08-09T00:36:02.816540+0000","last_clean":"2024-08-09T00:36:02.816540+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:36:02.816540+0000","last_undegraded":"2024-08-09T00:36:02.816540+0000","last_fullsized":"2024-08-09T00:36:02.816540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:09:24.525056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'299","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.879310+0000","last_change":"2024-08-08T23:28:30.776772+0000","last_active":"2024-08-09T00:39:58.879310+0000","last_peered":"2024-08-09T00:39:58.879310+0000","last_clean":"2024-08-09T00:39:58.879310+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:39:58.879310+0000","last_undegraded":"2024-08-09T00:39:58.879310+0000","last_fullsized":"2024-08-09T00:39:58.879310+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:54.049825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":987,"num_read_kb":1031,"num_write":1530,"num_write_kb":1359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.817176+0000","last_change":"2024-08-08T23:28:32.821436+0000","last_active":"2024-08-09T00:36:02.817176+0000","last_peered":"2024-08-09T00:36:02.817176+0000","last_clean":"2024-08-09T00:36:02.817176+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:36:02.817176+0000","last_undegraded":"2024-08-09T00:36:02.817176+0000","last_fullsized":"2024-08-09T00:36:02.817176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:21:40.233740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'102","reported_seq":609,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.944405+0000","last_change":"2024-08-08T23:28:34.822628+0000","last_active":"2024-08-09T00:39:51.944405+0000","last_peered":"2024-08-09T00:39:51.944405+0000","last_clean":"2024-08-09T00:39:51.944405+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:39:51.944405+0000","last_undegraded":"2024-08-09T00:39:51.944405+0000","last_fullsized":"2024-08-09T00:39:51.944405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:13.362222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836399+0000","last_change":"2024-08-08T23:28:26.782849+0000","last_active":"2024-08-09T00:37:22.836399+0000","last_peered":"2024-08-09T00:37:22.836399+0000","last_clean":"2024-08-09T00:37:22.836399+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:37:22.836399+0000","last_undegraded":"2024-08-09T00:37:22.836399+0000","last_fullsized":"2024-08-09T00:37:22.836399+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:36.999822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.875811+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:38:22.875811+0000","last_peered":"2024-08-09T00:38:22.875811+0000","last_clean":"2024-08-09T00:38:22.875811+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:38:22.875811+0000","last_undegraded":"2024-08-09T00:38:22.875811+0000","last_fullsized":"2024-08-09T00:38:22.875811+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059673+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-09T00:37:03.059673+0000","last_peered":"2024-08-09T00:37:03.059673+0000","last_clean":"2024-08-09T00:37:03.059673+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:37:03.059673+0000","last_undegraded":"2024-08-09T00:37:03.059673+0000","last_fullsized":"2024-08-09T00:37:03.059673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'169","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.659235+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:37:12.659235+0000","last_peered":"2024-08-09T00:37:12.659235+0000","last_clean":"2024-08-09T00:37:12.659235+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:37:12.659235+0000","last_undegraded":"2024-08-09T00:37:12.659235+0000","last_fullsized":"2024-08-09T00:37:12.659235+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:08.383791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423898,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":19880,"num_write":945,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.861276+0000","last_change":"2024-08-08T23:28:28.785997+0000","last_active":"2024-08-09T00:37:17.861276+0000","last_peered":"2024-08-09T00:37:17.861276+0000","last_clean":"2024-08-09T00:37:17.861276+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:37:17.861276+0000","last_undegraded":"2024-08-09T00:37:17.861276+0000","last_fullsized":"2024-08-09T00:37:17.861276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:19.940501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'322","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.911428+0000","last_change":"2024-08-08T23:28:30.788180+0000","last_active":"2024-08-09T00:39:58.911428+0000","last_peered":"2024-08-09T00:39:58.911428+0000","last_clean":"2024-08-09T00:39:58.911428+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:39:58.911428+0000","last_undegraded":"2024-08-09T00:39:58.911428+0000","last_fullsized":"2024-08-09T00:39:58.911428+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:08.134619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":621,"num_read_kb":848,"num_write":582,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.839007+0000","last_change":"2024-08-08T23:28:32.821568+0000","last_active":"2024-08-09T00:37:52.839007+0000","last_peered":"2024-08-09T00:37:52.839007+0000","last_clean":"2024-08-09T00:37:52.839007+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:37:52.839007+0000","last_undegraded":"2024-08-09T00:37:52.839007+0000","last_fullsized":"2024-08-09T00:37:52.839007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:04:45.502986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'206","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.227768+0000","last_change":"2024-08-08T23:28:34.829682+0000","last_active":"2024-08-09T00:39:54.227768+0000","last_peered":"2024-08-09T00:39:54.227768+0000","last_clean":"2024-08-09T00:39:54.227768+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:39:54.227768+0000","last_undegraded":"2024-08-09T00:39:54.227768+0000","last_fullsized":"2024-08-09T00:39:54.227768+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:20:02.874767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'188","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:08.036140+0000","last_change":"2024-08-08T23:28:26.775022+0000","last_active":"2024-08-09T00:38:08.036140+0000","last_peered":"2024-08-09T00:38:08.036140+0000","last_clean":"2024-08-09T00:38:08.036140+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:38:08.036140+0000","last_undegraded":"2024-08-09T00:38:08.036140+0000","last_fullsized":"2024-08-09T00:38:08.036140+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:54.073153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849650+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:36:27.849650+0000","last_peered":"2024-08-09T00:36:27.849650+0000","last_clean":"2024-08-09T00:36:27.849650+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:36:27.849650+0000","last_undegraded":"2024-08-09T00:36:27.849650+0000","last_fullsized":"2024-08-09T00:36:27.849650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'199","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830339+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:37:12.830339+0000","last_peered":"2024-08-09T00:37:12.830339+0000","last_clean":"2024-08-09T00:37:12.830339+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:37:12.830339+0000","last_undegraded":"2024-08-09T00:37:12.830339+0000","last_fullsized":"2024-08-09T00:37:12.830339+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:09.134864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3726460,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":17063,"num_write":1106,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070776+0000","last_change":"2024-08-08T23:28:28.772772+0000","last_active":"2024-08-09T00:37:53.070776+0000","last_peered":"2024-08-09T00:37:53.070776+0000","last_clean":"2024-08-09T00:37:53.070776+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:37:53.070776+0000","last_undegraded":"2024-08-09T00:37:53.070776+0000","last_fullsized":"2024-08-09T00:37:53.070776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:35:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'679","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.162698+0000","last_change":"2024-08-08T23:28:30.774420+0000","last_active":"2024-08-09T00:39:59.162698+0000","last_peered":"2024-08-09T00:39:59.162698+0000","last_clean":"2024-08-09T00:39:59.162698+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:39:59.162698+0000","last_undegraded":"2024-08-09T00:39:59.162698+0000","last_fullsized":"2024-08-09T00:39:59.162698+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":600,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:41.556054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38624,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":976,"num_read_kb":1169,"num_write":310,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:27.863596+0000","last_change":"2024-08-08T23:28:32.810173+0000","last_active":"2024-08-09T00:37:27.863596+0000","last_peered":"2024-08-09T00:37:27.863596+0000","last_clean":"2024-08-09T00:37:27.863596+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:37:27.863596+0000","last_undegraded":"2024-08-09T00:37:27.863596+0000","last_fullsized":"2024-08-09T00:37:27.863596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:44.557649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'129","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855394+0000","last_change":"2024-08-08T23:28:34.828009+0000","last_active":"2024-08-09T00:38:12.855394+0000","last_peered":"2024-08-09T00:38:12.855394+0000","last_clean":"2024-08-09T00:38:12.855394+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:38:12.855394+0000","last_undegraded":"2024-08-09T00:38:12.855394+0000","last_fullsized":"2024-08-09T00:38:12.855394+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:16:30.650076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:19.246847+0000","last_change":"2024-08-08T23:28:26.777388+0000","last_active":"2024-08-09T00:38:19.246847+0000","last_peered":"2024-08-09T00:38:19.246847+0000","last_clean":"2024-08-09T00:38:19.246847+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:38:19.246847+0000","last_undegraded":"2024-08-09T00:38:19.246847+0000","last_fullsized":"2024-08-09T00:38:19.246847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:00:11.706140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834117+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-09T00:37:02.834117+0000","last_peered":"2024-08-09T00:37:02.834117+0000","last_clean":"2024-08-09T00:37:02.834117+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:37:02.834117+0000","last_undegraded":"2024-08-09T00:37:02.834117+0000","last_fullsized":"2024-08-09T00:37:02.834117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'152","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.028592+0000","last_change":"2024-08-08T23:28:24.757810+0000","last_active":"2024-08-09T00:39:28.028592+0000","last_peered":"2024-08-09T00:39:28.028592+0000","last_clean":"2024-08-09T00:39:28.028592+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:39:28.028592+0000","last_undegraded":"2024-08-09T00:39:28.028592+0000","last_fullsized":"2024-08-09T00:39:28.028592+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:35.709380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12202139,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":424,"num_read_kb":29266,"num_write":855,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843917+0000","last_change":"2024-08-08T23:28:28.775991+0000","last_active":"2024-08-09T00:37:52.843917+0000","last_peered":"2024-08-09T00:37:52.843917+0000","last_clean":"2024-08-09T00:37:52.843917+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:37:52.843917+0000","last_undegraded":"2024-08-09T00:37:52.843917+0000","last_fullsized":"2024-08-09T00:37:52.843917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:48.817766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.141922+0000","last_change":"2024-08-08T23:28:31.049356+0000","last_active":"2024-08-09T00:39:59.141922+0000","last_peered":"2024-08-09T00:39:59.141922+0000","last_clean":"2024-08-09T00:39:59.141922+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:39:59.141922+0000","last_undegraded":"2024-08-09T00:39:59.141922+0000","last_fullsized":"2024-08-09T00:39:59.141922+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:10.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831629+0000","last_change":"2024-08-08T23:28:32.827179+0000","last_active":"2024-08-09T00:37:17.831629+0000","last_peered":"2024-08-09T00:37:17.831629+0000","last_clean":"2024-08-09T00:37:17.831629+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:37:17.831629+0000","last_undegraded":"2024-08-09T00:37:17.831629+0000","last_fullsized":"2024-08-09T00:37:17.831629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:18.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'277","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.918904+0000","last_change":"2024-08-08T23:28:34.830435+0000","last_active":"2024-08-09T00:39:52.918904+0000","last_peered":"2024-08-09T00:39:52.918904+0000","last_clean":"2024-08-09T00:39:52.918904+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:39:52.918904+0000","last_undegraded":"2024-08-09T00:39:52.918904+0000","last_fullsized":"2024-08-09T00:39:52.918904+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:09.607368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843420+0000","last_change":"2024-08-08T23:28:26.762755+0000","last_active":"2024-08-09T00:37:12.843420+0000","last_peered":"2024-08-09T00:37:12.843420+0000","last_clean":"2024-08-09T00:37:12.843420+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:37:12.843420+0000","last_undegraded":"2024-08-09T00:37:12.843420+0000","last_fullsized":"2024-08-09T00:37:12.843420+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:23:47.959221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059606+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-09T00:37:03.059606+0000","last_peered":"2024-08-09T00:37:03.059606+0000","last_clean":"2024-08-09T00:37:03.059606+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:37:03.059606+0000","last_undegraded":"2024-08-09T00:37:03.059606+0000","last_fullsized":"2024-08-09T00:37:03.059606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'192","reported_seq":831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833282+0000","last_change":"2024-08-08T23:28:24.760341+0000","last_active":"2024-08-09T00:37:12.833282+0000","last_peered":"2024-08-09T00:37:12.833282+0000","last_clean":"2024-08-09T00:37:12.833282+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:37:12.833282+0000","last_undegraded":"2024-08-09T00:37:12.833282+0000","last_fullsized":"2024-08-09T00:37:12.833282+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:38.374476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053350,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":408,"num_read_kb":7644,"num_write":1036,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.834591+0000","last_change":"2024-08-08T23:28:28.778088+0000","last_active":"2024-08-09T00:37:32.834591+0000","last_peered":"2024-08-09T00:37:32.834591+0000","last_clean":"2024-08-09T00:37:32.834591+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:37:32.834591+0000","last_undegraded":"2024-08-09T00:37:32.834591+0000","last_fullsized":"2024-08-09T00:37:32.834591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:46.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.518432+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:39:52.518432+0000","last_peered":"2024-08-09T00:39:52.518432+0000","last_clean":"2024-08-09T00:39:52.518432+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:39:52.518432+0000","last_undegraded":"2024-08-09T00:39:52.518432+0000","last_fullsized":"2024-08-09T00:39:52.518432+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:19.698033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844707+0000","last_change":"2024-08-08T23:28:32.831075+0000","last_active":"2024-08-09T00:37:52.844707+0000","last_peered":"2024-08-09T00:37:52.844707+0000","last_clean":"2024-08-09T00:37:52.844707+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:37:52.844707+0000","last_undegraded":"2024-08-09T00:37:52.844707+0000","last_fullsized":"2024-08-09T00:37:52.844707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:55:52.866081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'113","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:58.071702+0000","last_change":"2024-08-08T23:28:34.834032+0000","last_active":"2024-08-09T00:37:58.071702+0000","last_peered":"2024-08-09T00:37:58.071702+0000","last_clean":"2024-08-09T00:37:58.071702+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:37:58.071702+0000","last_undegraded":"2024-08-09T00:37:58.071702+0000","last_fullsized":"2024-08-09T00:37:58.071702+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:41.070436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'155","reported_seq":753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:21.963237+0000","last_change":"2024-08-08T23:28:26.777411+0000","last_active":"2024-08-09T00:38:21.963237+0000","last_peered":"2024-08-09T00:38:21.963237+0000","last_clean":"2024-08-09T00:38:21.963237+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:38:21.963237+0000","last_undegraded":"2024-08-09T00:38:21.963237+0000","last_fullsized":"2024-08-09T00:38:21.963237+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:18.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'225","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.064954+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:37:28.064954+0000","last_peered":"2024-08-09T00:37:28.064954+0000","last_clean":"2024-08-09T00:37:28.064954+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:37:28.064954+0000","last_undegraded":"2024-08-09T00:37:28.064954+0000","last_fullsized":"2024-08-09T00:37:28.064954+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:17.537000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506136,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":805,"num_read_kb":62351,"num_write":1157,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.841587+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-09T00:37:02.841587+0000","last_peered":"2024-08-09T00:37:02.841587+0000","last_clean":"2024-08-09T00:37:02.841587+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:37:02.841587+0000","last_undegraded":"2024-08-09T00:37:02.841587+0000","last_fullsized":"2024-08-09T00:37:02.841587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831582+0000","last_change":"2024-08-08T23:28:28.783451+0000","last_active":"2024-08-09T00:37:17.831582+0000","last_peered":"2024-08-09T00:37:17.831582+0000","last_clean":"2024-08-09T00:37:17.831582+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:37:17.831582+0000","last_undegraded":"2024-08-09T00:37:17.831582+0000","last_fullsized":"2024-08-09T00:37:17.831582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:47:09.084557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'302","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.913667+0000","last_change":"2024-08-08T23:28:30.784027+0000","last_active":"2024-08-09T00:39:58.913667+0000","last_peered":"2024-08-09T00:39:58.913667+0000","last_clean":"2024-08-09T00:39:58.913667+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:39:58.913667+0000","last_undegraded":"2024-08-09T00:39:58.913667+0000","last_fullsized":"2024-08-09T00:39:58.913667+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:56:56.170296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34540,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":434,"num_read_kb":591,"num_write":250,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834636+0000","last_change":"2024-08-08T23:28:32.814130+0000","last_active":"2024-08-09T00:37:17.834636+0000","last_peered":"2024-08-09T00:37:17.834636+0000","last_clean":"2024-08-09T00:37:17.834636+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:37:17.834636+0000","last_undegraded":"2024-08-09T00:37:17.834636+0000","last_fullsized":"2024-08-09T00:37:17.834636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:24:28.569706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'117","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.476580+0000","last_change":"2024-08-08T23:28:34.838026+0000","last_active":"2024-08-09T00:39:53.476580+0000","last_peered":"2024-08-09T00:39:53.476580+0000","last_clean":"2024-08-09T00:39:53.476580+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:39:53.476580+0000","last_undegraded":"2024-08-09T00:39:53.476580+0000","last_fullsized":"2024-08-09T00:39:53.476580+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:23.463646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.431957+0000","last_change":"2024-08-08T23:28:26.780124+0000","last_active":"2024-08-09T00:39:27.431957+0000","last_peered":"2024-08-09T00:39:27.431957+0000","last_clean":"2024-08-09T00:39:27.431957+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:39:27.431957+0000","last_undegraded":"2024-08-09T00:39:27.431957+0000","last_fullsized":"2024-08-09T00:39:27.431957+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:11.326856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'311","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843393+0000","last_change":"2024-08-08T23:28:24.764595+0000","last_active":"2024-08-09T00:37:12.843393+0000","last_peered":"2024-08-09T00:37:12.843393+0000","last_clean":"2024-08-09T00:37:12.843393+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:37:12.843393+0000","last_undegraded":"2024-08-09T00:37:12.843393+0000","last_fullsized":"2024-08-09T00:37:12.843393+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:13.394500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14943339,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":185751,"num_write":1329,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.860057+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:37:12.860057+0000","last_peered":"2024-08-09T00:37:12.860057+0000","last_clean":"2024-08-09T00:37:12.860057+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:37:12.860057+0000","last_undegraded":"2024-08-09T00:37:12.860057+0000","last_fullsized":"2024-08-09T00:37:12.860057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835003+0000","last_change":"2024-08-08T23:28:28.779571+0000","last_active":"2024-08-09T00:37:17.835003+0000","last_peered":"2024-08-09T00:37:17.835003+0000","last_clean":"2024-08-09T00:37:17.835003+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:37:17.835003+0000","last_undegraded":"2024-08-09T00:37:17.835003+0000","last_fullsized":"2024-08-09T00:37:17.835003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:59:20.339670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'221","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.327545+0000","last_change":"2024-08-08T23:28:31.042472+0000","last_active":"2024-08-09T00:39:48.327545+0000","last_peered":"2024-08-09T00:39:48.327545+0000","last_clean":"2024-08-09T00:39:48.327545+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:39:48.327545+0000","last_undegraded":"2024-08-09T00:39:48.327545+0000","last_fullsized":"2024-08-09T00:39:48.327545+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:24.658995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'525","reported_seq":4398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.950770+0000","last_change":"2024-08-08T23:28:32.815950+0000","last_active":"2024-08-09T00:39:58.950770+0000","last_peered":"2024-08-09T00:39:58.950770+0000","last_clean":"2024-08-09T00:39:58.950770+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:39:58.950770+0000","last_undegraded":"2024-08-09T00:39:58.950770+0000","last_fullsized":"2024-08-09T00:39:58.950770+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:11.787941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'164","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.453818+0000","last_change":"2024-08-08T23:28:34.830158+0000","last_active":"2024-08-09T00:39:54.453818+0000","last_peered":"2024-08-09T00:39:54.453818+0000","last_clean":"2024-08-09T00:39:54.453818+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:39:54.453818+0000","last_undegraded":"2024-08-09T00:39:54.453818+0000","last_fullsized":"2024-08-09T00:39:54.453818+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:25.038657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":713,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.619859+0000","last_change":"2024-08-08T23:28:26.776845+0000","last_active":"2024-08-09T00:37:15.619859+0000","last_peered":"2024-08-09T00:37:15.619859+0000","last_clean":"2024-08-09T00:37:15.619859+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:37:15.619859+0000","last_undegraded":"2024-08-09T00:37:15.619859+0000","last_fullsized":"2024-08-09T00:37:15.619859+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:55:03.906562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667331+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:37:47.667331+0000","last_peered":"2024-08-09T00:37:47.667331+0000","last_clean":"2024-08-09T00:37:47.667331+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:37:47.667331+0000","last_undegraded":"2024-08-09T00:37:47.667331+0000","last_fullsized":"2024-08-09T00:37:47.667331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:13.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535244,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1086,"num_read_kb":6563,"num_write":1289,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.848189+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-09T00:37:37.848189+0000","last_peered":"2024-08-09T00:37:37.848189+0000","last_clean":"2024-08-09T00:37:37.848189+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:37:37.848189+0000","last_undegraded":"2024-08-09T00:37:37.848189+0000","last_fullsized":"2024-08-09T00:37:37.848189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834567+0000","last_change":"2024-08-08T23:28:28.777156+0000","last_active":"2024-08-09T00:37:17.834567+0000","last_peered":"2024-08-09T00:37:17.834567+0000","last_clean":"2024-08-09T00:37:17.834567+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:37:17.834567+0000","last_undegraded":"2024-08-09T00:37:17.834567+0000","last_fullsized":"2024-08-09T00:37:17.834567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:42.927296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'148","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.398773+0000","last_change":"2024-08-08T23:28:30.790179+0000","last_active":"2024-08-09T00:39:11.398773+0000","last_peered":"2024-08-09T00:39:11.398773+0000","last_clean":"2024-08-09T00:39:11.398773+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:39:11.398773+0000","last_undegraded":"2024-08-09T00:39:11.398773+0000","last_fullsized":"2024-08-09T00:39:11.398773+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:38.377166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'522","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.959357+0000","last_change":"2024-08-08T23:28:32.808377+0000","last_active":"2024-08-09T00:39:58.959357+0000","last_peered":"2024-08-09T00:39:58.959357+0000","last_clean":"2024-08-09T00:39:58.959357+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:39:58.959357+0000","last_undegraded":"2024-08-09T00:39:58.959357+0000","last_fullsized":"2024-08-09T00:39:58.959357+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:26:13.925905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'236","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.845482+0000","last_change":"2024-08-08T23:28:34.832992+0000","last_active":"2024-08-09T00:38:22.845482+0000","last_peered":"2024-08-09T00:38:22.845482+0000","last_clean":"2024-08-09T00:38:22.845482+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:38:22.845482+0000","last_undegraded":"2024-08-09T00:38:22.845482+0000","last_fullsized":"2024-08-09T00:38:22.845482+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:38.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:57.761692+0000","last_change":"2024-08-08T23:28:26.770700+0000","last_active":"2024-08-09T00:38:57.761692+0000","last_peered":"2024-08-09T00:38:57.761692+0000","last_clean":"2024-08-09T00:38:57.761692+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:38:57.761692+0000","last_undegraded":"2024-08-09T00:38:57.761692+0000","last_fullsized":"2024-08-09T00:38:57.761692+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:15:02.492992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'214","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:56.150980+0000","last_change":"2024-08-08T23:29:01.887794+0000","last_active":"2024-08-09T00:38:56.150980+0000","last_peered":"2024-08-09T00:38:56.150980+0000","last_clean":"2024-08-09T00:38:56.150980+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:38:56.150980+0000","last_undegraded":"2024-08-09T00:38:56.150980+0000","last_fullsized":"2024-08-09T00:38:56.150980+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:04.725884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3108640,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":66311,"num_write":1068,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840460+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-09T00:37:37.840460+0000","last_peered":"2024-08-09T00:37:37.840460+0000","last_clean":"2024-08-09T00:37:37.840460+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:37:37.840460+0000","last_undegraded":"2024-08-09T00:37:37.840460+0000","last_fullsized":"2024-08-09T00:37:37.840460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.545277+0000","last_change":"2024-08-08T23:28:28.771236+0000","last_active":"2024-08-09T00:39:58.545277+0000","last_peered":"2024-08-09T00:39:58.545277+0000","last_clean":"2024-08-09T00:39:58.545277+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:39:58.545277+0000","last_undegraded":"2024-08-09T00:39:58.545277+0000","last_fullsized":"2024-08-09T00:39:58.545277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":792,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'338","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.855571+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:39:58.855571+0000","last_peered":"2024-08-09T00:39:58.855571+0000","last_clean":"2024-08-09T00:39:58.855571+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:39:58.855571+0000","last_undegraded":"2024-08-09T00:39:58.855571+0000","last_fullsized":"2024-08-09T00:39:58.855571+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:47.586741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30329,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":500,"num_read_kb":654,"num_write":264,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660385+0000","last_change":"2024-08-08T23:28:32.805174+0000","last_active":"2024-08-09T00:37:17.660385+0000","last_peered":"2024-08-09T00:37:17.660385+0000","last_clean":"2024-08-09T00:37:17.660385+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:37:17.660385+0000","last_undegraded":"2024-08-09T00:37:17.660385+0000","last_fullsized":"2024-08-09T00:37:17.660385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:59.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.746561+0000","last_change":"2024-08-08T23:28:34.830149+0000","last_active":"2024-08-09T00:38:37.746561+0000","last_peered":"2024-08-09T00:38:37.746561+0000","last_clean":"2024-08-09T00:38:37.746561+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:38:37.746561+0000","last_undegraded":"2024-08-09T00:38:37.746561+0000","last_fullsized":"2024-08-09T00:38:37.746561+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:14.678670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'138","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.814333+0000","last_change":"2024-08-08T23:28:34.836373+0000","last_active":"2024-08-09T00:39:52.814333+0000","last_peered":"2024-08-09T00:39:52.814333+0000","last_clean":"2024-08-09T00:39:52.814333+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:39:52.814333+0000","last_undegraded":"2024-08-09T00:39:52.814333+0000","last_fullsized":"2024-08-09T00:39:52.814333+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:53:20.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817769+0000","last_change":"2024-08-08T23:28:26.776818+0000","last_active":"2024-08-09T00:36:07.817769+0000","last_peered":"2024-08-09T00:36:07.817769+0000","last_clean":"2024-08-09T00:36:07.817769+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:36:07.817769+0000","last_undegraded":"2024-08-09T00:36:07.817769+0000","last_fullsized":"2024-08-09T00:36:07.817769+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:01.090667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'217","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821151+0000","last_change":"2024-08-08T23:28:24.798893+0000","last_active":"2024-08-09T00:36:22.821151+0000","last_peered":"2024-08-09T00:36:22.821151+0000","last_clean":"2024-08-09T00:36:22.821151+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:36:22.821151+0000","last_undegraded":"2024-08-09T00:36:22.821151+0000","last_fullsized":"2024-08-09T00:36:22.821151+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:08:59.221674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812819,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":23484,"num_write":1158,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831284+0000","last_change":"2024-08-08T23:28:28.765882+0000","last_active":"2024-08-09T00:36:12.831284+0000","last_peered":"2024-08-09T00:36:12.831284+0000","last_clean":"2024-08-09T00:36:12.831284+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:36:12.831284+0000","last_undegraded":"2024-08-09T00:36:12.831284+0000","last_fullsized":"2024-08-09T00:36:12.831284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:59.984218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'161","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.487776+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:39:11.487776+0000","last_peered":"2024-08-09T00:39:11.487776+0000","last_clean":"2024-08-09T00:39:11.487776+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:39:11.487776+0000","last_undegraded":"2024-08-09T00:39:11.487776+0000","last_fullsized":"2024-08-09T00:39:11.487776+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:39:49.869700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8633,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":250,"num_write":112,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645239+0000","last_change":"2024-08-08T23:28:32.810146+0000","last_active":"2024-08-09T00:36:12.645239+0000","last_peered":"2024-08-09T00:36:12.645239+0000","last_clean":"2024-08-09T00:36:12.645239+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:36:12.645239+0000","last_undegraded":"2024-08-09T00:36:12.645239+0000","last_fullsized":"2024-08-09T00:36:12.645239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:08.379082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654865+0000","last_change":"2024-08-08T23:28:34.828599+0000","last_active":"2024-08-09T00:36:52.654865+0000","last_peered":"2024-08-09T00:36:52.654865+0000","last_clean":"2024-08-09T00:36:52.654865+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:36:52.654865+0000","last_undegraded":"2024-08-09T00:36:52.654865+0000","last_fullsized":"2024-08-09T00:36:52.654865+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:45.153446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830175+0000","last_change":"2024-08-08T23:28:26.775873+0000","last_active":"2024-08-09T00:36:07.830175+0000","last_peered":"2024-08-09T00:36:07.830175+0000","last_clean":"2024-08-09T00:36:07.830175+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:36:07.830175+0000","last_undegraded":"2024-08-09T00:36:07.830175+0000","last_fullsized":"2024-08-09T00:36:07.830175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:52:27.431250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'181","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:26.590093+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:37:26.590093+0000","last_peered":"2024-08-09T00:37:26.590093+0000","last_clean":"2024-08-09T00:37:26.590093+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:37:26.590093+0000","last_undegraded":"2024-08-09T00:37:26.590093+0000","last_fullsized":"2024-08-09T00:37:26.590093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:56:26.350323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4882691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":377,"num_read_kb":16787,"num_write":981,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645488+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:36:12.645488+0000","last_peered":"2024-08-09T00:36:12.645488+0000","last_clean":"2024-08-09T00:36:12.645488+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:36:12.645488+0000","last_undegraded":"2024-08-09T00:36:12.645488+0000","last_fullsized":"2024-08-09T00:36:12.645488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:21.712748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'54","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.811769+0000","last_change":"2024-08-08T23:28:30.783385+0000","last_active":"2024-08-09T00:39:08.811769+0000","last_peered":"2024-08-09T00:39:08.811769+0000","last_clean":"2024-08-09T00:39:08.811769+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:39:08.811769+0000","last_undegraded":"2024-08-09T00:39:08.811769+0000","last_fullsized":"2024-08-09T00:39:08.811769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:25.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846097+0000","last_change":"2024-08-08T23:28:32.810977+0000","last_active":"2024-08-09T00:36:12.846097+0000","last_peered":"2024-08-09T00:36:12.846097+0000","last_clean":"2024-08-09T00:36:12.846097+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:36:12.846097+0000","last_undegraded":"2024-08-09T00:36:12.846097+0000","last_fullsized":"2024-08-09T00:36:12.846097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:46:30.450790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'187","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.463217+0000","last_change":"2024-08-08T23:28:34.841150+0000","last_active":"2024-08-09T00:39:52.463217+0000","last_peered":"2024-08-09T00:39:52.463217+0000","last_clean":"2024-08-09T00:39:52.463217+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:39:52.463217+0000","last_undegraded":"2024-08-09T00:39:52.463217+0000","last_fullsized":"2024-08-09T00:39:52.463217+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:15.845980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644070+0000","last_change":"2024-08-08T23:28:26.776192+0000","last_active":"2024-08-09T00:36:07.644070+0000","last_peered":"2024-08-09T00:36:07.644070+0000","last_clean":"2024-08-09T00:36:07.644070+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:36:07.644070+0000","last_undegraded":"2024-08-09T00:36:07.644070+0000","last_fullsized":"2024-08-09T00:36:07.644070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:40:01.464080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'197","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.726169+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:38:02.726169+0000","last_peered":"2024-08-09T00:38:02.726169+0000","last_clean":"2024-08-09T00:38:02.726169+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:38:02.726169+0000","last_undegraded":"2024-08-09T00:38:02.726169+0000","last_fullsized":"2024-08-09T00:38:02.726169+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:13.784247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13765036,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":9686,"num_write":1118,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846034+0000","last_change":"2024-08-08T23:28:28.781246+0000","last_active":"2024-08-09T00:36:12.846034+0000","last_peered":"2024-08-09T00:36:12.846034+0000","last_clean":"2024-08-09T00:36:12.846034+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:36:12.846034+0000","last_undegraded":"2024-08-09T00:36:12.846034+0000","last_fullsized":"2024-08-09T00:36:12.846034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:01.140883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'196","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.316317+0000","last_change":"2024-08-08T23:28:30.796061+0000","last_active":"2024-08-09T00:39:11.316317+0000","last_peered":"2024-08-09T00:39:11.316317+0000","last_clean":"2024-08-09T00:39:11.316317+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:39:11.316317+0000","last_undegraded":"2024-08-09T00:39:11.316317+0000","last_fullsized":"2024-08-09T00:39:11.316317+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:56:58.690952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":340,"num_write":154,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819418+0000","last_change":"2024-08-08T23:28:32.828831+0000","last_active":"2024-08-09T00:36:12.819418+0000","last_peered":"2024-08-09T00:36:12.819418+0000","last_clean":"2024-08-09T00:36:12.819418+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:36:12.819418+0000","last_undegraded":"2024-08-09T00:36:12.819418+0000","last_fullsized":"2024-08-09T00:36:12.819418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:56:10.147406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'114","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:50.542493+0000","last_change":"2024-08-08T23:28:34.830478+0000","last_active":"2024-08-09T00:39:50.542493+0000","last_peered":"2024-08-09T00:39:50.542493+0000","last_clean":"2024-08-09T00:39:50.542493+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:39:50.542493+0000","last_undegraded":"2024-08-09T00:39:50.542493+0000","last_fullsized":"2024-08-09T00:39:50.542493+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:39.468849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644019+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:36:07.644019+0000","last_peered":"2024-08-09T00:36:07.644019+0000","last_clean":"2024-08-09T00:36:07.644019+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:36:07.644019+0000","last_undegraded":"2024-08-09T00:36:07.644019+0000","last_fullsized":"2024-08-09T00:36:07.644019+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:02:52.706658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'162","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815902+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:36:07.815902+0000","last_peered":"2024-08-09T00:36:07.815902+0000","last_clean":"2024-08-09T00:36:07.815902+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:36:07.815902+0000","last_undegraded":"2024-08-09T00:36:07.815902+0000","last_fullsized":"2024-08-09T00:36:07.815902+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:24.065006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":312,"num_read_kb":1399,"num_write":876,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819359+0000","last_change":"2024-08-08T23:28:28.781772+0000","last_active":"2024-08-09T00:36:12.819359+0000","last_peered":"2024-08-09T00:36:12.819359+0000","last_clean":"2024-08-09T00:36:12.819359+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:36:12.819359+0000","last_undegraded":"2024-08-09T00:36:12.819359+0000","last_fullsized":"2024-08-09T00:36:12.819359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:15:35.500922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'133","reported_seq":714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.858047+0000","last_change":"2024-08-08T23:28:30.780651+0000","last_active":"2024-08-09T00:39:09.858047+0000","last_peered":"2024-08-09T00:39:09.858047+0000","last_clean":"2024-08-09T00:39:09.858047+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:39:09.858047+0000","last_undegraded":"2024-08-09T00:39:09.858047+0000","last_fullsized":"2024-08-09T00:39:09.858047+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:26.754888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":224,"num_write":92,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816952+0000","last_change":"2024-08-08T23:28:32.826903+0000","last_active":"2024-08-09T00:36:12.816952+0000","last_peered":"2024-08-09T00:36:12.816952+0000","last_clean":"2024-08-09T00:36:12.816952+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:36:12.816952+0000","last_undegraded":"2024-08-09T00:36:12.816952+0000","last_fullsized":"2024-08-09T00:36:12.816952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:15.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:11.641070+0000","last_change":"2024-08-08T23:28:26.774602+0000","last_active":"2024-08-09T00:38:11.641070+0000","last_peered":"2024-08-09T00:38:11.641070+0000","last_clean":"2024-08-09T00:38:11.641070+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:38:11.641070+0000","last_undegraded":"2024-08-09T00:38:11.641070+0000","last_fullsized":"2024-08-09T00:38:11.641070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:48.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'155","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:44.302908+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:37:44.302908+0000","last_peered":"2024-08-09T00:37:44.302908+0000","last_clean":"2024-08-09T00:37:44.302908+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:37:44.302908+0000","last_undegraded":"2024-08-09T00:37:44.302908+0000","last_fullsized":"2024-08-09T00:37:44.302908+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:46:45.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789162,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":18716,"num_write":867,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824970+0000","last_change":"2024-08-08T23:28:28.783884+0000","last_active":"2024-08-09T00:36:47.824970+0000","last_peered":"2024-08-09T00:36:47.824970+0000","last_clean":"2024-08-09T00:36:47.824970+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:36:47.824970+0000","last_undegraded":"2024-08-09T00:36:47.824970+0000","last_fullsized":"2024-08-09T00:36:47.824970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:35.459983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'214","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.908143+0000","last_change":"2024-08-08T23:28:30.780333+0000","last_active":"2024-08-09T00:39:58.908143+0000","last_peered":"2024-08-09T00:39:58.908143+0000","last_clean":"2024-08-09T00:39:58.908143+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:39:58.908143+0000","last_undegraded":"2024-08-09T00:39:58.908143+0000","last_fullsized":"2024-08-09T00:39:58.908143+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:34.051721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":471,"num_write":214,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046320+0000","last_change":"2024-08-08T23:28:32.819377+0000","last_active":"2024-08-09T00:36:03.046320+0000","last_peered":"2024-08-09T00:36:03.046320+0000","last_clean":"2024-08-09T00:36:03.046320+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:36:03.046320+0000","last_undegraded":"2024-08-09T00:36:03.046320+0000","last_fullsized":"2024-08-09T00:36:03.046320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:12.118204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'163","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.920905+0000","last_change":"2024-08-08T23:28:34.830516+0000","last_active":"2024-08-09T00:36:25.920905+0000","last_peered":"2024-08-09T00:36:25.920905+0000","last_clean":"2024-08-09T00:36:25.920905+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:36:25.920905+0000","last_undegraded":"2024-08-09T00:36:25.920905+0000","last_fullsized":"2024-08-09T00:36:25.920905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:35:24.816908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.297627+0000","last_change":"2024-08-08T23:28:26.777062+0000","last_active":"2024-08-09T00:37:55.297627+0000","last_peered":"2024-08-09T00:37:55.297627+0000","last_clean":"2024-08-09T00:37:55.297627+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:37:55.297627+0000","last_undegraded":"2024-08-09T00:37:55.297627+0000","last_fullsized":"2024-08-09T00:37:55.297627+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:50.644245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'279","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.823854+0000","last_change":"2024-08-08T23:29:01.888808+0000","last_active":"2024-08-09T00:36:57.823854+0000","last_peered":"2024-08-09T00:36:57.823854+0000","last_clean":"2024-08-09T00:36:57.823854+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:36:57.823854+0000","last_undegraded":"2024-08-09T00:36:57.823854+0000","last_fullsized":"2024-08-09T00:36:57.823854+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:10.690056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9708426,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":766,"num_read_kb":69125,"num_write":1342,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835144+0000","last_change":"2024-08-08T23:28:28.781761+0000","last_active":"2024-08-09T00:37:17.835144+0000","last_peered":"2024-08-09T00:37:17.835144+0000","last_clean":"2024-08-09T00:37:17.835144+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:37:17.835144+0000","last_undegraded":"2024-08-09T00:37:17.835144+0000","last_fullsized":"2024-08-09T00:37:17.835144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:51:42.627370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'194","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.988259+0000","last_change":"2024-08-08T23:28:30.775644+0000","last_active":"2024-08-09T00:39:10.988259+0000","last_peered":"2024-08-09T00:39:10.988259+0000","last_clean":"2024-08-09T00:39:10.988259+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:39:10.988259+0000","last_undegraded":"2024-08-09T00:39:10.988259+0000","last_fullsized":"2024-08-09T00:39:10.988259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:29:40.576029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6139,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":298,"num_write":166,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828941+0000","last_change":"2024-08-08T23:28:32.809931+0000","last_active":"2024-08-09T00:36:02.828941+0000","last_peered":"2024-08-09T00:36:02.828941+0000","last_clean":"2024-08-09T00:36:02.828941+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:36:02.828941+0000","last_undegraded":"2024-08-09T00:36:02.828941+0000","last_fullsized":"2024-08-09T00:36:02.828941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:04:26.809257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'178","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.059858+0000","last_change":"2024-08-08T23:28:34.836352+0000","last_active":"2024-08-09T00:39:48.059858+0000","last_peered":"2024-08-09T00:39:48.059858+0000","last_clean":"2024-08-09T00:39:48.059858+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:39:48.059858+0000","last_undegraded":"2024-08-09T00:39:48.059858+0000","last_fullsized":"2024-08-09T00:39:48.059858+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:31:46.433299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641569+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:35:57.641569+0000","last_peered":"2024-08-09T00:35:57.641569+0000","last_clean":"2024-08-09T00:35:57.641569+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:35:57.641569+0000","last_undegraded":"2024-08-09T00:35:57.641569+0000","last_fullsized":"2024-08-09T00:35:57.641569+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:31.478254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'206","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839680+0000","last_change":"2024-08-08T23:30:01.782029+0000","last_active":"2024-08-09T00:37:32.839680+0000","last_peered":"2024-08-09T00:37:32.839680+0000","last_clean":"2024-08-09T00:37:32.839680+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:37:32.839680+0000","last_undegraded":"2024-08-09T00:37:32.839680+0000","last_fullsized":"2024-08-09T00:37:32.839680+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.293628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486326,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":437,"num_read_kb":59906,"num_write":1085,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816465+0000","last_change":"2024-08-08T23:28:28.778478+0000","last_active":"2024-08-09T00:36:02.816465+0000","last_peered":"2024-08-09T00:36:02.816465+0000","last_clean":"2024-08-09T00:36:02.816465+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:36:02.816465+0000","last_undegraded":"2024-08-09T00:36:02.816465+0000","last_fullsized":"2024-08-09T00:36:02.816465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:25.183992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'165","reported_seq":776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.689420+0000","last_change":"2024-08-08T23:28:31.043004+0000","last_active":"2024-08-09T00:39:22.689420+0000","last_peered":"2024-08-09T00:39:22.689420+0000","last_clean":"2024-08-09T00:39:22.689420+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:39:22.689420+0000","last_undegraded":"2024-08-09T00:39:22.689420+0000","last_fullsized":"2024-08-09T00:39:22.689420+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:24:09.108955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11404,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":276,"num_write":120,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.838957+0000","last_change":"2024-08-08T23:28:32.802329+0000","last_active":"2024-08-09T00:36:47.838957+0000","last_peered":"2024-08-09T00:36:47.838957+0000","last_clean":"2024-08-09T00:36:47.838957+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:36:47.838957+0000","last_undegraded":"2024-08-09T00:36:47.838957+0000","last_fullsized":"2024-08-09T00:36:47.838957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:08.553685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'166","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.919419+0000","last_change":"2024-08-08T23:28:34.830880+0000","last_active":"2024-08-09T00:39:58.919419+0000","last_peered":"2024-08-09T00:39:58.919419+0000","last_clean":"2024-08-09T00:39:58.919419+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:39:58.919419+0000","last_undegraded":"2024-08-09T00:39:58.919419+0000","last_fullsized":"2024-08-09T00:39:58.919419+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:41:57.656951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.821534+0000","last_change":"2024-08-08T23:28:26.769723+0000","last_active":"2024-08-09T00:35:57.821534+0000","last_peered":"2024-08-09T00:35:57.821534+0000","last_clean":"2024-08-09T00:35:57.821534+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:35:57.821534+0000","last_undegraded":"2024-08-09T00:35:57.821534+0000","last_fullsized":"2024-08-09T00:35:57.821534+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:50:45.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'171","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813081+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:35:57.813081+0000","last_peered":"2024-08-09T00:35:57.813081+0000","last_clean":"2024-08-09T00:35:57.813081+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:35:57.813081+0000","last_undegraded":"2024-08-09T00:35:57.813081+0000","last_fullsized":"2024-08-09T00:35:57.813081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:17.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":4608,"num_write":1007,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828975+0000","last_change":"2024-08-08T23:28:28.776616+0000","last_active":"2024-08-09T00:36:02.828975+0000","last_peered":"2024-08-09T00:36:02.828975+0000","last_clean":"2024-08-09T00:36:02.828975+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:36:02.828975+0000","last_undegraded":"2024-08-09T00:36:02.828975+0000","last_fullsized":"2024-08-09T00:36:02.828975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:14:52.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'118","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.457751+0000","last_change":"2024-08-08T23:28:31.044012+0000","last_active":"2024-08-09T00:39:11.457751+0000","last_peered":"2024-08-09T00:39:11.457751+0000","last_clean":"2024-08-09T00:39:11.457751+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:39:11.457751+0000","last_undegraded":"2024-08-09T00:39:11.457751+0000","last_fullsized":"2024-08-09T00:39:11.457751+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:11.270743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'497","reported_seq":2372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.948213+0000","last_change":"2024-08-08T23:28:32.818008+0000","last_active":"2024-08-09T00:39:58.948213+0000","last_peered":"2024-08-09T00:39:58.948213+0000","last_clean":"2024-08-09T00:39:58.948213+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:39:58.948213+0000","last_undegraded":"2024-08-09T00:39:58.948213+0000","last_fullsized":"2024-08-09T00:39:58.948213+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:38.571079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.807216+0000","last_change":"2024-08-08T23:28:34.827314+0000","last_active":"2024-08-09T00:39:53.807216+0000","last_peered":"2024-08-09T00:39:53.807216+0000","last_clean":"2024-08-09T00:39:53.807216+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:39:53.807216+0000","last_undegraded":"2024-08-09T00:39:53.807216+0000","last_fullsized":"2024-08-09T00:39:53.807216+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:05.794292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:00.392022+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:37:00.392022+0000","last_peered":"2024-08-09T00:37:00.392022+0000","last_clean":"2024-08-09T00:37:00.392022+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:37:00.392022+0000","last_undegraded":"2024-08-09T00:37:00.392022+0000","last_fullsized":"2024-08-09T00:37:00.392022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:35.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'190","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:36.917105+0000","last_change":"2024-08-08T23:28:24.820992+0000","last_active":"2024-08-09T00:36:36.917105+0000","last_peered":"2024-08-09T00:36:36.917105+0000","last_clean":"2024-08-09T00:36:36.917105+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:36:36.917105+0000","last_undegraded":"2024-08-09T00:36:36.917105+0000","last_fullsized":"2024-08-09T00:36:36.917105+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:54.019037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9145639,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":50563,"num_write":1095,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843379+0000","last_change":"2024-08-08T23:28:28.790145+0000","last_active":"2024-08-09T00:36:02.843379+0000","last_peered":"2024-08-09T00:36:02.843379+0000","last_clean":"2024-08-09T00:36:02.843379+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:36:02.843379+0000","last_undegraded":"2024-08-09T00:36:02.843379+0000","last_fullsized":"2024-08-09T00:36:02.843379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:10.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'239","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.521474+0000","last_change":"2024-08-08T23:28:30.776086+0000","last_active":"2024-08-09T00:39:11.521474+0000","last_peered":"2024-08-09T00:39:11.521474+0000","last_clean":"2024-08-09T00:39:11.521474+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:39:11.521474+0000","last_undegraded":"2024-08-09T00:39:11.521474+0000","last_fullsized":"2024-08-09T00:39:11.521474+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:38.136653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18007,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":316,"num_read_kb":411,"num_write":196,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816883+0000","last_change":"2024-08-08T23:28:32.820762+0000","last_active":"2024-08-09T00:36:12.816883+0000","last_peered":"2024-08-09T00:36:12.816883+0000","last_clean":"2024-08-09T00:36:12.816883+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:36:12.816883+0000","last_undegraded":"2024-08-09T00:36:12.816883+0000","last_fullsized":"2024-08-09T00:36:12.816883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:28:00.396123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'118","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.831243+0000","last_change":"2024-08-08T23:28:34.840657+0000","last_active":"2024-08-09T00:39:51.831243+0000","last_peered":"2024-08-09T00:39:51.831243+0000","last_clean":"2024-08-09T00:39:51.831243+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:39:51.831243+0000","last_undegraded":"2024-08-09T00:39:51.831243+0000","last_fullsized":"2024-08-09T00:39:51.831243+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:16.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.121529+0000","last_change":"2024-08-08T23:28:26.750931+0000","last_active":"2024-08-09T00:39:54.121529+0000","last_peered":"2024-08-09T00:39:54.121529+0000","last_clean":"2024-08-09T00:39:54.121529+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:39:54.121529+0000","last_undegraded":"2024-08-09T00:39:54.121529+0000","last_fullsized":"2024-08-09T00:39:54.121529+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:28:50.333511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'196","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045277+0000","last_change":"2024-08-08T23:28:24.818191+0000","last_active":"2024-08-09T00:35:58.045277+0000","last_peered":"2024-08-09T00:35:58.045277+0000","last_clean":"2024-08-09T00:35:58.045277+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:35:58.045277+0000","last_undegraded":"2024-08-09T00:35:58.045277+0000","last_fullsized":"2024-08-09T00:35:58.045277+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:42.912960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2993812,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":62745,"num_write":1018,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046264+0000","last_change":"2024-08-08T23:28:28.776983+0000","last_active":"2024-08-09T00:36:03.046264+0000","last_peered":"2024-08-09T00:36:03.046264+0000","last_clean":"2024-08-09T00:36:03.046264+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:36:03.046264+0000","last_undegraded":"2024-08-09T00:36:03.046264+0000","last_fullsized":"2024-08-09T00:36:03.046264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:16.950419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'142","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.473257+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:39:08.473257+0000","last_peered":"2024-08-09T00:39:08.473257+0000","last_clean":"2024-08-09T00:39:08.473257+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:39:08.473257+0000","last_undegraded":"2024-08-09T00:39:08.473257+0000","last_fullsized":"2024-08-09T00:39:08.473257+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:37:42.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":253,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821824+0000","last_change":"2024-08-08T23:28:32.813742+0000","last_active":"2024-08-09T00:36:22.821824+0000","last_peered":"2024-08-09T00:36:22.821824+0000","last_clean":"2024-08-09T00:36:22.821824+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:36:22.821824+0000","last_undegraded":"2024-08-09T00:36:22.821824+0000","last_fullsized":"2024-08-09T00:36:22.821824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:08.279720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.679892+0000","last_change":"2024-08-08T23:28:34.830000+0000","last_active":"2024-08-09T00:38:42.679892+0000","last_peered":"2024-08-09T00:38:42.679892+0000","last_clean":"2024-08-09T00:38:42.679892+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:38:42.679892+0000","last_undegraded":"2024-08-09T00:38:42.679892+0000","last_fullsized":"2024-08-09T00:38:42.679892+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:25.028910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.647917+0000","last_change":"2024-08-08T23:28:26.762374+0000","last_active":"2024-08-09T00:36:22.647917+0000","last_peered":"2024-08-09T00:36:22.647917+0000","last_clean":"2024-08-09T00:36:22.647917+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:36:22.647917+0000","last_undegraded":"2024-08-09T00:36:22.647917+0000","last_fullsized":"2024-08-09T00:36:22.647917+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:04:01.695211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'260","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.832311+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:39:28.832311+0000","last_peered":"2024-08-09T00:39:28.832311+0000","last_clean":"2024-08-09T00:39:28.832311+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:39:28.832311+0000","last_undegraded":"2024-08-09T00:39:28.832311+0000","last_fullsized":"2024-08-09T00:39:28.832311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:58:00.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14282888,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":663,"num_read_kb":32625,"num_write":1553,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818766+0000","last_change":"2024-08-08T23:28:28.778212+0000","last_active":"2024-08-09T00:36:12.818766+0000","last_peered":"2024-08-09T00:36:12.818766+0000","last_clean":"2024-08-09T00:36:12.818766+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:36:12.818766+0000","last_undegraded":"2024-08-09T00:36:12.818766+0000","last_fullsized":"2024-08-09T00:36:12.818766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:32:33.405064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'120","reported_seq":701,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.370669+0000","last_change":"2024-08-08T23:28:30.796071+0000","last_active":"2024-08-09T00:39:09.370669+0000","last_peered":"2024-08-09T00:39:09.370669+0000","last_clean":"2024-08-09T00:39:09.370669+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:39:09.370669+0000","last_undegraded":"2024-08-09T00:39:09.370669+0000","last_fullsized":"2024-08-09T00:39:09.370669+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:29.366191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":202,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816384+0000","last_change":"2024-08-08T23:28:32.812326+0000","last_active":"2024-08-09T00:36:02.816384+0000","last_peered":"2024-08-09T00:36:02.816384+0000","last_clean":"2024-08-09T00:36:02.816384+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:36:02.816384+0000","last_undegraded":"2024-08-09T00:36:02.816384+0000","last_fullsized":"2024-08-09T00:36:02.816384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.507723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'144","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.001008+0000","last_change":"2024-08-08T23:28:34.835991+0000","last_active":"2024-08-09T00:39:48.001008+0000","last_peered":"2024-08-09T00:39:48.001008+0000","last_clean":"2024-08-09T00:39:48.001008+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:39:48.001008+0000","last_undegraded":"2024-08-09T00:39:48.001008+0000","last_fullsized":"2024-08-09T00:39:48.001008+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:43:41.405272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:46.216752+0000","last_change":"2024-08-08T23:28:26.781125+0000","last_active":"2024-08-09T00:37:46.216752+0000","last_peered":"2024-08-09T00:37:46.216752+0000","last_clean":"2024-08-09T00:37:46.216752+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:37:46.216752+0000","last_undegraded":"2024-08-09T00:37:46.216752+0000","last_fullsized":"2024-08-09T00:37:46.216752+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:49.822476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'156","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.247514+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:39:28.247514+0000","last_peered":"2024-08-09T00:39:28.247514+0000","last_clean":"2024-08-09T00:39:28.247514+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:39:28.247514+0000","last_undegraded":"2024-08-09T00:39:28.247514+0000","last_fullsized":"2024-08-09T00:39:28.247514+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:35.389417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6396645,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":16350,"num_write":844,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.834834+0000","last_change":"2024-08-08T23:28:28.765925+0000","last_active":"2024-08-09T00:36:27.834834+0000","last_peered":"2024-08-09T00:36:27.834834+0000","last_clean":"2024-08-09T00:36:27.834834+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:36:27.834834+0000","last_undegraded":"2024-08-09T00:36:27.834834+0000","last_fullsized":"2024-08-09T00:36:27.834834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:35.033143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'191","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.898713+0000","last_change":"2024-08-08T23:28:30.786260+0000","last_active":"2024-08-09T00:39:09.898713+0000","last_peered":"2024-08-09T00:39:09.898713+0000","last_clean":"2024-08-09T00:39:09.898713+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:39:09.898713+0000","last_undegraded":"2024-08-09T00:39:09.898713+0000","last_fullsized":"2024-08-09T00:39:09.898713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:07.104811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15323,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":328,"num_write":148,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814259+0000","last_change":"2024-08-08T23:28:32.820890+0000","last_active":"2024-08-09T00:36:02.814259+0000","last_peered":"2024-08-09T00:36:02.814259+0000","last_clean":"2024-08-09T00:36:02.814259+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:36:02.814259+0000","last_undegraded":"2024-08-09T00:36:02.814259+0000","last_fullsized":"2024-08-09T00:36:02.814259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:53.798935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'141","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823481+0000","last_change":"2024-08-08T23:28:34.832607+0000","last_active":"2024-08-09T00:36:32.823481+0000","last_peered":"2024-08-09T00:36:32.823481+0000","last_clean":"2024-08-09T00:36:32.823481+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:36:32.823481+0000","last_undegraded":"2024-08-09T00:36:32.823481+0000","last_fullsized":"2024-08-09T00:36:32.823481+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:55.224306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'225","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850396+0000","last_change":"2024-08-08T23:28:26.769233+0000","last_active":"2024-08-09T00:37:47.850396+0000","last_peered":"2024-08-09T00:37:47.850396+0000","last_clean":"2024-08-09T00:37:47.850396+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:37:47.850396+0000","last_undegraded":"2024-08-09T00:37:47.850396+0000","last_fullsized":"2024-08-09T00:37:47.850396+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:17:12.484894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.269231+0000","last_change":"2024-08-08T23:28:24.802451+0000","last_active":"2024-08-09T00:38:27.269231+0000","last_peered":"2024-08-09T00:38:27.269231+0000","last_clean":"2024-08-09T00:38:27.269231+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:38:27.269231+0000","last_undegraded":"2024-08-09T00:38:27.269231+0000","last_fullsized":"2024-08-09T00:38:27.269231+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:35.524843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13856288,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":400,"num_read_kb":16979,"num_write":1172,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'147","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048709+0000","last_change":"2024-08-08T23:29:01.584374+0000","last_active":"2024-08-09T00:36:13.048709+0000","last_peered":"2024-08-09T00:36:13.048709+0000","last_clean":"2024-08-09T00:36:13.048709+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:36:13.048709+0000","last_undegraded":"2024-08-09T00:36:13.048709+0000","last_fullsized":"2024-08-09T00:36:13.048709+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:12.686573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'205","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:36.724508+0000","last_change":"2024-08-08T23:28:24.787727+0000","last_active":"2024-08-09T00:38:36.724508+0000","last_peered":"2024-08-09T00:38:36.724508+0000","last_clean":"2024-08-09T00:38:36.724508+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:38:36.724508+0000","last_undegraded":"2024-08-09T00:38:36.724508+0000","last_fullsized":"2024-08-09T00:38:36.724508+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:30.042158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3011599,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":27391,"num_write":1077,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.508050+0000","last_change":"2024-08-08T23:28:26.789544+0000","last_active":"2024-08-09T00:39:52.508050+0000","last_peered":"2024-08-09T00:39:52.508050+0000","last_clean":"2024-08-09T00:39:52.508050+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:39:52.508050+0000","last_undegraded":"2024-08-09T00:39:52.508050+0000","last_fullsized":"2024-08-09T00:39:52.508050+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:52.896837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.996849+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:37:15.996849+0000","last_peered":"2024-08-09T00:37:15.996849+0000","last_clean":"2024-08-09T00:37:15.996849+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:37:15.996849+0000","last_undegraded":"2024-08-09T00:37:15.996849+0000","last_fullsized":"2024-08-09T00:37:15.996849+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:57:25.172421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221596,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":17234,"num_write":1186,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'69","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850284+0000","last_change":"2024-08-08T23:28:26.775062+0000","last_active":"2024-08-09T00:37:47.850284+0000","last_peered":"2024-08-09T00:37:47.850284+0000","last_clean":"2024-08-09T00:37:47.850284+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:37:47.850284+0000","last_undegraded":"2024-08-09T00:37:47.850284+0000","last_fullsized":"2024-08-09T00:37:47.850284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:06.373460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'253","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:30.807161+0000","last_change":"2024-08-08T23:29:01.885397+0000","last_active":"2024-08-09T00:39:30.807161+0000","last_peered":"2024-08-09T00:39:30.807161+0000","last_clean":"2024-08-09T00:39:30.807161+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:39:30.807161+0000","last_undegraded":"2024-08-09T00:39:30.807161+0000","last_fullsized":"2024-08-09T00:39:30.807161+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:40:13.222712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13676806,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":58241,"num_write":1236,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'129","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.958544+0000","last_change":"2024-08-08T23:28:26.776123+0000","last_active":"2024-08-09T00:38:32.958544+0000","last_peered":"2024-08-09T00:38:32.958544+0000","last_clean":"2024-08-09T00:38:32.958544+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:38:32.958544+0000","last_undegraded":"2024-08-09T00:38:32.958544+0000","last_fullsized":"2024-08-09T00:38:32.958544+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:05:18.665033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667208+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:37:47.667208+0000","last_peered":"2024-08-09T00:37:47.667208+0000","last_clean":"2024-08-09T00:37:47.667208+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:37:47.667208+0000","last_undegraded":"2024-08-09T00:37:47.667208+0000","last_fullsized":"2024-08-09T00:37:47.667208+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:48:27.331256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1127696,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":401,"num_read_kb":7859,"num_write":1104,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833217+0000","last_change":"2024-08-08T23:28:26.779441+0000","last_active":"2024-08-09T00:37:12.833217+0000","last_peered":"2024-08-09T00:37:12.833217+0000","last_clean":"2024-08-09T00:37:12.833217+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:37:12.833217+0000","last_undegraded":"2024-08-09T00:37:12.833217+0000","last_fullsized":"2024-08-09T00:37:12.833217+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:29.987307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'234","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.308534+0000","last_change":"2024-08-08T23:28:24.759289+0000","last_active":"2024-08-09T00:39:10.308534+0000","last_peered":"2024-08-09T00:39:10.308534+0000","last_clean":"2024-08-09T00:39:10.308534+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:39:10.308534+0000","last_undegraded":"2024-08-09T00:39:10.308534+0000","last_fullsized":"2024-08-09T00:39:10.308534+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:07.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12876135,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":668,"num_read_kb":20658,"num_write":1113,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:56.569083+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:37:56.569083+0000","last_peered":"2024-08-09T00:37:56.569083+0000","last_clean":"2024-08-09T00:37:56.569083+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:37:56.569083+0000","last_undegraded":"2024-08-09T00:37:56.569083+0000","last_fullsized":"2024-08-09T00:37:56.569083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:23.078114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'193","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.843291+0000","last_change":"2024-08-08T23:28:24.795170+0000","last_active":"2024-08-09T00:37:47.843291+0000","last_peered":"2024-08-09T00:37:47.843291+0000","last_clean":"2024-08-09T00:37:47.843291+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:37:47.843291+0000","last_undegraded":"2024-08-09T00:37:47.843291+0000","last_fullsized":"2024-08-09T00:37:47.843291+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:54:04.809402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12695211,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":357,"num_read_kb":32922,"num_write":1091,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'232","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833591+0000","last_change":"2024-08-08T23:28:26.770453+0000","last_active":"2024-08-09T00:37:12.833591+0000","last_peered":"2024-08-09T00:37:12.833591+0000","last_clean":"2024-08-09T00:37:12.833591+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:37:12.833591+0000","last_undegraded":"2024-08-09T00:37:12.833591+0000","last_fullsized":"2024-08-09T00:37:12.833591+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:19:56.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'248","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831439+0000","last_change":"2024-08-08T23:29:01.888000+0000","last_active":"2024-08-09T00:36:12.831439+0000","last_peered":"2024-08-09T00:36:12.831439+0000","last_clean":"2024-08-09T00:36:12.831439+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:36:12.831439+0000","last_undegraded":"2024-08-09T00:36:12.831439+0000","last_fullsized":"2024-08-09T00:36:12.831439+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:43.322003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7977264,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":854,"num_read_kb":18739,"num_write":1238,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.709916+0000","last_change":"2024-08-08T23:28:26.775305+0000","last_active":"2024-08-09T00:36:13.709916+0000","last_peered":"2024-08-09T00:36:13.709916+0000","last_clean":"2024-08-09T00:36:13.709916+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:36:13.709916+0000","last_undegraded":"2024-08-09T00:36:13.709916+0000","last_fullsized":"2024-08-09T00:36:13.709916+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:15:22.024427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'183","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:03.072739+0000","last_change":"2024-08-08T23:28:24.788596+0000","last_active":"2024-08-09T00:38:03.072739+0000","last_peered":"2024-08-09T00:38:03.072739+0000","last_clean":"2024-08-09T00:38:03.072739+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:38:03.072739+0000","last_undegraded":"2024-08-09T00:38:03.072739+0000","last_fullsized":"2024-08-09T00:38:03.072739+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:22.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11383947,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":34111,"num_write":1039,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'81","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:04.076175+0000","last_change":"2024-08-08T23:28:26.763616+0000","last_active":"2024-08-09T00:38:04.076175+0000","last_peered":"2024-08-09T00:38:04.076175+0000","last_clean":"2024-08-09T00:38:04.076175+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:38:04.076175+0000","last_undegraded":"2024-08-09T00:38:04.076175+0000","last_fullsized":"2024-08-09T00:38:04.076175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:06.979294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'200","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:18.395370+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:38:18.395370+0000","last_peered":"2024-08-09T00:38:18.395370+0000","last_clean":"2024-08-09T00:38:18.395370+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:38:18.395370+0000","last_undegraded":"2024-08-09T00:38:18.395370+0000","last_fullsized":"2024-08-09T00:38:18.395370+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:23.874712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10206260,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":96889,"num_write":1095,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:04.420125+0000","last_change":"2024-08-08T23:28:26.767042+0000","last_active":"2024-08-09T00:37:04.420125+0000","last_peered":"2024-08-09T00:37:04.420125+0000","last_clean":"2024-08-09T00:37:04.420125+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:37:04.420125+0000","last_undegraded":"2024-08-09T00:37:04.420125+0000","last_fullsized":"2024-08-09T00:37:04.420125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:15.401572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'180","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.074959+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:38:13.074959+0000","last_peered":"2024-08-09T00:38:13.074959+0000","last_clean":"2024-08-09T00:38:13.074959+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:38:13.074959+0000","last_undegraded":"2024-08-09T00:38:13.074959+0000","last_fullsized":"2024-08-09T00:38:13.074959+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:35:20.239264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529795,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":71209,"num_write":974,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849790+0000","last_change":"2024-08-08T23:28:26.778789+0000","last_active":"2024-08-09T00:38:12.849790+0000","last_peered":"2024-08-09T00:38:12.849790+0000","last_clean":"2024-08-09T00:38:12.849790+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:38:12.849790+0000","last_undegraded":"2024-08-09T00:38:12.849790+0000","last_fullsized":"2024-08-09T00:38:12.849790+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:39.269574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'168","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843328+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:38:12.843328+0000","last_peered":"2024-08-09T00:38:12.843328+0000","last_clean":"2024-08-09T00:38:12.843328+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:38:12.843328+0000","last_undegraded":"2024-08-09T00:38:12.843328+0000","last_fullsized":"2024-08-09T00:38:12.843328+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:59:20.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13960223,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":327,"num_read_kb":31431,"num_write":988,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.855443+0000","last_change":"2024-08-08T23:28:26.782721+0000","last_active":"2024-08-09T00:39:19.855443+0000","last_peered":"2024-08-09T00:39:19.855443+0000","last_clean":"2024-08-09T00:39:19.855443+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:39:19.855443+0000","last_undegraded":"2024-08-09T00:39:19.855443+0000","last_fullsized":"2024-08-09T00:39:19.855443+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:29:54.581163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'227","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.850152+0000","last_change":"2024-08-08T23:28:24.763154+0000","last_active":"2024-08-09T00:38:12.850152+0000","last_peered":"2024-08-09T00:38:12.850152+0000","last_clean":"2024-08-09T00:38:12.850152+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:38:12.850152+0000","last_undegraded":"2024-08-09T00:38:12.850152+0000","last_fullsized":"2024-08-09T00:38:12.850152+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:09.336390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197764,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":70204,"num_write":1294,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843242+0000","last_change":"2024-08-08T23:28:26.773873+0000","last_active":"2024-08-09T00:38:12.843242+0000","last_peered":"2024-08-09T00:38:12.843242+0000","last_clean":"2024-08-09T00:38:12.843242+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:38:12.843242+0000","last_undegraded":"2024-08-09T00:38:12.843242+0000","last_fullsized":"2024-08-09T00:38:12.843242+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:24:31.308127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'208","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:26.833717+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:36:26.833717+0000","last_peered":"2024-08-09T00:36:26.833717+0000","last_clean":"2024-08-09T00:36:26.833717+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:36:26.833717+0000","last_undegraded":"2024-08-09T00:36:26.833717+0000","last_fullsized":"2024-08-09T00:36:26.833717+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:22.337895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12882300,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":469,"num_read_kb":54938,"num_write":1143,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672406+0000","last_change":"2024-08-08T23:28:26.754194+0000","last_active":"2024-08-09T00:38:12.672406+0000","last_peered":"2024-08-09T00:38:12.672406+0000","last_clean":"2024-08-09T00:38:12.672406+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:38:12.672406+0000","last_undegraded":"2024-08-09T00:38:12.672406+0000","last_fullsized":"2024-08-09T00:38:12.672406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:20.564322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'154","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:39.246999+0000","last_change":"2024-08-08T23:28:24.763602+0000","last_active":"2024-08-09T00:36:39.246999+0000","last_peered":"2024-08-09T00:36:39.246999+0000","last_clean":"2024-08-09T00:36:39.246999+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:36:39.246999+0000","last_undegraded":"2024-08-09T00:36:39.246999+0000","last_fullsized":"2024-08-09T00:36:39.246999+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:31.123341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564764,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":411,"num_read_kb":19124,"num_write":932,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870130+0000","last_change":"2024-08-08T23:28:26.782907+0000","last_active":"2024-08-09T00:37:57.870130+0000","last_peered":"2024-08-09T00:37:57.870130+0000","last_clean":"2024-08-09T00:37:57.870130+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:37:57.870130+0000","last_undegraded":"2024-08-09T00:37:57.870130+0000","last_fullsized":"2024-08-09T00:37:57.870130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:55.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'227","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047591+0000","last_change":"2024-08-08T23:28:24.815220+0000","last_active":"2024-08-09T00:36:08.047591+0000","last_peered":"2024-08-09T00:36:08.047591+0000","last_clean":"2024-08-09T00:36:08.047591+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:36:08.047591+0000","last_undegraded":"2024-08-09T00:36:08.047591+0000","last_fullsized":"2024-08-09T00:36:08.047591+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:31.780990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15599336,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":526,"num_read_kb":89533,"num_write":1163,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.012893+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:37:03.012893+0000","last_peered":"2024-08-09T00:37:03.012893+0000","last_clean":"2024-08-09T00:37:03.012893+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:37:03.012893+0000","last_undegraded":"2024-08-09T00:37:03.012893+0000","last_fullsized":"2024-08-09T00:37:03.012893+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:25.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15688548,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":157320,"num_write":1028,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819437+0000","last_change":"2024-08-08T23:28:26.766116+0000","last_active":"2024-08-09T00:36:22.819437+0000","last_peered":"2024-08-09T00:36:22.819437+0000","last_clean":"2024-08-09T00:36:22.819437+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:36:22.819437+0000","last_undegraded":"2024-08-09T00:36:22.819437+0000","last_fullsized":"2024-08-09T00:36:22.819437+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:53:40.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'181","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.684500+0000","last_change":"2024-08-08T23:28:24.777397+0000","last_active":"2024-08-09T00:38:22.684500+0000","last_peered":"2024-08-09T00:38:22.684500+0000","last_clean":"2024-08-09T00:38:22.684500+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:38:22.684500+0000","last_undegraded":"2024-08-09T00:38:22.684500+0000","last_fullsized":"2024-08-09T00:38:22.684500+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:46.812342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4167544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":488,"num_read_kb":17056,"num_write":1038,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:21.953586+0000","last_change":"2024-08-08T23:28:26.790814+0000","last_active":"2024-08-09T00:37:21.953586+0000","last_peered":"2024-08-09T00:37:21.953586+0000","last_clean":"2024-08-09T00:37:21.953586+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:37:21.953586+0000","last_undegraded":"2024-08-09T00:37:21.953586+0000","last_fullsized":"2024-08-09T00:37:21.953586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:39:18.226934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1052,"ondisk_log_size":1052,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1764,"ondisk_log_size":1764,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":569,"ondisk_log_size":569,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":425460,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9554,"num_read_kb":11556,"num_write":6725,"num_write_kb":2855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":737280,"data_stored":228824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1603,"num_read_kb":1909,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3446,"ondisk_log_size":3446,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":486920049,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":32037,"num_read_kb":2279949,"num_write":69215,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":733556736,"data_stored":733556736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4350,"ondisk_log_size":4350,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":194734,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":137,"num_read_kb":183422,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575722,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336972,"kb_used_data":129476,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94034868,"statfs":{"total":96636764160,"available":96291704832,"internally_reserved":0,"allocated":132583424,"data_stored":130375216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575720,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":137188,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":140480512,"data_stored":138341905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575721,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199664,"kb_used_data":110248,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94172176,"statfs":{"total":96636764160,"available":96432308224,"internally_reserved":0,"allocated":112893952,"data_stored":110669074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575720,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218668,"kb_used_data":129188,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94153172,"statfs":{"total":96636764160,"available":96412848128,"internally_reserved":0,"allocated":132288512,"data_stored":130226726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575719,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326016,"kb_used_data":114360,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94045824,"statfs":{"total":96636764160,"available":96302923776,"internally_reserved":0,"allocated":117104640,"data_stored":114919562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575720,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214704,"kb_used_data":133608,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94157136,"statfs":{"total":96636764160,"available":96416907264,"internally_reserved":0,"allocated":136814592,"data_stored":134711966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575723,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284944,"kb_used_data":163592,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94086896,"statfs":{"total":96636764160,"available":96344981504,"internally_reserved":0,"allocated":167518208,"data_stored":165365008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575720,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378920,"kb_used_data":163104,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":93992920,"statfs":{"total":96636764160,"available":96248750080,"internally_reserved":0,"allocated":167018496,"data_stored":164829157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86249472,"data_stored":86249472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108445696,"data_stored":108445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88334336,"data_stored":88334336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":82051072,"data_stored":82051072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92254208,"data_stored":92254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77799424,"data_stored":77799424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":103501824,"data_stored":103501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94920704,"data_stored":94920704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":26939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":27234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":44499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":47166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":16811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41992192,"data_stored":41991459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27361280,"data_stored":27359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:40:31.126 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:40:31.528 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:31.542 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:40:31.548 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2432,"stamp":"2024-08-09T00:40:31.304723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655923416,"num_objects":964,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":149375,"num_read_kb":2759222,"num_write":129679,"num_write_kb":2369685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13348,"ondisk_log_size":13348,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2375356,"kb_used_data":1080764,"kb_used_omap":12,"kb_used_meta":1294515,"kb_avail":752599364,"statfs":{"total":773094113280,"available":770661748736,"internally_reserved":0,"allocated":1106702336,"data_stored":1089438614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1325583920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009325"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059551+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:37:03.059551+0000","last_peered":"2024-08-09T00:37:03.059551+0000","last_clean":"2024-08-09T00:37:03.059551+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:37:03.059551+0000","last_undegraded":"2024-08-09T00:37:03.059551+0000","last_fullsized":"2024-08-09T00:37:03.059551+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:30:02.130065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048604+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:36:13.048604+0000","last_peered":"2024-08-09T00:36:13.048604+0000","last_clean":"2024-08-09T00:36:13.048604+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:36:13.048604+0000","last_undegraded":"2024-08-09T00:36:13.048604+0000","last_fullsized":"2024-08-09T00:36:13.048604+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:23.793811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644232+0000","last_change":"2024-08-08T23:48:38.082677+0000","last_active":"2024-08-09T00:36:07.644232+0000","last_peered":"2024-08-09T00:36:07.644232+0000","last_clean":"2024-08-09T00:36:07.644232+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:36:07.644232+0000","last_undegraded":"2024-08-09T00:36:07.644232+0000","last_fullsized":"2024-08-09T00:36:07.644232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:45.392917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.826049+0000","last_change":"2024-08-08T23:44:47.428900+0000","last_active":"2024-08-09T00:36:52.826049+0000","last_peered":"2024-08-09T00:36:52.826049+0000","last_clean":"2024-08-09T00:36:52.826049+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:36:52.826049+0000","last_undegraded":"2024-08-09T00:36:52.826049+0000","last_fullsized":"2024-08-09T00:36:52.826049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:21:21.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834206+0000","last_change":"2024-08-09T00:04:29.843428+0000","last_active":"2024-08-09T00:37:02.834206+0000","last_peered":"2024-08-09T00:37:02.834206+0000","last_clean":"2024-08-09T00:37:02.834206+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:37:02.834206+0000","last_undegraded":"2024-08-09T00:37:02.834206+0000","last_fullsized":"2024-08-09T00:37:02.834206+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.089851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818932+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:36:12.818932+0000","last_peered":"2024-08-09T00:36:12.818932+0000","last_clean":"2024-08-09T00:36:12.818932+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:36:12.818932+0000","last_undegraded":"2024-08-09T00:36:12.818932+0000","last_fullsized":"2024-08-09T00:36:12.818932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.411299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9218,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830256+0000","last_change":"2024-08-08T23:48:38.092226+0000","last_active":"2024-08-09T00:36:07.830256+0000","last_peered":"2024-08-09T00:36:07.830256+0000","last_clean":"2024-08-09T00:36:07.830256+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:36:07.830256+0000","last_undegraded":"2024-08-09T00:36:07.830256+0000","last_fullsized":"2024-08-09T00:36:07.830256+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:37.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":18,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":216,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833279+0000","last_change":"2024-08-08T23:44:47.413408+0000","last_active":"2024-08-09T00:36:57.833279+0000","last_peered":"2024-08-09T00:36:57.833279+0000","last_clean":"2024-08-09T00:36:57.833279+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:36:57.833279+0000","last_undegraded":"2024-08-09T00:36:57.833279+0000","last_fullsized":"2024-08-09T00:36:57.833279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:17.443794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815930+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:35:57.815930+0000","last_peered":"2024-08-09T00:35:57.815930+0000","last_clean":"2024-08-09T00:35:57.815930+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:35:57.815930+0000","last_undegraded":"2024-08-09T00:35:57.815930+0000","last_fullsized":"2024-08-09T00:35:57.815930+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:26:55.553956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822731+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:36:37.822731+0000","last_peered":"2024-08-09T00:36:37.822731+0000","last_clean":"2024-08-09T00:36:37.822731+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:36:37.822731+0000","last_undegraded":"2024-08-09T00:36:37.822731+0000","last_fullsized":"2024-08-09T00:36:37.822731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:03:58.706204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":4,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.831734+0000","last_change":"2024-08-08T23:48:38.096960+0000","last_active":"2024-08-09T00:36:47.831734+0000","last_peered":"2024-08-09T00:36:47.831734+0000","last_clean":"2024-08-09T00:36:47.831734+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:36:47.831734+0000","last_undegraded":"2024-08-09T00:36:47.831734+0000","last_fullsized":"2024-08-09T00:36:47.831734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:44:59.425002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831661+0000","last_change":"2024-08-08T23:44:47.415903+0000","last_active":"2024-08-09T00:37:17.831661+0000","last_peered":"2024-08-09T00:37:17.831661+0000","last_clean":"2024-08-09T00:37:17.831661+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:37:17.831661+0000","last_undegraded":"2024-08-09T00:37:17.831661+0000","last_fullsized":"2024-08-09T00:37:17.831661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:31.219458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644103+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:36:07.644103+0000","last_peered":"2024-08-09T00:36:07.644103+0000","last_clean":"2024-08-09T00:36:07.644103+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:36:07.644103+0000","last_undegraded":"2024-08-09T00:36:07.644103+0000","last_fullsized":"2024-08-09T00:36:07.644103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:47.348267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654897+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:36:52.654897+0000","last_peered":"2024-08-09T00:36:52.654897+0000","last_clean":"2024-08-09T00:36:52.654897+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:36:52.654897+0000","last_undegraded":"2024-08-09T00:36:52.654897+0000","last_fullsized":"2024-08-09T00:36:52.654897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:15.853173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823587+0000","last_change":"2024-08-08T23:48:38.064262+0000","last_active":"2024-08-09T00:36:32.823587+0000","last_peered":"2024-08-09T00:36:32.823587+0000","last_clean":"2024-08-09T00:36:32.823587+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:36:32.823587+0000","last_undegraded":"2024-08-09T00:36:32.823587+0000","last_fullsized":"2024-08-09T00:36:32.823587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:08.321374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660513+0000","last_change":"2024-08-08T23:44:47.404876+0000","last_active":"2024-08-09T00:37:17.660513+0000","last_peered":"2024-08-09T00:37:17.660513+0000","last_clean":"2024-08-09T00:37:17.660513+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:37:17.660513+0000","last_undegraded":"2024-08-09T00:37:17.660513+0000","last_fullsized":"2024-08-09T00:37:17.660513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:44.526394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652649+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:36:42.652649+0000","last_peered":"2024-08-09T00:36:42.652649+0000","last_clean":"2024-08-09T00:36:42.652649+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:36:42.652649+0000","last_undegraded":"2024-08-09T00:36:42.652649+0000","last_fullsized":"2024-08-09T00:36:42.652649+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:16:17.115238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061679+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:37:13.061679+0000","last_peered":"2024-08-09T00:37:13.061679+0000","last_clean":"2024-08-09T00:37:13.061679+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:37:13.061679+0000","last_undegraded":"2024-08-09T00:37:13.061679+0000","last_fullsized":"2024-08-09T00:37:13.061679+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:31.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096989,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":17458,"num_write":14,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'5","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.826910+0000","last_change":"2024-08-08T23:48:38.059017+0000","last_active":"2024-08-09T00:36:57.826910+0000","last_peered":"2024-08-09T00:36:57.826910+0000","last_clean":"2024-08-09T00:36:57.826910+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:36:57.826910+0000","last_undegraded":"2024-08-09T00:36:57.826910+0000","last_fullsized":"2024-08-09T00:36:57.826910+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:57.310351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660430+0000","last_change":"2024-08-08T23:44:47.424336+0000","last_active":"2024-08-09T00:37:17.660430+0000","last_peered":"2024-08-09T00:37:17.660430+0000","last_clean":"2024-08-09T00:37:17.660430+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:37:17.660430+0000","last_undegraded":"2024-08-09T00:37:17.660430+0000","last_fullsized":"2024-08-09T00:37:17.660430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:30:34.660972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.851421+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:37:52.851421+0000","last_peered":"2024-08-09T00:37:52.851421+0000","last_clean":"2024-08-09T00:37:52.851421+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:37:52.851421+0000","last_undegraded":"2024-08-09T00:37:52.851421+0000","last_fullsized":"2024-08-09T00:37:52.851421+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:40:37.743717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831092+0000","last_change":"2024-08-08T23:48:42.099507+0000","last_active":"2024-08-09T00:37:02.831092+0000","last_peered":"2024-08-09T00:37:02.831092+0000","last_clean":"2024-08-09T00:37:02.831092+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:37:02.831092+0000","last_undegraded":"2024-08-09T00:37:02.831092+0000","last_fullsized":"2024-08-09T00:37:02.831092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:58:00.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833107+0000","last_change":"2024-08-08T23:48:38.063345+0000","last_active":"2024-08-09T00:37:12.833107+0000","last_peered":"2024-08-09T00:37:12.833107+0000","last_clean":"2024-08-09T00:37:12.833107+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:37:12.833107+0000","last_undegraded":"2024-08-09T00:37:12.833107+0000","last_fullsized":"2024-08-09T00:37:12.833107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:22:39.743227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834919+0000","last_change":"2024-08-08T23:44:47.415691+0000","last_active":"2024-08-09T00:37:17.834919+0000","last_peered":"2024-08-09T00:37:17.834919+0000","last_clean":"2024-08-09T00:37:17.834919+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:37:17.834919+0000","last_undegraded":"2024-08-09T00:37:17.834919+0000","last_fullsized":"2024-08-09T00:37:17.834919+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:32.215875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857873+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:37:02.857873+0000","last_peered":"2024-08-09T00:37:02.857873+0000","last_clean":"2024-08-09T00:37:02.857873+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:37:02.857873+0000","last_undegraded":"2024-08-09T00:37:02.857873+0000","last_fullsized":"2024-08-09T00:37:02.857873+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:42.897370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819450+0000","last_change":"2024-08-08T23:48:42.104797+0000","last_active":"2024-08-09T00:36:12.819450+0000","last_peered":"2024-08-09T00:36:12.819450+0000","last_clean":"2024-08-09T00:36:12.819450+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:36:12.819450+0000","last_undegraded":"2024-08-09T00:36:12.819450+0000","last_fullsized":"2024-08-09T00:36:12.819450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:25:12.169302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817685+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:36:07.817685+0000","last_peered":"2024-08-09T00:36:07.817685+0000","last_clean":"2024-08-09T00:36:07.817685+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:36:07.817685+0000","last_undegraded":"2024-08-09T00:36:07.817685+0000","last_fullsized":"2024-08-09T00:36:07.817685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:13.656553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:42.809243+0000","last_change":"2024-08-08T23:44:47.418893+0000","last_active":"2024-08-09T00:35:42.809243+0000","last_peered":"2024-08-09T00:35:42.809243+0000","last_clean":"2024-08-09T00:35:42.809243+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:35:42.809243+0000","last_undegraded":"2024-08-09T00:35:42.809243+0000","last_fullsized":"2024-08-09T00:35:42.809243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:10.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857956+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:37:02.857956+0000","last_peered":"2024-08-09T00:37:02.857956+0000","last_clean":"2024-08-09T00:37:02.857956+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:37:02.857956+0000","last_undegraded":"2024-08-09T00:37:02.857956+0000","last_fullsized":"2024-08-09T00:37:02.857956+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:54.964878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645398+0000","last_change":"2024-08-08T23:48:42.093531+0000","last_active":"2024-08-09T00:36:12.645398+0000","last_peered":"2024-08-09T00:36:12.645398+0000","last_clean":"2024-08-09T00:36:12.645398+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:36:12.645398+0000","last_undegraded":"2024-08-09T00:36:12.645398+0000","last_fullsized":"2024-08-09T00:36:12.645398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:15:00.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'1","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815669+0000","last_change":"2024-08-08T23:48:38.070086+0000","last_active":"2024-08-09T00:36:07.815669+0000","last_peered":"2024-08-09T00:36:07.815669+0000","last_clean":"2024-08-09T00:36:07.815669+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:36:07.815669+0000","last_undegraded":"2024-08-09T00:36:07.815669+0000","last_fullsized":"2024-08-09T00:36:07.815669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:09.001506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.852322+0000","last_change":"2024-08-08T23:44:47.401774+0000","last_active":"2024-08-09T00:37:57.852322+0000","last_peered":"2024-08-09T00:37:57.852322+0000","last_clean":"2024-08-09T00:37:57.852322+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:37:57.852322+0000","last_undegraded":"2024-08-09T00:37:57.852322+0000","last_fullsized":"2024-08-09T00:37:57.852322+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:30.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843286+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:37:12.843286+0000","last_peered":"2024-08-09T00:37:12.843286+0000","last_clean":"2024-08-09T00:37:12.843286+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:37:12.843286+0000","last_undegraded":"2024-08-09T00:37:12.843286+0000","last_fullsized":"2024-08-09T00:37:12.843286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:35.805429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657057+0000","last_change":"2024-08-08T23:48:42.569594+0000","last_active":"2024-08-09T00:37:02.657057+0000","last_peered":"2024-08-09T00:37:02.657057+0000","last_clean":"2024-08-09T00:37:02.657057+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:37:02.657057+0000","last_undegraded":"2024-08-09T00:37:02.657057+0000","last_fullsized":"2024-08-09T00:37:02.657057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:05:00.915075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:48.069350+0000","last_change":"2024-08-08T23:48:38.078390+0000","last_active":"2024-08-09T00:37:48.069350+0000","last_peered":"2024-08-09T00:37:48.069350+0000","last_clean":"2024-08-09T00:37:48.069350+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:37:48.069350+0000","last_undegraded":"2024-08-09T00:37:48.069350+0000","last_fullsized":"2024-08-09T00:37:48.069350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:32.220322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.840117+0000","last_change":"2024-08-08T23:44:47.428042+0000","last_active":"2024-08-09T00:37:57.840117+0000","last_peered":"2024-08-09T00:37:57.840117+0000","last_clean":"2024-08-09T00:37:57.840117+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:37:57.840117+0000","last_undegraded":"2024-08-09T00:37:57.840117+0000","last_fullsized":"2024-08-09T00:37:57.840117+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:18.129270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836193+0000","last_change":"2024-08-09T00:04:29.838090+0000","last_active":"2024-08-09T00:37:12.836193+0000","last_peered":"2024-08-09T00:37:12.836193+0000","last_clean":"2024-08-09T00:37:12.836193+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:37:12.836193+0000","last_undegraded":"2024-08-09T00:37:12.836193+0000","last_fullsized":"2024-08-09T00:37:12.836193+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:20.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.668499+0000","last_change":"2024-08-08T23:48:42.571114+0000","last_active":"2024-08-09T00:37:52.668499+0000","last_peered":"2024-08-09T00:37:52.668499+0000","last_clean":"2024-08-09T00:37:52.668499+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:37:52.668499+0000","last_undegraded":"2024-08-09T00:37:52.668499+0000","last_fullsized":"2024-08-09T00:37:52.668499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:19:04.633722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856729+0000","last_change":"2024-08-08T23:48:38.081638+0000","last_active":"2024-08-09T00:36:57.856729+0000","last_peered":"2024-08-09T00:36:57.856729+0000","last_clean":"2024-08-09T00:36:57.856729+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:36:57.856729+0000","last_undegraded":"2024-08-09T00:36:57.856729+0000","last_fullsized":"2024-08-09T00:36:57.856729+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:56.987204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.669657+0000","last_change":"2024-08-08T23:44:47.418443+0000","last_active":"2024-08-09T00:37:57.669657+0000","last_peered":"2024-08-09T00:37:57.669657+0000","last_clean":"2024-08-09T00:37:57.669657+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:37:57.669657+0000","last_undegraded":"2024-08-09T00:37:57.669657+0000","last_fullsized":"2024-08-09T00:37:57.669657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:00.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.859886+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:37:12.859886+0000","last_peered":"2024-08-09T00:37:12.859886+0000","last_clean":"2024-08-09T00:37:12.859886+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:37:12.859886+0000","last_undegraded":"2024-08-09T00:37:12.859886+0000","last_fullsized":"2024-08-09T00:37:12.859886+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:54.135762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657135+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:37:02.657135+0000","last_peered":"2024-08-09T00:37:02.657135+0000","last_clean":"2024-08-09T00:37:02.657135+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:37:02.657135+0000","last_undegraded":"2024-08-09T00:37:02.657135+0000","last_fullsized":"2024-08-09T00:37:02.657135+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:37:02.420547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833259+0000","last_change":"2024-08-08T23:48:38.069892+0000","last_active":"2024-08-09T00:36:57.833259+0000","last_peered":"2024-08-09T00:36:57.833259+0000","last_clean":"2024-08-09T00:36:57.833259+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:36:57.833259+0000","last_undegraded":"2024-08-09T00:36:57.833259+0000","last_fullsized":"2024-08-09T00:36:57.833259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:56:09.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.845044+0000","last_change":"2024-08-08T23:44:47.403895+0000","last_active":"2024-08-09T00:37:57.845044+0000","last_peered":"2024-08-09T00:37:57.845044+0000","last_clean":"2024-08-09T00:37:57.845044+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:37:57.845044+0000","last_undegraded":"2024-08-09T00:37:57.845044+0000","last_fullsized":"2024-08-09T00:37:57.845044+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:20:56.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061641+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:37:13.061641+0000","last_peered":"2024-08-09T00:37:13.061641+0000","last_clean":"2024-08-09T00:37:13.061641+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:37:13.061641+0000","last_undegraded":"2024-08-09T00:37:13.061641+0000","last_fullsized":"2024-08-09T00:37:13.061641+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:35.438575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.830657+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:37:02.830657+0000","last_peered":"2024-08-09T00:37:02.830657+0000","last_clean":"2024-08-09T00:37:02.830657+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:37:02.830657+0000","last_undegraded":"2024-08-09T00:37:02.830657+0000","last_fullsized":"2024-08-09T00:37:02.830657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:31.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.827150+0000","last_change":"2024-08-08T23:48:38.073422+0000","last_active":"2024-08-09T00:36:57.827150+0000","last_peered":"2024-08-09T00:36:57.827150+0000","last_clean":"2024-08-09T00:36:57.827150+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:36:57.827150+0000","last_undegraded":"2024-08-09T00:36:57.827150+0000","last_fullsized":"2024-08-09T00:36:57.827150+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:06.420714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846240+0000","last_change":"2024-08-08T23:44:47.416042+0000","last_active":"2024-08-09T00:36:12.846240+0000","last_peered":"2024-08-09T00:36:12.846240+0000","last_clean":"2024-08-09T00:36:12.846240+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:36:12.846240+0000","last_undegraded":"2024-08-09T00:36:12.846240+0000","last_fullsized":"2024-08-09T00:36:12.846240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:18.630574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641678+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:35:57.641678+0000","last_peered":"2024-08-09T00:35:57.641678+0000","last_clean":"2024-08-09T00:35:57.641678+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:35:57.641678+0000","last_undegraded":"2024-08-09T00:35:57.641678+0000","last_fullsized":"2024-08-09T00:35:57.641678+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:48:51.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849230+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:37:42.849230+0000","last_peered":"2024-08-09T00:37:42.849230+0000","last_clean":"2024-08-09T00:37:42.849230+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:37:42.849230+0000","last_undegraded":"2024-08-09T00:37:42.849230+0000","last_fullsized":"2024-08-09T00:37:42.849230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:37.725025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840154+0000","last_change":"2024-08-08T23:48:38.068093+0000","last_active":"2024-08-09T00:37:37.840154+0000","last_peered":"2024-08-09T00:37:37.840154+0000","last_clean":"2024-08-09T00:37:37.840154+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:37:37.840154+0000","last_undegraded":"2024-08-09T00:37:37.840154+0000","last_fullsized":"2024-08-09T00:37:37.840154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:31:07.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844757+0000","last_change":"2024-08-08T23:44:47.417665+0000","last_active":"2024-08-09T00:36:07.844757+0000","last_peered":"2024-08-09T00:36:07.844757+0000","last_clean":"2024-08-09T00:36:07.844757+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:36:07.844757+0000","last_undegraded":"2024-08-09T00:36:07.844757+0000","last_fullsized":"2024-08-09T00:36:07.844757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:54.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813256+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:35:57.813256+0000","last_peered":"2024-08-09T00:35:57.813256+0000","last_clean":"2024-08-09T00:35:57.813256+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:35:57.813256+0000","last_undegraded":"2024-08-09T00:35:57.813256+0000","last_fullsized":"2024-08-09T00:35:57.813256+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:53.142711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849163+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:37:42.849163+0000","last_peered":"2024-08-09T00:37:42.849163+0000","last_clean":"2024-08-09T00:37:42.849163+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:37:42.849163+0000","last_undegraded":"2024-08-09T00:37:42.849163+0000","last_fullsized":"2024-08-09T00:37:42.849163+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.916828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'1","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.664886+0000","last_change":"2024-08-08T23:48:38.082209+0000","last_active":"2024-08-09T00:37:37.664886+0000","last_peered":"2024-08-09T00:37:37.664886+0000","last_clean":"2024-08-09T00:37:37.664886+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:37:37.664886+0000","last_undegraded":"2024-08-09T00:37:37.664886+0000","last_fullsized":"2024-08-09T00:37:37.664886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:19.106154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815548+0000","last_change":"2024-08-08T23:44:47.414517+0000","last_active":"2024-08-09T00:36:07.815548+0000","last_peered":"2024-08-09T00:36:07.815548+0000","last_clean":"2024-08-09T00:36:07.815548+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:36:07.815548+0000","last_undegraded":"2024-08-09T00:36:07.815548+0000","last_fullsized":"2024-08-09T00:36:07.815548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:24.856912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.832729+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:37:22.832729+0000","last_peered":"2024-08-09T00:37:22.832729+0000","last_clean":"2024-08-09T00:37:22.832729+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:37:22.832729+0000","last_undegraded":"2024-08-09T00:37:22.832729+0000","last_fullsized":"2024-08-09T00:37:22.832729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:11.805690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.841067+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:38:02.841067+0000","last_peered":"2024-08-09T00:38:02.841067+0000","last_clean":"2024-08-09T00:38:02.841067+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:38:02.841067+0000","last_undegraded":"2024-08-09T00:38:02.841067+0000","last_fullsized":"2024-08-09T00:38:02.841067+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:17.911780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840304+0000","last_change":"2024-08-08T23:48:38.094796+0000","last_active":"2024-08-09T00:37:37.840304+0000","last_peered":"2024-08-09T00:37:37.840304+0000","last_clean":"2024-08-09T00:37:37.840304+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:37:37.840304+0000","last_undegraded":"2024-08-09T00:37:37.840304+0000","last_fullsized":"2024-08-09T00:37:37.840304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:24.637100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817622+0000","last_change":"2024-08-08T23:44:47.394560+0000","last_active":"2024-08-09T00:36:07.817622+0000","last_peered":"2024-08-09T00:36:07.817622+0000","last_clean":"2024-08-09T00:36:07.817622+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:36:07.817622+0000","last_undegraded":"2024-08-09T00:36:07.817622+0000","last_fullsized":"2024-08-09T00:36:07.817622+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:27:00.732298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641490+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:35:57.641490+0000","last_peered":"2024-08-09T00:35:57.641490+0000","last_clean":"2024-08-09T00:35:57.641490+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:35:57.641490+0000","last_undegraded":"2024-08-09T00:35:57.641490+0000","last_fullsized":"2024-08-09T00:35:57.641490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:42.318744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.841717+0000","last_change":"2024-08-08T23:48:42.119272+0000","last_active":"2024-08-09T00:37:42.841717+0000","last_peered":"2024-08-09T00:37:42.841717+0000","last_clean":"2024-08-09T00:37:42.841717+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:37:42.841717+0000","last_undegraded":"2024-08-09T00:37:42.841717+0000","last_fullsized":"2024-08-09T00:37:42.841717+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:12.818880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:38.066987+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:37:38.066987+0000","last_peered":"2024-08-09T00:37:38.066987+0000","last_clean":"2024-08-09T00:37:38.066987+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:37:38.066987+0000","last_undegraded":"2024-08-09T00:37:38.066987+0000","last_fullsized":"2024-08-09T00:37:38.066987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:13.879567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.643947+0000","last_change":"2024-08-08T23:44:47.404724+0000","last_active":"2024-08-09T00:36:07.643947+0000","last_peered":"2024-08-09T00:36:07.643947+0000","last_clean":"2024-08-09T00:36:07.643947+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:36:07.643947+0000","last_undegraded":"2024-08-09T00:36:07.643947+0000","last_fullsized":"2024-08-09T00:36:07.643947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:52:50.706903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:07.835155+0000","last_change":"2024-08-09T00:04:29.835767+0000","last_active":"2024-08-09T00:37:07.835155+0000","last_peered":"2024-08-09T00:37:07.835155+0000","last_clean":"2024-08-09T00:37:07.835155+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:37:07.835155+0000","last_undegraded":"2024-08-09T00:37:07.835155+0000","last_fullsized":"2024-08-09T00:37:07.835155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.738421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672519+0000","last_change":"2024-08-08T23:48:42.111533+0000","last_active":"2024-08-09T00:38:12.672519+0000","last_peered":"2024-08-09T00:38:12.672519+0000","last_clean":"2024-08-09T00:38:12.672519+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:38:12.672519+0000","last_undegraded":"2024-08-09T00:38:12.672519+0000","last_fullsized":"2024-08-09T00:38:12.672519+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:24.814125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.872421+0000","last_change":"2024-08-08T23:48:38.087296+0000","last_active":"2024-08-09T00:38:07.872421+0000","last_peered":"2024-08-09T00:38:07.872421+0000","last_clean":"2024-08-09T00:38:07.872421+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:38:07.872421+0000","last_undegraded":"2024-08-09T00:38:07.872421+0000","last_fullsized":"2024-08-09T00:38:07.872421+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:01:04.545816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652733+0000","last_change":"2024-08-08T23:44:47.428169+0000","last_active":"2024-08-09T00:36:42.652733+0000","last_peered":"2024-08-09T00:36:42.652733+0000","last_clean":"2024-08-09T00:36:42.652733+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:36:42.652733+0000","last_undegraded":"2024-08-09T00:36:42.652733+0000","last_fullsized":"2024-08-09T00:36:42.652733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:49.375073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843416+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:36:02.843416+0000","last_peered":"2024-08-09T00:36:02.843416+0000","last_clean":"2024-08-09T00:36:02.843416+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:36:02.843416+0000","last_undegraded":"2024-08-09T00:36:02.843416+0000","last_fullsized":"2024-08-09T00:36:02.843416+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:32.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672470+0000","last_change":"2024-08-08T23:48:42.099382+0000","last_active":"2024-08-09T00:38:12.672470+0000","last_peered":"2024-08-09T00:38:12.672470+0000","last_clean":"2024-08-09T00:38:12.672470+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:38:12.672470+0000","last_undegraded":"2024-08-09T00:38:12.672470+0000","last_fullsized":"2024-08-09T00:38:12.672470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:20.657160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12631331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":21602,"num_write":16,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.847395+0000","last_change":"2024-08-08T23:48:38.060640+0000","last_active":"2024-08-09T00:38:07.847395+0000","last_peered":"2024-08-09T00:38:07.847395+0000","last_clean":"2024-08-09T00:38:07.847395+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:38:07.847395+0000","last_undegraded":"2024-08-09T00:38:07.847395+0000","last_fullsized":"2024-08-09T00:38:07.847395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:37.913237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:33.053185+0000","last_change":"2024-08-08T23:44:47.403129+0000","last_active":"2024-08-09T00:36:33.053185+0000","last_peered":"2024-08-09T00:36:33.053185+0000","last_clean":"2024-08-09T00:36:33.053185+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:36:33.053185+0000","last_undegraded":"2024-08-09T00:36:33.053185+0000","last_fullsized":"2024-08-09T00:36:33.053185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:39.986809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831148+0000","last_change":"2024-08-09T00:04:29.861378+0000","last_active":"2024-08-09T00:37:02.831148+0000","last_peered":"2024-08-09T00:37:02.831148+0000","last_clean":"2024-08-09T00:37:02.831148+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:37:02.831148+0000","last_undegraded":"2024-08-09T00:37:02.831148+0000","last_fullsized":"2024-08-09T00:37:02.831148+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:00.665233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830335+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:36:07.830335+0000","last_peered":"2024-08-09T00:36:07.830335+0000","last_clean":"2024-08-09T00:36:07.830335+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:36:07.830335+0000","last_undegraded":"2024-08-09T00:36:07.830335+0000","last_fullsized":"2024-08-09T00:36:07.830335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:27:45.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'1","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.842246+0000","last_change":"2024-08-08T23:48:38.085232+0000","last_active":"2024-08-09T00:38:07.842246+0000","last_peered":"2024-08-09T00:38:07.842246+0000","last_clean":"2024-08-09T00:38:07.842246+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:38:07.842246+0000","last_undegraded":"2024-08-09T00:38:07.842246+0000","last_fullsized":"2024-08-09T00:38:07.842246+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:15.159124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824087+0000","last_change":"2024-08-08T23:44:47.399086+0000","last_active":"2024-08-09T00:36:32.824087+0000","last_peered":"2024-08-09T00:36:32.824087+0000","last_clean":"2024-08-09T00:36:32.824087+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:36:32.824087+0000","last_undegraded":"2024-08-09T00:36:32.824087+0000","last_fullsized":"2024-08-09T00:36:32.824087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:59.479905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857757+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:37:02.857757+0000","last_peered":"2024-08-09T00:37:02.857757+0000","last_clean":"2024-08-09T00:37:02.857757+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:37:02.857757+0000","last_undegraded":"2024-08-09T00:37:02.857757+0000","last_fullsized":"2024-08-09T00:37:02.857757+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:37:09.466033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672556+0000","last_change":"2024-08-08T23:48:42.109080+0000","last_active":"2024-08-09T00:38:12.672556+0000","last_peered":"2024-08-09T00:38:12.672556+0000","last_clean":"2024-08-09T00:38:12.672556+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:38:12.672556+0000","last_undegraded":"2024-08-09T00:38:12.672556+0000","last_fullsized":"2024-08-09T00:38:12.672556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:13.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.829079+0000","last_change":"2024-08-08T23:48:38.092262+0000","last_active":"2024-08-09T00:36:02.829079+0000","last_peered":"2024-08-09T00:36:02.829079+0000","last_clean":"2024-08-09T00:36:02.829079+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:36:02.829079+0000","last_undegraded":"2024-08-09T00:36:02.829079+0000","last_fullsized":"2024-08-09T00:36:02.829079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:52:00.439329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.828951+0000","last_change":"2024-08-08T23:44:47.399289+0000","last_active":"2024-08-09T00:36:32.828951+0000","last_peered":"2024-08-09T00:36:32.828951+0000","last_clean":"2024-08-09T00:36:32.828951+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:36:32.828951+0000","last_undegraded":"2024-08-09T00:36:32.828951+0000","last_fullsized":"2024-08-09T00:36:32.828951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:04.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.643044+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:36:02.643044+0000","last_peered":"2024-08-09T00:36:02.643044+0000","last_clean":"2024-08-09T00:36:02.643044+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:36:02.643044+0000","last_undegraded":"2024-08-09T00:36:02.643044+0000","last_fullsized":"2024-08-09T00:36:02.643044+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:08.530056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821001+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:36:22.821001+0000","last_peered":"2024-08-09T00:36:22.821001+0000","last_clean":"2024-08-09T00:36:22.821001+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:36:22.821001+0000","last_undegraded":"2024-08-09T00:36:22.821001+0000","last_fullsized":"2024-08-09T00:36:22.821001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:18:01.697005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818021+0000","last_change":"2024-08-08T23:48:38.084236+0000","last_active":"2024-08-09T00:36:17.818021+0000","last_peered":"2024-08-09T00:36:17.818021+0000","last_clean":"2024-08-09T00:36:17.818021+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:36:17.818021+0000","last_undegraded":"2024-08-09T00:36:17.818021+0000","last_fullsized":"2024-08-09T00:36:17.818021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:54.693443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":9,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.821527+0000","last_change":"2024-08-08T23:44:47.408356+0000","last_active":"2024-08-09T00:36:32.821527+0000","last_peered":"2024-08-09T00:36:32.821527+0000","last_clean":"2024-08-09T00:36:32.821527+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:36:32.821527+0000","last_undegraded":"2024-08-09T00:36:32.821527+0000","last_fullsized":"2024-08-09T00:36:32.821527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:09.358087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845039+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:36:07.845039+0000","last_peered":"2024-08-09T00:36:07.845039+0000","last_clean":"2024-08-09T00:36:07.845039+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:36:07.845039+0000","last_undegraded":"2024-08-09T00:36:07.845039+0000","last_fullsized":"2024-08-09T00:36:07.845039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:02:05.119656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848531+0000","last_change":"2024-08-08T23:48:42.570789+0000","last_active":"2024-08-09T00:36:22.848531+0000","last_peered":"2024-08-09T00:36:22.848531+0000","last_clean":"2024-08-09T00:36:22.848531+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:36:22.848531+0000","last_undegraded":"2024-08-09T00:36:22.848531+0000","last_fullsized":"2024-08-09T00:36:22.848531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:34.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'7","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.832336+0000","last_change":"2024-08-08T23:48:38.092188+0000","last_active":"2024-08-09T00:36:17.832336+0000","last_peered":"2024-08-09T00:36:17.832336+0000","last_clean":"2024-08-09T00:36:17.832336+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:36:17.832336+0000","last_undegraded":"2024-08-09T00:36:17.832336+0000","last_fullsized":"2024-08-09T00:36:17.832336+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:33.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855435+0000","last_change":"2024-08-08T23:44:47.396027+0000","last_active":"2024-08-09T00:36:52.855435+0000","last_peered":"2024-08-09T00:36:52.855435+0000","last_clean":"2024-08-09T00:36:52.855435+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:36:52.855435+0000","last_undegraded":"2024-08-09T00:36:52.855435+0000","last_fullsized":"2024-08-09T00:36:52.855435+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:49:52.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843458+0000","last_change":"2024-08-09T00:04:29.877623+0000","last_active":"2024-08-09T00:36:02.843458+0000","last_peered":"2024-08-09T00:36:02.843458+0000","last_clean":"2024-08-09T00:36:02.843458+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:36:02.843458+0000","last_undegraded":"2024-08-09T00:36:02.843458+0000","last_fullsized":"2024-08-09T00:36:02.843458+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:58.415040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855444+0000","last_change":"2024-08-08T23:48:42.117970+0000","last_active":"2024-08-09T00:38:12.855444+0000","last_peered":"2024-08-09T00:38:12.855444+0000","last_clean":"2024-08-09T00:38:12.855444+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:38:12.855444+0000","last_undegraded":"2024-08-09T00:38:12.855444+0000","last_fullsized":"2024-08-09T00:38:12.855444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:08.226037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.820427+0000","last_change":"2024-08-08T23:48:38.070526+0000","last_active":"2024-08-09T00:36:27.820427+0000","last_peered":"2024-08-09T00:36:27.820427+0000","last_clean":"2024-08-09T00:36:27.820427+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:36:27.820427+0000","last_undegraded":"2024-08-09T00:36:27.820427+0000","last_fullsized":"2024-08-09T00:36:27.820427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:04.766563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.653651+0000","last_change":"2024-08-08T23:44:47.397051+0000","last_active":"2024-08-09T00:36:47.653651+0000","last_peered":"2024-08-09T00:36:47.653651+0000","last_clean":"2024-08-09T00:36:47.653651+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:36:47.653651+0000","last_undegraded":"2024-08-09T00:36:47.653651+0000","last_fullsized":"2024-08-09T00:36:47.653651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:05:19.891906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814357+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:36:02.814357+0000","last_peered":"2024-08-09T00:36:02.814357+0000","last_clean":"2024-08-09T00:36:02.814357+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:36:02.814357+0000","last_undegraded":"2024-08-09T00:36:02.814357+0000","last_fullsized":"2024-08-09T00:36:02.814357+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:18:12.990248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849765+0000","last_change":"2024-08-08T23:48:42.107127+0000","last_active":"2024-08-09T00:36:27.849765+0000","last_peered":"2024-08-09T00:36:27.849765+0000","last_clean":"2024-08-09T00:36:27.849765+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:36:27.849765+0000","last_undegraded":"2024-08-09T00:36:27.849765+0000","last_fullsized":"2024-08-09T00:36:27.849765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:54:09.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.848661+0000","last_change":"2024-08-08T23:48:38.063944+0000","last_active":"2024-08-09T00:38:07.848661+0000","last_peered":"2024-08-09T00:38:07.848661+0000","last_clean":"2024-08-09T00:38:07.848661+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:38:07.848661+0000","last_undegraded":"2024-08-09T00:38:07.848661+0000","last_fullsized":"2024-08-09T00:38:07.848661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:06:32.473872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827506+0000","last_change":"2024-08-08T23:44:47.398875+0000","last_active":"2024-08-09T00:36:47.827506+0000","last_peered":"2024-08-09T00:36:47.827506+0000","last_clean":"2024-08-09T00:36:47.827506+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:36:47.827506+0000","last_undegraded":"2024-08-09T00:36:47.827506+0000","last_fullsized":"2024-08-09T00:36:47.827506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:26.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868969+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:37:52.868969+0000","last_peered":"2024-08-09T00:37:52.868969+0000","last_clean":"2024-08-09T00:37:52.868969+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:37:52.868969+0000","last_undegraded":"2024-08-09T00:37:52.868969+0000","last_fullsized":"2024-08-09T00:37:52.868969+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:57:10.837360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'5","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824916+0000","last_change":"2024-08-08T23:48:42.101066+0000","last_active":"2024-08-09T00:36:47.824916+0000","last_peered":"2024-08-09T00:36:47.824916+0000","last_clean":"2024-08-09T00:36:47.824916+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:36:47.824916+0000","last_undegraded":"2024-08-09T00:36:47.824916+0000","last_fullsized":"2024-08-09T00:36:47.824916+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:06.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850986+0000","last_change":"2024-08-08T23:48:38.078556+0000","last_active":"2024-08-09T00:36:32.850986+0000","last_peered":"2024-08-09T00:36:32.850986+0000","last_clean":"2024-08-09T00:36:32.850986+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:36:32.850986+0000","last_undegraded":"2024-08-09T00:36:32.850986+0000","last_fullsized":"2024-08-09T00:36:32.850986+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:01.058350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.825020+0000","last_change":"2024-08-08T23:44:47.428182+0000","last_active":"2024-08-09T00:36:47.825020+0000","last_peered":"2024-08-09T00:36:47.825020+0000","last_clean":"2024-08-09T00:36:47.825020+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:36:47.825020+0000","last_undegraded":"2024-08-09T00:36:47.825020+0000","last_fullsized":"2024-08-09T00:36:47.825020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:23.238421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070601+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:37:53.070601+0000","last_peered":"2024-08-09T00:37:53.070601+0000","last_clean":"2024-08-09T00:37:53.070601+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:37:53.070601+0000","last_undegraded":"2024-08-09T00:37:53.070601+0000","last_fullsized":"2024-08-09T00:37:53.070601+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:59:54.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822637+0000","last_change":"2024-08-08T23:48:42.574733+0000","last_active":"2024-08-09T00:36:37.822637+0000","last_peered":"2024-08-09T00:36:37.822637+0000","last_clean":"2024-08-09T00:36:37.822637+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:36:37.822637+0000","last_undegraded":"2024-08-09T00:36:37.822637+0000","last_fullsized":"2024-08-09T00:36:37.822637+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:12.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830892+0000","last_change":"2024-08-08T23:48:38.060729+0000","last_active":"2024-08-09T00:36:42.830892+0000","last_peered":"2024-08-09T00:36:42.830892+0000","last_clean":"2024-08-09T00:36:42.830892+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:36:42.830892+0000","last_undegraded":"2024-08-09T00:36:42.830892+0000","last_fullsized":"2024-08-09T00:36:42.830892+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:21.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'85","reported_seq":328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827642+0000","last_change":"2024-08-08T23:44:47.407071+0000","last_active":"2024-08-09T00:36:47.827642+0000","last_peered":"2024-08-09T00:36:47.827642+0000","last_clean":"2024-08-09T00:36:47.827642+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:36:47.827642+0000","last_undegraded":"2024-08-09T00:36:47.827642+0000","last_fullsized":"2024-08-09T00:36:47.827642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:20.171645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836281+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:36:37.836281+0000","last_peered":"2024-08-09T00:36:37.836281+0000","last_clean":"2024-08-09T00:36:37.836281+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:36:37.836281+0000","last_undegraded":"2024-08-09T00:36:37.836281+0000","last_fullsized":"2024-08-09T00:36:37.836281+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:00.019365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848808+0000","last_change":"2024-08-08T23:48:42.574649+0000","last_active":"2024-08-09T00:36:22.848808+0000","last_peered":"2024-08-09T00:36:22.848808+0000","last_clean":"2024-08-09T00:36:22.848808+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:36:22.848808+0000","last_undegraded":"2024-08-09T00:36:22.848808+0000","last_fullsized":"2024-08-09T00:36:22.848808+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:27.719355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'6","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:18.049822+0000","last_change":"2024-08-08T23:48:38.074200+0000","last_active":"2024-08-09T00:36:18.049822+0000","last_peered":"2024-08-09T00:36:18.049822+0000","last_clean":"2024-08-09T00:36:18.049822+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:36:18.049822+0000","last_undegraded":"2024-08-09T00:36:18.049822+0000","last_fullsized":"2024-08-09T00:36:18.049822+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:00.327462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14338,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856642+0000","last_change":"2024-08-08T23:44:47.409012+0000","last_active":"2024-08-09T00:36:57.856642+0000","last_peered":"2024-08-09T00:36:57.856642+0000","last_clean":"2024-08-09T00:36:57.856642+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:36:57.856642+0000","last_undegraded":"2024-08-09T00:36:57.856642+0000","last_fullsized":"2024-08-09T00:36:57.856642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:41:17.851838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844591+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:37:52.844591+0000","last_peered":"2024-08-09T00:37:52.844591+0000","last_clean":"2024-08-09T00:37:52.844591+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:37:52.844591+0000","last_undegraded":"2024-08-09T00:37:52.844591+0000","last_fullsized":"2024-08-09T00:37:52.844591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:53.664350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821249+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:36:22.821249+0000","last_peered":"2024-08-09T00:36:22.821249+0000","last_clean":"2024-08-09T00:36:22.821249+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:36:22.821249+0000","last_undegraded":"2024-08-09T00:36:22.821249+0000","last_fullsized":"2024-08-09T00:36:22.821249+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:57.922645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7184,"num_write":5,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847687+0000","last_change":"2024-08-08T23:48:38.078416+0000","last_active":"2024-08-09T00:36:17.847687+0000","last_peered":"2024-08-09T00:36:17.847687+0000","last_clean":"2024-08-09T00:36:17.847687+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:36:17.847687+0000","last_undegraded":"2024-08-09T00:36:17.847687+0000","last_fullsized":"2024-08-09T00:36:17.847687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:01:01.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.839733+0000","last_change":"2024-08-08T23:44:47.401342+0000","last_active":"2024-08-09T00:36:52.839733+0000","last_peered":"2024-08-09T00:36:52.839733+0000","last_clean":"2024-08-09T00:36:52.839733+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:36:52.839733+0000","last_undegraded":"2024-08-09T00:36:52.839733+0000","last_fullsized":"2024-08-09T00:36:52.839733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:44.529457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834315+0000","last_change":"2024-08-09T00:04:29.863724+0000","last_active":"2024-08-09T00:37:02.834315+0000","last_peered":"2024-08-09T00:37:02.834315+0000","last_clean":"2024-08-09T00:37:02.834315+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:37:02.834315+0000","last_undegraded":"2024-08-09T00:37:02.834315+0000","last_fullsized":"2024-08-09T00:37:02.834315+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:29.579952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'7","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836323+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:36:37.836323+0000","last_peered":"2024-08-09T00:36:37.836323+0000","last_clean":"2024-08-09T00:36:37.836323+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:36:37.836323+0000","last_undegraded":"2024-08-09T00:36:37.836323+0000","last_fullsized":"2024-08-09T00:36:37.836323+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:10.329411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.853121+0000","last_change":"2024-08-08T23:48:38.072020+0000","last_active":"2024-08-09T00:36:42.853121+0000","last_peered":"2024-08-09T00:36:42.853121+0000","last_clean":"2024-08-09T00:36:42.853121+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:36:42.853121+0000","last_undegraded":"2024-08-09T00:36:42.853121+0000","last_fullsized":"2024-08-09T00:36:42.853121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.841674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057480+0000","last_change":"2024-08-08T23:44:47.415563+0000","last_active":"2024-08-09T00:36:53.057480+0000","last_peered":"2024-08-09T00:36:53.057480+0000","last_clean":"2024-08-09T00:36:53.057480+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:36:53.057480+0000","last_undegraded":"2024-08-09T00:36:53.057480+0000","last_fullsized":"2024-08-09T00:36:53.057480+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:14.499630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.828240+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:37:02.828240+0000","last_peered":"2024-08-09T00:37:02.828240+0000","last_clean":"2024-08-09T00:37:02.828240+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:37:02.828240+0000","last_undegraded":"2024-08-09T00:37:02.828240+0000","last_fullsized":"2024-08-09T00:37:02.828240+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:48.269801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057343+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:36:53.057343+0000","last_peered":"2024-08-09T00:36:53.057343+0000","last_clean":"2024-08-09T00:36:53.057343+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:36:53.057343+0000","last_undegraded":"2024-08-09T00:36:53.057343+0000","last_fullsized":"2024-08-09T00:36:53.057343+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:22.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'3","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850843+0000","last_change":"2024-08-08T23:48:38.073918+0000","last_active":"2024-08-09T00:36:32.850843+0000","last_peered":"2024-08-09T00:36:32.850843+0000","last_clean":"2024-08-09T00:36:32.850843+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:36:32.850843+0000","last_undegraded":"2024-08-09T00:36:32.850843+0000","last_fullsized":"2024-08-09T00:36:32.850843+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:36.717576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828053+0000","last_change":"2024-08-08T23:44:47.396682+0000","last_active":"2024-08-09T00:36:52.828053+0000","last_peered":"2024-08-09T00:36:52.828053+0000","last_clean":"2024-08-09T00:36:52.828053+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:36:52.828053+0000","last_undegraded":"2024-08-09T00:36:52.828053+0000","last_fullsized":"2024-08-09T00:36:52.828053+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:54.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.838905+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:37:52.838905+0000","last_peered":"2024-08-09T00:37:52.838905+0000","last_clean":"2024-08-09T00:37:52.838905+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:37:52.838905+0000","last_undegraded":"2024-08-09T00:37:52.838905+0000","last_fullsized":"2024-08-09T00:37:52.838905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:40.806416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825081+0000","last_change":"2024-08-08T23:48:42.101703+0000","last_active":"2024-08-09T00:36:37.825081+0000","last_peered":"2024-08-09T00:36:37.825081+0000","last_clean":"2024-08-09T00:36:37.825081+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:36:37.825081+0000","last_undegraded":"2024-08-09T00:36:37.825081+0000","last_fullsized":"2024-08-09T00:36:37.825081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:28:20.232434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.835642+0000","last_change":"2024-08-08T23:48:38.094574+0000","last_active":"2024-08-09T00:36:32.835642+0000","last_peered":"2024-08-09T00:36:32.835642+0000","last_clean":"2024-08-09T00:36:32.835642+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:36:32.835642+0000","last_undegraded":"2024-08-09T00:36:32.835642+0000","last_fullsized":"2024-08-09T00:36:32.835642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:54:58.203802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828719+0000","last_change":"2024-08-08T23:44:47.406106+0000","last_active":"2024-08-09T00:36:52.828719+0000","last_peered":"2024-08-09T00:36:52.828719+0000","last_clean":"2024-08-09T00:36:52.828719+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:36:52.828719+0000","last_undegraded":"2024-08-09T00:36:52.828719+0000","last_fullsized":"2024-08-09T00:36:52.828719+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:06.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870272+0000","last_change":"2024-08-09T00:04:29.876240+0000","last_active":"2024-08-09T00:37:57.870272+0000","last_peered":"2024-08-09T00:37:57.870272+0000","last_clean":"2024-08-09T00:37:57.870272+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:37:57.870272+0000","last_undegraded":"2024-08-09T00:37:57.870272+0000","last_fullsized":"2024-08-09T00:37:57.870272+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:16.600617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.824528+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:36:37.824528+0000","last_peered":"2024-08-09T00:36:37.824528+0000","last_clean":"2024-08-09T00:36:37.824528+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:36:37.824528+0000","last_undegraded":"2024-08-09T00:36:37.824528+0000","last_fullsized":"2024-08-09T00:36:37.824528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:25:48.483740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824034+0000","last_change":"2024-08-08T23:48:38.075180+0000","last_active":"2024-08-09T00:36:32.824034+0000","last_peered":"2024-08-09T00:36:32.824034+0000","last_clean":"2024-08-09T00:36:32.824034+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:36:32.824034+0000","last_undegraded":"2024-08-09T00:36:32.824034+0000","last_fullsized":"2024-08-09T00:36:32.824034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:33:20.643494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'75","reported_seq":297,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855332+0000","last_change":"2024-08-08T23:44:47.393129+0000","last_active":"2024-08-09T00:36:52.855332+0000","last_peered":"2024-08-09T00:36:52.855332+0000","last_clean":"2024-08-09T00:36:52.855332+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:36:52.855332+0000","last_undegraded":"2024-08-09T00:36:52.855332+0000","last_fullsized":"2024-08-09T00:36:52.855332+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:52.154862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'158","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.029188+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:39:28.029188+0000","last_peered":"2024-08-09T00:39:28.029188+0000","last_clean":"2024-08-09T00:39:28.029188+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:39:28.029188+0000","last_undegraded":"2024-08-09T00:39:28.029188+0000","last_fullsized":"2024-08-09T00:39:28.029188+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:02:46.763933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6911130,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":12258,"num_write":949,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045046+0000","last_change":"2024-08-08T23:28:26.788360+0000","last_active":"2024-08-09T00:35:58.045046+0000","last_peered":"2024-08-09T00:35:58.045046+0000","last_clean":"2024-08-09T00:35:58.045046+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:35:58.045046+0000","last_undegraded":"2024-08-09T00:35:58.045046+0000","last_fullsized":"2024-08-09T00:35:58.045046+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:04.030286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'178","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843501+0000","last_change":"2024-08-08T23:28:24.771874+0000","last_active":"2024-08-09T00:37:12.843501+0000","last_peered":"2024-08-09T00:37:12.843501+0000","last_clean":"2024-08-09T00:37:12.843501+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:37:12.843501+0000","last_undegraded":"2024-08-09T00:37:12.843501+0000","last_fullsized":"2024-08-09T00:37:12.843501+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:05.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7444278,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":346,"num_read_kb":3378,"num_write":891,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'233","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.842052+0000","last_change":"2024-08-08T23:28:26.783710+0000","last_active":"2024-08-09T00:35:57.842052+0000","last_peered":"2024-08-09T00:35:57.842052+0000","last_clean":"2024-08-09T00:35:57.842052+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:35:57.842052+0000","last_undegraded":"2024-08-09T00:35:57.842052+0000","last_fullsized":"2024-08-09T00:35:57.842052+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:28.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830506+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:37:12.830506+0000","last_peered":"2024-08-09T00:37:12.830506+0000","last_clean":"2024-08-09T00:37:12.830506+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:37:12.830506+0000","last_undegraded":"2024-08-09T00:37:12.830506+0000","last_fullsized":"2024-08-09T00:37:12.830506+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:18.881767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15339219,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":22668,"num_write":1170,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815161+0000","last_change":"2024-08-08T23:28:26.764063+0000","last_active":"2024-08-09T00:35:57.815161+0000","last_peered":"2024-08-09T00:35:57.815161+0000","last_clean":"2024-08-09T00:35:57.815161+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:35:57.815161+0000","last_undegraded":"2024-08-09T00:35:57.815161+0000","last_fullsized":"2024-08-09T00:35:57.815161+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:02.226948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'195","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.742763+0000","last_change":"2024-08-08T23:28:24.820523+0000","last_active":"2024-08-09T00:37:55.742763+0000","last_peered":"2024-08-09T00:37:55.742763+0000","last_clean":"2024-08-09T00:37:55.742763+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:37:55.742763+0000","last_undegraded":"2024-08-09T00:37:55.742763+0000","last_fullsized":"2024-08-09T00:37:55.742763+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:09.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311815,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":443,"num_read_kb":38040,"num_write":1150,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:54.879381+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:38:54.879381+0000","last_peered":"2024-08-09T00:38:54.879381+0000","last_clean":"2024-08-09T00:38:54.879381+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:38:54.879381+0000","last_undegraded":"2024-08-09T00:38:54.879381+0000","last_fullsized":"2024-08-09T00:38:54.879381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:03.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'212","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032599+0000","last_change":"2024-08-08T23:29:01.888800+0000","last_active":"2024-08-09T00:39:28.032599+0000","last_peered":"2024-08-09T00:39:28.032599+0000","last_clean":"2024-08-09T00:39:28.032599+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:39:28.032599+0000","last_undegraded":"2024-08-09T00:39:28.032599+0000","last_fullsized":"2024-08-09T00:39:28.032599+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:13.683511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8773046,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":506,"num_read_kb":21778,"num_write":1214,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825152+0000","last_change":"2024-08-08T23:28:26.768598+0000","last_active":"2024-08-09T00:36:37.825152+0000","last_peered":"2024-08-09T00:36:37.825152+0000","last_clean":"2024-08-09T00:36:37.825152+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:36:37.825152+0000","last_undegraded":"2024-08-09T00:36:37.825152+0000","last_fullsized":"2024-08-09T00:36:37.825152+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.114726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'186","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.189372+0000","last_change":"2024-08-08T23:28:24.817326+0000","last_active":"2024-08-09T00:36:25.189372+0000","last_peered":"2024-08-09T00:36:25.189372+0000","last_clean":"2024-08-09T00:36:25.189372+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:36:25.189372+0000","last_undegraded":"2024-08-09T00:36:25.189372+0000","last_fullsized":"2024-08-09T00:36:25.189372+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:00.886762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120656,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":427,"num_read_kb":54098,"num_write":1116,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833361+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:37:12.833361+0000","last_peered":"2024-08-09T00:37:12.833361+0000","last_clean":"2024-08-09T00:37:12.833361+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:37:12.833361+0000","last_undegraded":"2024-08-09T00:37:12.833361+0000","last_fullsized":"2024-08-09T00:37:12.833361+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:31.362319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'194","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032872+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:39:28.032872+0000","last_peered":"2024-08-09T00:39:28.032872+0000","last_clean":"2024-08-09T00:39:28.032872+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:39:28.032872+0000","last_undegraded":"2024-08-09T00:39:28.032872+0000","last_fullsized":"2024-08-09T00:39:28.032872+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:11.097799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4771500,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":11259,"num_write":1110,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'106","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:23.806748+0000","last_change":"2024-08-08T23:28:26.777046+0000","last_active":"2024-08-09T00:38:23.806748+0000","last_peered":"2024-08-09T00:38:23.806748+0000","last_clean":"2024-08-09T00:38:23.806748+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:38:23.806748+0000","last_undegraded":"2024-08-09T00:38:23.806748+0000","last_fullsized":"2024-08-09T00:38:23.806748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:14.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'152","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641086+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:35:57.641086+0000","last_peered":"2024-08-09T00:35:57.641086+0000","last_clean":"2024-08-09T00:35:57.641086+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:35:57.641086+0000","last_undegraded":"2024-08-09T00:35:57.641086+0000","last_fullsized":"2024-08-09T00:35:57.641086+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:02:01.420135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7223405,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":32780,"num_write":884,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'208","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836345+0000","last_change":"2024-08-08T23:28:26.768844+0000","last_active":"2024-08-09T00:37:12.836345+0000","last_peered":"2024-08-09T00:37:12.836345+0000","last_clean":"2024-08-09T00:37:12.836345+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:37:12.836345+0000","last_undegraded":"2024-08-09T00:37:12.836345+0000","last_fullsized":"2024-08-09T00:37:12.836345+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:09.349357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'33","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817514+0000","last_change":"2024-08-08T23:28:26.764534+0000","last_active":"2024-08-09T00:36:07.817514+0000","last_peered":"2024-08-09T00:36:07.817514+0000","last_clean":"2024-08-09T00:36:07.817514+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:36:07.817514+0000","last_undegraded":"2024-08-09T00:36:07.817514+0000","last_fullsized":"2024-08-09T00:36:07.817514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:18.335354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'170","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847733+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:36:17.847733+0000","last_peered":"2024-08-09T00:36:17.847733+0000","last_clean":"2024-08-09T00:36:17.847733+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:36:17.847733+0000","last_undegraded":"2024-08-09T00:36:17.847733+0000","last_fullsized":"2024-08-09T00:36:17.847733+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:16.221071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5065774,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":348,"num_read_kb":8171,"num_write":1045,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844698+0000","last_change":"2024-08-08T23:28:26.784260+0000","last_active":"2024-08-09T00:36:07.844698+0000","last_peered":"2024-08-09T00:36:07.844698+0000","last_clean":"2024-08-09T00:36:07.844698+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:36:07.844698+0000","last_undegraded":"2024-08-09T00:36:07.844698+0000","last_fullsized":"2024-08-09T00:36:07.844698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:39:01.299632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'194","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830951+0000","last_change":"2024-08-08T23:29:01.887779+0000","last_active":"2024-08-09T00:36:42.830951+0000","last_peered":"2024-08-09T00:36:42.830951+0000","last_clean":"2024-08-09T00:36:42.830951+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:36:42.830951+0000","last_undegraded":"2024-08-09T00:36:42.830951+0000","last_fullsized":"2024-08-09T00:36:42.830951+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:42.436187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120347,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":375,"num_read_kb":6729,"num_write":995,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.006860+0000","last_change":"2024-08-08T23:28:26.788985+0000","last_active":"2024-08-09T00:38:30.006860+0000","last_peered":"2024-08-09T00:38:30.006860+0000","last_clean":"2024-08-09T00:38:30.006860+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:38:30.006860+0000","last_undegraded":"2024-08-09T00:38:30.006860+0000","last_fullsized":"2024-08-09T00:38:30.006860+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:17:32.725693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818345+0000","last_change":"2024-08-08T23:28:24.818699+0000","last_active":"2024-08-09T00:36:07.818345+0000","last_peered":"2024-08-09T00:36:07.818345+0000","last_clean":"2024-08-09T00:36:07.818345+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:36:07.818345+0000","last_undegraded":"2024-08-09T00:36:07.818345+0000","last_fullsized":"2024-08-09T00:36:07.818345+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:59:40.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437226,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":911,"num_read_kb":13197,"num_write":1119,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'21","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823766+0000","last_change":"2024-08-08T23:28:26.768040+0000","last_active":"2024-08-09T00:36:07.823766+0000","last_peered":"2024-08-09T00:36:07.823766+0000","last_clean":"2024-08-09T00:36:07.823766+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:36:07.823766+0000","last_undegraded":"2024-08-09T00:36:07.823766+0000","last_fullsized":"2024-08-09T00:36:07.823766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:37.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'171","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830837+0000","last_change":"2024-08-08T23:29:01.581302+0000","last_active":"2024-08-09T00:36:42.830837+0000","last_peered":"2024-08-09T00:36:42.830837+0000","last_clean":"2024-08-09T00:36:42.830837+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:36:42.830837+0000","last_undegraded":"2024-08-09T00:36:42.830837+0000","last_fullsized":"2024-08-09T00:36:42.830837+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:24.899484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586044,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":349,"num_read_kb":29619,"num_write":947,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823828+0000","last_change":"2024-08-08T23:28:26.771260+0000","last_active":"2024-08-09T00:36:07.823828+0000","last_peered":"2024-08-09T00:36:07.823828+0000","last_clean":"2024-08-09T00:36:07.823828+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:36:07.823828+0000","last_undegraded":"2024-08-09T00:36:07.823828+0000","last_fullsized":"2024-08-09T00:36:07.823828+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:20:43.254989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'162","reported_seq":794,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644186+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:36:07.644186+0000","last_peered":"2024-08-09T00:36:07.644186+0000","last_clean":"2024-08-09T00:36:07.644186+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:36:07.644186+0000","last_undegraded":"2024-08-09T00:36:07.644186+0000","last_fullsized":"2024-08-09T00:36:07.644186+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:25:13.214512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714729,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":381,"num_read_kb":37287,"num_write":961,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817822+0000","last_change":"2024-08-08T23:28:26.767880+0000","last_active":"2024-08-09T00:36:07.817822+0000","last_peered":"2024-08-09T00:36:07.817822+0000","last_clean":"2024-08-09T00:36:07.817822+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:36:07.817822+0000","last_undegraded":"2024-08-09T00:36:07.817822+0000","last_fullsized":"2024-08-09T00:36:07.817822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:43:28.316031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'216","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819246+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:36:22.819246+0000","last_peered":"2024-08-09T00:36:22.819246+0000","last_clean":"2024-08-09T00:36:22.819246+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:36:22.819246+0000","last_undegraded":"2024-08-09T00:36:22.819246+0000","last_fullsized":"2024-08-09T00:36:22.819246+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:57:29.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120629,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":738,"num_write":1166,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.385719+0000","last_change":"2024-08-08T23:28:34.831960+0000","last_active":"2024-08-09T00:39:54.385719+0000","last_peered":"2024-08-09T00:39:54.385719+0000","last_clean":"2024-08-09T00:39:54.385719+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:39:54.385719+0000","last_undegraded":"2024-08-09T00:39:54.385719+0000","last_fullsized":"2024-08-09T00:39:54.385719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:01:36.286772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.137781+0000","last_change":"2024-08-08T23:29:01.588729+0000","last_active":"2024-08-09T00:37:28.137781+0000","last_peered":"2024-08-09T00:37:28.137781+0000","last_clean":"2024-08-09T00:37:28.137781+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:37:28.137781+0000","last_undegraded":"2024-08-09T00:37:28.137781+0000","last_fullsized":"2024-08-09T00:37:28.137781+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:04.343684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'174","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844794+0000","last_change":"2024-08-08T23:29:01.582685+0000","last_active":"2024-08-09T00:36:07.844794+0000","last_peered":"2024-08-09T00:36:07.844794+0000","last_clean":"2024-08-09T00:36:07.844794+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:36:07.844794+0000","last_undegraded":"2024-08-09T00:36:07.844794+0000","last_fullsized":"2024-08-09T00:36:07.844794+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:29:26.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6576285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":22191,"num_write":1034,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048658+0000","last_change":"2024-08-08T23:28:28.771835+0000","last_active":"2024-08-09T00:36:13.048658+0000","last_peered":"2024-08-09T00:36:13.048658+0000","last_clean":"2024-08-09T00:36:13.048658+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:36:13.048658+0000","last_undegraded":"2024-08-09T00:36:13.048658+0000","last_fullsized":"2024-08-09T00:36:13.048658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'216","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.965960+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:39:08.965960+0000","last_peered":"2024-08-09T00:39:08.965960+0000","last_clean":"2024-08-09T00:39:08.965960+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:39:08.965960+0000","last_undegraded":"2024-08-09T00:39:08.965960+0000","last_fullsized":"2024-08-09T00:39:08.965960+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:08:57.234564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":275,"num_write":166,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846496+0000","last_change":"2024-08-08T23:28:32.817763+0000","last_active":"2024-08-09T00:36:12.846496+0000","last_peered":"2024-08-09T00:36:12.846496+0000","last_clean":"2024-08-09T00:36:12.846496+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:36:12.846496+0000","last_undegraded":"2024-08-09T00:36:12.846496+0000","last_fullsized":"2024-08-09T00:36:12.846496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:21:08.427418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2399","reported_seq":4282,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.107418+0000","last_change":"2024-08-08T23:28:34.824612+0000","last_active":"2024-08-09T00:39:54.107418+0000","last_peered":"2024-08-09T00:39:54.107418+0000","last_clean":"2024-08-09T00:39:54.107418+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:39:54.107418+0000","last_undegraded":"2024-08-09T00:39:54.107418+0000","last_fullsized":"2024-08-09T00:39:54.107418+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":2300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:14:35.095843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047473+0000","last_change":"2024-08-08T23:28:26.791324+0000","last_active":"2024-08-09T00:36:08.047473+0000","last_peered":"2024-08-09T00:36:08.047473+0000","last_clean":"2024-08-09T00:36:08.047473+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:36:08.047473+0000","last_undegraded":"2024-08-09T00:36:08.047473+0000","last_fullsized":"2024-08-09T00:36:08.047473+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:56.405552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'181","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815607+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:36:07.815607+0000","last_peered":"2024-08-09T00:36:07.815607+0000","last_clean":"2024-08-09T00:36:07.815607+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:36:07.815607+0000","last_undegraded":"2024-08-09T00:36:07.815607+0000","last_fullsized":"2024-08-09T00:36:07.815607+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:48.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155271,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":389,"num_read_kb":16280,"num_write":967,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.649204+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:36:27.649204+0000","last_peered":"2024-08-09T00:36:27.649204+0000","last_clean":"2024-08-09T00:36:27.649204+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:36:27.649204+0000","last_undegraded":"2024-08-09T00:36:27.649204+0000","last_fullsized":"2024-08-09T00:36:27.649204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:59.953494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.254771+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:39:11.254771+0000","last_peered":"2024-08-09T00:39:11.254771+0000","last_clean":"2024-08-09T00:39:11.254771+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:39:11.254771+0000","last_undegraded":"2024-08-09T00:39:11.254771+0000","last_fullsized":"2024-08-09T00:39:11.254771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:58:11.384265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819027+0000","last_change":"2024-08-08T23:28:32.826736+0000","last_active":"2024-08-09T00:36:12.819027+0000","last_peered":"2024-08-09T00:36:12.819027+0000","last_clean":"2024-08-09T00:36:12.819027+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:36:12.819027+0000","last_undegraded":"2024-08-09T00:36:12.819027+0000","last_fullsized":"2024-08-09T00:36:12.819027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:45:43.822368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'134","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.448507+0000","last_change":"2024-08-08T23:28:34.836179+0000","last_active":"2024-08-09T00:39:52.448507+0000","last_peered":"2024-08-09T00:39:52.448507+0000","last_clean":"2024-08-09T00:39:52.448507+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:39:52.448507+0000","last_undegraded":"2024-08-09T00:39:52.448507+0000","last_fullsized":"2024-08-09T00:39:52.448507+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:42.899329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:24.902450+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:36:24.902450+0000","last_peered":"2024-08-09T00:36:24.902450+0000","last_clean":"2024-08-09T00:36:24.902450+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:36:24.902450+0000","last_undegraded":"2024-08-09T00:36:24.902450+0000","last_fullsized":"2024-08-09T00:36:24.902450+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:07:42.497596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'224","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:58.387270+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:38:58.387270+0000","last_peered":"2024-08-09T00:38:58.387270+0000","last_clean":"2024-08-09T00:38:58.387270+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:38:58.387270+0000","last_undegraded":"2024-08-09T00:38:58.387270+0000","last_fullsized":"2024-08-09T00:38:58.387270+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:42:05.542806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895562,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":26852,"num_write":1136,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645614+0000","last_change":"2024-08-08T23:28:28.771848+0000","last_active":"2024-08-09T00:36:12.645614+0000","last_peered":"2024-08-09T00:36:12.645614+0000","last_clean":"2024-08-09T00:36:12.645614+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:36:12.645614+0000","last_undegraded":"2024-08-09T00:36:12.645614+0000","last_fullsized":"2024-08-09T00:36:12.645614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:28.078906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'147","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.365433+0000","last_change":"2024-08-08T23:28:30.779574+0000","last_active":"2024-08-09T00:39:11.365433+0000","last_peered":"2024-08-09T00:39:11.365433+0000","last_clean":"2024-08-09T00:39:11.365433+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:39:11.365433+0000","last_undegraded":"2024-08-09T00:39:11.365433+0000","last_fullsized":"2024-08-09T00:39:11.365433+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:33:41.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'510","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.953210+0000","last_change":"2024-08-08T23:28:32.809653+0000","last_active":"2024-08-09T00:39:58.953210+0000","last_peered":"2024-08-09T00:39:58.953210+0000","last_clean":"2024-08-09T00:39:58.953210+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:39:58.953210+0000","last_undegraded":"2024-08-09T00:39:58.953210+0000","last_fullsized":"2024-08-09T00:39:58.953210+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:24:46.048044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'202","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.763064+0000","last_change":"2024-08-08T23:28:34.809979+0000","last_active":"2024-08-09T00:39:52.763064+0000","last_peered":"2024-08-09T00:39:52.763064+0000","last_clean":"2024-08-09T00:39:52.763064+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:39:52.763064+0000","last_undegraded":"2024-08-09T00:39:52.763064+0000","last_fullsized":"2024-08-09T00:39:52.763064+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:31.899889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'197","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644339+0000","last_change":"2024-08-08T23:28:26.776218+0000","last_active":"2024-08-09T00:36:07.644339+0000","last_peered":"2024-08-09T00:36:07.644339+0000","last_clean":"2024-08-09T00:36:07.644339+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:36:07.644339+0000","last_undegraded":"2024-08-09T00:36:07.644339+0000","last_fullsized":"2024-08-09T00:36:07.644339+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:48.787304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'178","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818116+0000","last_change":"2024-08-08T23:28:24.782432+0000","last_active":"2024-08-09T00:36:07.818116+0000","last_peered":"2024-08-09T00:36:07.818116+0000","last_clean":"2024-08-09T00:36:07.818116+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:36:07.818116+0000","last_undegraded":"2024-08-09T00:36:07.818116+0000","last_fullsized":"2024-08-09T00:36:07.818116+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:18.496718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2433240,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":343,"num_read_kb":11144,"num_write":992,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048748+0000","last_change":"2024-08-08T23:28:28.772715+0000","last_active":"2024-08-09T00:36:13.048748+0000","last_peered":"2024-08-09T00:36:13.048748+0000","last_clean":"2024-08-09T00:36:13.048748+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:36:13.048748+0000","last_undegraded":"2024-08-09T00:36:13.048748+0000","last_fullsized":"2024-08-09T00:36:13.048748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:38.667154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'143","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.384877+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:39:11.384877+0000","last_peered":"2024-08-09T00:39:11.384877+0000","last_clean":"2024-08-09T00:39:11.384877+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:39:11.384877+0000","last_undegraded":"2024-08-09T00:39:11.384877+0000","last_fullsized":"2024-08-09T00:39:11.384877+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:25:51.738224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":250,"num_write":102,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'522","reported_seq":2423,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.960804+0000","last_change":"2024-08-08T23:28:32.811070+0000","last_active":"2024-08-09T00:39:58.960804+0000","last_peered":"2024-08-09T00:39:58.960804+0000","last_clean":"2024-08-09T00:39:58.960804+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:39:58.960804+0000","last_undegraded":"2024-08-09T00:39:58.960804+0000","last_fullsized":"2024-08-09T00:39:58.960804+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:13.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.775798+0000","last_change":"2024-08-08T23:28:26.793556+0000","last_active":"2024-08-09T00:38:37.775798+0000","last_peered":"2024-08-09T00:38:37.775798+0000","last_clean":"2024-08-09T00:38:37.775798+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:38:37.775798+0000","last_undegraded":"2024-08-09T00:38:37.775798+0000","last_fullsized":"2024-08-09T00:38:37.775798+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:58:15.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'199","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845093+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:36:07.845093+0000","last_peered":"2024-08-09T00:36:07.845093+0000","last_clean":"2024-08-09T00:36:07.845093+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:36:07.845093+0000","last_undegraded":"2024-08-09T00:36:07.845093+0000","last_fullsized":"2024-08-09T00:36:07.845093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:39.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265532,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":38000,"num_write":1172,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868934+0000","last_change":"2024-08-08T23:28:28.785365+0000","last_active":"2024-08-09T00:37:52.868934+0000","last_peered":"2024-08-09T00:37:52.868934+0000","last_clean":"2024-08-09T00:37:52.868934+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:37:52.868934+0000","last_undegraded":"2024-08-09T00:37:52.868934+0000","last_fullsized":"2024-08-09T00:37:52.868934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:37.826252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'263","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.888477+0000","last_change":"2024-08-08T23:28:31.043616+0000","last_active":"2024-08-09T00:39:58.888477+0000","last_peered":"2024-08-09T00:39:58.888477+0000","last_clean":"2024-08-09T00:39:58.888477+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:39:58.888477+0000","last_undegraded":"2024-08-09T00:39:58.888477+0000","last_fullsized":"2024-08-09T00:39:58.888477+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:10:22.767945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8771,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":410,"num_write":220,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828810+0000","last_change":"2024-08-08T23:28:32.806513+0000","last_active":"2024-08-09T00:36:02.828810+0000","last_peered":"2024-08-09T00:36:02.828810+0000","last_clean":"2024-08-09T00:36:02.828810+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:36:02.828810+0000","last_undegraded":"2024-08-09T00:36:02.828810+0000","last_fullsized":"2024-08-09T00:36:02.828810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:46.925794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'551","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.923595+0000","last_change":"2024-08-08T23:28:34.840230+0000","last_active":"2024-08-09T00:39:58.923595+0000","last_peered":"2024-08-09T00:39:58.923595+0000","last_clean":"2024-08-09T00:39:58.923595+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:39:58.923595+0000","last_undegraded":"2024-08-09T00:39:58.923595+0000","last_fullsized":"2024-08-09T00:39:58.923595+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:31:37.941097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4315","reported_seq":4942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.368667+0000","last_change":"2024-08-08T23:28:26.754321+0000","last_active":"2024-08-09T00:39:09.368667+0000","last_peered":"2024-08-09T00:39:09.368667+0000","last_clean":"2024-08-09T00:39:09.368667+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:39:09.368667+0000","last_undegraded":"2024-08-09T00:39:09.368667+0000","last_fullsized":"2024-08-09T00:39:09.368667+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:13.192471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'228","reported_seq":1088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873654+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:38:12.873654+0000","last_peered":"2024-08-09T00:38:12.873654+0000","last_clean":"2024-08-09T00:38:12.873654+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:38:12.873654+0000","last_undegraded":"2024-08-09T00:38:12.873654+0000","last_fullsized":"2024-08-09T00:38:12.873654+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:53.700576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":40415,"num_write":1267,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843723+0000","last_change":"2024-08-08T23:28:28.772465+0000","last_active":"2024-08-09T00:37:52.843723+0000","last_peered":"2024-08-09T00:37:52.843723+0000","last_clean":"2024-08-09T00:37:52.843723+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:37:52.843723+0000","last_undegraded":"2024-08-09T00:37:52.843723+0000","last_fullsized":"2024-08-09T00:37:52.843723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:08.165167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'142","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.329872+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:39:11.329872+0000","last_peered":"2024-08-09T00:39:11.329872+0000","last_clean":"2024-08-09T00:39:11.329872+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:39:11.329872+0000","last_undegraded":"2024-08-09T00:39:11.329872+0000","last_fullsized":"2024-08-09T00:39:11.329872+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:47.333462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":237,"num_write":98,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.671591+0000","last_change":"2024-08-08T23:28:32.799931+0000","last_active":"2024-08-09T00:38:07.671591+0000","last_peered":"2024-08-09T00:38:07.671591+0000","last_clean":"2024-08-09T00:38:07.671591+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:38:07.671591+0000","last_undegraded":"2024-08-09T00:38:07.671591+0000","last_fullsized":"2024-08-09T00:38:07.671591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:18.351011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'95","reported_seq":601,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839035+0000","last_change":"2024-08-08T23:28:34.829500+0000","last_active":"2024-08-09T00:37:32.839035+0000","last_peered":"2024-08-09T00:37:32.839035+0000","last_clean":"2024-08-09T00:37:32.839035+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:37:32.839035+0000","last_undegraded":"2024-08-09T00:37:32.839035+0000","last_fullsized":"2024-08-09T00:37:32.839035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:50.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'226","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:09.757893+0000","last_change":"2024-08-08T23:28:26.774608+0000","last_active":"2024-08-09T00:38:09.757893+0000","last_peered":"2024-08-09T00:38:09.757893+0000","last_clean":"2024-08-09T00:38:09.757893+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:38:09.757893+0000","last_undegraded":"2024-08-09T00:38:09.757893+0000","last_fullsized":"2024-08-09T00:38:09.757893+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:00:42.181061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'156","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873595+0000","last_change":"2024-08-08T23:28:24.823026+0000","last_active":"2024-08-09T00:38:12.873595+0000","last_peered":"2024-08-09T00:38:12.873595+0000","last_clean":"2024-08-09T00:38:12.873595+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:38:12.873595+0000","last_undegraded":"2024-08-09T00:38:12.873595+0000","last_fullsized":"2024-08-09T00:38:12.873595+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:44.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3698921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":142181,"num_write":940,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822571+0000","last_change":"2024-08-08T23:28:28.775239+0000","last_active":"2024-08-09T00:36:02.822571+0000","last_peered":"2024-08-09T00:36:02.822571+0000","last_clean":"2024-08-09T00:36:02.822571+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:36:02.822571+0000","last_undegraded":"2024-08-09T00:36:02.822571+0000","last_fullsized":"2024-08-09T00:36:02.822571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:13:33.333304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'207","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.894182+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:39:58.894182+0000","last_peered":"2024-08-09T00:39:58.894182+0000","last_clean":"2024-08-09T00:39:58.894182+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:39:58.894182+0000","last_undegraded":"2024-08-09T00:39:58.894182+0000","last_fullsized":"2024-08-09T00:39:58.894182+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:08.571641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16354,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":341,"num_write":170,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'506","reported_seq":4394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.734428+0000","last_change":"2024-08-08T23:28:32.823537+0000","last_active":"2024-08-09T00:40:02.734428+0000","last_peered":"2024-08-09T00:40:02.734428+0000","last_clean":"2024-08-09T00:40:02.734428+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:02.734428+0000","last_undegraded":"2024-08-09T00:40:02.734428+0000","last_fullsized":"2024-08-09T00:40:02.734428+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:05.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'109","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.861091+0000","last_change":"2024-08-08T23:28:34.837367+0000","last_active":"2024-08-09T00:39:19.861091+0000","last_peered":"2024-08-09T00:39:19.861091+0000","last_clean":"2024-08-09T00:39:19.861091+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:39:19.861091+0000","last_undegraded":"2024-08-09T00:39:19.861091+0000","last_fullsized":"2024-08-09T00:39:19.861091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:08.993869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843304+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:38:12.843304+0000","last_peered":"2024-08-09T00:38:12.843304+0000","last_clean":"2024-08-09T00:38:12.843304+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:38:12.843304+0000","last_undegraded":"2024-08-09T00:38:12.843304+0000","last_fullsized":"2024-08-09T00:38:12.843304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:37:06.665341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.075069+0000","last_change":"2024-08-08T23:28:24.819082+0000","last_active":"2024-08-09T00:38:13.075069+0000","last_peered":"2024-08-09T00:38:13.075069+0000","last_clean":"2024-08-09T00:38:13.075069+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:38:13.075069+0000","last_undegraded":"2024-08-09T00:38:13.075069+0000","last_fullsized":"2024-08-09T00:38:13.075069+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:51:31.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6865694,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":514,"num_read_kb":20328,"num_write":1158,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"37'3","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.791480+0000","last_change":"2024-08-08T23:28:28.779663+0000","last_active":"2024-08-09T00:39:58.791480+0000","last_peered":"2024-08-09T00:39:58.791480+0000","last_clean":"2024-08-09T00:39:58.791480+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:39:58.791480+0000","last_undegraded":"2024-08-09T00:39:58.791480+0000","last_fullsized":"2024-08-09T00:39:58.791480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:47:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":485,"num_read_kb":483,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'244","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.899361+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:39:58.899361+0000","last_peered":"2024-08-09T00:39:58.899361+0000","last_clean":"2024-08-09T00:39:58.899361+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:39:58.899361+0000","last_undegraded":"2024-08-09T00:39:58.899361+0000","last_fullsized":"2024-08-09T00:39:58.899361+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:59.690242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52900,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":576,"num_write":196,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843661+0000","last_change":"2024-08-08T23:28:32.808451+0000","last_active":"2024-08-09T00:37:52.843661+0000","last_peered":"2024-08-09T00:37:52.843661+0000","last_clean":"2024-08-09T00:37:52.843661+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:37:52.843661+0000","last_undegraded":"2024-08-09T00:37:52.843661+0000","last_fullsized":"2024-08-09T00:37:52.843661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:52:53.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'102","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.011905+0000","last_change":"2024-08-08T23:28:34.833803+0000","last_active":"2024-08-09T00:38:30.011905+0000","last_peered":"2024-08-09T00:38:30.011905+0000","last_clean":"2024-08-09T00:38:30.011905+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:38:30.011905+0000","last_undegraded":"2024-08-09T00:38:30.011905+0000","last_fullsized":"2024-08-09T00:38:30.011905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:59:23.748669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849839+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:38:12.849839+0000","last_peered":"2024-08-09T00:38:12.849839+0000","last_clean":"2024-08-09T00:38:12.849839+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:38:12.849839+0000","last_undegraded":"2024-08-09T00:38:12.849839+0000","last_fullsized":"2024-08-09T00:38:12.849839+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:09.973740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'167","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:31.364791+0000","last_change":"2024-08-08T23:30:01.784156+0000","last_active":"2024-08-09T00:38:31.364791+0000","last_peered":"2024-08-09T00:38:31.364791+0000","last_clean":"2024-08-09T00:38:31.364791+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:38:31.364791+0000","last_undegraded":"2024-08-09T00:38:31.364791+0000","last_fullsized":"2024-08-09T00:38:31.364791+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:26.083283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444614,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":5320,"num_write":978,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822697+0000","last_change":"2024-08-08T23:28:28.780395+0000","last_active":"2024-08-09T00:36:02.822697+0000","last_peered":"2024-08-09T00:36:02.822697+0000","last_clean":"2024-08-09T00:36:02.822697+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:36:02.822697+0000","last_undegraded":"2024-08-09T00:36:02.822697+0000","last_fullsized":"2024-08-09T00:36:02.822697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:52.579128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'170","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.450349+0000","last_change":"2024-08-08T23:28:30.784352+0000","last_active":"2024-08-09T00:39:11.450349+0000","last_peered":"2024-08-09T00:39:11.450349+0000","last_clean":"2024-08-09T00:39:11.450349+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:39:11.450349+0000","last_undegraded":"2024-08-09T00:39:11.450349+0000","last_fullsized":"2024-08-09T00:39:11.450349+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:59:35.310017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":298,"num_write":188,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818266+0000","last_change":"2024-08-08T23:28:32.827076+0000","last_active":"2024-08-09T00:36:17.818266+0000","last_peered":"2024-08-09T00:36:17.818266+0000","last_clean":"2024-08-09T00:36:17.818266+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:36:17.818266+0000","last_undegraded":"2024-08-09T00:36:17.818266+0000","last_fullsized":"2024-08-09T00:36:17.818266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.028693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'134","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.323973+0000","last_change":"2024-08-08T23:28:34.836409+0000","last_active":"2024-08-09T00:39:09.323973+0000","last_peered":"2024-08-09T00:39:09.323973+0000","last_clean":"2024-08-09T00:39:09.323973+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:39:09.323973+0000","last_undegraded":"2024-08-09T00:39:09.323973+0000","last_fullsized":"2024-08-09T00:39:09.323973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:52:23.979940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'185","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849875+0000","last_change":"2024-08-08T23:28:26.768527+0000","last_active":"2024-08-09T00:38:12.849875+0000","last_peered":"2024-08-09T00:38:12.849875+0000","last_clean":"2024-08-09T00:38:12.849875+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:38:12.849875+0000","last_undegraded":"2024-08-09T00:38:12.849875+0000","last_fullsized":"2024-08-09T00:38:12.849875+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:57.863036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'204","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.846177+0000","last_change":"2024-08-08T23:28:24.767491+0000","last_active":"2024-08-09T00:37:57.846177+0000","last_peered":"2024-08-09T00:37:57.846177+0000","last_clean":"2024-08-09T00:37:57.846177+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:37:57.846177+0000","last_undegraded":"2024-08-09T00:37:57.846177+0000","last_fullsized":"2024-08-09T00:37:57.846177+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:24:23.880570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456498,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":34331,"num_write":1086,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828882+0000","last_change":"2024-08-08T23:28:28.777081+0000","last_active":"2024-08-09T00:36:02.828882+0000","last_peered":"2024-08-09T00:36:02.828882+0000","last_clean":"2024-08-09T00:36:02.828882+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:36:02.828882+0000","last_undegraded":"2024-08-09T00:36:02.828882+0000","last_fullsized":"2024-08-09T00:36:02.828882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:29.639169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'194","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.566053+0000","last_change":"2024-08-08T23:28:30.783664+0000","last_active":"2024-08-09T00:39:11.566053+0000","last_peered":"2024-08-09T00:39:11.566053+0000","last_clean":"2024-08-09T00:39:11.566053+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:39:11.566053+0000","last_undegraded":"2024-08-09T00:39:11.566053+0000","last_fullsized":"2024-08-09T00:39:11.566053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:08.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":264,"num_read_kb":353,"num_write":156,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'490","reported_seq":2254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.955189+0000","last_change":"2024-08-08T23:28:32.806321+0000","last_active":"2024-08-09T00:39:58.955189+0000","last_peered":"2024-08-09T00:39:58.955189+0000","last_clean":"2024-08-09T00:39:58.955189+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:39:58.955189+0000","last_undegraded":"2024-08-09T00:39:58.955189+0000","last_fullsized":"2024-08-09T00:39:58.955189+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:35:07.612864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.871072+0000","last_change":"2024-08-08T23:28:34.837840+0000","last_active":"2024-08-09T00:39:27.871072+0000","last_peered":"2024-08-09T00:39:27.871072+0000","last_clean":"2024-08-09T00:39:27.871072+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:39:27.871072+0000","last_undegraded":"2024-08-09T00:39:27.871072+0000","last_fullsized":"2024-08-09T00:39:27.871072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:51.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849903+0000","last_change":"2024-08-08T23:28:26.779476+0000","last_active":"2024-08-09T00:38:12.849903+0000","last_peered":"2024-08-09T00:38:12.849903+0000","last_clean":"2024-08-09T00:38:12.849903+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:38:12.849903+0000","last_undegraded":"2024-08-09T00:38:12.849903+0000","last_fullsized":"2024-08-09T00:38:12.849903+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:31:06.993378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'201","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:10.488115+0000","last_change":"2024-08-08T23:28:24.790265+0000","last_active":"2024-08-09T00:38:10.488115+0000","last_peered":"2024-08-09T00:38:10.488115+0000","last_clean":"2024-08-09T00:38:10.488115+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:38:10.488115+0000","last_undegraded":"2024-08-09T00:38:10.488115+0000","last_fullsized":"2024-08-09T00:38:10.488115+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:21.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443685,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":23703,"num_write":1087,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.559910+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:39:58.559910+0000","last_peered":"2024-08-09T00:39:58.559910+0000","last_clean":"2024-08-09T00:39:58.559910+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:39:58.559910+0000","last_undegraded":"2024-08-09T00:39:58.559910+0000","last_fullsized":"2024-08-09T00:39:58.559910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:45.142309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":634,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'105","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.103522+0000","last_change":"2024-08-08T23:28:31.048124+0000","last_active":"2024-08-09T00:39:11.103522+0000","last_peered":"2024-08-09T00:39:11.103522+0000","last_clean":"2024-08-09T00:39:11.103522+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:39:11.103522+0000","last_undegraded":"2024-08-09T00:39:11.103522+0000","last_fullsized":"2024-08-09T00:39:11.103522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:47:38.686500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'497","reported_seq":2257,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.958326+0000","last_change":"2024-08-08T23:28:32.814344+0000","last_active":"2024-08-09T00:39:58.958326+0000","last_peered":"2024-08-09T00:39:58.958326+0000","last_clean":"2024-08-09T00:39:58.958326+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:39:58.958326+0000","last_undegraded":"2024-08-09T00:39:58.958326+0000","last_fullsized":"2024-08-09T00:39:58.958326+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:20.130194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836068+0000","last_change":"2024-08-08T23:28:34.832392+0000","last_active":"2024-08-09T00:37:22.836068+0000","last_peered":"2024-08-09T00:37:22.836068+0000","last_clean":"2024-08-09T00:37:22.836068+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:37:22.836068+0000","last_undegraded":"2024-08-09T00:37:22.836068+0000","last_fullsized":"2024-08-09T00:37:22.836068+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:53:39.542207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'461","reported_seq":1174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831471+0000","last_change":"2024-08-08T23:28:26.762100+0000","last_active":"2024-08-09T00:36:12.831471+0000","last_peered":"2024-08-09T00:36:12.831471+0000","last_clean":"2024-08-09T00:36:12.831471+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:36:12.831471+0000","last_undegraded":"2024-08-09T00:36:12.831471+0000","last_fullsized":"2024-08-09T00:36:12.831471+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:31:41.700529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'177","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667019+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:37:47.667019+0000","last_peered":"2024-08-09T00:37:47.667019+0000","last_clean":"2024-08-09T00:37:47.667019+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:37:47.667019+0000","last_undegraded":"2024-08-09T00:37:47.667019+0000","last_fullsized":"2024-08-09T00:37:47.667019+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:55.568959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":4543,"num_write":1041,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816540+0000","last_change":"2024-08-08T23:28:28.778804+0000","last_active":"2024-08-09T00:36:02.816540+0000","last_peered":"2024-08-09T00:36:02.816540+0000","last_clean":"2024-08-09T00:36:02.816540+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:36:02.816540+0000","last_undegraded":"2024-08-09T00:36:02.816540+0000","last_fullsized":"2024-08-09T00:36:02.816540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:09:24.525056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'299","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.879310+0000","last_change":"2024-08-08T23:28:30.776772+0000","last_active":"2024-08-09T00:39:58.879310+0000","last_peered":"2024-08-09T00:39:58.879310+0000","last_clean":"2024-08-09T00:39:58.879310+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:39:58.879310+0000","last_undegraded":"2024-08-09T00:39:58.879310+0000","last_fullsized":"2024-08-09T00:39:58.879310+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:54.049825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":987,"num_read_kb":1031,"num_write":1530,"num_write_kb":1359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.817176+0000","last_change":"2024-08-08T23:28:32.821436+0000","last_active":"2024-08-09T00:36:02.817176+0000","last_peered":"2024-08-09T00:36:02.817176+0000","last_clean":"2024-08-09T00:36:02.817176+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:36:02.817176+0000","last_undegraded":"2024-08-09T00:36:02.817176+0000","last_fullsized":"2024-08-09T00:36:02.817176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:21:40.233740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'102","reported_seq":609,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.944405+0000","last_change":"2024-08-08T23:28:34.822628+0000","last_active":"2024-08-09T00:39:51.944405+0000","last_peered":"2024-08-09T00:39:51.944405+0000","last_clean":"2024-08-09T00:39:51.944405+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:39:51.944405+0000","last_undegraded":"2024-08-09T00:39:51.944405+0000","last_fullsized":"2024-08-09T00:39:51.944405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:13.362222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836399+0000","last_change":"2024-08-08T23:28:26.782849+0000","last_active":"2024-08-09T00:37:22.836399+0000","last_peered":"2024-08-09T00:37:22.836399+0000","last_clean":"2024-08-09T00:37:22.836399+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:37:22.836399+0000","last_undegraded":"2024-08-09T00:37:22.836399+0000","last_fullsized":"2024-08-09T00:37:22.836399+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:36.999822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.875811+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:38:22.875811+0000","last_peered":"2024-08-09T00:38:22.875811+0000","last_clean":"2024-08-09T00:38:22.875811+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:38:22.875811+0000","last_undegraded":"2024-08-09T00:38:22.875811+0000","last_fullsized":"2024-08-09T00:38:22.875811+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059673+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-09T00:37:03.059673+0000","last_peered":"2024-08-09T00:37:03.059673+0000","last_clean":"2024-08-09T00:37:03.059673+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:37:03.059673+0000","last_undegraded":"2024-08-09T00:37:03.059673+0000","last_fullsized":"2024-08-09T00:37:03.059673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'169","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.659235+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:37:12.659235+0000","last_peered":"2024-08-09T00:37:12.659235+0000","last_clean":"2024-08-09T00:37:12.659235+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:37:12.659235+0000","last_undegraded":"2024-08-09T00:37:12.659235+0000","last_fullsized":"2024-08-09T00:37:12.659235+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:08.383791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423898,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":19880,"num_write":945,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.861276+0000","last_change":"2024-08-08T23:28:28.785997+0000","last_active":"2024-08-09T00:37:17.861276+0000","last_peered":"2024-08-09T00:37:17.861276+0000","last_clean":"2024-08-09T00:37:17.861276+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:37:17.861276+0000","last_undegraded":"2024-08-09T00:37:17.861276+0000","last_fullsized":"2024-08-09T00:37:17.861276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:19.940501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'322","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.911428+0000","last_change":"2024-08-08T23:28:30.788180+0000","last_active":"2024-08-09T00:39:58.911428+0000","last_peered":"2024-08-09T00:39:58.911428+0000","last_clean":"2024-08-09T00:39:58.911428+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:39:58.911428+0000","last_undegraded":"2024-08-09T00:39:58.911428+0000","last_fullsized":"2024-08-09T00:39:58.911428+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:08.134619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":621,"num_read_kb":848,"num_write":582,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.839007+0000","last_change":"2024-08-08T23:28:32.821568+0000","last_active":"2024-08-09T00:37:52.839007+0000","last_peered":"2024-08-09T00:37:52.839007+0000","last_clean":"2024-08-09T00:37:52.839007+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:37:52.839007+0000","last_undegraded":"2024-08-09T00:37:52.839007+0000","last_fullsized":"2024-08-09T00:37:52.839007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:04:45.502986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'206","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.227768+0000","last_change":"2024-08-08T23:28:34.829682+0000","last_active":"2024-08-09T00:39:54.227768+0000","last_peered":"2024-08-09T00:39:54.227768+0000","last_clean":"2024-08-09T00:39:54.227768+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:39:54.227768+0000","last_undegraded":"2024-08-09T00:39:54.227768+0000","last_fullsized":"2024-08-09T00:39:54.227768+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:20:02.874767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'188","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:08.036140+0000","last_change":"2024-08-08T23:28:26.775022+0000","last_active":"2024-08-09T00:38:08.036140+0000","last_peered":"2024-08-09T00:38:08.036140+0000","last_clean":"2024-08-09T00:38:08.036140+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:38:08.036140+0000","last_undegraded":"2024-08-09T00:38:08.036140+0000","last_fullsized":"2024-08-09T00:38:08.036140+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:54.073153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849650+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:36:27.849650+0000","last_peered":"2024-08-09T00:36:27.849650+0000","last_clean":"2024-08-09T00:36:27.849650+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:36:27.849650+0000","last_undegraded":"2024-08-09T00:36:27.849650+0000","last_fullsized":"2024-08-09T00:36:27.849650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'199","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830339+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:37:12.830339+0000","last_peered":"2024-08-09T00:37:12.830339+0000","last_clean":"2024-08-09T00:37:12.830339+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:37:12.830339+0000","last_undegraded":"2024-08-09T00:37:12.830339+0000","last_fullsized":"2024-08-09T00:37:12.830339+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:09.134864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3726460,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":17063,"num_write":1106,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070776+0000","last_change":"2024-08-08T23:28:28.772772+0000","last_active":"2024-08-09T00:37:53.070776+0000","last_peered":"2024-08-09T00:37:53.070776+0000","last_clean":"2024-08-09T00:37:53.070776+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:37:53.070776+0000","last_undegraded":"2024-08-09T00:37:53.070776+0000","last_fullsized":"2024-08-09T00:37:53.070776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:35:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'679","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.162698+0000","last_change":"2024-08-08T23:28:30.774420+0000","last_active":"2024-08-09T00:39:59.162698+0000","last_peered":"2024-08-09T00:39:59.162698+0000","last_clean":"2024-08-09T00:39:59.162698+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:39:59.162698+0000","last_undegraded":"2024-08-09T00:39:59.162698+0000","last_fullsized":"2024-08-09T00:39:59.162698+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":600,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:41.556054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38624,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":976,"num_read_kb":1169,"num_write":310,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:27.863596+0000","last_change":"2024-08-08T23:28:32.810173+0000","last_active":"2024-08-09T00:37:27.863596+0000","last_peered":"2024-08-09T00:37:27.863596+0000","last_clean":"2024-08-09T00:37:27.863596+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:37:27.863596+0000","last_undegraded":"2024-08-09T00:37:27.863596+0000","last_fullsized":"2024-08-09T00:37:27.863596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:44.557649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'129","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855394+0000","last_change":"2024-08-08T23:28:34.828009+0000","last_active":"2024-08-09T00:38:12.855394+0000","last_peered":"2024-08-09T00:38:12.855394+0000","last_clean":"2024-08-09T00:38:12.855394+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:38:12.855394+0000","last_undegraded":"2024-08-09T00:38:12.855394+0000","last_fullsized":"2024-08-09T00:38:12.855394+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:16:30.650076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:19.246847+0000","last_change":"2024-08-08T23:28:26.777388+0000","last_active":"2024-08-09T00:38:19.246847+0000","last_peered":"2024-08-09T00:38:19.246847+0000","last_clean":"2024-08-09T00:38:19.246847+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:38:19.246847+0000","last_undegraded":"2024-08-09T00:38:19.246847+0000","last_fullsized":"2024-08-09T00:38:19.246847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:00:11.706140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834117+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-09T00:37:02.834117+0000","last_peered":"2024-08-09T00:37:02.834117+0000","last_clean":"2024-08-09T00:37:02.834117+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:37:02.834117+0000","last_undegraded":"2024-08-09T00:37:02.834117+0000","last_fullsized":"2024-08-09T00:37:02.834117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'152","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.028592+0000","last_change":"2024-08-08T23:28:24.757810+0000","last_active":"2024-08-09T00:39:28.028592+0000","last_peered":"2024-08-09T00:39:28.028592+0000","last_clean":"2024-08-09T00:39:28.028592+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:39:28.028592+0000","last_undegraded":"2024-08-09T00:39:28.028592+0000","last_fullsized":"2024-08-09T00:39:28.028592+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:35.709380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12202139,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":424,"num_read_kb":29266,"num_write":855,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843917+0000","last_change":"2024-08-08T23:28:28.775991+0000","last_active":"2024-08-09T00:37:52.843917+0000","last_peered":"2024-08-09T00:37:52.843917+0000","last_clean":"2024-08-09T00:37:52.843917+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:37:52.843917+0000","last_undegraded":"2024-08-09T00:37:52.843917+0000","last_fullsized":"2024-08-09T00:37:52.843917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:48.817766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.141922+0000","last_change":"2024-08-08T23:28:31.049356+0000","last_active":"2024-08-09T00:39:59.141922+0000","last_peered":"2024-08-09T00:39:59.141922+0000","last_clean":"2024-08-09T00:39:59.141922+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:39:59.141922+0000","last_undegraded":"2024-08-09T00:39:59.141922+0000","last_fullsized":"2024-08-09T00:39:59.141922+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:10.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831629+0000","last_change":"2024-08-08T23:28:32.827179+0000","last_active":"2024-08-09T00:37:17.831629+0000","last_peered":"2024-08-09T00:37:17.831629+0000","last_clean":"2024-08-09T00:37:17.831629+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:37:17.831629+0000","last_undegraded":"2024-08-09T00:37:17.831629+0000","last_fullsized":"2024-08-09T00:37:17.831629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:18.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'277","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.918904+0000","last_change":"2024-08-08T23:28:34.830435+0000","last_active":"2024-08-09T00:39:52.918904+0000","last_peered":"2024-08-09T00:39:52.918904+0000","last_clean":"2024-08-09T00:39:52.918904+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:39:52.918904+0000","last_undegraded":"2024-08-09T00:39:52.918904+0000","last_fullsized":"2024-08-09T00:39:52.918904+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:09.607368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843420+0000","last_change":"2024-08-08T23:28:26.762755+0000","last_active":"2024-08-09T00:37:12.843420+0000","last_peered":"2024-08-09T00:37:12.843420+0000","last_clean":"2024-08-09T00:37:12.843420+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:37:12.843420+0000","last_undegraded":"2024-08-09T00:37:12.843420+0000","last_fullsized":"2024-08-09T00:37:12.843420+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:23:47.959221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059606+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-09T00:37:03.059606+0000","last_peered":"2024-08-09T00:37:03.059606+0000","last_clean":"2024-08-09T00:37:03.059606+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:37:03.059606+0000","last_undegraded":"2024-08-09T00:37:03.059606+0000","last_fullsized":"2024-08-09T00:37:03.059606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'192","reported_seq":831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833282+0000","last_change":"2024-08-08T23:28:24.760341+0000","last_active":"2024-08-09T00:37:12.833282+0000","last_peered":"2024-08-09T00:37:12.833282+0000","last_clean":"2024-08-09T00:37:12.833282+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:37:12.833282+0000","last_undegraded":"2024-08-09T00:37:12.833282+0000","last_fullsized":"2024-08-09T00:37:12.833282+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:38.374476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053350,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":408,"num_read_kb":7644,"num_write":1036,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.834591+0000","last_change":"2024-08-08T23:28:28.778088+0000","last_active":"2024-08-09T00:37:32.834591+0000","last_peered":"2024-08-09T00:37:32.834591+0000","last_clean":"2024-08-09T00:37:32.834591+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:37:32.834591+0000","last_undegraded":"2024-08-09T00:37:32.834591+0000","last_fullsized":"2024-08-09T00:37:32.834591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:46.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.518432+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:39:52.518432+0000","last_peered":"2024-08-09T00:39:52.518432+0000","last_clean":"2024-08-09T00:39:52.518432+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:39:52.518432+0000","last_undegraded":"2024-08-09T00:39:52.518432+0000","last_fullsized":"2024-08-09T00:39:52.518432+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:19.698033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844707+0000","last_change":"2024-08-08T23:28:32.831075+0000","last_active":"2024-08-09T00:37:52.844707+0000","last_peered":"2024-08-09T00:37:52.844707+0000","last_clean":"2024-08-09T00:37:52.844707+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:37:52.844707+0000","last_undegraded":"2024-08-09T00:37:52.844707+0000","last_fullsized":"2024-08-09T00:37:52.844707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:55:52.866081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'113","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:58.071702+0000","last_change":"2024-08-08T23:28:34.834032+0000","last_active":"2024-08-09T00:37:58.071702+0000","last_peered":"2024-08-09T00:37:58.071702+0000","last_clean":"2024-08-09T00:37:58.071702+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:37:58.071702+0000","last_undegraded":"2024-08-09T00:37:58.071702+0000","last_fullsized":"2024-08-09T00:37:58.071702+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:41.070436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'155","reported_seq":753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:21.963237+0000","last_change":"2024-08-08T23:28:26.777411+0000","last_active":"2024-08-09T00:38:21.963237+0000","last_peered":"2024-08-09T00:38:21.963237+0000","last_clean":"2024-08-09T00:38:21.963237+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:38:21.963237+0000","last_undegraded":"2024-08-09T00:38:21.963237+0000","last_fullsized":"2024-08-09T00:38:21.963237+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:18.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'225","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.064954+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:37:28.064954+0000","last_peered":"2024-08-09T00:37:28.064954+0000","last_clean":"2024-08-09T00:37:28.064954+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:37:28.064954+0000","last_undegraded":"2024-08-09T00:37:28.064954+0000","last_fullsized":"2024-08-09T00:37:28.064954+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:17.537000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506136,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":805,"num_read_kb":62351,"num_write":1157,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.841587+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-09T00:37:02.841587+0000","last_peered":"2024-08-09T00:37:02.841587+0000","last_clean":"2024-08-09T00:37:02.841587+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:37:02.841587+0000","last_undegraded":"2024-08-09T00:37:02.841587+0000","last_fullsized":"2024-08-09T00:37:02.841587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831582+0000","last_change":"2024-08-08T23:28:28.783451+0000","last_active":"2024-08-09T00:37:17.831582+0000","last_peered":"2024-08-09T00:37:17.831582+0000","last_clean":"2024-08-09T00:37:17.831582+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:37:17.831582+0000","last_undegraded":"2024-08-09T00:37:17.831582+0000","last_fullsized":"2024-08-09T00:37:17.831582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:47:09.084557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'302","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.913667+0000","last_change":"2024-08-08T23:28:30.784027+0000","last_active":"2024-08-09T00:39:58.913667+0000","last_peered":"2024-08-09T00:39:58.913667+0000","last_clean":"2024-08-09T00:39:58.913667+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:39:58.913667+0000","last_undegraded":"2024-08-09T00:39:58.913667+0000","last_fullsized":"2024-08-09T00:39:58.913667+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:56:56.170296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34540,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":434,"num_read_kb":591,"num_write":250,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834636+0000","last_change":"2024-08-08T23:28:32.814130+0000","last_active":"2024-08-09T00:37:17.834636+0000","last_peered":"2024-08-09T00:37:17.834636+0000","last_clean":"2024-08-09T00:37:17.834636+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:37:17.834636+0000","last_undegraded":"2024-08-09T00:37:17.834636+0000","last_fullsized":"2024-08-09T00:37:17.834636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:24:28.569706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'117","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.476580+0000","last_change":"2024-08-08T23:28:34.838026+0000","last_active":"2024-08-09T00:39:53.476580+0000","last_peered":"2024-08-09T00:39:53.476580+0000","last_clean":"2024-08-09T00:39:53.476580+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:39:53.476580+0000","last_undegraded":"2024-08-09T00:39:53.476580+0000","last_fullsized":"2024-08-09T00:39:53.476580+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:23.463646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.431957+0000","last_change":"2024-08-08T23:28:26.780124+0000","last_active":"2024-08-09T00:39:27.431957+0000","last_peered":"2024-08-09T00:39:27.431957+0000","last_clean":"2024-08-09T00:39:27.431957+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:39:27.431957+0000","last_undegraded":"2024-08-09T00:39:27.431957+0000","last_fullsized":"2024-08-09T00:39:27.431957+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:11.326856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'311","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843393+0000","last_change":"2024-08-08T23:28:24.764595+0000","last_active":"2024-08-09T00:37:12.843393+0000","last_peered":"2024-08-09T00:37:12.843393+0000","last_clean":"2024-08-09T00:37:12.843393+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:37:12.843393+0000","last_undegraded":"2024-08-09T00:37:12.843393+0000","last_fullsized":"2024-08-09T00:37:12.843393+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:13.394500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14943339,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":185751,"num_write":1329,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.860057+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:37:12.860057+0000","last_peered":"2024-08-09T00:37:12.860057+0000","last_clean":"2024-08-09T00:37:12.860057+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:37:12.860057+0000","last_undegraded":"2024-08-09T00:37:12.860057+0000","last_fullsized":"2024-08-09T00:37:12.860057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835003+0000","last_change":"2024-08-08T23:28:28.779571+0000","last_active":"2024-08-09T00:37:17.835003+0000","last_peered":"2024-08-09T00:37:17.835003+0000","last_clean":"2024-08-09T00:37:17.835003+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:37:17.835003+0000","last_undegraded":"2024-08-09T00:37:17.835003+0000","last_fullsized":"2024-08-09T00:37:17.835003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:59:20.339670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'221","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.327545+0000","last_change":"2024-08-08T23:28:31.042472+0000","last_active":"2024-08-09T00:39:48.327545+0000","last_peered":"2024-08-09T00:39:48.327545+0000","last_clean":"2024-08-09T00:39:48.327545+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:39:48.327545+0000","last_undegraded":"2024-08-09T00:39:48.327545+0000","last_fullsized":"2024-08-09T00:39:48.327545+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:24.658995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'525","reported_seq":4398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.950770+0000","last_change":"2024-08-08T23:28:32.815950+0000","last_active":"2024-08-09T00:39:58.950770+0000","last_peered":"2024-08-09T00:39:58.950770+0000","last_clean":"2024-08-09T00:39:58.950770+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:39:58.950770+0000","last_undegraded":"2024-08-09T00:39:58.950770+0000","last_fullsized":"2024-08-09T00:39:58.950770+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:11.787941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'164","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.453818+0000","last_change":"2024-08-08T23:28:34.830158+0000","last_active":"2024-08-09T00:39:54.453818+0000","last_peered":"2024-08-09T00:39:54.453818+0000","last_clean":"2024-08-09T00:39:54.453818+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:39:54.453818+0000","last_undegraded":"2024-08-09T00:39:54.453818+0000","last_fullsized":"2024-08-09T00:39:54.453818+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:25.038657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":713,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.619859+0000","last_change":"2024-08-08T23:28:26.776845+0000","last_active":"2024-08-09T00:37:15.619859+0000","last_peered":"2024-08-09T00:37:15.619859+0000","last_clean":"2024-08-09T00:37:15.619859+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:37:15.619859+0000","last_undegraded":"2024-08-09T00:37:15.619859+0000","last_fullsized":"2024-08-09T00:37:15.619859+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:55:03.906562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667331+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:37:47.667331+0000","last_peered":"2024-08-09T00:37:47.667331+0000","last_clean":"2024-08-09T00:37:47.667331+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:37:47.667331+0000","last_undegraded":"2024-08-09T00:37:47.667331+0000","last_fullsized":"2024-08-09T00:37:47.667331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:13.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535244,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1086,"num_read_kb":6563,"num_write":1289,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.848189+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-09T00:37:37.848189+0000","last_peered":"2024-08-09T00:37:37.848189+0000","last_clean":"2024-08-09T00:37:37.848189+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:37:37.848189+0000","last_undegraded":"2024-08-09T00:37:37.848189+0000","last_fullsized":"2024-08-09T00:37:37.848189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834567+0000","last_change":"2024-08-08T23:28:28.777156+0000","last_active":"2024-08-09T00:37:17.834567+0000","last_peered":"2024-08-09T00:37:17.834567+0000","last_clean":"2024-08-09T00:37:17.834567+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:37:17.834567+0000","last_undegraded":"2024-08-09T00:37:17.834567+0000","last_fullsized":"2024-08-09T00:37:17.834567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:42.927296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'148","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.398773+0000","last_change":"2024-08-08T23:28:30.790179+0000","last_active":"2024-08-09T00:39:11.398773+0000","last_peered":"2024-08-09T00:39:11.398773+0000","last_clean":"2024-08-09T00:39:11.398773+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:39:11.398773+0000","last_undegraded":"2024-08-09T00:39:11.398773+0000","last_fullsized":"2024-08-09T00:39:11.398773+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:38.377166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'522","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.959357+0000","last_change":"2024-08-08T23:28:32.808377+0000","last_active":"2024-08-09T00:39:58.959357+0000","last_peered":"2024-08-09T00:39:58.959357+0000","last_clean":"2024-08-09T00:39:58.959357+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:39:58.959357+0000","last_undegraded":"2024-08-09T00:39:58.959357+0000","last_fullsized":"2024-08-09T00:39:58.959357+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:26:13.925905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'236","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.845482+0000","last_change":"2024-08-08T23:28:34.832992+0000","last_active":"2024-08-09T00:38:22.845482+0000","last_peered":"2024-08-09T00:38:22.845482+0000","last_clean":"2024-08-09T00:38:22.845482+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:38:22.845482+0000","last_undegraded":"2024-08-09T00:38:22.845482+0000","last_fullsized":"2024-08-09T00:38:22.845482+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:38.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:57.761692+0000","last_change":"2024-08-08T23:28:26.770700+0000","last_active":"2024-08-09T00:38:57.761692+0000","last_peered":"2024-08-09T00:38:57.761692+0000","last_clean":"2024-08-09T00:38:57.761692+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:38:57.761692+0000","last_undegraded":"2024-08-09T00:38:57.761692+0000","last_fullsized":"2024-08-09T00:38:57.761692+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:15:02.492992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'214","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:56.150980+0000","last_change":"2024-08-08T23:29:01.887794+0000","last_active":"2024-08-09T00:38:56.150980+0000","last_peered":"2024-08-09T00:38:56.150980+0000","last_clean":"2024-08-09T00:38:56.150980+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:38:56.150980+0000","last_undegraded":"2024-08-09T00:38:56.150980+0000","last_fullsized":"2024-08-09T00:38:56.150980+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:04.725884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3108640,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":66311,"num_write":1068,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840460+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-09T00:37:37.840460+0000","last_peered":"2024-08-09T00:37:37.840460+0000","last_clean":"2024-08-09T00:37:37.840460+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:37:37.840460+0000","last_undegraded":"2024-08-09T00:37:37.840460+0000","last_fullsized":"2024-08-09T00:37:37.840460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.545277+0000","last_change":"2024-08-08T23:28:28.771236+0000","last_active":"2024-08-09T00:39:58.545277+0000","last_peered":"2024-08-09T00:39:58.545277+0000","last_clean":"2024-08-09T00:39:58.545277+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:39:58.545277+0000","last_undegraded":"2024-08-09T00:39:58.545277+0000","last_fullsized":"2024-08-09T00:39:58.545277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":792,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'338","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.855571+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:39:58.855571+0000","last_peered":"2024-08-09T00:39:58.855571+0000","last_clean":"2024-08-09T00:39:58.855571+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:39:58.855571+0000","last_undegraded":"2024-08-09T00:39:58.855571+0000","last_fullsized":"2024-08-09T00:39:58.855571+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:47.586741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30329,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":500,"num_read_kb":654,"num_write":264,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660385+0000","last_change":"2024-08-08T23:28:32.805174+0000","last_active":"2024-08-09T00:37:17.660385+0000","last_peered":"2024-08-09T00:37:17.660385+0000","last_clean":"2024-08-09T00:37:17.660385+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:37:17.660385+0000","last_undegraded":"2024-08-09T00:37:17.660385+0000","last_fullsized":"2024-08-09T00:37:17.660385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:59.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.746561+0000","last_change":"2024-08-08T23:28:34.830149+0000","last_active":"2024-08-09T00:38:37.746561+0000","last_peered":"2024-08-09T00:38:37.746561+0000","last_clean":"2024-08-09T00:38:37.746561+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:38:37.746561+0000","last_undegraded":"2024-08-09T00:38:37.746561+0000","last_fullsized":"2024-08-09T00:38:37.746561+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:14.678670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'138","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.814333+0000","last_change":"2024-08-08T23:28:34.836373+0000","last_active":"2024-08-09T00:39:52.814333+0000","last_peered":"2024-08-09T00:39:52.814333+0000","last_clean":"2024-08-09T00:39:52.814333+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:39:52.814333+0000","last_undegraded":"2024-08-09T00:39:52.814333+0000","last_fullsized":"2024-08-09T00:39:52.814333+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:53:20.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817769+0000","last_change":"2024-08-08T23:28:26.776818+0000","last_active":"2024-08-09T00:36:07.817769+0000","last_peered":"2024-08-09T00:36:07.817769+0000","last_clean":"2024-08-09T00:36:07.817769+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:36:07.817769+0000","last_undegraded":"2024-08-09T00:36:07.817769+0000","last_fullsized":"2024-08-09T00:36:07.817769+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:01.090667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'217","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821151+0000","last_change":"2024-08-08T23:28:24.798893+0000","last_active":"2024-08-09T00:36:22.821151+0000","last_peered":"2024-08-09T00:36:22.821151+0000","last_clean":"2024-08-09T00:36:22.821151+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:36:22.821151+0000","last_undegraded":"2024-08-09T00:36:22.821151+0000","last_fullsized":"2024-08-09T00:36:22.821151+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:08:59.221674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812819,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":23484,"num_write":1158,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831284+0000","last_change":"2024-08-08T23:28:28.765882+0000","last_active":"2024-08-09T00:36:12.831284+0000","last_peered":"2024-08-09T00:36:12.831284+0000","last_clean":"2024-08-09T00:36:12.831284+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:36:12.831284+0000","last_undegraded":"2024-08-09T00:36:12.831284+0000","last_fullsized":"2024-08-09T00:36:12.831284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:59.984218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'161","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.487776+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:39:11.487776+0000","last_peered":"2024-08-09T00:39:11.487776+0000","last_clean":"2024-08-09T00:39:11.487776+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:39:11.487776+0000","last_undegraded":"2024-08-09T00:39:11.487776+0000","last_fullsized":"2024-08-09T00:39:11.487776+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:39:49.869700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8633,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":250,"num_write":112,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645239+0000","last_change":"2024-08-08T23:28:32.810146+0000","last_active":"2024-08-09T00:36:12.645239+0000","last_peered":"2024-08-09T00:36:12.645239+0000","last_clean":"2024-08-09T00:36:12.645239+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:36:12.645239+0000","last_undegraded":"2024-08-09T00:36:12.645239+0000","last_fullsized":"2024-08-09T00:36:12.645239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:08.379082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654865+0000","last_change":"2024-08-08T23:28:34.828599+0000","last_active":"2024-08-09T00:36:52.654865+0000","last_peered":"2024-08-09T00:36:52.654865+0000","last_clean":"2024-08-09T00:36:52.654865+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:36:52.654865+0000","last_undegraded":"2024-08-09T00:36:52.654865+0000","last_fullsized":"2024-08-09T00:36:52.654865+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:45.153446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830175+0000","last_change":"2024-08-08T23:28:26.775873+0000","last_active":"2024-08-09T00:36:07.830175+0000","last_peered":"2024-08-09T00:36:07.830175+0000","last_clean":"2024-08-09T00:36:07.830175+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:36:07.830175+0000","last_undegraded":"2024-08-09T00:36:07.830175+0000","last_fullsized":"2024-08-09T00:36:07.830175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:52:27.431250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'181","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:26.590093+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:37:26.590093+0000","last_peered":"2024-08-09T00:37:26.590093+0000","last_clean":"2024-08-09T00:37:26.590093+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:37:26.590093+0000","last_undegraded":"2024-08-09T00:37:26.590093+0000","last_fullsized":"2024-08-09T00:37:26.590093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:56:26.350323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4882691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":377,"num_read_kb":16787,"num_write":981,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645488+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:36:12.645488+0000","last_peered":"2024-08-09T00:36:12.645488+0000","last_clean":"2024-08-09T00:36:12.645488+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:36:12.645488+0000","last_undegraded":"2024-08-09T00:36:12.645488+0000","last_fullsized":"2024-08-09T00:36:12.645488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:21.712748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'54","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.811769+0000","last_change":"2024-08-08T23:28:30.783385+0000","last_active":"2024-08-09T00:39:08.811769+0000","last_peered":"2024-08-09T00:39:08.811769+0000","last_clean":"2024-08-09T00:39:08.811769+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:39:08.811769+0000","last_undegraded":"2024-08-09T00:39:08.811769+0000","last_fullsized":"2024-08-09T00:39:08.811769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:25.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846097+0000","last_change":"2024-08-08T23:28:32.810977+0000","last_active":"2024-08-09T00:36:12.846097+0000","last_peered":"2024-08-09T00:36:12.846097+0000","last_clean":"2024-08-09T00:36:12.846097+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:36:12.846097+0000","last_undegraded":"2024-08-09T00:36:12.846097+0000","last_fullsized":"2024-08-09T00:36:12.846097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:46:30.450790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'187","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.463217+0000","last_change":"2024-08-08T23:28:34.841150+0000","last_active":"2024-08-09T00:39:52.463217+0000","last_peered":"2024-08-09T00:39:52.463217+0000","last_clean":"2024-08-09T00:39:52.463217+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:39:52.463217+0000","last_undegraded":"2024-08-09T00:39:52.463217+0000","last_fullsized":"2024-08-09T00:39:52.463217+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:15.845980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644070+0000","last_change":"2024-08-08T23:28:26.776192+0000","last_active":"2024-08-09T00:36:07.644070+0000","last_peered":"2024-08-09T00:36:07.644070+0000","last_clean":"2024-08-09T00:36:07.644070+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:36:07.644070+0000","last_undegraded":"2024-08-09T00:36:07.644070+0000","last_fullsized":"2024-08-09T00:36:07.644070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:40:01.464080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'197","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.726169+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:38:02.726169+0000","last_peered":"2024-08-09T00:38:02.726169+0000","last_clean":"2024-08-09T00:38:02.726169+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:38:02.726169+0000","last_undegraded":"2024-08-09T00:38:02.726169+0000","last_fullsized":"2024-08-09T00:38:02.726169+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:13.784247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13765036,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":9686,"num_write":1118,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846034+0000","last_change":"2024-08-08T23:28:28.781246+0000","last_active":"2024-08-09T00:36:12.846034+0000","last_peered":"2024-08-09T00:36:12.846034+0000","last_clean":"2024-08-09T00:36:12.846034+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:36:12.846034+0000","last_undegraded":"2024-08-09T00:36:12.846034+0000","last_fullsized":"2024-08-09T00:36:12.846034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:01.140883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'196","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.316317+0000","last_change":"2024-08-08T23:28:30.796061+0000","last_active":"2024-08-09T00:39:11.316317+0000","last_peered":"2024-08-09T00:39:11.316317+0000","last_clean":"2024-08-09T00:39:11.316317+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:39:11.316317+0000","last_undegraded":"2024-08-09T00:39:11.316317+0000","last_fullsized":"2024-08-09T00:39:11.316317+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:56:58.690952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":340,"num_write":154,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819418+0000","last_change":"2024-08-08T23:28:32.828831+0000","last_active":"2024-08-09T00:36:12.819418+0000","last_peered":"2024-08-09T00:36:12.819418+0000","last_clean":"2024-08-09T00:36:12.819418+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:36:12.819418+0000","last_undegraded":"2024-08-09T00:36:12.819418+0000","last_fullsized":"2024-08-09T00:36:12.819418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:56:10.147406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'114","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:50.542493+0000","last_change":"2024-08-08T23:28:34.830478+0000","last_active":"2024-08-09T00:39:50.542493+0000","last_peered":"2024-08-09T00:39:50.542493+0000","last_clean":"2024-08-09T00:39:50.542493+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:39:50.542493+0000","last_undegraded":"2024-08-09T00:39:50.542493+0000","last_fullsized":"2024-08-09T00:39:50.542493+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:39.468849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644019+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:36:07.644019+0000","last_peered":"2024-08-09T00:36:07.644019+0000","last_clean":"2024-08-09T00:36:07.644019+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:36:07.644019+0000","last_undegraded":"2024-08-09T00:36:07.644019+0000","last_fullsized":"2024-08-09T00:36:07.644019+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:02:52.706658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'162","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815902+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:36:07.815902+0000","last_peered":"2024-08-09T00:36:07.815902+0000","last_clean":"2024-08-09T00:36:07.815902+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:36:07.815902+0000","last_undegraded":"2024-08-09T00:36:07.815902+0000","last_fullsized":"2024-08-09T00:36:07.815902+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:24.065006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":312,"num_read_kb":1399,"num_write":876,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819359+0000","last_change":"2024-08-08T23:28:28.781772+0000","last_active":"2024-08-09T00:36:12.819359+0000","last_peered":"2024-08-09T00:36:12.819359+0000","last_clean":"2024-08-09T00:36:12.819359+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:36:12.819359+0000","last_undegraded":"2024-08-09T00:36:12.819359+0000","last_fullsized":"2024-08-09T00:36:12.819359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:15:35.500922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'133","reported_seq":714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.858047+0000","last_change":"2024-08-08T23:28:30.780651+0000","last_active":"2024-08-09T00:39:09.858047+0000","last_peered":"2024-08-09T00:39:09.858047+0000","last_clean":"2024-08-09T00:39:09.858047+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:39:09.858047+0000","last_undegraded":"2024-08-09T00:39:09.858047+0000","last_fullsized":"2024-08-09T00:39:09.858047+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:26.754888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":224,"num_write":92,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816952+0000","last_change":"2024-08-08T23:28:32.826903+0000","last_active":"2024-08-09T00:36:12.816952+0000","last_peered":"2024-08-09T00:36:12.816952+0000","last_clean":"2024-08-09T00:36:12.816952+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:36:12.816952+0000","last_undegraded":"2024-08-09T00:36:12.816952+0000","last_fullsized":"2024-08-09T00:36:12.816952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:15.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:11.641070+0000","last_change":"2024-08-08T23:28:26.774602+0000","last_active":"2024-08-09T00:38:11.641070+0000","last_peered":"2024-08-09T00:38:11.641070+0000","last_clean":"2024-08-09T00:38:11.641070+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:38:11.641070+0000","last_undegraded":"2024-08-09T00:38:11.641070+0000","last_fullsized":"2024-08-09T00:38:11.641070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:48.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'155","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:44.302908+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:37:44.302908+0000","last_peered":"2024-08-09T00:37:44.302908+0000","last_clean":"2024-08-09T00:37:44.302908+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:37:44.302908+0000","last_undegraded":"2024-08-09T00:37:44.302908+0000","last_fullsized":"2024-08-09T00:37:44.302908+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:46:45.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789162,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":18716,"num_write":867,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824970+0000","last_change":"2024-08-08T23:28:28.783884+0000","last_active":"2024-08-09T00:36:47.824970+0000","last_peered":"2024-08-09T00:36:47.824970+0000","last_clean":"2024-08-09T00:36:47.824970+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:36:47.824970+0000","last_undegraded":"2024-08-09T00:36:47.824970+0000","last_fullsized":"2024-08-09T00:36:47.824970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:35.459983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'214","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.908143+0000","last_change":"2024-08-08T23:28:30.780333+0000","last_active":"2024-08-09T00:39:58.908143+0000","last_peered":"2024-08-09T00:39:58.908143+0000","last_clean":"2024-08-09T00:39:58.908143+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:39:58.908143+0000","last_undegraded":"2024-08-09T00:39:58.908143+0000","last_fullsized":"2024-08-09T00:39:58.908143+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:34.051721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":471,"num_write":214,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046320+0000","last_change":"2024-08-08T23:28:32.819377+0000","last_active":"2024-08-09T00:36:03.046320+0000","last_peered":"2024-08-09T00:36:03.046320+0000","last_clean":"2024-08-09T00:36:03.046320+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:36:03.046320+0000","last_undegraded":"2024-08-09T00:36:03.046320+0000","last_fullsized":"2024-08-09T00:36:03.046320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:12.118204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'163","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.920905+0000","last_change":"2024-08-08T23:28:34.830516+0000","last_active":"2024-08-09T00:36:25.920905+0000","last_peered":"2024-08-09T00:36:25.920905+0000","last_clean":"2024-08-09T00:36:25.920905+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:36:25.920905+0000","last_undegraded":"2024-08-09T00:36:25.920905+0000","last_fullsized":"2024-08-09T00:36:25.920905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:35:24.816908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.297627+0000","last_change":"2024-08-08T23:28:26.777062+0000","last_active":"2024-08-09T00:37:55.297627+0000","last_peered":"2024-08-09T00:37:55.297627+0000","last_clean":"2024-08-09T00:37:55.297627+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:37:55.297627+0000","last_undegraded":"2024-08-09T00:37:55.297627+0000","last_fullsized":"2024-08-09T00:37:55.297627+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:50.644245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'279","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.823854+0000","last_change":"2024-08-08T23:29:01.888808+0000","last_active":"2024-08-09T00:36:57.823854+0000","last_peered":"2024-08-09T00:36:57.823854+0000","last_clean":"2024-08-09T00:36:57.823854+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:36:57.823854+0000","last_undegraded":"2024-08-09T00:36:57.823854+0000","last_fullsized":"2024-08-09T00:36:57.823854+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:10.690056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9708426,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":766,"num_read_kb":69125,"num_write":1342,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835144+0000","last_change":"2024-08-08T23:28:28.781761+0000","last_active":"2024-08-09T00:37:17.835144+0000","last_peered":"2024-08-09T00:37:17.835144+0000","last_clean":"2024-08-09T00:37:17.835144+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:37:17.835144+0000","last_undegraded":"2024-08-09T00:37:17.835144+0000","last_fullsized":"2024-08-09T00:37:17.835144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:51:42.627370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'194","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.988259+0000","last_change":"2024-08-08T23:28:30.775644+0000","last_active":"2024-08-09T00:39:10.988259+0000","last_peered":"2024-08-09T00:39:10.988259+0000","last_clean":"2024-08-09T00:39:10.988259+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:39:10.988259+0000","last_undegraded":"2024-08-09T00:39:10.988259+0000","last_fullsized":"2024-08-09T00:39:10.988259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:29:40.576029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6139,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":298,"num_write":166,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828941+0000","last_change":"2024-08-08T23:28:32.809931+0000","last_active":"2024-08-09T00:36:02.828941+0000","last_peered":"2024-08-09T00:36:02.828941+0000","last_clean":"2024-08-09T00:36:02.828941+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:36:02.828941+0000","last_undegraded":"2024-08-09T00:36:02.828941+0000","last_fullsized":"2024-08-09T00:36:02.828941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:04:26.809257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'178","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.059858+0000","last_change":"2024-08-08T23:28:34.836352+0000","last_active":"2024-08-09T00:39:48.059858+0000","last_peered":"2024-08-09T00:39:48.059858+0000","last_clean":"2024-08-09T00:39:48.059858+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:39:48.059858+0000","last_undegraded":"2024-08-09T00:39:48.059858+0000","last_fullsized":"2024-08-09T00:39:48.059858+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:31:46.433299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641569+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:35:57.641569+0000","last_peered":"2024-08-09T00:35:57.641569+0000","last_clean":"2024-08-09T00:35:57.641569+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:35:57.641569+0000","last_undegraded":"2024-08-09T00:35:57.641569+0000","last_fullsized":"2024-08-09T00:35:57.641569+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:31.478254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'206","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839680+0000","last_change":"2024-08-08T23:30:01.782029+0000","last_active":"2024-08-09T00:37:32.839680+0000","last_peered":"2024-08-09T00:37:32.839680+0000","last_clean":"2024-08-09T00:37:32.839680+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:37:32.839680+0000","last_undegraded":"2024-08-09T00:37:32.839680+0000","last_fullsized":"2024-08-09T00:37:32.839680+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.293628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486326,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":437,"num_read_kb":59906,"num_write":1085,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816465+0000","last_change":"2024-08-08T23:28:28.778478+0000","last_active":"2024-08-09T00:36:02.816465+0000","last_peered":"2024-08-09T00:36:02.816465+0000","last_clean":"2024-08-09T00:36:02.816465+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:36:02.816465+0000","last_undegraded":"2024-08-09T00:36:02.816465+0000","last_fullsized":"2024-08-09T00:36:02.816465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:25.183992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'165","reported_seq":776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.689420+0000","last_change":"2024-08-08T23:28:31.043004+0000","last_active":"2024-08-09T00:39:22.689420+0000","last_peered":"2024-08-09T00:39:22.689420+0000","last_clean":"2024-08-09T00:39:22.689420+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:39:22.689420+0000","last_undegraded":"2024-08-09T00:39:22.689420+0000","last_fullsized":"2024-08-09T00:39:22.689420+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:24:09.108955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11404,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":276,"num_write":120,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.838957+0000","last_change":"2024-08-08T23:28:32.802329+0000","last_active":"2024-08-09T00:36:47.838957+0000","last_peered":"2024-08-09T00:36:47.838957+0000","last_clean":"2024-08-09T00:36:47.838957+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:36:47.838957+0000","last_undegraded":"2024-08-09T00:36:47.838957+0000","last_fullsized":"2024-08-09T00:36:47.838957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:08.553685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'166","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.919419+0000","last_change":"2024-08-08T23:28:34.830880+0000","last_active":"2024-08-09T00:39:58.919419+0000","last_peered":"2024-08-09T00:39:58.919419+0000","last_clean":"2024-08-09T00:39:58.919419+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:39:58.919419+0000","last_undegraded":"2024-08-09T00:39:58.919419+0000","last_fullsized":"2024-08-09T00:39:58.919419+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:41:57.656951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.821534+0000","last_change":"2024-08-08T23:28:26.769723+0000","last_active":"2024-08-09T00:35:57.821534+0000","last_peered":"2024-08-09T00:35:57.821534+0000","last_clean":"2024-08-09T00:35:57.821534+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:35:57.821534+0000","last_undegraded":"2024-08-09T00:35:57.821534+0000","last_fullsized":"2024-08-09T00:35:57.821534+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:50:45.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'171","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813081+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:35:57.813081+0000","last_peered":"2024-08-09T00:35:57.813081+0000","last_clean":"2024-08-09T00:35:57.813081+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:35:57.813081+0000","last_undegraded":"2024-08-09T00:35:57.813081+0000","last_fullsized":"2024-08-09T00:35:57.813081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:17.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":4608,"num_write":1007,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828975+0000","last_change":"2024-08-08T23:28:28.776616+0000","last_active":"2024-08-09T00:36:02.828975+0000","last_peered":"2024-08-09T00:36:02.828975+0000","last_clean":"2024-08-09T00:36:02.828975+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:36:02.828975+0000","last_undegraded":"2024-08-09T00:36:02.828975+0000","last_fullsized":"2024-08-09T00:36:02.828975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:14:52.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'118","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.457751+0000","last_change":"2024-08-08T23:28:31.044012+0000","last_active":"2024-08-09T00:39:11.457751+0000","last_peered":"2024-08-09T00:39:11.457751+0000","last_clean":"2024-08-09T00:39:11.457751+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:39:11.457751+0000","last_undegraded":"2024-08-09T00:39:11.457751+0000","last_fullsized":"2024-08-09T00:39:11.457751+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:11.270743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'497","reported_seq":2372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.948213+0000","last_change":"2024-08-08T23:28:32.818008+0000","last_active":"2024-08-09T00:39:58.948213+0000","last_peered":"2024-08-09T00:39:58.948213+0000","last_clean":"2024-08-09T00:39:58.948213+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:39:58.948213+0000","last_undegraded":"2024-08-09T00:39:58.948213+0000","last_fullsized":"2024-08-09T00:39:58.948213+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:38.571079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.807216+0000","last_change":"2024-08-08T23:28:34.827314+0000","last_active":"2024-08-09T00:39:53.807216+0000","last_peered":"2024-08-09T00:39:53.807216+0000","last_clean":"2024-08-09T00:39:53.807216+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:39:53.807216+0000","last_undegraded":"2024-08-09T00:39:53.807216+0000","last_fullsized":"2024-08-09T00:39:53.807216+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:05.794292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:00.392022+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:37:00.392022+0000","last_peered":"2024-08-09T00:37:00.392022+0000","last_clean":"2024-08-09T00:37:00.392022+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:37:00.392022+0000","last_undegraded":"2024-08-09T00:37:00.392022+0000","last_fullsized":"2024-08-09T00:37:00.392022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:35.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'190","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:36.917105+0000","last_change":"2024-08-08T23:28:24.820992+0000","last_active":"2024-08-09T00:36:36.917105+0000","last_peered":"2024-08-09T00:36:36.917105+0000","last_clean":"2024-08-09T00:36:36.917105+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:36:36.917105+0000","last_undegraded":"2024-08-09T00:36:36.917105+0000","last_fullsized":"2024-08-09T00:36:36.917105+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:54.019037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9145639,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":50563,"num_write":1095,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843379+0000","last_change":"2024-08-08T23:28:28.790145+0000","last_active":"2024-08-09T00:36:02.843379+0000","last_peered":"2024-08-09T00:36:02.843379+0000","last_clean":"2024-08-09T00:36:02.843379+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:36:02.843379+0000","last_undegraded":"2024-08-09T00:36:02.843379+0000","last_fullsized":"2024-08-09T00:36:02.843379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:10.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'239","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.521474+0000","last_change":"2024-08-08T23:28:30.776086+0000","last_active":"2024-08-09T00:39:11.521474+0000","last_peered":"2024-08-09T00:39:11.521474+0000","last_clean":"2024-08-09T00:39:11.521474+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:39:11.521474+0000","last_undegraded":"2024-08-09T00:39:11.521474+0000","last_fullsized":"2024-08-09T00:39:11.521474+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:38.136653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18007,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":316,"num_read_kb":411,"num_write":196,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816883+0000","last_change":"2024-08-08T23:28:32.820762+0000","last_active":"2024-08-09T00:36:12.816883+0000","last_peered":"2024-08-09T00:36:12.816883+0000","last_clean":"2024-08-09T00:36:12.816883+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:36:12.816883+0000","last_undegraded":"2024-08-09T00:36:12.816883+0000","last_fullsized":"2024-08-09T00:36:12.816883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:28:00.396123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'118","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.831243+0000","last_change":"2024-08-08T23:28:34.840657+0000","last_active":"2024-08-09T00:39:51.831243+0000","last_peered":"2024-08-09T00:39:51.831243+0000","last_clean":"2024-08-09T00:39:51.831243+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:39:51.831243+0000","last_undegraded":"2024-08-09T00:39:51.831243+0000","last_fullsized":"2024-08-09T00:39:51.831243+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:16.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.121529+0000","last_change":"2024-08-08T23:28:26.750931+0000","last_active":"2024-08-09T00:39:54.121529+0000","last_peered":"2024-08-09T00:39:54.121529+0000","last_clean":"2024-08-09T00:39:54.121529+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:39:54.121529+0000","last_undegraded":"2024-08-09T00:39:54.121529+0000","last_fullsized":"2024-08-09T00:39:54.121529+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:28:50.333511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'196","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045277+0000","last_change":"2024-08-08T23:28:24.818191+0000","last_active":"2024-08-09T00:35:58.045277+0000","last_peered":"2024-08-09T00:35:58.045277+0000","last_clean":"2024-08-09T00:35:58.045277+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:35:58.045277+0000","last_undegraded":"2024-08-09T00:35:58.045277+0000","last_fullsized":"2024-08-09T00:35:58.045277+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:42.912960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2993812,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":62745,"num_write":1018,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046264+0000","last_change":"2024-08-08T23:28:28.776983+0000","last_active":"2024-08-09T00:36:03.046264+0000","last_peered":"2024-08-09T00:36:03.046264+0000","last_clean":"2024-08-09T00:36:03.046264+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:36:03.046264+0000","last_undegraded":"2024-08-09T00:36:03.046264+0000","last_fullsized":"2024-08-09T00:36:03.046264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:16.950419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'142","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.473257+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:39:08.473257+0000","last_peered":"2024-08-09T00:39:08.473257+0000","last_clean":"2024-08-09T00:39:08.473257+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:39:08.473257+0000","last_undegraded":"2024-08-09T00:39:08.473257+0000","last_fullsized":"2024-08-09T00:39:08.473257+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:37:42.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":253,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821824+0000","last_change":"2024-08-08T23:28:32.813742+0000","last_active":"2024-08-09T00:36:22.821824+0000","last_peered":"2024-08-09T00:36:22.821824+0000","last_clean":"2024-08-09T00:36:22.821824+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:36:22.821824+0000","last_undegraded":"2024-08-09T00:36:22.821824+0000","last_fullsized":"2024-08-09T00:36:22.821824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:08.279720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.679892+0000","last_change":"2024-08-08T23:28:34.830000+0000","last_active":"2024-08-09T00:38:42.679892+0000","last_peered":"2024-08-09T00:38:42.679892+0000","last_clean":"2024-08-09T00:38:42.679892+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:38:42.679892+0000","last_undegraded":"2024-08-09T00:38:42.679892+0000","last_fullsized":"2024-08-09T00:38:42.679892+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:25.028910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.647917+0000","last_change":"2024-08-08T23:28:26.762374+0000","last_active":"2024-08-09T00:36:22.647917+0000","last_peered":"2024-08-09T00:36:22.647917+0000","last_clean":"2024-08-09T00:36:22.647917+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:36:22.647917+0000","last_undegraded":"2024-08-09T00:36:22.647917+0000","last_fullsized":"2024-08-09T00:36:22.647917+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:04:01.695211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'260","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.832311+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:39:28.832311+0000","last_peered":"2024-08-09T00:39:28.832311+0000","last_clean":"2024-08-09T00:39:28.832311+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:39:28.832311+0000","last_undegraded":"2024-08-09T00:39:28.832311+0000","last_fullsized":"2024-08-09T00:39:28.832311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:58:00.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14282888,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":663,"num_read_kb":32625,"num_write":1553,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818766+0000","last_change":"2024-08-08T23:28:28.778212+0000","last_active":"2024-08-09T00:36:12.818766+0000","last_peered":"2024-08-09T00:36:12.818766+0000","last_clean":"2024-08-09T00:36:12.818766+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:36:12.818766+0000","last_undegraded":"2024-08-09T00:36:12.818766+0000","last_fullsized":"2024-08-09T00:36:12.818766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:32:33.405064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'120","reported_seq":701,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.370669+0000","last_change":"2024-08-08T23:28:30.796071+0000","last_active":"2024-08-09T00:39:09.370669+0000","last_peered":"2024-08-09T00:39:09.370669+0000","last_clean":"2024-08-09T00:39:09.370669+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:39:09.370669+0000","last_undegraded":"2024-08-09T00:39:09.370669+0000","last_fullsized":"2024-08-09T00:39:09.370669+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:29.366191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":202,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816384+0000","last_change":"2024-08-08T23:28:32.812326+0000","last_active":"2024-08-09T00:36:02.816384+0000","last_peered":"2024-08-09T00:36:02.816384+0000","last_clean":"2024-08-09T00:36:02.816384+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:36:02.816384+0000","last_undegraded":"2024-08-09T00:36:02.816384+0000","last_fullsized":"2024-08-09T00:36:02.816384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.507723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'144","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.001008+0000","last_change":"2024-08-08T23:28:34.835991+0000","last_active":"2024-08-09T00:39:48.001008+0000","last_peered":"2024-08-09T00:39:48.001008+0000","last_clean":"2024-08-09T00:39:48.001008+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:39:48.001008+0000","last_undegraded":"2024-08-09T00:39:48.001008+0000","last_fullsized":"2024-08-09T00:39:48.001008+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:43:41.405272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:46.216752+0000","last_change":"2024-08-08T23:28:26.781125+0000","last_active":"2024-08-09T00:37:46.216752+0000","last_peered":"2024-08-09T00:37:46.216752+0000","last_clean":"2024-08-09T00:37:46.216752+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:37:46.216752+0000","last_undegraded":"2024-08-09T00:37:46.216752+0000","last_fullsized":"2024-08-09T00:37:46.216752+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:49.822476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'156","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.247514+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:39:28.247514+0000","last_peered":"2024-08-09T00:39:28.247514+0000","last_clean":"2024-08-09T00:39:28.247514+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:39:28.247514+0000","last_undegraded":"2024-08-09T00:39:28.247514+0000","last_fullsized":"2024-08-09T00:39:28.247514+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:35.389417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6396645,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":16350,"num_write":844,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.834834+0000","last_change":"2024-08-08T23:28:28.765925+0000","last_active":"2024-08-09T00:36:27.834834+0000","last_peered":"2024-08-09T00:36:27.834834+0000","last_clean":"2024-08-09T00:36:27.834834+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:36:27.834834+0000","last_undegraded":"2024-08-09T00:36:27.834834+0000","last_fullsized":"2024-08-09T00:36:27.834834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:35.033143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'191","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.898713+0000","last_change":"2024-08-08T23:28:30.786260+0000","last_active":"2024-08-09T00:39:09.898713+0000","last_peered":"2024-08-09T00:39:09.898713+0000","last_clean":"2024-08-09T00:39:09.898713+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:39:09.898713+0000","last_undegraded":"2024-08-09T00:39:09.898713+0000","last_fullsized":"2024-08-09T00:39:09.898713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:07.104811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15323,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":328,"num_write":148,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814259+0000","last_change":"2024-08-08T23:28:32.820890+0000","last_active":"2024-08-09T00:36:02.814259+0000","last_peered":"2024-08-09T00:36:02.814259+0000","last_clean":"2024-08-09T00:36:02.814259+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:36:02.814259+0000","last_undegraded":"2024-08-09T00:36:02.814259+0000","last_fullsized":"2024-08-09T00:36:02.814259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:53.798935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'141","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823481+0000","last_change":"2024-08-08T23:28:34.832607+0000","last_active":"2024-08-09T00:36:32.823481+0000","last_peered":"2024-08-09T00:36:32.823481+0000","last_clean":"2024-08-09T00:36:32.823481+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:36:32.823481+0000","last_undegraded":"2024-08-09T00:36:32.823481+0000","last_fullsized":"2024-08-09T00:36:32.823481+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:55.224306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'225","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850396+0000","last_change":"2024-08-08T23:28:26.769233+0000","last_active":"2024-08-09T00:37:47.850396+0000","last_peered":"2024-08-09T00:37:47.850396+0000","last_clean":"2024-08-09T00:37:47.850396+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:37:47.850396+0000","last_undegraded":"2024-08-09T00:37:47.850396+0000","last_fullsized":"2024-08-09T00:37:47.850396+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:17:12.484894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.269231+0000","last_change":"2024-08-08T23:28:24.802451+0000","last_active":"2024-08-09T00:38:27.269231+0000","last_peered":"2024-08-09T00:38:27.269231+0000","last_clean":"2024-08-09T00:38:27.269231+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:38:27.269231+0000","last_undegraded":"2024-08-09T00:38:27.269231+0000","last_fullsized":"2024-08-09T00:38:27.269231+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:35.524843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13856288,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":400,"num_read_kb":16979,"num_write":1172,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'147","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048709+0000","last_change":"2024-08-08T23:29:01.584374+0000","last_active":"2024-08-09T00:36:13.048709+0000","last_peered":"2024-08-09T00:36:13.048709+0000","last_clean":"2024-08-09T00:36:13.048709+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:36:13.048709+0000","last_undegraded":"2024-08-09T00:36:13.048709+0000","last_fullsized":"2024-08-09T00:36:13.048709+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:12.686573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'205","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:36.724508+0000","last_change":"2024-08-08T23:28:24.787727+0000","last_active":"2024-08-09T00:38:36.724508+0000","last_peered":"2024-08-09T00:38:36.724508+0000","last_clean":"2024-08-09T00:38:36.724508+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:38:36.724508+0000","last_undegraded":"2024-08-09T00:38:36.724508+0000","last_fullsized":"2024-08-09T00:38:36.724508+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:30.042158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3011599,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":27391,"num_write":1077,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.508050+0000","last_change":"2024-08-08T23:28:26.789544+0000","last_active":"2024-08-09T00:39:52.508050+0000","last_peered":"2024-08-09T00:39:52.508050+0000","last_clean":"2024-08-09T00:39:52.508050+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:39:52.508050+0000","last_undegraded":"2024-08-09T00:39:52.508050+0000","last_fullsized":"2024-08-09T00:39:52.508050+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:52.896837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.996849+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:37:15.996849+0000","last_peered":"2024-08-09T00:37:15.996849+0000","last_clean":"2024-08-09T00:37:15.996849+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:37:15.996849+0000","last_undegraded":"2024-08-09T00:37:15.996849+0000","last_fullsized":"2024-08-09T00:37:15.996849+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:57:25.172421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221596,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":17234,"num_write":1186,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'69","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850284+0000","last_change":"2024-08-08T23:28:26.775062+0000","last_active":"2024-08-09T00:37:47.850284+0000","last_peered":"2024-08-09T00:37:47.850284+0000","last_clean":"2024-08-09T00:37:47.850284+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:37:47.850284+0000","last_undegraded":"2024-08-09T00:37:47.850284+0000","last_fullsized":"2024-08-09T00:37:47.850284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:06.373460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'253","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:30.807161+0000","last_change":"2024-08-08T23:29:01.885397+0000","last_active":"2024-08-09T00:39:30.807161+0000","last_peered":"2024-08-09T00:39:30.807161+0000","last_clean":"2024-08-09T00:39:30.807161+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:39:30.807161+0000","last_undegraded":"2024-08-09T00:39:30.807161+0000","last_fullsized":"2024-08-09T00:39:30.807161+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:40:13.222712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13676806,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":58241,"num_write":1236,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'129","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.958544+0000","last_change":"2024-08-08T23:28:26.776123+0000","last_active":"2024-08-09T00:38:32.958544+0000","last_peered":"2024-08-09T00:38:32.958544+0000","last_clean":"2024-08-09T00:38:32.958544+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:38:32.958544+0000","last_undegraded":"2024-08-09T00:38:32.958544+0000","last_fullsized":"2024-08-09T00:38:32.958544+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:05:18.665033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667208+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:37:47.667208+0000","last_peered":"2024-08-09T00:37:47.667208+0000","last_clean":"2024-08-09T00:37:47.667208+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:37:47.667208+0000","last_undegraded":"2024-08-09T00:37:47.667208+0000","last_fullsized":"2024-08-09T00:37:47.667208+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:48:27.331256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1127696,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":401,"num_read_kb":7859,"num_write":1104,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833217+0000","last_change":"2024-08-08T23:28:26.779441+0000","last_active":"2024-08-09T00:37:12.833217+0000","last_peered":"2024-08-09T00:37:12.833217+0000","last_clean":"2024-08-09T00:37:12.833217+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:37:12.833217+0000","last_undegraded":"2024-08-09T00:37:12.833217+0000","last_fullsized":"2024-08-09T00:37:12.833217+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:29.987307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'234","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.308534+0000","last_change":"2024-08-08T23:28:24.759289+0000","last_active":"2024-08-09T00:39:10.308534+0000","last_peered":"2024-08-09T00:39:10.308534+0000","last_clean":"2024-08-09T00:39:10.308534+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:39:10.308534+0000","last_undegraded":"2024-08-09T00:39:10.308534+0000","last_fullsized":"2024-08-09T00:39:10.308534+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:07.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12876135,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":668,"num_read_kb":20658,"num_write":1113,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:56.569083+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:37:56.569083+0000","last_peered":"2024-08-09T00:37:56.569083+0000","last_clean":"2024-08-09T00:37:56.569083+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:37:56.569083+0000","last_undegraded":"2024-08-09T00:37:56.569083+0000","last_fullsized":"2024-08-09T00:37:56.569083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:23.078114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'193","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.843291+0000","last_change":"2024-08-08T23:28:24.795170+0000","last_active":"2024-08-09T00:37:47.843291+0000","last_peered":"2024-08-09T00:37:47.843291+0000","last_clean":"2024-08-09T00:37:47.843291+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:37:47.843291+0000","last_undegraded":"2024-08-09T00:37:47.843291+0000","last_fullsized":"2024-08-09T00:37:47.843291+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:54:04.809402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12695211,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":357,"num_read_kb":32922,"num_write":1091,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'232","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833591+0000","last_change":"2024-08-08T23:28:26.770453+0000","last_active":"2024-08-09T00:37:12.833591+0000","last_peered":"2024-08-09T00:37:12.833591+0000","last_clean":"2024-08-09T00:37:12.833591+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:37:12.833591+0000","last_undegraded":"2024-08-09T00:37:12.833591+0000","last_fullsized":"2024-08-09T00:37:12.833591+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:19:56.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'248","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831439+0000","last_change":"2024-08-08T23:29:01.888000+0000","last_active":"2024-08-09T00:36:12.831439+0000","last_peered":"2024-08-09T00:36:12.831439+0000","last_clean":"2024-08-09T00:36:12.831439+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:36:12.831439+0000","last_undegraded":"2024-08-09T00:36:12.831439+0000","last_fullsized":"2024-08-09T00:36:12.831439+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:43.322003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7977264,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":854,"num_read_kb":18739,"num_write":1238,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.709916+0000","last_change":"2024-08-08T23:28:26.775305+0000","last_active":"2024-08-09T00:36:13.709916+0000","last_peered":"2024-08-09T00:36:13.709916+0000","last_clean":"2024-08-09T00:36:13.709916+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:36:13.709916+0000","last_undegraded":"2024-08-09T00:36:13.709916+0000","last_fullsized":"2024-08-09T00:36:13.709916+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:15:22.024427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'183","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:03.072739+0000","last_change":"2024-08-08T23:28:24.788596+0000","last_active":"2024-08-09T00:38:03.072739+0000","last_peered":"2024-08-09T00:38:03.072739+0000","last_clean":"2024-08-09T00:38:03.072739+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:38:03.072739+0000","last_undegraded":"2024-08-09T00:38:03.072739+0000","last_fullsized":"2024-08-09T00:38:03.072739+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:22.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11383947,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":34111,"num_write":1039,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'81","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:04.076175+0000","last_change":"2024-08-08T23:28:26.763616+0000","last_active":"2024-08-09T00:38:04.076175+0000","last_peered":"2024-08-09T00:38:04.076175+0000","last_clean":"2024-08-09T00:38:04.076175+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:38:04.076175+0000","last_undegraded":"2024-08-09T00:38:04.076175+0000","last_fullsized":"2024-08-09T00:38:04.076175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:06.979294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'200","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:18.395370+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:38:18.395370+0000","last_peered":"2024-08-09T00:38:18.395370+0000","last_clean":"2024-08-09T00:38:18.395370+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:38:18.395370+0000","last_undegraded":"2024-08-09T00:38:18.395370+0000","last_fullsized":"2024-08-09T00:38:18.395370+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:23.874712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10206260,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":96889,"num_write":1095,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:04.420125+0000","last_change":"2024-08-08T23:28:26.767042+0000","last_active":"2024-08-09T00:37:04.420125+0000","last_peered":"2024-08-09T00:37:04.420125+0000","last_clean":"2024-08-09T00:37:04.420125+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:37:04.420125+0000","last_undegraded":"2024-08-09T00:37:04.420125+0000","last_fullsized":"2024-08-09T00:37:04.420125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:15.401572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'180","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.074959+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:38:13.074959+0000","last_peered":"2024-08-09T00:38:13.074959+0000","last_clean":"2024-08-09T00:38:13.074959+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:38:13.074959+0000","last_undegraded":"2024-08-09T00:38:13.074959+0000","last_fullsized":"2024-08-09T00:38:13.074959+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:35:20.239264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529795,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":71209,"num_write":974,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849790+0000","last_change":"2024-08-08T23:28:26.778789+0000","last_active":"2024-08-09T00:38:12.849790+0000","last_peered":"2024-08-09T00:38:12.849790+0000","last_clean":"2024-08-09T00:38:12.849790+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:38:12.849790+0000","last_undegraded":"2024-08-09T00:38:12.849790+0000","last_fullsized":"2024-08-09T00:38:12.849790+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:39.269574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'168","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843328+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:38:12.843328+0000","last_peered":"2024-08-09T00:38:12.843328+0000","last_clean":"2024-08-09T00:38:12.843328+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:38:12.843328+0000","last_undegraded":"2024-08-09T00:38:12.843328+0000","last_fullsized":"2024-08-09T00:38:12.843328+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:59:20.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13960223,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":327,"num_read_kb":31431,"num_write":988,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.855443+0000","last_change":"2024-08-08T23:28:26.782721+0000","last_active":"2024-08-09T00:39:19.855443+0000","last_peered":"2024-08-09T00:39:19.855443+0000","last_clean":"2024-08-09T00:39:19.855443+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:39:19.855443+0000","last_undegraded":"2024-08-09T00:39:19.855443+0000","last_fullsized":"2024-08-09T00:39:19.855443+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:29:54.581163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'227","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.850152+0000","last_change":"2024-08-08T23:28:24.763154+0000","last_active":"2024-08-09T00:38:12.850152+0000","last_peered":"2024-08-09T00:38:12.850152+0000","last_clean":"2024-08-09T00:38:12.850152+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:38:12.850152+0000","last_undegraded":"2024-08-09T00:38:12.850152+0000","last_fullsized":"2024-08-09T00:38:12.850152+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:09.336390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197764,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":70204,"num_write":1294,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843242+0000","last_change":"2024-08-08T23:28:26.773873+0000","last_active":"2024-08-09T00:38:12.843242+0000","last_peered":"2024-08-09T00:38:12.843242+0000","last_clean":"2024-08-09T00:38:12.843242+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:38:12.843242+0000","last_undegraded":"2024-08-09T00:38:12.843242+0000","last_fullsized":"2024-08-09T00:38:12.843242+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:24:31.308127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'208","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:26.833717+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:36:26.833717+0000","last_peered":"2024-08-09T00:36:26.833717+0000","last_clean":"2024-08-09T00:36:26.833717+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:36:26.833717+0000","last_undegraded":"2024-08-09T00:36:26.833717+0000","last_fullsized":"2024-08-09T00:36:26.833717+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:22.337895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12882300,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":469,"num_read_kb":54938,"num_write":1143,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672406+0000","last_change":"2024-08-08T23:28:26.754194+0000","last_active":"2024-08-09T00:38:12.672406+0000","last_peered":"2024-08-09T00:38:12.672406+0000","last_clean":"2024-08-09T00:38:12.672406+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:38:12.672406+0000","last_undegraded":"2024-08-09T00:38:12.672406+0000","last_fullsized":"2024-08-09T00:38:12.672406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:20.564322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'154","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:39.246999+0000","last_change":"2024-08-08T23:28:24.763602+0000","last_active":"2024-08-09T00:36:39.246999+0000","last_peered":"2024-08-09T00:36:39.246999+0000","last_clean":"2024-08-09T00:36:39.246999+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:36:39.246999+0000","last_undegraded":"2024-08-09T00:36:39.246999+0000","last_fullsized":"2024-08-09T00:36:39.246999+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:31.123341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564764,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":411,"num_read_kb":19124,"num_write":932,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870130+0000","last_change":"2024-08-08T23:28:26.782907+0000","last_active":"2024-08-09T00:37:57.870130+0000","last_peered":"2024-08-09T00:37:57.870130+0000","last_clean":"2024-08-09T00:37:57.870130+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:37:57.870130+0000","last_undegraded":"2024-08-09T00:37:57.870130+0000","last_fullsized":"2024-08-09T00:37:57.870130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:55.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'227","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047591+0000","last_change":"2024-08-08T23:28:24.815220+0000","last_active":"2024-08-09T00:36:08.047591+0000","last_peered":"2024-08-09T00:36:08.047591+0000","last_clean":"2024-08-09T00:36:08.047591+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:36:08.047591+0000","last_undegraded":"2024-08-09T00:36:08.047591+0000","last_fullsized":"2024-08-09T00:36:08.047591+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:31.780990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15599336,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":526,"num_read_kb":89533,"num_write":1163,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.012893+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:37:03.012893+0000","last_peered":"2024-08-09T00:37:03.012893+0000","last_clean":"2024-08-09T00:37:03.012893+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:37:03.012893+0000","last_undegraded":"2024-08-09T00:37:03.012893+0000","last_fullsized":"2024-08-09T00:37:03.012893+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:25.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15688548,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":157320,"num_write":1028,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819437+0000","last_change":"2024-08-08T23:28:26.766116+0000","last_active":"2024-08-09T00:36:22.819437+0000","last_peered":"2024-08-09T00:36:22.819437+0000","last_clean":"2024-08-09T00:36:22.819437+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:36:22.819437+0000","last_undegraded":"2024-08-09T00:36:22.819437+0000","last_fullsized":"2024-08-09T00:36:22.819437+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:53:40.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'181","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.684500+0000","last_change":"2024-08-08T23:28:24.777397+0000","last_active":"2024-08-09T00:38:22.684500+0000","last_peered":"2024-08-09T00:38:22.684500+0000","last_clean":"2024-08-09T00:38:22.684500+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:38:22.684500+0000","last_undegraded":"2024-08-09T00:38:22.684500+0000","last_fullsized":"2024-08-09T00:38:22.684500+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:46.812342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4167544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":488,"num_read_kb":17056,"num_write":1038,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:21.953586+0000","last_change":"2024-08-08T23:28:26.790814+0000","last_active":"2024-08-09T00:37:21.953586+0000","last_peered":"2024-08-09T00:37:21.953586+0000","last_clean":"2024-08-09T00:37:21.953586+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:37:21.953586+0000","last_undegraded":"2024-08-09T00:37:21.953586+0000","last_fullsized":"2024-08-09T00:37:21.953586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:39:18.226934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1052,"ondisk_log_size":1052,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1764,"ondisk_log_size":1764,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":569,"ondisk_log_size":569,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":425460,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9554,"num_read_kb":11556,"num_write":6725,"num_write_kb":2855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":737280,"data_stored":228824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1603,"num_read_kb":1909,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3446,"ondisk_log_size":3446,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":486920049,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":32037,"num_read_kb":2279949,"num_write":69215,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":733556736,"data_stored":733556736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4350,"ondisk_log_size":4350,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":194734,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":137,"num_read_kb":183422,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575722,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336972,"kb_used_data":129476,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94034868,"statfs":{"total":96636764160,"available":96291704832,"internally_reserved":0,"allocated":132583424,"data_stored":130375216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575720,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":137188,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":140480512,"data_stored":138341905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575721,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199664,"kb_used_data":110248,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94172176,"statfs":{"total":96636764160,"available":96432308224,"internally_reserved":0,"allocated":112893952,"data_stored":110669074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575720,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218668,"kb_used_data":129188,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94153172,"statfs":{"total":96636764160,"available":96412848128,"internally_reserved":0,"allocated":132288512,"data_stored":130226726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575719,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326016,"kb_used_data":114360,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94045824,"statfs":{"total":96636764160,"available":96302923776,"internally_reserved":0,"allocated":117104640,"data_stored":114919562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575720,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214704,"kb_used_data":133608,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94157136,"statfs":{"total":96636764160,"available":96416907264,"internally_reserved":0,"allocated":136814592,"data_stored":134711966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575723,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284944,"kb_used_data":163592,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94086896,"statfs":{"total":96636764160,"available":96344981504,"internally_reserved":0,"allocated":167518208,"data_stored":165365008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575720,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378920,"kb_used_data":163104,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":93992920,"statfs":{"total":96636764160,"available":96248750080,"internally_reserved":0,"allocated":167018496,"data_stored":164829157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86249472,"data_stored":86249472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108445696,"data_stored":108445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88334336,"data_stored":88334336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":82051072,"data_stored":82051072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92254208,"data_stored":92254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77799424,"data_stored":77799424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":103501824,"data_stored":103501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94920704,"data_stored":94920704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":26939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":27234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":44499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":47166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":16811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41992192,"data_stored":41991459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27361280,"data_stored":27359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:40:31.563 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-09T00:40:31.564 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:40:31.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:31.973 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:40:31.977 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2432,"stamp":"2024-08-09T00:40:31.304723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655923416,"num_objects":964,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":149375,"num_read_kb":2759222,"num_write":129679,"num_write_kb":2369685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13348,"ondisk_log_size":13348,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2375356,"kb_used_data":1080764,"kb_used_omap":12,"kb_used_meta":1294515,"kb_avail":752599364,"statfs":{"total":773094113280,"available":770661748736,"internally_reserved":0,"allocated":1106702336,"data_stored":1089438614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1325583920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009325"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059551+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:37:03.059551+0000","last_peered":"2024-08-09T00:37:03.059551+0000","last_clean":"2024-08-09T00:37:03.059551+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:37:03.059551+0000","last_undegraded":"2024-08-09T00:37:03.059551+0000","last_fullsized":"2024-08-09T00:37:03.059551+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:30:02.130065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048604+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:36:13.048604+0000","last_peered":"2024-08-09T00:36:13.048604+0000","last_clean":"2024-08-09T00:36:13.048604+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:36:13.048604+0000","last_undegraded":"2024-08-09T00:36:13.048604+0000","last_fullsized":"2024-08-09T00:36:13.048604+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:23.793811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644232+0000","last_change":"2024-08-08T23:48:38.082677+0000","last_active":"2024-08-09T00:36:07.644232+0000","last_peered":"2024-08-09T00:36:07.644232+0000","last_clean":"2024-08-09T00:36:07.644232+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:36:07.644232+0000","last_undegraded":"2024-08-09T00:36:07.644232+0000","last_fullsized":"2024-08-09T00:36:07.644232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:45.392917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.826049+0000","last_change":"2024-08-08T23:44:47.428900+0000","last_active":"2024-08-09T00:36:52.826049+0000","last_peered":"2024-08-09T00:36:52.826049+0000","last_clean":"2024-08-09T00:36:52.826049+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:36:52.826049+0000","last_undegraded":"2024-08-09T00:36:52.826049+0000","last_fullsized":"2024-08-09T00:36:52.826049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:21:21.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834206+0000","last_change":"2024-08-09T00:04:29.843428+0000","last_active":"2024-08-09T00:37:02.834206+0000","last_peered":"2024-08-09T00:37:02.834206+0000","last_clean":"2024-08-09T00:37:02.834206+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:37:02.834206+0000","last_undegraded":"2024-08-09T00:37:02.834206+0000","last_fullsized":"2024-08-09T00:37:02.834206+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.089851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818932+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:36:12.818932+0000","last_peered":"2024-08-09T00:36:12.818932+0000","last_clean":"2024-08-09T00:36:12.818932+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:36:12.818932+0000","last_undegraded":"2024-08-09T00:36:12.818932+0000","last_fullsized":"2024-08-09T00:36:12.818932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.411299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9218,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830256+0000","last_change":"2024-08-08T23:48:38.092226+0000","last_active":"2024-08-09T00:36:07.830256+0000","last_peered":"2024-08-09T00:36:07.830256+0000","last_clean":"2024-08-09T00:36:07.830256+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:36:07.830256+0000","last_undegraded":"2024-08-09T00:36:07.830256+0000","last_fullsized":"2024-08-09T00:36:07.830256+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:37.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":18,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":216,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833279+0000","last_change":"2024-08-08T23:44:47.413408+0000","last_active":"2024-08-09T00:36:57.833279+0000","last_peered":"2024-08-09T00:36:57.833279+0000","last_clean":"2024-08-09T00:36:57.833279+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:36:57.833279+0000","last_undegraded":"2024-08-09T00:36:57.833279+0000","last_fullsized":"2024-08-09T00:36:57.833279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:17.443794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815930+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:35:57.815930+0000","last_peered":"2024-08-09T00:35:57.815930+0000","last_clean":"2024-08-09T00:35:57.815930+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:35:57.815930+0000","last_undegraded":"2024-08-09T00:35:57.815930+0000","last_fullsized":"2024-08-09T00:35:57.815930+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:26:55.553956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822731+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:36:37.822731+0000","last_peered":"2024-08-09T00:36:37.822731+0000","last_clean":"2024-08-09T00:36:37.822731+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:36:37.822731+0000","last_undegraded":"2024-08-09T00:36:37.822731+0000","last_fullsized":"2024-08-09T00:36:37.822731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:03:58.706204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":4,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.831734+0000","last_change":"2024-08-08T23:48:38.096960+0000","last_active":"2024-08-09T00:36:47.831734+0000","last_peered":"2024-08-09T00:36:47.831734+0000","last_clean":"2024-08-09T00:36:47.831734+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:36:47.831734+0000","last_undegraded":"2024-08-09T00:36:47.831734+0000","last_fullsized":"2024-08-09T00:36:47.831734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:44:59.425002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831661+0000","last_change":"2024-08-08T23:44:47.415903+0000","last_active":"2024-08-09T00:37:17.831661+0000","last_peered":"2024-08-09T00:37:17.831661+0000","last_clean":"2024-08-09T00:37:17.831661+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:37:17.831661+0000","last_undegraded":"2024-08-09T00:37:17.831661+0000","last_fullsized":"2024-08-09T00:37:17.831661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:31.219458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644103+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:36:07.644103+0000","last_peered":"2024-08-09T00:36:07.644103+0000","last_clean":"2024-08-09T00:36:07.644103+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:36:07.644103+0000","last_undegraded":"2024-08-09T00:36:07.644103+0000","last_fullsized":"2024-08-09T00:36:07.644103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:47.348267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654897+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:36:52.654897+0000","last_peered":"2024-08-09T00:36:52.654897+0000","last_clean":"2024-08-09T00:36:52.654897+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:36:52.654897+0000","last_undegraded":"2024-08-09T00:36:52.654897+0000","last_fullsized":"2024-08-09T00:36:52.654897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:15.853173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823587+0000","last_change":"2024-08-08T23:48:38.064262+0000","last_active":"2024-08-09T00:36:32.823587+0000","last_peered":"2024-08-09T00:36:32.823587+0000","last_clean":"2024-08-09T00:36:32.823587+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:36:32.823587+0000","last_undegraded":"2024-08-09T00:36:32.823587+0000","last_fullsized":"2024-08-09T00:36:32.823587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:08.321374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660513+0000","last_change":"2024-08-08T23:44:47.404876+0000","last_active":"2024-08-09T00:37:17.660513+0000","last_peered":"2024-08-09T00:37:17.660513+0000","last_clean":"2024-08-09T00:37:17.660513+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:37:17.660513+0000","last_undegraded":"2024-08-09T00:37:17.660513+0000","last_fullsized":"2024-08-09T00:37:17.660513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:44.526394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652649+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:36:42.652649+0000","last_peered":"2024-08-09T00:36:42.652649+0000","last_clean":"2024-08-09T00:36:42.652649+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:36:42.652649+0000","last_undegraded":"2024-08-09T00:36:42.652649+0000","last_fullsized":"2024-08-09T00:36:42.652649+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:16:17.115238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061679+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:37:13.061679+0000","last_peered":"2024-08-09T00:37:13.061679+0000","last_clean":"2024-08-09T00:37:13.061679+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:37:13.061679+0000","last_undegraded":"2024-08-09T00:37:13.061679+0000","last_fullsized":"2024-08-09T00:37:13.061679+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:31.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096989,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":17458,"num_write":14,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'5","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.826910+0000","last_change":"2024-08-08T23:48:38.059017+0000","last_active":"2024-08-09T00:36:57.826910+0000","last_peered":"2024-08-09T00:36:57.826910+0000","last_clean":"2024-08-09T00:36:57.826910+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:36:57.826910+0000","last_undegraded":"2024-08-09T00:36:57.826910+0000","last_fullsized":"2024-08-09T00:36:57.826910+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:57.310351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660430+0000","last_change":"2024-08-08T23:44:47.424336+0000","last_active":"2024-08-09T00:37:17.660430+0000","last_peered":"2024-08-09T00:37:17.660430+0000","last_clean":"2024-08-09T00:37:17.660430+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:37:17.660430+0000","last_undegraded":"2024-08-09T00:37:17.660430+0000","last_fullsized":"2024-08-09T00:37:17.660430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:30:34.660972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.851421+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:37:52.851421+0000","last_peered":"2024-08-09T00:37:52.851421+0000","last_clean":"2024-08-09T00:37:52.851421+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:37:52.851421+0000","last_undegraded":"2024-08-09T00:37:52.851421+0000","last_fullsized":"2024-08-09T00:37:52.851421+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:40:37.743717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831092+0000","last_change":"2024-08-08T23:48:42.099507+0000","last_active":"2024-08-09T00:37:02.831092+0000","last_peered":"2024-08-09T00:37:02.831092+0000","last_clean":"2024-08-09T00:37:02.831092+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:37:02.831092+0000","last_undegraded":"2024-08-09T00:37:02.831092+0000","last_fullsized":"2024-08-09T00:37:02.831092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:58:00.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833107+0000","last_change":"2024-08-08T23:48:38.063345+0000","last_active":"2024-08-09T00:37:12.833107+0000","last_peered":"2024-08-09T00:37:12.833107+0000","last_clean":"2024-08-09T00:37:12.833107+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:37:12.833107+0000","last_undegraded":"2024-08-09T00:37:12.833107+0000","last_fullsized":"2024-08-09T00:37:12.833107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:22:39.743227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834919+0000","last_change":"2024-08-08T23:44:47.415691+0000","last_active":"2024-08-09T00:37:17.834919+0000","last_peered":"2024-08-09T00:37:17.834919+0000","last_clean":"2024-08-09T00:37:17.834919+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:37:17.834919+0000","last_undegraded":"2024-08-09T00:37:17.834919+0000","last_fullsized":"2024-08-09T00:37:17.834919+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:32.215875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857873+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:37:02.857873+0000","last_peered":"2024-08-09T00:37:02.857873+0000","last_clean":"2024-08-09T00:37:02.857873+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:37:02.857873+0000","last_undegraded":"2024-08-09T00:37:02.857873+0000","last_fullsized":"2024-08-09T00:37:02.857873+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:42.897370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'1","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819450+0000","last_change":"2024-08-08T23:48:42.104797+0000","last_active":"2024-08-09T00:36:12.819450+0000","last_peered":"2024-08-09T00:36:12.819450+0000","last_clean":"2024-08-09T00:36:12.819450+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:36:12.819450+0000","last_undegraded":"2024-08-09T00:36:12.819450+0000","last_fullsized":"2024-08-09T00:36:12.819450+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:25:12.169302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817685+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:36:07.817685+0000","last_peered":"2024-08-09T00:36:07.817685+0000","last_clean":"2024-08-09T00:36:07.817685+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:36:07.817685+0000","last_undegraded":"2024-08-09T00:36:07.817685+0000","last_fullsized":"2024-08-09T00:36:07.817685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:13.656553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:42.809243+0000","last_change":"2024-08-08T23:44:47.418893+0000","last_active":"2024-08-09T00:35:42.809243+0000","last_peered":"2024-08-09T00:35:42.809243+0000","last_clean":"2024-08-09T00:35:42.809243+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:35:42.809243+0000","last_undegraded":"2024-08-09T00:35:42.809243+0000","last_fullsized":"2024-08-09T00:35:42.809243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:10.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857956+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:37:02.857956+0000","last_peered":"2024-08-09T00:37:02.857956+0000","last_clean":"2024-08-09T00:37:02.857956+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:37:02.857956+0000","last_undegraded":"2024-08-09T00:37:02.857956+0000","last_fullsized":"2024-08-09T00:37:02.857956+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:54.964878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645398+0000","last_change":"2024-08-08T23:48:42.093531+0000","last_active":"2024-08-09T00:36:12.645398+0000","last_peered":"2024-08-09T00:36:12.645398+0000","last_clean":"2024-08-09T00:36:12.645398+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:36:12.645398+0000","last_undegraded":"2024-08-09T00:36:12.645398+0000","last_fullsized":"2024-08-09T00:36:12.645398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:15:00.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'1","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815669+0000","last_change":"2024-08-08T23:48:38.070086+0000","last_active":"2024-08-09T00:36:07.815669+0000","last_peered":"2024-08-09T00:36:07.815669+0000","last_clean":"2024-08-09T00:36:07.815669+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:36:07.815669+0000","last_undegraded":"2024-08-09T00:36:07.815669+0000","last_fullsized":"2024-08-09T00:36:07.815669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:09.001506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.852322+0000","last_change":"2024-08-08T23:44:47.401774+0000","last_active":"2024-08-09T00:37:57.852322+0000","last_peered":"2024-08-09T00:37:57.852322+0000","last_clean":"2024-08-09T00:37:57.852322+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:37:57.852322+0000","last_undegraded":"2024-08-09T00:37:57.852322+0000","last_fullsized":"2024-08-09T00:37:57.852322+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:30.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843286+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:37:12.843286+0000","last_peered":"2024-08-09T00:37:12.843286+0000","last_clean":"2024-08-09T00:37:12.843286+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:37:12.843286+0000","last_undegraded":"2024-08-09T00:37:12.843286+0000","last_fullsized":"2024-08-09T00:37:12.843286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:35.805429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657057+0000","last_change":"2024-08-08T23:48:42.569594+0000","last_active":"2024-08-09T00:37:02.657057+0000","last_peered":"2024-08-09T00:37:02.657057+0000","last_clean":"2024-08-09T00:37:02.657057+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:37:02.657057+0000","last_undegraded":"2024-08-09T00:37:02.657057+0000","last_fullsized":"2024-08-09T00:37:02.657057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:05:00.915075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:48.069350+0000","last_change":"2024-08-08T23:48:38.078390+0000","last_active":"2024-08-09T00:37:48.069350+0000","last_peered":"2024-08-09T00:37:48.069350+0000","last_clean":"2024-08-09T00:37:48.069350+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:37:48.069350+0000","last_undegraded":"2024-08-09T00:37:48.069350+0000","last_fullsized":"2024-08-09T00:37:48.069350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:32.220322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.840117+0000","last_change":"2024-08-08T23:44:47.428042+0000","last_active":"2024-08-09T00:37:57.840117+0000","last_peered":"2024-08-09T00:37:57.840117+0000","last_clean":"2024-08-09T00:37:57.840117+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:37:57.840117+0000","last_undegraded":"2024-08-09T00:37:57.840117+0000","last_fullsized":"2024-08-09T00:37:57.840117+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:18.129270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836193+0000","last_change":"2024-08-09T00:04:29.838090+0000","last_active":"2024-08-09T00:37:12.836193+0000","last_peered":"2024-08-09T00:37:12.836193+0000","last_clean":"2024-08-09T00:37:12.836193+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:37:12.836193+0000","last_undegraded":"2024-08-09T00:37:12.836193+0000","last_fullsized":"2024-08-09T00:37:12.836193+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:20.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.668499+0000","last_change":"2024-08-08T23:48:42.571114+0000","last_active":"2024-08-09T00:37:52.668499+0000","last_peered":"2024-08-09T00:37:52.668499+0000","last_clean":"2024-08-09T00:37:52.668499+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:37:52.668499+0000","last_undegraded":"2024-08-09T00:37:52.668499+0000","last_fullsized":"2024-08-09T00:37:52.668499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:19:04.633722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856729+0000","last_change":"2024-08-08T23:48:38.081638+0000","last_active":"2024-08-09T00:36:57.856729+0000","last_peered":"2024-08-09T00:36:57.856729+0000","last_clean":"2024-08-09T00:36:57.856729+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:36:57.856729+0000","last_undegraded":"2024-08-09T00:36:57.856729+0000","last_fullsized":"2024-08-09T00:36:57.856729+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:56.987204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.669657+0000","last_change":"2024-08-08T23:44:47.418443+0000","last_active":"2024-08-09T00:37:57.669657+0000","last_peered":"2024-08-09T00:37:57.669657+0000","last_clean":"2024-08-09T00:37:57.669657+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:37:57.669657+0000","last_undegraded":"2024-08-09T00:37:57.669657+0000","last_fullsized":"2024-08-09T00:37:57.669657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:00.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.859886+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:37:12.859886+0000","last_peered":"2024-08-09T00:37:12.859886+0000","last_clean":"2024-08-09T00:37:12.859886+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:37:12.859886+0000","last_undegraded":"2024-08-09T00:37:12.859886+0000","last_fullsized":"2024-08-09T00:37:12.859886+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:54.135762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657135+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:37:02.657135+0000","last_peered":"2024-08-09T00:37:02.657135+0000","last_clean":"2024-08-09T00:37:02.657135+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:37:02.657135+0000","last_undegraded":"2024-08-09T00:37:02.657135+0000","last_fullsized":"2024-08-09T00:37:02.657135+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:37:02.420547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833259+0000","last_change":"2024-08-08T23:48:38.069892+0000","last_active":"2024-08-09T00:36:57.833259+0000","last_peered":"2024-08-09T00:36:57.833259+0000","last_clean":"2024-08-09T00:36:57.833259+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:36:57.833259+0000","last_undegraded":"2024-08-09T00:36:57.833259+0000","last_fullsized":"2024-08-09T00:36:57.833259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:56:09.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.845044+0000","last_change":"2024-08-08T23:44:47.403895+0000","last_active":"2024-08-09T00:37:57.845044+0000","last_peered":"2024-08-09T00:37:57.845044+0000","last_clean":"2024-08-09T00:37:57.845044+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:37:57.845044+0000","last_undegraded":"2024-08-09T00:37:57.845044+0000","last_fullsized":"2024-08-09T00:37:57.845044+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:20:56.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061641+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:37:13.061641+0000","last_peered":"2024-08-09T00:37:13.061641+0000","last_clean":"2024-08-09T00:37:13.061641+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:37:13.061641+0000","last_undegraded":"2024-08-09T00:37:13.061641+0000","last_fullsized":"2024-08-09T00:37:13.061641+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:35.438575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.830657+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:37:02.830657+0000","last_peered":"2024-08-09T00:37:02.830657+0000","last_clean":"2024-08-09T00:37:02.830657+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:37:02.830657+0000","last_undegraded":"2024-08-09T00:37:02.830657+0000","last_fullsized":"2024-08-09T00:37:02.830657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:31.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.827150+0000","last_change":"2024-08-08T23:48:38.073422+0000","last_active":"2024-08-09T00:36:57.827150+0000","last_peered":"2024-08-09T00:36:57.827150+0000","last_clean":"2024-08-09T00:36:57.827150+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:36:57.827150+0000","last_undegraded":"2024-08-09T00:36:57.827150+0000","last_fullsized":"2024-08-09T00:36:57.827150+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:06.420714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846240+0000","last_change":"2024-08-08T23:44:47.416042+0000","last_active":"2024-08-09T00:36:12.846240+0000","last_peered":"2024-08-09T00:36:12.846240+0000","last_clean":"2024-08-09T00:36:12.846240+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:36:12.846240+0000","last_undegraded":"2024-08-09T00:36:12.846240+0000","last_fullsized":"2024-08-09T00:36:12.846240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:18.630574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641678+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:35:57.641678+0000","last_peered":"2024-08-09T00:35:57.641678+0000","last_clean":"2024-08-09T00:35:57.641678+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:35:57.641678+0000","last_undegraded":"2024-08-09T00:35:57.641678+0000","last_fullsized":"2024-08-09T00:35:57.641678+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:48:51.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849230+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:37:42.849230+0000","last_peered":"2024-08-09T00:37:42.849230+0000","last_clean":"2024-08-09T00:37:42.849230+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:37:42.849230+0000","last_undegraded":"2024-08-09T00:37:42.849230+0000","last_fullsized":"2024-08-09T00:37:42.849230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:37.725025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840154+0000","last_change":"2024-08-08T23:48:38.068093+0000","last_active":"2024-08-09T00:37:37.840154+0000","last_peered":"2024-08-09T00:37:37.840154+0000","last_clean":"2024-08-09T00:37:37.840154+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:37:37.840154+0000","last_undegraded":"2024-08-09T00:37:37.840154+0000","last_fullsized":"2024-08-09T00:37:37.840154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:31:07.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844757+0000","last_change":"2024-08-08T23:44:47.417665+0000","last_active":"2024-08-09T00:36:07.844757+0000","last_peered":"2024-08-09T00:36:07.844757+0000","last_clean":"2024-08-09T00:36:07.844757+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:36:07.844757+0000","last_undegraded":"2024-08-09T00:36:07.844757+0000","last_fullsized":"2024-08-09T00:36:07.844757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:54.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813256+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:35:57.813256+0000","last_peered":"2024-08-09T00:35:57.813256+0000","last_clean":"2024-08-09T00:35:57.813256+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:35:57.813256+0000","last_undegraded":"2024-08-09T00:35:57.813256+0000","last_fullsized":"2024-08-09T00:35:57.813256+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:53.142711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849163+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:37:42.849163+0000","last_peered":"2024-08-09T00:37:42.849163+0000","last_clean":"2024-08-09T00:37:42.849163+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:37:42.849163+0000","last_undegraded":"2024-08-09T00:37:42.849163+0000","last_fullsized":"2024-08-09T00:37:42.849163+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.916828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'1","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.664886+0000","last_change":"2024-08-08T23:48:38.082209+0000","last_active":"2024-08-09T00:37:37.664886+0000","last_peered":"2024-08-09T00:37:37.664886+0000","last_clean":"2024-08-09T00:37:37.664886+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:37:37.664886+0000","last_undegraded":"2024-08-09T00:37:37.664886+0000","last_fullsized":"2024-08-09T00:37:37.664886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:19.106154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815548+0000","last_change":"2024-08-08T23:44:47.414517+0000","last_active":"2024-08-09T00:36:07.815548+0000","last_peered":"2024-08-09T00:36:07.815548+0000","last_clean":"2024-08-09T00:36:07.815548+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:36:07.815548+0000","last_undegraded":"2024-08-09T00:36:07.815548+0000","last_fullsized":"2024-08-09T00:36:07.815548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:24.856912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.832729+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:37:22.832729+0000","last_peered":"2024-08-09T00:37:22.832729+0000","last_clean":"2024-08-09T00:37:22.832729+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:37:22.832729+0000","last_undegraded":"2024-08-09T00:37:22.832729+0000","last_fullsized":"2024-08-09T00:37:22.832729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:11.805690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.841067+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:38:02.841067+0000","last_peered":"2024-08-09T00:38:02.841067+0000","last_clean":"2024-08-09T00:38:02.841067+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:38:02.841067+0000","last_undegraded":"2024-08-09T00:38:02.841067+0000","last_fullsized":"2024-08-09T00:38:02.841067+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:17.911780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840304+0000","last_change":"2024-08-08T23:48:38.094796+0000","last_active":"2024-08-09T00:37:37.840304+0000","last_peered":"2024-08-09T00:37:37.840304+0000","last_clean":"2024-08-09T00:37:37.840304+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:37:37.840304+0000","last_undegraded":"2024-08-09T00:37:37.840304+0000","last_fullsized":"2024-08-09T00:37:37.840304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:24.637100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817622+0000","last_change":"2024-08-08T23:44:47.394560+0000","last_active":"2024-08-09T00:36:07.817622+0000","last_peered":"2024-08-09T00:36:07.817622+0000","last_clean":"2024-08-09T00:36:07.817622+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:36:07.817622+0000","last_undegraded":"2024-08-09T00:36:07.817622+0000","last_fullsized":"2024-08-09T00:36:07.817622+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:27:00.732298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641490+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:35:57.641490+0000","last_peered":"2024-08-09T00:35:57.641490+0000","last_clean":"2024-08-09T00:35:57.641490+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:35:57.641490+0000","last_undegraded":"2024-08-09T00:35:57.641490+0000","last_fullsized":"2024-08-09T00:35:57.641490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:42.318744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.841717+0000","last_change":"2024-08-08T23:48:42.119272+0000","last_active":"2024-08-09T00:37:42.841717+0000","last_peered":"2024-08-09T00:37:42.841717+0000","last_clean":"2024-08-09T00:37:42.841717+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:37:42.841717+0000","last_undegraded":"2024-08-09T00:37:42.841717+0000","last_fullsized":"2024-08-09T00:37:42.841717+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:12.818880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:38.066987+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:37:38.066987+0000","last_peered":"2024-08-09T00:37:38.066987+0000","last_clean":"2024-08-09T00:37:38.066987+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:37:38.066987+0000","last_undegraded":"2024-08-09T00:37:38.066987+0000","last_fullsized":"2024-08-09T00:37:38.066987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:13.879567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.643947+0000","last_change":"2024-08-08T23:44:47.404724+0000","last_active":"2024-08-09T00:36:07.643947+0000","last_peered":"2024-08-09T00:36:07.643947+0000","last_clean":"2024-08-09T00:36:07.643947+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:36:07.643947+0000","last_undegraded":"2024-08-09T00:36:07.643947+0000","last_fullsized":"2024-08-09T00:36:07.643947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:52:50.706903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:07.835155+0000","last_change":"2024-08-09T00:04:29.835767+0000","last_active":"2024-08-09T00:37:07.835155+0000","last_peered":"2024-08-09T00:37:07.835155+0000","last_clean":"2024-08-09T00:37:07.835155+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:37:07.835155+0000","last_undegraded":"2024-08-09T00:37:07.835155+0000","last_fullsized":"2024-08-09T00:37:07.835155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.738421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672519+0000","last_change":"2024-08-08T23:48:42.111533+0000","last_active":"2024-08-09T00:38:12.672519+0000","last_peered":"2024-08-09T00:38:12.672519+0000","last_clean":"2024-08-09T00:38:12.672519+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:38:12.672519+0000","last_undegraded":"2024-08-09T00:38:12.672519+0000","last_fullsized":"2024-08-09T00:38:12.672519+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:24.814125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.872421+0000","last_change":"2024-08-08T23:48:38.087296+0000","last_active":"2024-08-09T00:38:07.872421+0000","last_peered":"2024-08-09T00:38:07.872421+0000","last_clean":"2024-08-09T00:38:07.872421+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:38:07.872421+0000","last_undegraded":"2024-08-09T00:38:07.872421+0000","last_fullsized":"2024-08-09T00:38:07.872421+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:01:04.545816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652733+0000","last_change":"2024-08-08T23:44:47.428169+0000","last_active":"2024-08-09T00:36:42.652733+0000","last_peered":"2024-08-09T00:36:42.652733+0000","last_clean":"2024-08-09T00:36:42.652733+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:36:42.652733+0000","last_undegraded":"2024-08-09T00:36:42.652733+0000","last_fullsized":"2024-08-09T00:36:42.652733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:49.375073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843416+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:36:02.843416+0000","last_peered":"2024-08-09T00:36:02.843416+0000","last_clean":"2024-08-09T00:36:02.843416+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:36:02.843416+0000","last_undegraded":"2024-08-09T00:36:02.843416+0000","last_fullsized":"2024-08-09T00:36:02.843416+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:32.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'11","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672470+0000","last_change":"2024-08-08T23:48:42.099382+0000","last_active":"2024-08-09T00:38:12.672470+0000","last_peered":"2024-08-09T00:38:12.672470+0000","last_clean":"2024-08-09T00:38:12.672470+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:38:12.672470+0000","last_undegraded":"2024-08-09T00:38:12.672470+0000","last_fullsized":"2024-08-09T00:38:12.672470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:20.657160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12631331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":21602,"num_write":16,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.847395+0000","last_change":"2024-08-08T23:48:38.060640+0000","last_active":"2024-08-09T00:38:07.847395+0000","last_peered":"2024-08-09T00:38:07.847395+0000","last_clean":"2024-08-09T00:38:07.847395+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:38:07.847395+0000","last_undegraded":"2024-08-09T00:38:07.847395+0000","last_fullsized":"2024-08-09T00:38:07.847395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:37.913237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:33.053185+0000","last_change":"2024-08-08T23:44:47.403129+0000","last_active":"2024-08-09T00:36:33.053185+0000","last_peered":"2024-08-09T00:36:33.053185+0000","last_clean":"2024-08-09T00:36:33.053185+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:36:33.053185+0000","last_undegraded":"2024-08-09T00:36:33.053185+0000","last_fullsized":"2024-08-09T00:36:33.053185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:39.986809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831148+0000","last_change":"2024-08-09T00:04:29.861378+0000","last_active":"2024-08-09T00:37:02.831148+0000","last_peered":"2024-08-09T00:37:02.831148+0000","last_clean":"2024-08-09T00:37:02.831148+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:37:02.831148+0000","last_undegraded":"2024-08-09T00:37:02.831148+0000","last_fullsized":"2024-08-09T00:37:02.831148+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:00.665233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'4","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830335+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:36:07.830335+0000","last_peered":"2024-08-09T00:36:07.830335+0000","last_clean":"2024-08-09T00:36:07.830335+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:36:07.830335+0000","last_undegraded":"2024-08-09T00:36:07.830335+0000","last_fullsized":"2024-08-09T00:36:07.830335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:27:45.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'1","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.842246+0000","last_change":"2024-08-08T23:48:38.085232+0000","last_active":"2024-08-09T00:38:07.842246+0000","last_peered":"2024-08-09T00:38:07.842246+0000","last_clean":"2024-08-09T00:38:07.842246+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:38:07.842246+0000","last_undegraded":"2024-08-09T00:38:07.842246+0000","last_fullsized":"2024-08-09T00:38:07.842246+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:15.159124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824087+0000","last_change":"2024-08-08T23:44:47.399086+0000","last_active":"2024-08-09T00:36:32.824087+0000","last_peered":"2024-08-09T00:36:32.824087+0000","last_clean":"2024-08-09T00:36:32.824087+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:36:32.824087+0000","last_undegraded":"2024-08-09T00:36:32.824087+0000","last_fullsized":"2024-08-09T00:36:32.824087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:59.479905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857757+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:37:02.857757+0000","last_peered":"2024-08-09T00:37:02.857757+0000","last_clean":"2024-08-09T00:37:02.857757+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:37:02.857757+0000","last_undegraded":"2024-08-09T00:37:02.857757+0000","last_fullsized":"2024-08-09T00:37:02.857757+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:37:09.466033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672556+0000","last_change":"2024-08-08T23:48:42.109080+0000","last_active":"2024-08-09T00:38:12.672556+0000","last_peered":"2024-08-09T00:38:12.672556+0000","last_clean":"2024-08-09T00:38:12.672556+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:38:12.672556+0000","last_undegraded":"2024-08-09T00:38:12.672556+0000","last_fullsized":"2024-08-09T00:38:12.672556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:13.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.829079+0000","last_change":"2024-08-08T23:48:38.092262+0000","last_active":"2024-08-09T00:36:02.829079+0000","last_peered":"2024-08-09T00:36:02.829079+0000","last_clean":"2024-08-09T00:36:02.829079+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:36:02.829079+0000","last_undegraded":"2024-08-09T00:36:02.829079+0000","last_fullsized":"2024-08-09T00:36:02.829079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:52:00.439329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.828951+0000","last_change":"2024-08-08T23:44:47.399289+0000","last_active":"2024-08-09T00:36:32.828951+0000","last_peered":"2024-08-09T00:36:32.828951+0000","last_clean":"2024-08-09T00:36:32.828951+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:36:32.828951+0000","last_undegraded":"2024-08-09T00:36:32.828951+0000","last_fullsized":"2024-08-09T00:36:32.828951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:04.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.643044+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:36:02.643044+0000","last_peered":"2024-08-09T00:36:02.643044+0000","last_clean":"2024-08-09T00:36:02.643044+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:36:02.643044+0000","last_undegraded":"2024-08-09T00:36:02.643044+0000","last_fullsized":"2024-08-09T00:36:02.643044+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:08.530056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821001+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:36:22.821001+0000","last_peered":"2024-08-09T00:36:22.821001+0000","last_clean":"2024-08-09T00:36:22.821001+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:36:22.821001+0000","last_undegraded":"2024-08-09T00:36:22.821001+0000","last_fullsized":"2024-08-09T00:36:22.821001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:18:01.697005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818021+0000","last_change":"2024-08-08T23:48:38.084236+0000","last_active":"2024-08-09T00:36:17.818021+0000","last_peered":"2024-08-09T00:36:17.818021+0000","last_clean":"2024-08-09T00:36:17.818021+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:36:17.818021+0000","last_undegraded":"2024-08-09T00:36:17.818021+0000","last_fullsized":"2024-08-09T00:36:17.818021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:54.693443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":9,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.821527+0000","last_change":"2024-08-08T23:44:47.408356+0000","last_active":"2024-08-09T00:36:32.821527+0000","last_peered":"2024-08-09T00:36:32.821527+0000","last_clean":"2024-08-09T00:36:32.821527+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:36:32.821527+0000","last_undegraded":"2024-08-09T00:36:32.821527+0000","last_fullsized":"2024-08-09T00:36:32.821527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:09.358087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845039+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:36:07.845039+0000","last_peered":"2024-08-09T00:36:07.845039+0000","last_clean":"2024-08-09T00:36:07.845039+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:36:07.845039+0000","last_undegraded":"2024-08-09T00:36:07.845039+0000","last_fullsized":"2024-08-09T00:36:07.845039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:02:05.119656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848531+0000","last_change":"2024-08-08T23:48:42.570789+0000","last_active":"2024-08-09T00:36:22.848531+0000","last_peered":"2024-08-09T00:36:22.848531+0000","last_clean":"2024-08-09T00:36:22.848531+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:36:22.848531+0000","last_undegraded":"2024-08-09T00:36:22.848531+0000","last_fullsized":"2024-08-09T00:36:22.848531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:34.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'7","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.832336+0000","last_change":"2024-08-08T23:48:38.092188+0000","last_active":"2024-08-09T00:36:17.832336+0000","last_peered":"2024-08-09T00:36:17.832336+0000","last_clean":"2024-08-09T00:36:17.832336+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:36:17.832336+0000","last_undegraded":"2024-08-09T00:36:17.832336+0000","last_fullsized":"2024-08-09T00:36:17.832336+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:33.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855435+0000","last_change":"2024-08-08T23:44:47.396027+0000","last_active":"2024-08-09T00:36:52.855435+0000","last_peered":"2024-08-09T00:36:52.855435+0000","last_clean":"2024-08-09T00:36:52.855435+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:36:52.855435+0000","last_undegraded":"2024-08-09T00:36:52.855435+0000","last_fullsized":"2024-08-09T00:36:52.855435+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:49:52.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843458+0000","last_change":"2024-08-09T00:04:29.877623+0000","last_active":"2024-08-09T00:36:02.843458+0000","last_peered":"2024-08-09T00:36:02.843458+0000","last_clean":"2024-08-09T00:36:02.843458+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:36:02.843458+0000","last_undegraded":"2024-08-09T00:36:02.843458+0000","last_fullsized":"2024-08-09T00:36:02.843458+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:58.415040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855444+0000","last_change":"2024-08-08T23:48:42.117970+0000","last_active":"2024-08-09T00:38:12.855444+0000","last_peered":"2024-08-09T00:38:12.855444+0000","last_clean":"2024-08-09T00:38:12.855444+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:38:12.855444+0000","last_undegraded":"2024-08-09T00:38:12.855444+0000","last_fullsized":"2024-08-09T00:38:12.855444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:08.226037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.820427+0000","last_change":"2024-08-08T23:48:38.070526+0000","last_active":"2024-08-09T00:36:27.820427+0000","last_peered":"2024-08-09T00:36:27.820427+0000","last_clean":"2024-08-09T00:36:27.820427+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:36:27.820427+0000","last_undegraded":"2024-08-09T00:36:27.820427+0000","last_fullsized":"2024-08-09T00:36:27.820427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:04.766563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.653651+0000","last_change":"2024-08-08T23:44:47.397051+0000","last_active":"2024-08-09T00:36:47.653651+0000","last_peered":"2024-08-09T00:36:47.653651+0000","last_clean":"2024-08-09T00:36:47.653651+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:36:47.653651+0000","last_undegraded":"2024-08-09T00:36:47.653651+0000","last_fullsized":"2024-08-09T00:36:47.653651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:05:19.891906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814357+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:36:02.814357+0000","last_peered":"2024-08-09T00:36:02.814357+0000","last_clean":"2024-08-09T00:36:02.814357+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:36:02.814357+0000","last_undegraded":"2024-08-09T00:36:02.814357+0000","last_fullsized":"2024-08-09T00:36:02.814357+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:18:12.990248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'6","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849765+0000","last_change":"2024-08-08T23:48:42.107127+0000","last_active":"2024-08-09T00:36:27.849765+0000","last_peered":"2024-08-09T00:36:27.849765+0000","last_clean":"2024-08-09T00:36:27.849765+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:36:27.849765+0000","last_undegraded":"2024-08-09T00:36:27.849765+0000","last_fullsized":"2024-08-09T00:36:27.849765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:54:09.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.848661+0000","last_change":"2024-08-08T23:48:38.063944+0000","last_active":"2024-08-09T00:38:07.848661+0000","last_peered":"2024-08-09T00:38:07.848661+0000","last_clean":"2024-08-09T00:38:07.848661+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:38:07.848661+0000","last_undegraded":"2024-08-09T00:38:07.848661+0000","last_fullsized":"2024-08-09T00:38:07.848661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:06:32.473872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827506+0000","last_change":"2024-08-08T23:44:47.398875+0000","last_active":"2024-08-09T00:36:47.827506+0000","last_peered":"2024-08-09T00:36:47.827506+0000","last_clean":"2024-08-09T00:36:47.827506+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:36:47.827506+0000","last_undegraded":"2024-08-09T00:36:47.827506+0000","last_fullsized":"2024-08-09T00:36:47.827506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:26.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868969+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:37:52.868969+0000","last_peered":"2024-08-09T00:37:52.868969+0000","last_clean":"2024-08-09T00:37:52.868969+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:37:52.868969+0000","last_undegraded":"2024-08-09T00:37:52.868969+0000","last_fullsized":"2024-08-09T00:37:52.868969+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:57:10.837360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'5","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824916+0000","last_change":"2024-08-08T23:48:42.101066+0000","last_active":"2024-08-09T00:36:47.824916+0000","last_peered":"2024-08-09T00:36:47.824916+0000","last_clean":"2024-08-09T00:36:47.824916+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:36:47.824916+0000","last_undegraded":"2024-08-09T00:36:47.824916+0000","last_fullsized":"2024-08-09T00:36:47.824916+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:06.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850986+0000","last_change":"2024-08-08T23:48:38.078556+0000","last_active":"2024-08-09T00:36:32.850986+0000","last_peered":"2024-08-09T00:36:32.850986+0000","last_clean":"2024-08-09T00:36:32.850986+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:36:32.850986+0000","last_undegraded":"2024-08-09T00:36:32.850986+0000","last_fullsized":"2024-08-09T00:36:32.850986+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:01.058350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.825020+0000","last_change":"2024-08-08T23:44:47.428182+0000","last_active":"2024-08-09T00:36:47.825020+0000","last_peered":"2024-08-09T00:36:47.825020+0000","last_clean":"2024-08-09T00:36:47.825020+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:36:47.825020+0000","last_undegraded":"2024-08-09T00:36:47.825020+0000","last_fullsized":"2024-08-09T00:36:47.825020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:23.238421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070601+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:37:53.070601+0000","last_peered":"2024-08-09T00:37:53.070601+0000","last_clean":"2024-08-09T00:37:53.070601+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:37:53.070601+0000","last_undegraded":"2024-08-09T00:37:53.070601+0000","last_fullsized":"2024-08-09T00:37:53.070601+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:59:54.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.822637+0000","last_change":"2024-08-08T23:48:42.574733+0000","last_active":"2024-08-09T00:36:37.822637+0000","last_peered":"2024-08-09T00:36:37.822637+0000","last_clean":"2024-08-09T00:36:37.822637+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:36:37.822637+0000","last_undegraded":"2024-08-09T00:36:37.822637+0000","last_fullsized":"2024-08-09T00:36:37.822637+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:12.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830892+0000","last_change":"2024-08-08T23:48:38.060729+0000","last_active":"2024-08-09T00:36:42.830892+0000","last_peered":"2024-08-09T00:36:42.830892+0000","last_clean":"2024-08-09T00:36:42.830892+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:36:42.830892+0000","last_undegraded":"2024-08-09T00:36:42.830892+0000","last_fullsized":"2024-08-09T00:36:42.830892+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:21.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'85","reported_seq":328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827642+0000","last_change":"2024-08-08T23:44:47.407071+0000","last_active":"2024-08-09T00:36:47.827642+0000","last_peered":"2024-08-09T00:36:47.827642+0000","last_clean":"2024-08-09T00:36:47.827642+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:36:47.827642+0000","last_undegraded":"2024-08-09T00:36:47.827642+0000","last_fullsized":"2024-08-09T00:36:47.827642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:20.171645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836281+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:36:37.836281+0000","last_peered":"2024-08-09T00:36:37.836281+0000","last_clean":"2024-08-09T00:36:37.836281+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:36:37.836281+0000","last_undegraded":"2024-08-09T00:36:37.836281+0000","last_fullsized":"2024-08-09T00:36:37.836281+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:00.019365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848808+0000","last_change":"2024-08-08T23:48:42.574649+0000","last_active":"2024-08-09T00:36:22.848808+0000","last_peered":"2024-08-09T00:36:22.848808+0000","last_clean":"2024-08-09T00:36:22.848808+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:36:22.848808+0000","last_undegraded":"2024-08-09T00:36:22.848808+0000","last_fullsized":"2024-08-09T00:36:22.848808+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:27.719355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'6","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:18.049822+0000","last_change":"2024-08-08T23:48:38.074200+0000","last_active":"2024-08-09T00:36:18.049822+0000","last_peered":"2024-08-09T00:36:18.049822+0000","last_clean":"2024-08-09T00:36:18.049822+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:36:18.049822+0000","last_undegraded":"2024-08-09T00:36:18.049822+0000","last_fullsized":"2024-08-09T00:36:18.049822+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:00.327462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14338,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856642+0000","last_change":"2024-08-08T23:44:47.409012+0000","last_active":"2024-08-09T00:36:57.856642+0000","last_peered":"2024-08-09T00:36:57.856642+0000","last_clean":"2024-08-09T00:36:57.856642+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:36:57.856642+0000","last_undegraded":"2024-08-09T00:36:57.856642+0000","last_fullsized":"2024-08-09T00:36:57.856642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:41:17.851838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844591+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:37:52.844591+0000","last_peered":"2024-08-09T00:37:52.844591+0000","last_clean":"2024-08-09T00:37:52.844591+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:37:52.844591+0000","last_undegraded":"2024-08-09T00:37:52.844591+0000","last_fullsized":"2024-08-09T00:37:52.844591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:53.664350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821249+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:36:22.821249+0000","last_peered":"2024-08-09T00:36:22.821249+0000","last_clean":"2024-08-09T00:36:22.821249+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:36:22.821249+0000","last_undegraded":"2024-08-09T00:36:22.821249+0000","last_fullsized":"2024-08-09T00:36:22.821249+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:57.922645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7184,"num_write":5,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847687+0000","last_change":"2024-08-08T23:48:38.078416+0000","last_active":"2024-08-09T00:36:17.847687+0000","last_peered":"2024-08-09T00:36:17.847687+0000","last_clean":"2024-08-09T00:36:17.847687+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:36:17.847687+0000","last_undegraded":"2024-08-09T00:36:17.847687+0000","last_fullsized":"2024-08-09T00:36:17.847687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:01:01.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.839733+0000","last_change":"2024-08-08T23:44:47.401342+0000","last_active":"2024-08-09T00:36:52.839733+0000","last_peered":"2024-08-09T00:36:52.839733+0000","last_clean":"2024-08-09T00:36:52.839733+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:36:52.839733+0000","last_undegraded":"2024-08-09T00:36:52.839733+0000","last_fullsized":"2024-08-09T00:36:52.839733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:44.529457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834315+0000","last_change":"2024-08-09T00:04:29.863724+0000","last_active":"2024-08-09T00:37:02.834315+0000","last_peered":"2024-08-09T00:37:02.834315+0000","last_clean":"2024-08-09T00:37:02.834315+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:37:02.834315+0000","last_undegraded":"2024-08-09T00:37:02.834315+0000","last_fullsized":"2024-08-09T00:37:02.834315+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:29.579952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'7","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836323+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:36:37.836323+0000","last_peered":"2024-08-09T00:36:37.836323+0000","last_clean":"2024-08-09T00:36:37.836323+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:36:37.836323+0000","last_undegraded":"2024-08-09T00:36:37.836323+0000","last_fullsized":"2024-08-09T00:36:37.836323+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:10.329411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.853121+0000","last_change":"2024-08-08T23:48:38.072020+0000","last_active":"2024-08-09T00:36:42.853121+0000","last_peered":"2024-08-09T00:36:42.853121+0000","last_clean":"2024-08-09T00:36:42.853121+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:36:42.853121+0000","last_undegraded":"2024-08-09T00:36:42.853121+0000","last_fullsized":"2024-08-09T00:36:42.853121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.841674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057480+0000","last_change":"2024-08-08T23:44:47.415563+0000","last_active":"2024-08-09T00:36:53.057480+0000","last_peered":"2024-08-09T00:36:53.057480+0000","last_clean":"2024-08-09T00:36:53.057480+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:36:53.057480+0000","last_undegraded":"2024-08-09T00:36:53.057480+0000","last_fullsized":"2024-08-09T00:36:53.057480+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:14.499630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.828240+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:37:02.828240+0000","last_peered":"2024-08-09T00:37:02.828240+0000","last_clean":"2024-08-09T00:37:02.828240+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:37:02.828240+0000","last_undegraded":"2024-08-09T00:37:02.828240+0000","last_fullsized":"2024-08-09T00:37:02.828240+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:48.269801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057343+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:36:53.057343+0000","last_peered":"2024-08-09T00:36:53.057343+0000","last_clean":"2024-08-09T00:36:53.057343+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:36:53.057343+0000","last_undegraded":"2024-08-09T00:36:53.057343+0000","last_fullsized":"2024-08-09T00:36:53.057343+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:22.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'3","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.850843+0000","last_change":"2024-08-08T23:48:38.073918+0000","last_active":"2024-08-09T00:36:32.850843+0000","last_peered":"2024-08-09T00:36:32.850843+0000","last_clean":"2024-08-09T00:36:32.850843+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:36:32.850843+0000","last_undegraded":"2024-08-09T00:36:32.850843+0000","last_fullsized":"2024-08-09T00:36:32.850843+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:36.717576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828053+0000","last_change":"2024-08-08T23:44:47.396682+0000","last_active":"2024-08-09T00:36:52.828053+0000","last_peered":"2024-08-09T00:36:52.828053+0000","last_clean":"2024-08-09T00:36:52.828053+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:36:52.828053+0000","last_undegraded":"2024-08-09T00:36:52.828053+0000","last_fullsized":"2024-08-09T00:36:52.828053+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:54.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.838905+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:37:52.838905+0000","last_peered":"2024-08-09T00:37:52.838905+0000","last_clean":"2024-08-09T00:37:52.838905+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:37:52.838905+0000","last_undegraded":"2024-08-09T00:37:52.838905+0000","last_fullsized":"2024-08-09T00:37:52.838905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:40.806416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825081+0000","last_change":"2024-08-08T23:48:42.101703+0000","last_active":"2024-08-09T00:36:37.825081+0000","last_peered":"2024-08-09T00:36:37.825081+0000","last_clean":"2024-08-09T00:36:37.825081+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:36:37.825081+0000","last_undegraded":"2024-08-09T00:36:37.825081+0000","last_fullsized":"2024-08-09T00:36:37.825081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:28:20.232434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.835642+0000","last_change":"2024-08-08T23:48:38.094574+0000","last_active":"2024-08-09T00:36:32.835642+0000","last_peered":"2024-08-09T00:36:32.835642+0000","last_clean":"2024-08-09T00:36:32.835642+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:36:32.835642+0000","last_undegraded":"2024-08-09T00:36:32.835642+0000","last_fullsized":"2024-08-09T00:36:32.835642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:54:58.203802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828719+0000","last_change":"2024-08-08T23:44:47.406106+0000","last_active":"2024-08-09T00:36:52.828719+0000","last_peered":"2024-08-09T00:36:52.828719+0000","last_clean":"2024-08-09T00:36:52.828719+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:36:52.828719+0000","last_undegraded":"2024-08-09T00:36:52.828719+0000","last_fullsized":"2024-08-09T00:36:52.828719+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:06.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870272+0000","last_change":"2024-08-09T00:04:29.876240+0000","last_active":"2024-08-09T00:37:57.870272+0000","last_peered":"2024-08-09T00:37:57.870272+0000","last_clean":"2024-08-09T00:37:57.870272+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:37:57.870272+0000","last_undegraded":"2024-08-09T00:37:57.870272+0000","last_fullsized":"2024-08-09T00:37:57.870272+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:16.600617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.824528+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:36:37.824528+0000","last_peered":"2024-08-09T00:36:37.824528+0000","last_clean":"2024-08-09T00:36:37.824528+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:36:37.824528+0000","last_undegraded":"2024-08-09T00:36:37.824528+0000","last_fullsized":"2024-08-09T00:36:37.824528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:25:48.483740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824034+0000","last_change":"2024-08-08T23:48:38.075180+0000","last_active":"2024-08-09T00:36:32.824034+0000","last_peered":"2024-08-09T00:36:32.824034+0000","last_clean":"2024-08-09T00:36:32.824034+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:36:32.824034+0000","last_undegraded":"2024-08-09T00:36:32.824034+0000","last_fullsized":"2024-08-09T00:36:32.824034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:33:20.643494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'75","reported_seq":297,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855332+0000","last_change":"2024-08-08T23:44:47.393129+0000","last_active":"2024-08-09T00:36:52.855332+0000","last_peered":"2024-08-09T00:36:52.855332+0000","last_clean":"2024-08-09T00:36:52.855332+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:36:52.855332+0000","last_undegraded":"2024-08-09T00:36:52.855332+0000","last_fullsized":"2024-08-09T00:36:52.855332+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:52.154862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'158","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.029188+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:39:28.029188+0000","last_peered":"2024-08-09T00:39:28.029188+0000","last_clean":"2024-08-09T00:39:28.029188+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:39:28.029188+0000","last_undegraded":"2024-08-09T00:39:28.029188+0000","last_fullsized":"2024-08-09T00:39:28.029188+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:02:46.763933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6911130,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":338,"num_read_kb":12258,"num_write":949,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045046+0000","last_change":"2024-08-08T23:28:26.788360+0000","last_active":"2024-08-09T00:35:58.045046+0000","last_peered":"2024-08-09T00:35:58.045046+0000","last_clean":"2024-08-09T00:35:58.045046+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:35:58.045046+0000","last_undegraded":"2024-08-09T00:35:58.045046+0000","last_fullsized":"2024-08-09T00:35:58.045046+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:04.030286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'178","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843501+0000","last_change":"2024-08-08T23:28:24.771874+0000","last_active":"2024-08-09T00:37:12.843501+0000","last_peered":"2024-08-09T00:37:12.843501+0000","last_clean":"2024-08-09T00:37:12.843501+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:37:12.843501+0000","last_undegraded":"2024-08-09T00:37:12.843501+0000","last_fullsized":"2024-08-09T00:37:12.843501+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:05.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7444278,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":346,"num_read_kb":3378,"num_write":891,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'233","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.842052+0000","last_change":"2024-08-08T23:28:26.783710+0000","last_active":"2024-08-09T00:35:57.842052+0000","last_peered":"2024-08-09T00:35:57.842052+0000","last_clean":"2024-08-09T00:35:57.842052+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:35:57.842052+0000","last_undegraded":"2024-08-09T00:35:57.842052+0000","last_fullsized":"2024-08-09T00:35:57.842052+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:28.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830506+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:37:12.830506+0000","last_peered":"2024-08-09T00:37:12.830506+0000","last_clean":"2024-08-09T00:37:12.830506+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:37:12.830506+0000","last_undegraded":"2024-08-09T00:37:12.830506+0000","last_fullsized":"2024-08-09T00:37:12.830506+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:18.881767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15339219,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":22668,"num_write":1170,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815161+0000","last_change":"2024-08-08T23:28:26.764063+0000","last_active":"2024-08-09T00:35:57.815161+0000","last_peered":"2024-08-09T00:35:57.815161+0000","last_clean":"2024-08-09T00:35:57.815161+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:35:57.815161+0000","last_undegraded":"2024-08-09T00:35:57.815161+0000","last_fullsized":"2024-08-09T00:35:57.815161+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:02.226948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'195","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.742763+0000","last_change":"2024-08-08T23:28:24.820523+0000","last_active":"2024-08-09T00:37:55.742763+0000","last_peered":"2024-08-09T00:37:55.742763+0000","last_clean":"2024-08-09T00:37:55.742763+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:37:55.742763+0000","last_undegraded":"2024-08-09T00:37:55.742763+0000","last_fullsized":"2024-08-09T00:37:55.742763+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:09.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311815,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":443,"num_read_kb":38040,"num_write":1150,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:54.879381+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:38:54.879381+0000","last_peered":"2024-08-09T00:38:54.879381+0000","last_clean":"2024-08-09T00:38:54.879381+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:38:54.879381+0000","last_undegraded":"2024-08-09T00:38:54.879381+0000","last_fullsized":"2024-08-09T00:38:54.879381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:03.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'212","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032599+0000","last_change":"2024-08-08T23:29:01.888800+0000","last_active":"2024-08-09T00:39:28.032599+0000","last_peered":"2024-08-09T00:39:28.032599+0000","last_clean":"2024-08-09T00:39:28.032599+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:39:28.032599+0000","last_undegraded":"2024-08-09T00:39:28.032599+0000","last_fullsized":"2024-08-09T00:39:28.032599+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:13.683511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8773046,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":506,"num_read_kb":21778,"num_write":1214,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825152+0000","last_change":"2024-08-08T23:28:26.768598+0000","last_active":"2024-08-09T00:36:37.825152+0000","last_peered":"2024-08-09T00:36:37.825152+0000","last_clean":"2024-08-09T00:36:37.825152+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:36:37.825152+0000","last_undegraded":"2024-08-09T00:36:37.825152+0000","last_fullsized":"2024-08-09T00:36:37.825152+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.114726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'186","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.189372+0000","last_change":"2024-08-08T23:28:24.817326+0000","last_active":"2024-08-09T00:36:25.189372+0000","last_peered":"2024-08-09T00:36:25.189372+0000","last_clean":"2024-08-09T00:36:25.189372+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:36:25.189372+0000","last_undegraded":"2024-08-09T00:36:25.189372+0000","last_fullsized":"2024-08-09T00:36:25.189372+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:00.886762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120656,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":427,"num_read_kb":54098,"num_write":1116,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833361+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:37:12.833361+0000","last_peered":"2024-08-09T00:37:12.833361+0000","last_clean":"2024-08-09T00:37:12.833361+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:37:12.833361+0000","last_undegraded":"2024-08-09T00:37:12.833361+0000","last_fullsized":"2024-08-09T00:37:12.833361+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:31.362319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'194","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.032872+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:39:28.032872+0000","last_peered":"2024-08-09T00:39:28.032872+0000","last_clean":"2024-08-09T00:39:28.032872+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:39:28.032872+0000","last_undegraded":"2024-08-09T00:39:28.032872+0000","last_fullsized":"2024-08-09T00:39:28.032872+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:11.097799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4771500,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":478,"num_read_kb":11259,"num_write":1110,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'106","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:23.806748+0000","last_change":"2024-08-08T23:28:26.777046+0000","last_active":"2024-08-09T00:38:23.806748+0000","last_peered":"2024-08-09T00:38:23.806748+0000","last_clean":"2024-08-09T00:38:23.806748+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:38:23.806748+0000","last_undegraded":"2024-08-09T00:38:23.806748+0000","last_fullsized":"2024-08-09T00:38:23.806748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:14.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'152","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641086+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:35:57.641086+0000","last_peered":"2024-08-09T00:35:57.641086+0000","last_clean":"2024-08-09T00:35:57.641086+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:35:57.641086+0000","last_undegraded":"2024-08-09T00:35:57.641086+0000","last_fullsized":"2024-08-09T00:35:57.641086+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:02:01.420135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7223405,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":32780,"num_write":884,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'208","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836345+0000","last_change":"2024-08-08T23:28:26.768844+0000","last_active":"2024-08-09T00:37:12.836345+0000","last_peered":"2024-08-09T00:37:12.836345+0000","last_clean":"2024-08-09T00:37:12.836345+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:37:12.836345+0000","last_undegraded":"2024-08-09T00:37:12.836345+0000","last_fullsized":"2024-08-09T00:37:12.836345+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:09.349357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'33","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817514+0000","last_change":"2024-08-08T23:28:26.764534+0000","last_active":"2024-08-09T00:36:07.817514+0000","last_peered":"2024-08-09T00:36:07.817514+0000","last_clean":"2024-08-09T00:36:07.817514+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:36:07.817514+0000","last_undegraded":"2024-08-09T00:36:07.817514+0000","last_fullsized":"2024-08-09T00:36:07.817514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:18.335354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'170","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847733+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:36:17.847733+0000","last_peered":"2024-08-09T00:36:17.847733+0000","last_clean":"2024-08-09T00:36:17.847733+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:36:17.847733+0000","last_undegraded":"2024-08-09T00:36:17.847733+0000","last_fullsized":"2024-08-09T00:36:17.847733+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:16.221071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5065774,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":348,"num_read_kb":8171,"num_write":1045,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844698+0000","last_change":"2024-08-08T23:28:26.784260+0000","last_active":"2024-08-09T00:36:07.844698+0000","last_peered":"2024-08-09T00:36:07.844698+0000","last_clean":"2024-08-09T00:36:07.844698+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:36:07.844698+0000","last_undegraded":"2024-08-09T00:36:07.844698+0000","last_fullsized":"2024-08-09T00:36:07.844698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:39:01.299632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'194","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830951+0000","last_change":"2024-08-08T23:29:01.887779+0000","last_active":"2024-08-09T00:36:42.830951+0000","last_peered":"2024-08-09T00:36:42.830951+0000","last_clean":"2024-08-09T00:36:42.830951+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:36:42.830951+0000","last_undegraded":"2024-08-09T00:36:42.830951+0000","last_fullsized":"2024-08-09T00:36:42.830951+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:42.436187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120347,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":375,"num_read_kb":6729,"num_write":995,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.006860+0000","last_change":"2024-08-08T23:28:26.788985+0000","last_active":"2024-08-09T00:38:30.006860+0000","last_peered":"2024-08-09T00:38:30.006860+0000","last_clean":"2024-08-09T00:38:30.006860+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:38:30.006860+0000","last_undegraded":"2024-08-09T00:38:30.006860+0000","last_fullsized":"2024-08-09T00:38:30.006860+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:17:32.725693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818345+0000","last_change":"2024-08-08T23:28:24.818699+0000","last_active":"2024-08-09T00:36:07.818345+0000","last_peered":"2024-08-09T00:36:07.818345+0000","last_clean":"2024-08-09T00:36:07.818345+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:36:07.818345+0000","last_undegraded":"2024-08-09T00:36:07.818345+0000","last_fullsized":"2024-08-09T00:36:07.818345+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:59:40.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437226,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":911,"num_read_kb":13197,"num_write":1119,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'21","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823766+0000","last_change":"2024-08-08T23:28:26.768040+0000","last_active":"2024-08-09T00:36:07.823766+0000","last_peered":"2024-08-09T00:36:07.823766+0000","last_clean":"2024-08-09T00:36:07.823766+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:36:07.823766+0000","last_undegraded":"2024-08-09T00:36:07.823766+0000","last_fullsized":"2024-08-09T00:36:07.823766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:37.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'171","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830837+0000","last_change":"2024-08-08T23:29:01.581302+0000","last_active":"2024-08-09T00:36:42.830837+0000","last_peered":"2024-08-09T00:36:42.830837+0000","last_clean":"2024-08-09T00:36:42.830837+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:36:42.830837+0000","last_undegraded":"2024-08-09T00:36:42.830837+0000","last_fullsized":"2024-08-09T00:36:42.830837+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:24.899484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586044,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":349,"num_read_kb":29619,"num_write":947,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823828+0000","last_change":"2024-08-08T23:28:26.771260+0000","last_active":"2024-08-09T00:36:07.823828+0000","last_peered":"2024-08-09T00:36:07.823828+0000","last_clean":"2024-08-09T00:36:07.823828+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:36:07.823828+0000","last_undegraded":"2024-08-09T00:36:07.823828+0000","last_fullsized":"2024-08-09T00:36:07.823828+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:20:43.254989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'162","reported_seq":794,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644186+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:36:07.644186+0000","last_peered":"2024-08-09T00:36:07.644186+0000","last_clean":"2024-08-09T00:36:07.644186+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:36:07.644186+0000","last_undegraded":"2024-08-09T00:36:07.644186+0000","last_fullsized":"2024-08-09T00:36:07.644186+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:25:13.214512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714729,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":381,"num_read_kb":37287,"num_write":961,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817822+0000","last_change":"2024-08-08T23:28:26.767880+0000","last_active":"2024-08-09T00:36:07.817822+0000","last_peered":"2024-08-09T00:36:07.817822+0000","last_clean":"2024-08-09T00:36:07.817822+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:36:07.817822+0000","last_undegraded":"2024-08-09T00:36:07.817822+0000","last_fullsized":"2024-08-09T00:36:07.817822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:43:28.316031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'216","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819246+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:36:22.819246+0000","last_peered":"2024-08-09T00:36:22.819246+0000","last_clean":"2024-08-09T00:36:22.819246+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:36:22.819246+0000","last_undegraded":"2024-08-09T00:36:22.819246+0000","last_fullsized":"2024-08-09T00:36:22.819246+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:57:29.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120629,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":738,"num_write":1166,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.385719+0000","last_change":"2024-08-08T23:28:34.831960+0000","last_active":"2024-08-09T00:39:54.385719+0000","last_peered":"2024-08-09T00:39:54.385719+0000","last_clean":"2024-08-09T00:39:54.385719+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:39:54.385719+0000","last_undegraded":"2024-08-09T00:39:54.385719+0000","last_fullsized":"2024-08-09T00:39:54.385719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:01:36.286772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.137781+0000","last_change":"2024-08-08T23:29:01.588729+0000","last_active":"2024-08-09T00:37:28.137781+0000","last_peered":"2024-08-09T00:37:28.137781+0000","last_clean":"2024-08-09T00:37:28.137781+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:37:28.137781+0000","last_undegraded":"2024-08-09T00:37:28.137781+0000","last_fullsized":"2024-08-09T00:37:28.137781+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:04.343684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'174","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844794+0000","last_change":"2024-08-08T23:29:01.582685+0000","last_active":"2024-08-09T00:36:07.844794+0000","last_peered":"2024-08-09T00:36:07.844794+0000","last_clean":"2024-08-09T00:36:07.844794+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:36:07.844794+0000","last_undegraded":"2024-08-09T00:36:07.844794+0000","last_fullsized":"2024-08-09T00:36:07.844794+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:29:26.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6576285,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":22191,"num_write":1034,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048658+0000","last_change":"2024-08-08T23:28:28.771835+0000","last_active":"2024-08-09T00:36:13.048658+0000","last_peered":"2024-08-09T00:36:13.048658+0000","last_clean":"2024-08-09T00:36:13.048658+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:36:13.048658+0000","last_undegraded":"2024-08-09T00:36:13.048658+0000","last_fullsized":"2024-08-09T00:36:13.048658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'216","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.965960+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:39:08.965960+0000","last_peered":"2024-08-09T00:39:08.965960+0000","last_clean":"2024-08-09T00:39:08.965960+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:39:08.965960+0000","last_undegraded":"2024-08-09T00:39:08.965960+0000","last_fullsized":"2024-08-09T00:39:08.965960+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:08:57.234564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":282,"num_read_kb":275,"num_write":166,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846496+0000","last_change":"2024-08-08T23:28:32.817763+0000","last_active":"2024-08-09T00:36:12.846496+0000","last_peered":"2024-08-09T00:36:12.846496+0000","last_clean":"2024-08-09T00:36:12.846496+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:36:12.846496+0000","last_undegraded":"2024-08-09T00:36:12.846496+0000","last_fullsized":"2024-08-09T00:36:12.846496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:21:08.427418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2399","reported_seq":4282,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.107418+0000","last_change":"2024-08-08T23:28:34.824612+0000","last_active":"2024-08-09T00:39:54.107418+0000","last_peered":"2024-08-09T00:39:54.107418+0000","last_clean":"2024-08-09T00:39:54.107418+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:39:54.107418+0000","last_undegraded":"2024-08-09T00:39:54.107418+0000","last_fullsized":"2024-08-09T00:39:54.107418+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":2300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:14:35.095843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047473+0000","last_change":"2024-08-08T23:28:26.791324+0000","last_active":"2024-08-09T00:36:08.047473+0000","last_peered":"2024-08-09T00:36:08.047473+0000","last_clean":"2024-08-09T00:36:08.047473+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:36:08.047473+0000","last_undegraded":"2024-08-09T00:36:08.047473+0000","last_fullsized":"2024-08-09T00:36:08.047473+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:56.405552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'181","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815607+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:36:07.815607+0000","last_peered":"2024-08-09T00:36:07.815607+0000","last_clean":"2024-08-09T00:36:07.815607+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:36:07.815607+0000","last_undegraded":"2024-08-09T00:36:07.815607+0000","last_fullsized":"2024-08-09T00:36:07.815607+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:48.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155271,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":389,"num_read_kb":16280,"num_write":967,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.649204+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:36:27.649204+0000","last_peered":"2024-08-09T00:36:27.649204+0000","last_clean":"2024-08-09T00:36:27.649204+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:36:27.649204+0000","last_undegraded":"2024-08-09T00:36:27.649204+0000","last_fullsized":"2024-08-09T00:36:27.649204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:59.953494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.254771+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:39:11.254771+0000","last_peered":"2024-08-09T00:39:11.254771+0000","last_clean":"2024-08-09T00:39:11.254771+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:39:11.254771+0000","last_undegraded":"2024-08-09T00:39:11.254771+0000","last_fullsized":"2024-08-09T00:39:11.254771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:58:11.384265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819027+0000","last_change":"2024-08-08T23:28:32.826736+0000","last_active":"2024-08-09T00:36:12.819027+0000","last_peered":"2024-08-09T00:36:12.819027+0000","last_clean":"2024-08-09T00:36:12.819027+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:36:12.819027+0000","last_undegraded":"2024-08-09T00:36:12.819027+0000","last_fullsized":"2024-08-09T00:36:12.819027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:45:43.822368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'134","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.448507+0000","last_change":"2024-08-08T23:28:34.836179+0000","last_active":"2024-08-09T00:39:52.448507+0000","last_peered":"2024-08-09T00:39:52.448507+0000","last_clean":"2024-08-09T00:39:52.448507+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:39:52.448507+0000","last_undegraded":"2024-08-09T00:39:52.448507+0000","last_fullsized":"2024-08-09T00:39:52.448507+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:42.899329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:24.902450+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:36:24.902450+0000","last_peered":"2024-08-09T00:36:24.902450+0000","last_clean":"2024-08-09T00:36:24.902450+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:36:24.902450+0000","last_undegraded":"2024-08-09T00:36:24.902450+0000","last_fullsized":"2024-08-09T00:36:24.902450+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:07:42.497596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'224","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:58.387270+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:38:58.387270+0000","last_peered":"2024-08-09T00:38:58.387270+0000","last_clean":"2024-08-09T00:38:58.387270+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:38:58.387270+0000","last_undegraded":"2024-08-09T00:38:58.387270+0000","last_fullsized":"2024-08-09T00:38:58.387270+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:42:05.542806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895562,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":26852,"num_write":1136,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645614+0000","last_change":"2024-08-08T23:28:28.771848+0000","last_active":"2024-08-09T00:36:12.645614+0000","last_peered":"2024-08-09T00:36:12.645614+0000","last_clean":"2024-08-09T00:36:12.645614+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:36:12.645614+0000","last_undegraded":"2024-08-09T00:36:12.645614+0000","last_fullsized":"2024-08-09T00:36:12.645614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:28.078906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'147","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.365433+0000","last_change":"2024-08-08T23:28:30.779574+0000","last_active":"2024-08-09T00:39:11.365433+0000","last_peered":"2024-08-09T00:39:11.365433+0000","last_clean":"2024-08-09T00:39:11.365433+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:39:11.365433+0000","last_undegraded":"2024-08-09T00:39:11.365433+0000","last_fullsized":"2024-08-09T00:39:11.365433+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:33:41.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'510","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.953210+0000","last_change":"2024-08-08T23:28:32.809653+0000","last_active":"2024-08-09T00:39:58.953210+0000","last_peered":"2024-08-09T00:39:58.953210+0000","last_clean":"2024-08-09T00:39:58.953210+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:39:58.953210+0000","last_undegraded":"2024-08-09T00:39:58.953210+0000","last_fullsized":"2024-08-09T00:39:58.953210+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:24:46.048044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'202","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.763064+0000","last_change":"2024-08-08T23:28:34.809979+0000","last_active":"2024-08-09T00:39:52.763064+0000","last_peered":"2024-08-09T00:39:52.763064+0000","last_clean":"2024-08-09T00:39:52.763064+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:39:52.763064+0000","last_undegraded":"2024-08-09T00:39:52.763064+0000","last_fullsized":"2024-08-09T00:39:52.763064+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:31.899889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'197","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644339+0000","last_change":"2024-08-08T23:28:26.776218+0000","last_active":"2024-08-09T00:36:07.644339+0000","last_peered":"2024-08-09T00:36:07.644339+0000","last_clean":"2024-08-09T00:36:07.644339+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:36:07.644339+0000","last_undegraded":"2024-08-09T00:36:07.644339+0000","last_fullsized":"2024-08-09T00:36:07.644339+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:48.787304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'178","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.818116+0000","last_change":"2024-08-08T23:28:24.782432+0000","last_active":"2024-08-09T00:36:07.818116+0000","last_peered":"2024-08-09T00:36:07.818116+0000","last_clean":"2024-08-09T00:36:07.818116+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:36:07.818116+0000","last_undegraded":"2024-08-09T00:36:07.818116+0000","last_fullsized":"2024-08-09T00:36:07.818116+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:18.496718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2433240,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":343,"num_read_kb":11144,"num_write":992,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048748+0000","last_change":"2024-08-08T23:28:28.772715+0000","last_active":"2024-08-09T00:36:13.048748+0000","last_peered":"2024-08-09T00:36:13.048748+0000","last_clean":"2024-08-09T00:36:13.048748+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:36:13.048748+0000","last_undegraded":"2024-08-09T00:36:13.048748+0000","last_fullsized":"2024-08-09T00:36:13.048748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:38.667154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'143","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.384877+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:39:11.384877+0000","last_peered":"2024-08-09T00:39:11.384877+0000","last_clean":"2024-08-09T00:39:11.384877+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:39:11.384877+0000","last_undegraded":"2024-08-09T00:39:11.384877+0000","last_fullsized":"2024-08-09T00:39:11.384877+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:25:51.738224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":250,"num_write":102,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'522","reported_seq":2423,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.960804+0000","last_change":"2024-08-08T23:28:32.811070+0000","last_active":"2024-08-09T00:39:58.960804+0000","last_peered":"2024-08-09T00:39:58.960804+0000","last_clean":"2024-08-09T00:39:58.960804+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:39:58.960804+0000","last_undegraded":"2024-08-09T00:39:58.960804+0000","last_fullsized":"2024-08-09T00:39:58.960804+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:13.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.775798+0000","last_change":"2024-08-08T23:28:26.793556+0000","last_active":"2024-08-09T00:38:37.775798+0000","last_peered":"2024-08-09T00:38:37.775798+0000","last_clean":"2024-08-09T00:38:37.775798+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:38:37.775798+0000","last_undegraded":"2024-08-09T00:38:37.775798+0000","last_fullsized":"2024-08-09T00:38:37.775798+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:58:15.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'199","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845093+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:36:07.845093+0000","last_peered":"2024-08-09T00:36:07.845093+0000","last_clean":"2024-08-09T00:36:07.845093+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:36:07.845093+0000","last_undegraded":"2024-08-09T00:36:07.845093+0000","last_fullsized":"2024-08-09T00:36:07.845093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:39.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265532,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":38000,"num_write":1172,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868934+0000","last_change":"2024-08-08T23:28:28.785365+0000","last_active":"2024-08-09T00:37:52.868934+0000","last_peered":"2024-08-09T00:37:52.868934+0000","last_clean":"2024-08-09T00:37:52.868934+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:37:52.868934+0000","last_undegraded":"2024-08-09T00:37:52.868934+0000","last_fullsized":"2024-08-09T00:37:52.868934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:37.826252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'263","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.888477+0000","last_change":"2024-08-08T23:28:31.043616+0000","last_active":"2024-08-09T00:39:58.888477+0000","last_peered":"2024-08-09T00:39:58.888477+0000","last_clean":"2024-08-09T00:39:58.888477+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:39:58.888477+0000","last_undegraded":"2024-08-09T00:39:58.888477+0000","last_fullsized":"2024-08-09T00:39:58.888477+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:10:22.767945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8771,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":410,"num_write":220,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828810+0000","last_change":"2024-08-08T23:28:32.806513+0000","last_active":"2024-08-09T00:36:02.828810+0000","last_peered":"2024-08-09T00:36:02.828810+0000","last_clean":"2024-08-09T00:36:02.828810+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:36:02.828810+0000","last_undegraded":"2024-08-09T00:36:02.828810+0000","last_fullsized":"2024-08-09T00:36:02.828810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:46.925794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'551","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.923595+0000","last_change":"2024-08-08T23:28:34.840230+0000","last_active":"2024-08-09T00:39:58.923595+0000","last_peered":"2024-08-09T00:39:58.923595+0000","last_clean":"2024-08-09T00:39:58.923595+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:39:58.923595+0000","last_undegraded":"2024-08-09T00:39:58.923595+0000","last_fullsized":"2024-08-09T00:39:58.923595+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:31:37.941097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4315","reported_seq":4942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.368667+0000","last_change":"2024-08-08T23:28:26.754321+0000","last_active":"2024-08-09T00:39:09.368667+0000","last_peered":"2024-08-09T00:39:09.368667+0000","last_clean":"2024-08-09T00:39:09.368667+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:39:09.368667+0000","last_undegraded":"2024-08-09T00:39:09.368667+0000","last_fullsized":"2024-08-09T00:39:09.368667+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:13.192471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'228","reported_seq":1088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873654+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:38:12.873654+0000","last_peered":"2024-08-09T00:38:12.873654+0000","last_clean":"2024-08-09T00:38:12.873654+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:38:12.873654+0000","last_undegraded":"2024-08-09T00:38:12.873654+0000","last_fullsized":"2024-08-09T00:38:12.873654+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:53.700576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":40415,"num_write":1267,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843723+0000","last_change":"2024-08-08T23:28:28.772465+0000","last_active":"2024-08-09T00:37:52.843723+0000","last_peered":"2024-08-09T00:37:52.843723+0000","last_clean":"2024-08-09T00:37:52.843723+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:37:52.843723+0000","last_undegraded":"2024-08-09T00:37:52.843723+0000","last_fullsized":"2024-08-09T00:37:52.843723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:08.165167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'142","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.329872+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:39:11.329872+0000","last_peered":"2024-08-09T00:39:11.329872+0000","last_clean":"2024-08-09T00:39:11.329872+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:39:11.329872+0000","last_undegraded":"2024-08-09T00:39:11.329872+0000","last_fullsized":"2024-08-09T00:39:11.329872+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:47.333462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":237,"num_write":98,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.671591+0000","last_change":"2024-08-08T23:28:32.799931+0000","last_active":"2024-08-09T00:38:07.671591+0000","last_peered":"2024-08-09T00:38:07.671591+0000","last_clean":"2024-08-09T00:38:07.671591+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:38:07.671591+0000","last_undegraded":"2024-08-09T00:38:07.671591+0000","last_fullsized":"2024-08-09T00:38:07.671591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:18.351011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'95","reported_seq":601,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839035+0000","last_change":"2024-08-08T23:28:34.829500+0000","last_active":"2024-08-09T00:37:32.839035+0000","last_peered":"2024-08-09T00:37:32.839035+0000","last_clean":"2024-08-09T00:37:32.839035+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:37:32.839035+0000","last_undegraded":"2024-08-09T00:37:32.839035+0000","last_fullsized":"2024-08-09T00:37:32.839035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:50.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'226","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:09.757893+0000","last_change":"2024-08-08T23:28:26.774608+0000","last_active":"2024-08-09T00:38:09.757893+0000","last_peered":"2024-08-09T00:38:09.757893+0000","last_clean":"2024-08-09T00:38:09.757893+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:38:09.757893+0000","last_undegraded":"2024-08-09T00:38:09.757893+0000","last_fullsized":"2024-08-09T00:38:09.757893+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:00:42.181061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'156","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.873595+0000","last_change":"2024-08-08T23:28:24.823026+0000","last_active":"2024-08-09T00:38:12.873595+0000","last_peered":"2024-08-09T00:38:12.873595+0000","last_clean":"2024-08-09T00:38:12.873595+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:38:12.873595+0000","last_undegraded":"2024-08-09T00:38:12.873595+0000","last_fullsized":"2024-08-09T00:38:12.873595+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:44.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3698921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":142181,"num_write":940,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822571+0000","last_change":"2024-08-08T23:28:28.775239+0000","last_active":"2024-08-09T00:36:02.822571+0000","last_peered":"2024-08-09T00:36:02.822571+0000","last_clean":"2024-08-09T00:36:02.822571+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:36:02.822571+0000","last_undegraded":"2024-08-09T00:36:02.822571+0000","last_fullsized":"2024-08-09T00:36:02.822571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:13:33.333304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'207","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.894182+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:39:58.894182+0000","last_peered":"2024-08-09T00:39:58.894182+0000","last_clean":"2024-08-09T00:39:58.894182+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:39:58.894182+0000","last_undegraded":"2024-08-09T00:39:58.894182+0000","last_fullsized":"2024-08-09T00:39:58.894182+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:08.571641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16354,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":341,"num_write":170,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'506","reported_seq":4394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.734428+0000","last_change":"2024-08-08T23:28:32.823537+0000","last_active":"2024-08-09T00:40:02.734428+0000","last_peered":"2024-08-09T00:40:02.734428+0000","last_clean":"2024-08-09T00:40:02.734428+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:02.734428+0000","last_undegraded":"2024-08-09T00:40:02.734428+0000","last_fullsized":"2024-08-09T00:40:02.734428+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:05.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'109","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.861091+0000","last_change":"2024-08-08T23:28:34.837367+0000","last_active":"2024-08-09T00:39:19.861091+0000","last_peered":"2024-08-09T00:39:19.861091+0000","last_clean":"2024-08-09T00:39:19.861091+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:39:19.861091+0000","last_undegraded":"2024-08-09T00:39:19.861091+0000","last_fullsized":"2024-08-09T00:39:19.861091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:08.993869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843304+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:38:12.843304+0000","last_peered":"2024-08-09T00:38:12.843304+0000","last_clean":"2024-08-09T00:38:12.843304+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:38:12.843304+0000","last_undegraded":"2024-08-09T00:38:12.843304+0000","last_fullsized":"2024-08-09T00:38:12.843304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:37:06.665341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.075069+0000","last_change":"2024-08-08T23:28:24.819082+0000","last_active":"2024-08-09T00:38:13.075069+0000","last_peered":"2024-08-09T00:38:13.075069+0000","last_clean":"2024-08-09T00:38:13.075069+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:38:13.075069+0000","last_undegraded":"2024-08-09T00:38:13.075069+0000","last_fullsized":"2024-08-09T00:38:13.075069+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:51:31.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6865694,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":514,"num_read_kb":20328,"num_write":1158,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"37'3","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.791480+0000","last_change":"2024-08-08T23:28:28.779663+0000","last_active":"2024-08-09T00:39:58.791480+0000","last_peered":"2024-08-09T00:39:58.791480+0000","last_clean":"2024-08-09T00:39:58.791480+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:39:58.791480+0000","last_undegraded":"2024-08-09T00:39:58.791480+0000","last_fullsized":"2024-08-09T00:39:58.791480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:47:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":485,"num_read_kb":483,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'244","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.899361+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:39:58.899361+0000","last_peered":"2024-08-09T00:39:58.899361+0000","last_clean":"2024-08-09T00:39:58.899361+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:39:58.899361+0000","last_undegraded":"2024-08-09T00:39:58.899361+0000","last_fullsized":"2024-08-09T00:39:58.899361+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:59.690242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52900,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":576,"num_write":196,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843661+0000","last_change":"2024-08-08T23:28:32.808451+0000","last_active":"2024-08-09T00:37:52.843661+0000","last_peered":"2024-08-09T00:37:52.843661+0000","last_clean":"2024-08-09T00:37:52.843661+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:37:52.843661+0000","last_undegraded":"2024-08-09T00:37:52.843661+0000","last_fullsized":"2024-08-09T00:37:52.843661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:52:53.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'102","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.011905+0000","last_change":"2024-08-08T23:28:34.833803+0000","last_active":"2024-08-09T00:38:30.011905+0000","last_peered":"2024-08-09T00:38:30.011905+0000","last_clean":"2024-08-09T00:38:30.011905+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:38:30.011905+0000","last_undegraded":"2024-08-09T00:38:30.011905+0000","last_fullsized":"2024-08-09T00:38:30.011905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:59:23.748669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849839+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:38:12.849839+0000","last_peered":"2024-08-09T00:38:12.849839+0000","last_clean":"2024-08-09T00:38:12.849839+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:38:12.849839+0000","last_undegraded":"2024-08-09T00:38:12.849839+0000","last_fullsized":"2024-08-09T00:38:12.849839+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:09.973740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'167","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:31.364791+0000","last_change":"2024-08-08T23:30:01.784156+0000","last_active":"2024-08-09T00:38:31.364791+0000","last_peered":"2024-08-09T00:38:31.364791+0000","last_clean":"2024-08-09T00:38:31.364791+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:38:31.364791+0000","last_undegraded":"2024-08-09T00:38:31.364791+0000","last_fullsized":"2024-08-09T00:38:31.364791+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:26.083283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444614,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":5320,"num_write":978,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.822697+0000","last_change":"2024-08-08T23:28:28.780395+0000","last_active":"2024-08-09T00:36:02.822697+0000","last_peered":"2024-08-09T00:36:02.822697+0000","last_clean":"2024-08-09T00:36:02.822697+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:36:02.822697+0000","last_undegraded":"2024-08-09T00:36:02.822697+0000","last_fullsized":"2024-08-09T00:36:02.822697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:52.579128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'170","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.450349+0000","last_change":"2024-08-08T23:28:30.784352+0000","last_active":"2024-08-09T00:39:11.450349+0000","last_peered":"2024-08-09T00:39:11.450349+0000","last_clean":"2024-08-09T00:39:11.450349+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:39:11.450349+0000","last_undegraded":"2024-08-09T00:39:11.450349+0000","last_fullsized":"2024-08-09T00:39:11.450349+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:59:35.310017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":298,"num_write":188,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818266+0000","last_change":"2024-08-08T23:28:32.827076+0000","last_active":"2024-08-09T00:36:17.818266+0000","last_peered":"2024-08-09T00:36:17.818266+0000","last_clean":"2024-08-09T00:36:17.818266+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:36:17.818266+0000","last_undegraded":"2024-08-09T00:36:17.818266+0000","last_fullsized":"2024-08-09T00:36:17.818266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.028693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'134","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.323973+0000","last_change":"2024-08-08T23:28:34.836409+0000","last_active":"2024-08-09T00:39:09.323973+0000","last_peered":"2024-08-09T00:39:09.323973+0000","last_clean":"2024-08-09T00:39:09.323973+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:39:09.323973+0000","last_undegraded":"2024-08-09T00:39:09.323973+0000","last_fullsized":"2024-08-09T00:39:09.323973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:52:23.979940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'185","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849875+0000","last_change":"2024-08-08T23:28:26.768527+0000","last_active":"2024-08-09T00:38:12.849875+0000","last_peered":"2024-08-09T00:38:12.849875+0000","last_clean":"2024-08-09T00:38:12.849875+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:38:12.849875+0000","last_undegraded":"2024-08-09T00:38:12.849875+0000","last_fullsized":"2024-08-09T00:38:12.849875+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:57.863036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'204","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.846177+0000","last_change":"2024-08-08T23:28:24.767491+0000","last_active":"2024-08-09T00:37:57.846177+0000","last_peered":"2024-08-09T00:37:57.846177+0000","last_clean":"2024-08-09T00:37:57.846177+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:37:57.846177+0000","last_undegraded":"2024-08-09T00:37:57.846177+0000","last_fullsized":"2024-08-09T00:37:57.846177+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:24:23.880570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456498,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":34331,"num_write":1086,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828882+0000","last_change":"2024-08-08T23:28:28.777081+0000","last_active":"2024-08-09T00:36:02.828882+0000","last_peered":"2024-08-09T00:36:02.828882+0000","last_clean":"2024-08-09T00:36:02.828882+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:36:02.828882+0000","last_undegraded":"2024-08-09T00:36:02.828882+0000","last_fullsized":"2024-08-09T00:36:02.828882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:29.639169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'194","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.566053+0000","last_change":"2024-08-08T23:28:30.783664+0000","last_active":"2024-08-09T00:39:11.566053+0000","last_peered":"2024-08-09T00:39:11.566053+0000","last_clean":"2024-08-09T00:39:11.566053+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:39:11.566053+0000","last_undegraded":"2024-08-09T00:39:11.566053+0000","last_fullsized":"2024-08-09T00:39:11.566053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:08.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":264,"num_read_kb":353,"num_write":156,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'490","reported_seq":2254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.955189+0000","last_change":"2024-08-08T23:28:32.806321+0000","last_active":"2024-08-09T00:39:58.955189+0000","last_peered":"2024-08-09T00:39:58.955189+0000","last_clean":"2024-08-09T00:39:58.955189+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:39:58.955189+0000","last_undegraded":"2024-08-09T00:39:58.955189+0000","last_fullsized":"2024-08-09T00:39:58.955189+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:35:07.612864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.871072+0000","last_change":"2024-08-08T23:28:34.837840+0000","last_active":"2024-08-09T00:39:27.871072+0000","last_peered":"2024-08-09T00:39:27.871072+0000","last_clean":"2024-08-09T00:39:27.871072+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:39:27.871072+0000","last_undegraded":"2024-08-09T00:39:27.871072+0000","last_fullsized":"2024-08-09T00:39:27.871072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:51.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849903+0000","last_change":"2024-08-08T23:28:26.779476+0000","last_active":"2024-08-09T00:38:12.849903+0000","last_peered":"2024-08-09T00:38:12.849903+0000","last_clean":"2024-08-09T00:38:12.849903+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:38:12.849903+0000","last_undegraded":"2024-08-09T00:38:12.849903+0000","last_fullsized":"2024-08-09T00:38:12.849903+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:31:06.993378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'201","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:10.488115+0000","last_change":"2024-08-08T23:28:24.790265+0000","last_active":"2024-08-09T00:38:10.488115+0000","last_peered":"2024-08-09T00:38:10.488115+0000","last_clean":"2024-08-09T00:38:10.488115+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:38:10.488115+0000","last_undegraded":"2024-08-09T00:38:10.488115+0000","last_fullsized":"2024-08-09T00:38:10.488115+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:21.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5443685,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":23703,"num_write":1087,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.559910+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:39:58.559910+0000","last_peered":"2024-08-09T00:39:58.559910+0000","last_clean":"2024-08-09T00:39:58.559910+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:39:58.559910+0000","last_undegraded":"2024-08-09T00:39:58.559910+0000","last_fullsized":"2024-08-09T00:39:58.559910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:45.142309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":634,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'105","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.103522+0000","last_change":"2024-08-08T23:28:31.048124+0000","last_active":"2024-08-09T00:39:11.103522+0000","last_peered":"2024-08-09T00:39:11.103522+0000","last_clean":"2024-08-09T00:39:11.103522+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:39:11.103522+0000","last_undegraded":"2024-08-09T00:39:11.103522+0000","last_fullsized":"2024-08-09T00:39:11.103522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:47:38.686500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'497","reported_seq":2257,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.958326+0000","last_change":"2024-08-08T23:28:32.814344+0000","last_active":"2024-08-09T00:39:58.958326+0000","last_peered":"2024-08-09T00:39:58.958326+0000","last_clean":"2024-08-09T00:39:58.958326+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:39:58.958326+0000","last_undegraded":"2024-08-09T00:39:58.958326+0000","last_fullsized":"2024-08-09T00:39:58.958326+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:20.130194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836068+0000","last_change":"2024-08-08T23:28:34.832392+0000","last_active":"2024-08-09T00:37:22.836068+0000","last_peered":"2024-08-09T00:37:22.836068+0000","last_clean":"2024-08-09T00:37:22.836068+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:37:22.836068+0000","last_undegraded":"2024-08-09T00:37:22.836068+0000","last_fullsized":"2024-08-09T00:37:22.836068+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:53:39.542207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'461","reported_seq":1174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831471+0000","last_change":"2024-08-08T23:28:26.762100+0000","last_active":"2024-08-09T00:36:12.831471+0000","last_peered":"2024-08-09T00:36:12.831471+0000","last_clean":"2024-08-09T00:36:12.831471+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:36:12.831471+0000","last_undegraded":"2024-08-09T00:36:12.831471+0000","last_fullsized":"2024-08-09T00:36:12.831471+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:31:41.700529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'177","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667019+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:37:47.667019+0000","last_peered":"2024-08-09T00:37:47.667019+0000","last_clean":"2024-08-09T00:37:47.667019+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:37:47.667019+0000","last_undegraded":"2024-08-09T00:37:47.667019+0000","last_fullsized":"2024-08-09T00:37:47.667019+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:55.568959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":4543,"num_write":1041,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816540+0000","last_change":"2024-08-08T23:28:28.778804+0000","last_active":"2024-08-09T00:36:02.816540+0000","last_peered":"2024-08-09T00:36:02.816540+0000","last_clean":"2024-08-09T00:36:02.816540+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:36:02.816540+0000","last_undegraded":"2024-08-09T00:36:02.816540+0000","last_fullsized":"2024-08-09T00:36:02.816540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:09:24.525056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'299","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.879310+0000","last_change":"2024-08-08T23:28:30.776772+0000","last_active":"2024-08-09T00:39:58.879310+0000","last_peered":"2024-08-09T00:39:58.879310+0000","last_clean":"2024-08-09T00:39:58.879310+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:39:58.879310+0000","last_undegraded":"2024-08-09T00:39:58.879310+0000","last_fullsized":"2024-08-09T00:39:58.879310+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:54.049825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":987,"num_read_kb":1031,"num_write":1530,"num_write_kb":1359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.817176+0000","last_change":"2024-08-08T23:28:32.821436+0000","last_active":"2024-08-09T00:36:02.817176+0000","last_peered":"2024-08-09T00:36:02.817176+0000","last_clean":"2024-08-09T00:36:02.817176+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:36:02.817176+0000","last_undegraded":"2024-08-09T00:36:02.817176+0000","last_fullsized":"2024-08-09T00:36:02.817176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:21:40.233740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'102","reported_seq":609,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.944405+0000","last_change":"2024-08-08T23:28:34.822628+0000","last_active":"2024-08-09T00:39:51.944405+0000","last_peered":"2024-08-09T00:39:51.944405+0000","last_clean":"2024-08-09T00:39:51.944405+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:39:51.944405+0000","last_undegraded":"2024-08-09T00:39:51.944405+0000","last_fullsized":"2024-08-09T00:39:51.944405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:13.362222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836399+0000","last_change":"2024-08-08T23:28:26.782849+0000","last_active":"2024-08-09T00:37:22.836399+0000","last_peered":"2024-08-09T00:37:22.836399+0000","last_clean":"2024-08-09T00:37:22.836399+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:37:22.836399+0000","last_undegraded":"2024-08-09T00:37:22.836399+0000","last_fullsized":"2024-08-09T00:37:22.836399+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:36.999822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.875811+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:38:22.875811+0000","last_peered":"2024-08-09T00:38:22.875811+0000","last_clean":"2024-08-09T00:38:22.875811+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:38:22.875811+0000","last_undegraded":"2024-08-09T00:38:22.875811+0000","last_fullsized":"2024-08-09T00:38:22.875811+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059673+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-09T00:37:03.059673+0000","last_peered":"2024-08-09T00:37:03.059673+0000","last_clean":"2024-08-09T00:37:03.059673+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:37:03.059673+0000","last_undegraded":"2024-08-09T00:37:03.059673+0000","last_fullsized":"2024-08-09T00:37:03.059673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'169","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.659235+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:37:12.659235+0000","last_peered":"2024-08-09T00:37:12.659235+0000","last_clean":"2024-08-09T00:37:12.659235+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:37:12.659235+0000","last_undegraded":"2024-08-09T00:37:12.659235+0000","last_fullsized":"2024-08-09T00:37:12.659235+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:08.383791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423898,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":19880,"num_write":945,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.861276+0000","last_change":"2024-08-08T23:28:28.785997+0000","last_active":"2024-08-09T00:37:17.861276+0000","last_peered":"2024-08-09T00:37:17.861276+0000","last_clean":"2024-08-09T00:37:17.861276+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:37:17.861276+0000","last_undegraded":"2024-08-09T00:37:17.861276+0000","last_fullsized":"2024-08-09T00:37:17.861276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:19.940501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'322","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.911428+0000","last_change":"2024-08-08T23:28:30.788180+0000","last_active":"2024-08-09T00:39:58.911428+0000","last_peered":"2024-08-09T00:39:58.911428+0000","last_clean":"2024-08-09T00:39:58.911428+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:39:58.911428+0000","last_undegraded":"2024-08-09T00:39:58.911428+0000","last_fullsized":"2024-08-09T00:39:58.911428+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:08.134619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":621,"num_read_kb":848,"num_write":582,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.839007+0000","last_change":"2024-08-08T23:28:32.821568+0000","last_active":"2024-08-09T00:37:52.839007+0000","last_peered":"2024-08-09T00:37:52.839007+0000","last_clean":"2024-08-09T00:37:52.839007+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:37:52.839007+0000","last_undegraded":"2024-08-09T00:37:52.839007+0000","last_fullsized":"2024-08-09T00:37:52.839007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:04:45.502986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'206","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.227768+0000","last_change":"2024-08-08T23:28:34.829682+0000","last_active":"2024-08-09T00:39:54.227768+0000","last_peered":"2024-08-09T00:39:54.227768+0000","last_clean":"2024-08-09T00:39:54.227768+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:39:54.227768+0000","last_undegraded":"2024-08-09T00:39:54.227768+0000","last_fullsized":"2024-08-09T00:39:54.227768+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:20:02.874767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'188","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:08.036140+0000","last_change":"2024-08-08T23:28:26.775022+0000","last_active":"2024-08-09T00:38:08.036140+0000","last_peered":"2024-08-09T00:38:08.036140+0000","last_clean":"2024-08-09T00:38:08.036140+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:38:08.036140+0000","last_undegraded":"2024-08-09T00:38:08.036140+0000","last_fullsized":"2024-08-09T00:38:08.036140+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:54.073153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.849650+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:36:27.849650+0000","last_peered":"2024-08-09T00:36:27.849650+0000","last_clean":"2024-08-09T00:36:27.849650+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:36:27.849650+0000","last_undegraded":"2024-08-09T00:36:27.849650+0000","last_fullsized":"2024-08-09T00:36:27.849650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'199","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.830339+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:37:12.830339+0000","last_peered":"2024-08-09T00:37:12.830339+0000","last_clean":"2024-08-09T00:37:12.830339+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:37:12.830339+0000","last_undegraded":"2024-08-09T00:37:12.830339+0000","last_fullsized":"2024-08-09T00:37:12.830339+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:09.134864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3726460,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":423,"num_read_kb":17063,"num_write":1106,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070776+0000","last_change":"2024-08-08T23:28:28.772772+0000","last_active":"2024-08-09T00:37:53.070776+0000","last_peered":"2024-08-09T00:37:53.070776+0000","last_clean":"2024-08-09T00:37:53.070776+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:37:53.070776+0000","last_undegraded":"2024-08-09T00:37:53.070776+0000","last_fullsized":"2024-08-09T00:37:53.070776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:35:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'679","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.162698+0000","last_change":"2024-08-08T23:28:30.774420+0000","last_active":"2024-08-09T00:39:59.162698+0000","last_peered":"2024-08-09T00:39:59.162698+0000","last_clean":"2024-08-09T00:39:59.162698+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:39:59.162698+0000","last_undegraded":"2024-08-09T00:39:59.162698+0000","last_fullsized":"2024-08-09T00:39:59.162698+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":600,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:41.556054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38624,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":976,"num_read_kb":1169,"num_write":310,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:27.863596+0000","last_change":"2024-08-08T23:28:32.810173+0000","last_active":"2024-08-09T00:37:27.863596+0000","last_peered":"2024-08-09T00:37:27.863596+0000","last_clean":"2024-08-09T00:37:27.863596+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:37:27.863596+0000","last_undegraded":"2024-08-09T00:37:27.863596+0000","last_fullsized":"2024-08-09T00:37:27.863596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:44.557649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'129","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855394+0000","last_change":"2024-08-08T23:28:34.828009+0000","last_active":"2024-08-09T00:38:12.855394+0000","last_peered":"2024-08-09T00:38:12.855394+0000","last_clean":"2024-08-09T00:38:12.855394+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:38:12.855394+0000","last_undegraded":"2024-08-09T00:38:12.855394+0000","last_fullsized":"2024-08-09T00:38:12.855394+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:16:30.650076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:19.246847+0000","last_change":"2024-08-08T23:28:26.777388+0000","last_active":"2024-08-09T00:38:19.246847+0000","last_peered":"2024-08-09T00:38:19.246847+0000","last_clean":"2024-08-09T00:38:19.246847+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:38:19.246847+0000","last_undegraded":"2024-08-09T00:38:19.246847+0000","last_fullsized":"2024-08-09T00:38:19.246847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:00:11.706140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834117+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-09T00:37:02.834117+0000","last_peered":"2024-08-09T00:37:02.834117+0000","last_clean":"2024-08-09T00:37:02.834117+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:37:02.834117+0000","last_undegraded":"2024-08-09T00:37:02.834117+0000","last_fullsized":"2024-08-09T00:37:02.834117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'152","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.028592+0000","last_change":"2024-08-08T23:28:24.757810+0000","last_active":"2024-08-09T00:39:28.028592+0000","last_peered":"2024-08-09T00:39:28.028592+0000","last_clean":"2024-08-09T00:39:28.028592+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:39:28.028592+0000","last_undegraded":"2024-08-09T00:39:28.028592+0000","last_fullsized":"2024-08-09T00:39:28.028592+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:35.709380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12202139,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":424,"num_read_kb":29266,"num_write":855,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843917+0000","last_change":"2024-08-08T23:28:28.775991+0000","last_active":"2024-08-09T00:37:52.843917+0000","last_peered":"2024-08-09T00:37:52.843917+0000","last_clean":"2024-08-09T00:37:52.843917+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:37:52.843917+0000","last_undegraded":"2024-08-09T00:37:52.843917+0000","last_fullsized":"2024-08-09T00:37:52.843917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:48.817766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.141922+0000","last_change":"2024-08-08T23:28:31.049356+0000","last_active":"2024-08-09T00:39:59.141922+0000","last_peered":"2024-08-09T00:39:59.141922+0000","last_clean":"2024-08-09T00:39:59.141922+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:39:59.141922+0000","last_undegraded":"2024-08-09T00:39:59.141922+0000","last_fullsized":"2024-08-09T00:39:59.141922+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:10.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831629+0000","last_change":"2024-08-08T23:28:32.827179+0000","last_active":"2024-08-09T00:37:17.831629+0000","last_peered":"2024-08-09T00:37:17.831629+0000","last_clean":"2024-08-09T00:37:17.831629+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:37:17.831629+0000","last_undegraded":"2024-08-09T00:37:17.831629+0000","last_fullsized":"2024-08-09T00:37:17.831629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:18.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'277","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.918904+0000","last_change":"2024-08-08T23:28:34.830435+0000","last_active":"2024-08-09T00:39:52.918904+0000","last_peered":"2024-08-09T00:39:52.918904+0000","last_clean":"2024-08-09T00:39:52.918904+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:39:52.918904+0000","last_undegraded":"2024-08-09T00:39:52.918904+0000","last_fullsized":"2024-08-09T00:39:52.918904+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:09.607368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843420+0000","last_change":"2024-08-08T23:28:26.762755+0000","last_active":"2024-08-09T00:37:12.843420+0000","last_peered":"2024-08-09T00:37:12.843420+0000","last_clean":"2024-08-09T00:37:12.843420+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:37:12.843420+0000","last_undegraded":"2024-08-09T00:37:12.843420+0000","last_fullsized":"2024-08-09T00:37:12.843420+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:23:47.959221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059606+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-09T00:37:03.059606+0000","last_peered":"2024-08-09T00:37:03.059606+0000","last_clean":"2024-08-09T00:37:03.059606+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:37:03.059606+0000","last_undegraded":"2024-08-09T00:37:03.059606+0000","last_fullsized":"2024-08-09T00:37:03.059606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'192","reported_seq":831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833282+0000","last_change":"2024-08-08T23:28:24.760341+0000","last_active":"2024-08-09T00:37:12.833282+0000","last_peered":"2024-08-09T00:37:12.833282+0000","last_clean":"2024-08-09T00:37:12.833282+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:37:12.833282+0000","last_undegraded":"2024-08-09T00:37:12.833282+0000","last_fullsized":"2024-08-09T00:37:12.833282+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:38.374476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053350,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":408,"num_read_kb":7644,"num_write":1036,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.834591+0000","last_change":"2024-08-08T23:28:28.778088+0000","last_active":"2024-08-09T00:37:32.834591+0000","last_peered":"2024-08-09T00:37:32.834591+0000","last_clean":"2024-08-09T00:37:32.834591+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:37:32.834591+0000","last_undegraded":"2024-08-09T00:37:32.834591+0000","last_fullsized":"2024-08-09T00:37:32.834591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:46.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.518432+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:39:52.518432+0000","last_peered":"2024-08-09T00:39:52.518432+0000","last_clean":"2024-08-09T00:39:52.518432+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:39:52.518432+0000","last_undegraded":"2024-08-09T00:39:52.518432+0000","last_fullsized":"2024-08-09T00:39:52.518432+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:19.698033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844707+0000","last_change":"2024-08-08T23:28:32.831075+0000","last_active":"2024-08-09T00:37:52.844707+0000","last_peered":"2024-08-09T00:37:52.844707+0000","last_clean":"2024-08-09T00:37:52.844707+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:37:52.844707+0000","last_undegraded":"2024-08-09T00:37:52.844707+0000","last_fullsized":"2024-08-09T00:37:52.844707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:55:52.866081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'113","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:58.071702+0000","last_change":"2024-08-08T23:28:34.834032+0000","last_active":"2024-08-09T00:37:58.071702+0000","last_peered":"2024-08-09T00:37:58.071702+0000","last_clean":"2024-08-09T00:37:58.071702+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:37:58.071702+0000","last_undegraded":"2024-08-09T00:37:58.071702+0000","last_fullsized":"2024-08-09T00:37:58.071702+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:41.070436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'155","reported_seq":753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:21.963237+0000","last_change":"2024-08-08T23:28:26.777411+0000","last_active":"2024-08-09T00:38:21.963237+0000","last_peered":"2024-08-09T00:38:21.963237+0000","last_clean":"2024-08-09T00:38:21.963237+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:38:21.963237+0000","last_undegraded":"2024-08-09T00:38:21.963237+0000","last_fullsized":"2024-08-09T00:38:21.963237+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:18.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'225","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.064954+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:37:28.064954+0000","last_peered":"2024-08-09T00:37:28.064954+0000","last_clean":"2024-08-09T00:37:28.064954+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:37:28.064954+0000","last_undegraded":"2024-08-09T00:37:28.064954+0000","last_fullsized":"2024-08-09T00:37:28.064954+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:17.537000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506136,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":805,"num_read_kb":62351,"num_write":1157,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.841587+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-09T00:37:02.841587+0000","last_peered":"2024-08-09T00:37:02.841587+0000","last_clean":"2024-08-09T00:37:02.841587+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:37:02.841587+0000","last_undegraded":"2024-08-09T00:37:02.841587+0000","last_fullsized":"2024-08-09T00:37:02.841587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831582+0000","last_change":"2024-08-08T23:28:28.783451+0000","last_active":"2024-08-09T00:37:17.831582+0000","last_peered":"2024-08-09T00:37:17.831582+0000","last_clean":"2024-08-09T00:37:17.831582+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:37:17.831582+0000","last_undegraded":"2024-08-09T00:37:17.831582+0000","last_fullsized":"2024-08-09T00:37:17.831582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:47:09.084557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'302","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.913667+0000","last_change":"2024-08-08T23:28:30.784027+0000","last_active":"2024-08-09T00:39:58.913667+0000","last_peered":"2024-08-09T00:39:58.913667+0000","last_clean":"2024-08-09T00:39:58.913667+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:39:58.913667+0000","last_undegraded":"2024-08-09T00:39:58.913667+0000","last_fullsized":"2024-08-09T00:39:58.913667+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:56:56.170296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34540,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":434,"num_read_kb":591,"num_write":250,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834636+0000","last_change":"2024-08-08T23:28:32.814130+0000","last_active":"2024-08-09T00:37:17.834636+0000","last_peered":"2024-08-09T00:37:17.834636+0000","last_clean":"2024-08-09T00:37:17.834636+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:37:17.834636+0000","last_undegraded":"2024-08-09T00:37:17.834636+0000","last_fullsized":"2024-08-09T00:37:17.834636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:24:28.569706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'117","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.476580+0000","last_change":"2024-08-08T23:28:34.838026+0000","last_active":"2024-08-09T00:39:53.476580+0000","last_peered":"2024-08-09T00:39:53.476580+0000","last_clean":"2024-08-09T00:39:53.476580+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:39:53.476580+0000","last_undegraded":"2024-08-09T00:39:53.476580+0000","last_fullsized":"2024-08-09T00:39:53.476580+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:23.463646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.431957+0000","last_change":"2024-08-08T23:28:26.780124+0000","last_active":"2024-08-09T00:39:27.431957+0000","last_peered":"2024-08-09T00:39:27.431957+0000","last_clean":"2024-08-09T00:39:27.431957+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:39:27.431957+0000","last_undegraded":"2024-08-09T00:39:27.431957+0000","last_fullsized":"2024-08-09T00:39:27.431957+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:11.326856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'311","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843393+0000","last_change":"2024-08-08T23:28:24.764595+0000","last_active":"2024-08-09T00:37:12.843393+0000","last_peered":"2024-08-09T00:37:12.843393+0000","last_clean":"2024-08-09T00:37:12.843393+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:37:12.843393+0000","last_undegraded":"2024-08-09T00:37:12.843393+0000","last_fullsized":"2024-08-09T00:37:12.843393+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:13.394500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14943339,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":185751,"num_write":1329,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.860057+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:37:12.860057+0000","last_peered":"2024-08-09T00:37:12.860057+0000","last_clean":"2024-08-09T00:37:12.860057+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:37:12.860057+0000","last_undegraded":"2024-08-09T00:37:12.860057+0000","last_fullsized":"2024-08-09T00:37:12.860057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835003+0000","last_change":"2024-08-08T23:28:28.779571+0000","last_active":"2024-08-09T00:37:17.835003+0000","last_peered":"2024-08-09T00:37:17.835003+0000","last_clean":"2024-08-09T00:37:17.835003+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:37:17.835003+0000","last_undegraded":"2024-08-09T00:37:17.835003+0000","last_fullsized":"2024-08-09T00:37:17.835003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:59:20.339670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'221","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.327545+0000","last_change":"2024-08-08T23:28:31.042472+0000","last_active":"2024-08-09T00:39:48.327545+0000","last_peered":"2024-08-09T00:39:48.327545+0000","last_clean":"2024-08-09T00:39:48.327545+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:39:48.327545+0000","last_undegraded":"2024-08-09T00:39:48.327545+0000","last_fullsized":"2024-08-09T00:39:48.327545+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:24.658995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'525","reported_seq":4398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.950770+0000","last_change":"2024-08-08T23:28:32.815950+0000","last_active":"2024-08-09T00:39:58.950770+0000","last_peered":"2024-08-09T00:39:58.950770+0000","last_clean":"2024-08-09T00:39:58.950770+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:39:58.950770+0000","last_undegraded":"2024-08-09T00:39:58.950770+0000","last_fullsized":"2024-08-09T00:39:58.950770+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:11.787941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'164","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.453818+0000","last_change":"2024-08-08T23:28:34.830158+0000","last_active":"2024-08-09T00:39:54.453818+0000","last_peered":"2024-08-09T00:39:54.453818+0000","last_clean":"2024-08-09T00:39:54.453818+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:39:54.453818+0000","last_undegraded":"2024-08-09T00:39:54.453818+0000","last_fullsized":"2024-08-09T00:39:54.453818+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:25.038657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":713,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.619859+0000","last_change":"2024-08-08T23:28:26.776845+0000","last_active":"2024-08-09T00:37:15.619859+0000","last_peered":"2024-08-09T00:37:15.619859+0000","last_clean":"2024-08-09T00:37:15.619859+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:37:15.619859+0000","last_undegraded":"2024-08-09T00:37:15.619859+0000","last_fullsized":"2024-08-09T00:37:15.619859+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:55:03.906562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667331+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:37:47.667331+0000","last_peered":"2024-08-09T00:37:47.667331+0000","last_clean":"2024-08-09T00:37:47.667331+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:37:47.667331+0000","last_undegraded":"2024-08-09T00:37:47.667331+0000","last_fullsized":"2024-08-09T00:37:47.667331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:13.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535244,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1086,"num_read_kb":6563,"num_write":1289,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.848189+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-09T00:37:37.848189+0000","last_peered":"2024-08-09T00:37:37.848189+0000","last_clean":"2024-08-09T00:37:37.848189+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:37:37.848189+0000","last_undegraded":"2024-08-09T00:37:37.848189+0000","last_fullsized":"2024-08-09T00:37:37.848189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834567+0000","last_change":"2024-08-08T23:28:28.777156+0000","last_active":"2024-08-09T00:37:17.834567+0000","last_peered":"2024-08-09T00:37:17.834567+0000","last_clean":"2024-08-09T00:37:17.834567+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:37:17.834567+0000","last_undegraded":"2024-08-09T00:37:17.834567+0000","last_fullsized":"2024-08-09T00:37:17.834567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:42.927296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'148","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.398773+0000","last_change":"2024-08-08T23:28:30.790179+0000","last_active":"2024-08-09T00:39:11.398773+0000","last_peered":"2024-08-09T00:39:11.398773+0000","last_clean":"2024-08-09T00:39:11.398773+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:39:11.398773+0000","last_undegraded":"2024-08-09T00:39:11.398773+0000","last_fullsized":"2024-08-09T00:39:11.398773+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:38.377166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'522","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.959357+0000","last_change":"2024-08-08T23:28:32.808377+0000","last_active":"2024-08-09T00:39:58.959357+0000","last_peered":"2024-08-09T00:39:58.959357+0000","last_clean":"2024-08-09T00:39:58.959357+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:39:58.959357+0000","last_undegraded":"2024-08-09T00:39:58.959357+0000","last_fullsized":"2024-08-09T00:39:58.959357+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:26:13.925905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'236","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.845482+0000","last_change":"2024-08-08T23:28:34.832992+0000","last_active":"2024-08-09T00:38:22.845482+0000","last_peered":"2024-08-09T00:38:22.845482+0000","last_clean":"2024-08-09T00:38:22.845482+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:38:22.845482+0000","last_undegraded":"2024-08-09T00:38:22.845482+0000","last_fullsized":"2024-08-09T00:38:22.845482+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:38.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:57.761692+0000","last_change":"2024-08-08T23:28:26.770700+0000","last_active":"2024-08-09T00:38:57.761692+0000","last_peered":"2024-08-09T00:38:57.761692+0000","last_clean":"2024-08-09T00:38:57.761692+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:38:57.761692+0000","last_undegraded":"2024-08-09T00:38:57.761692+0000","last_fullsized":"2024-08-09T00:38:57.761692+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:15:02.492992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'214","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:56.150980+0000","last_change":"2024-08-08T23:29:01.887794+0000","last_active":"2024-08-09T00:38:56.150980+0000","last_peered":"2024-08-09T00:38:56.150980+0000","last_clean":"2024-08-09T00:38:56.150980+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:38:56.150980+0000","last_undegraded":"2024-08-09T00:38:56.150980+0000","last_fullsized":"2024-08-09T00:38:56.150980+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:04.725884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3108640,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":66311,"num_write":1068,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840460+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-09T00:37:37.840460+0000","last_peered":"2024-08-09T00:37:37.840460+0000","last_clean":"2024-08-09T00:37:37.840460+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:37:37.840460+0000","last_undegraded":"2024-08-09T00:37:37.840460+0000","last_fullsized":"2024-08-09T00:37:37.840460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.545277+0000","last_change":"2024-08-08T23:28:28.771236+0000","last_active":"2024-08-09T00:39:58.545277+0000","last_peered":"2024-08-09T00:39:58.545277+0000","last_clean":"2024-08-09T00:39:58.545277+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:39:58.545277+0000","last_undegraded":"2024-08-09T00:39:58.545277+0000","last_fullsized":"2024-08-09T00:39:58.545277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":792,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'338","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.855571+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:39:58.855571+0000","last_peered":"2024-08-09T00:39:58.855571+0000","last_clean":"2024-08-09T00:39:58.855571+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:39:58.855571+0000","last_undegraded":"2024-08-09T00:39:58.855571+0000","last_fullsized":"2024-08-09T00:39:58.855571+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:47.586741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30329,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":500,"num_read_kb":654,"num_write":264,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660385+0000","last_change":"2024-08-08T23:28:32.805174+0000","last_active":"2024-08-09T00:37:17.660385+0000","last_peered":"2024-08-09T00:37:17.660385+0000","last_clean":"2024-08-09T00:37:17.660385+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:37:17.660385+0000","last_undegraded":"2024-08-09T00:37:17.660385+0000","last_fullsized":"2024-08-09T00:37:17.660385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:59.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.746561+0000","last_change":"2024-08-08T23:28:34.830149+0000","last_active":"2024-08-09T00:38:37.746561+0000","last_peered":"2024-08-09T00:38:37.746561+0000","last_clean":"2024-08-09T00:38:37.746561+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:38:37.746561+0000","last_undegraded":"2024-08-09T00:38:37.746561+0000","last_fullsized":"2024-08-09T00:38:37.746561+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:14.678670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'138","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.814333+0000","last_change":"2024-08-08T23:28:34.836373+0000","last_active":"2024-08-09T00:39:52.814333+0000","last_peered":"2024-08-09T00:39:52.814333+0000","last_clean":"2024-08-09T00:39:52.814333+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:39:52.814333+0000","last_undegraded":"2024-08-09T00:39:52.814333+0000","last_fullsized":"2024-08-09T00:39:52.814333+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:53:20.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817769+0000","last_change":"2024-08-08T23:28:26.776818+0000","last_active":"2024-08-09T00:36:07.817769+0000","last_peered":"2024-08-09T00:36:07.817769+0000","last_clean":"2024-08-09T00:36:07.817769+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:36:07.817769+0000","last_undegraded":"2024-08-09T00:36:07.817769+0000","last_fullsized":"2024-08-09T00:36:07.817769+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:01.090667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'217","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821151+0000","last_change":"2024-08-08T23:28:24.798893+0000","last_active":"2024-08-09T00:36:22.821151+0000","last_peered":"2024-08-09T00:36:22.821151+0000","last_clean":"2024-08-09T00:36:22.821151+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:36:22.821151+0000","last_undegraded":"2024-08-09T00:36:22.821151+0000","last_fullsized":"2024-08-09T00:36:22.821151+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:08:59.221674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812819,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":530,"num_read_kb":23484,"num_write":1158,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831284+0000","last_change":"2024-08-08T23:28:28.765882+0000","last_active":"2024-08-09T00:36:12.831284+0000","last_peered":"2024-08-09T00:36:12.831284+0000","last_clean":"2024-08-09T00:36:12.831284+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:36:12.831284+0000","last_undegraded":"2024-08-09T00:36:12.831284+0000","last_fullsized":"2024-08-09T00:36:12.831284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:59.984218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'161","reported_seq":768,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.487776+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:39:11.487776+0000","last_peered":"2024-08-09T00:39:11.487776+0000","last_clean":"2024-08-09T00:39:11.487776+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:39:11.487776+0000","last_undegraded":"2024-08-09T00:39:11.487776+0000","last_fullsized":"2024-08-09T00:39:11.487776+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:39:49.869700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8633,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":250,"num_write":112,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645239+0000","last_change":"2024-08-08T23:28:32.810146+0000","last_active":"2024-08-09T00:36:12.645239+0000","last_peered":"2024-08-09T00:36:12.645239+0000","last_clean":"2024-08-09T00:36:12.645239+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:36:12.645239+0000","last_undegraded":"2024-08-09T00:36:12.645239+0000","last_fullsized":"2024-08-09T00:36:12.645239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:08.379082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654865+0000","last_change":"2024-08-08T23:28:34.828599+0000","last_active":"2024-08-09T00:36:52.654865+0000","last_peered":"2024-08-09T00:36:52.654865+0000","last_clean":"2024-08-09T00:36:52.654865+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:36:52.654865+0000","last_undegraded":"2024-08-09T00:36:52.654865+0000","last_fullsized":"2024-08-09T00:36:52.654865+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:45.153446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830175+0000","last_change":"2024-08-08T23:28:26.775873+0000","last_active":"2024-08-09T00:36:07.830175+0000","last_peered":"2024-08-09T00:36:07.830175+0000","last_clean":"2024-08-09T00:36:07.830175+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:36:07.830175+0000","last_undegraded":"2024-08-09T00:36:07.830175+0000","last_fullsized":"2024-08-09T00:36:07.830175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:52:27.431250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'181","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:26.590093+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:37:26.590093+0000","last_peered":"2024-08-09T00:37:26.590093+0000","last_clean":"2024-08-09T00:37:26.590093+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:37:26.590093+0000","last_undegraded":"2024-08-09T00:37:26.590093+0000","last_fullsized":"2024-08-09T00:37:26.590093+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:56:26.350323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4882691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":377,"num_read_kb":16787,"num_write":981,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645488+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:36:12.645488+0000","last_peered":"2024-08-09T00:36:12.645488+0000","last_clean":"2024-08-09T00:36:12.645488+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:36:12.645488+0000","last_undegraded":"2024-08-09T00:36:12.645488+0000","last_fullsized":"2024-08-09T00:36:12.645488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:21.712748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'54","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.811769+0000","last_change":"2024-08-08T23:28:30.783385+0000","last_active":"2024-08-09T00:39:08.811769+0000","last_peered":"2024-08-09T00:39:08.811769+0000","last_clean":"2024-08-09T00:39:08.811769+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:39:08.811769+0000","last_undegraded":"2024-08-09T00:39:08.811769+0000","last_fullsized":"2024-08-09T00:39:08.811769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:25.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846097+0000","last_change":"2024-08-08T23:28:32.810977+0000","last_active":"2024-08-09T00:36:12.846097+0000","last_peered":"2024-08-09T00:36:12.846097+0000","last_clean":"2024-08-09T00:36:12.846097+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:36:12.846097+0000","last_undegraded":"2024-08-09T00:36:12.846097+0000","last_fullsized":"2024-08-09T00:36:12.846097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:46:30.450790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'187","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.463217+0000","last_change":"2024-08-08T23:28:34.841150+0000","last_active":"2024-08-09T00:39:52.463217+0000","last_peered":"2024-08-09T00:39:52.463217+0000","last_clean":"2024-08-09T00:39:52.463217+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:39:52.463217+0000","last_undegraded":"2024-08-09T00:39:52.463217+0000","last_fullsized":"2024-08-09T00:39:52.463217+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:15.845980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644070+0000","last_change":"2024-08-08T23:28:26.776192+0000","last_active":"2024-08-09T00:36:07.644070+0000","last_peered":"2024-08-09T00:36:07.644070+0000","last_clean":"2024-08-09T00:36:07.644070+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:36:07.644070+0000","last_undegraded":"2024-08-09T00:36:07.644070+0000","last_fullsized":"2024-08-09T00:36:07.644070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:40:01.464080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'197","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:02.726169+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:38:02.726169+0000","last_peered":"2024-08-09T00:38:02.726169+0000","last_clean":"2024-08-09T00:38:02.726169+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:38:02.726169+0000","last_undegraded":"2024-08-09T00:38:02.726169+0000","last_fullsized":"2024-08-09T00:38:02.726169+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:13.784247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13765036,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":9686,"num_write":1118,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846034+0000","last_change":"2024-08-08T23:28:28.781246+0000","last_active":"2024-08-09T00:36:12.846034+0000","last_peered":"2024-08-09T00:36:12.846034+0000","last_clean":"2024-08-09T00:36:12.846034+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:36:12.846034+0000","last_undegraded":"2024-08-09T00:36:12.846034+0000","last_fullsized":"2024-08-09T00:36:12.846034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:01.140883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'196","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.316317+0000","last_change":"2024-08-08T23:28:30.796061+0000","last_active":"2024-08-09T00:39:11.316317+0000","last_peered":"2024-08-09T00:39:11.316317+0000","last_clean":"2024-08-09T00:39:11.316317+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:39:11.316317+0000","last_undegraded":"2024-08-09T00:39:11.316317+0000","last_fullsized":"2024-08-09T00:39:11.316317+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:56:58.690952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":340,"num_write":154,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819418+0000","last_change":"2024-08-08T23:28:32.828831+0000","last_active":"2024-08-09T00:36:12.819418+0000","last_peered":"2024-08-09T00:36:12.819418+0000","last_clean":"2024-08-09T00:36:12.819418+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:36:12.819418+0000","last_undegraded":"2024-08-09T00:36:12.819418+0000","last_fullsized":"2024-08-09T00:36:12.819418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:56:10.147406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'114","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:50.542493+0000","last_change":"2024-08-08T23:28:34.830478+0000","last_active":"2024-08-09T00:39:50.542493+0000","last_peered":"2024-08-09T00:39:50.542493+0000","last_clean":"2024-08-09T00:39:50.542493+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:39:50.542493+0000","last_undegraded":"2024-08-09T00:39:50.542493+0000","last_fullsized":"2024-08-09T00:39:50.542493+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:39.468849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644019+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:36:07.644019+0000","last_peered":"2024-08-09T00:36:07.644019+0000","last_clean":"2024-08-09T00:36:07.644019+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:36:07.644019+0000","last_undegraded":"2024-08-09T00:36:07.644019+0000","last_fullsized":"2024-08-09T00:36:07.644019+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:02:52.706658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'162","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815902+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:36:07.815902+0000","last_peered":"2024-08-09T00:36:07.815902+0000","last_clean":"2024-08-09T00:36:07.815902+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:36:07.815902+0000","last_undegraded":"2024-08-09T00:36:07.815902+0000","last_fullsized":"2024-08-09T00:36:07.815902+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:24.065006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":312,"num_read_kb":1399,"num_write":876,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819359+0000","last_change":"2024-08-08T23:28:28.781772+0000","last_active":"2024-08-09T00:36:12.819359+0000","last_peered":"2024-08-09T00:36:12.819359+0000","last_clean":"2024-08-09T00:36:12.819359+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:36:12.819359+0000","last_undegraded":"2024-08-09T00:36:12.819359+0000","last_fullsized":"2024-08-09T00:36:12.819359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:15:35.500922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'133","reported_seq":714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.858047+0000","last_change":"2024-08-08T23:28:30.780651+0000","last_active":"2024-08-09T00:39:09.858047+0000","last_peered":"2024-08-09T00:39:09.858047+0000","last_clean":"2024-08-09T00:39:09.858047+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:39:09.858047+0000","last_undegraded":"2024-08-09T00:39:09.858047+0000","last_fullsized":"2024-08-09T00:39:09.858047+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:26.754888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":224,"num_write":92,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816952+0000","last_change":"2024-08-08T23:28:32.826903+0000","last_active":"2024-08-09T00:36:12.816952+0000","last_peered":"2024-08-09T00:36:12.816952+0000","last_clean":"2024-08-09T00:36:12.816952+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:36:12.816952+0000","last_undegraded":"2024-08-09T00:36:12.816952+0000","last_fullsized":"2024-08-09T00:36:12.816952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:15.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:11.641070+0000","last_change":"2024-08-08T23:28:26.774602+0000","last_active":"2024-08-09T00:38:11.641070+0000","last_peered":"2024-08-09T00:38:11.641070+0000","last_clean":"2024-08-09T00:38:11.641070+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:38:11.641070+0000","last_undegraded":"2024-08-09T00:38:11.641070+0000","last_fullsized":"2024-08-09T00:38:11.641070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:48.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'155","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:44.302908+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:37:44.302908+0000","last_peered":"2024-08-09T00:37:44.302908+0000","last_clean":"2024-08-09T00:37:44.302908+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:37:44.302908+0000","last_undegraded":"2024-08-09T00:37:44.302908+0000","last_fullsized":"2024-08-09T00:37:44.302908+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:46:45.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789162,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":18716,"num_write":867,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824970+0000","last_change":"2024-08-08T23:28:28.783884+0000","last_active":"2024-08-09T00:36:47.824970+0000","last_peered":"2024-08-09T00:36:47.824970+0000","last_clean":"2024-08-09T00:36:47.824970+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:36:47.824970+0000","last_undegraded":"2024-08-09T00:36:47.824970+0000","last_fullsized":"2024-08-09T00:36:47.824970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:35.459983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'214","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.908143+0000","last_change":"2024-08-08T23:28:30.780333+0000","last_active":"2024-08-09T00:39:58.908143+0000","last_peered":"2024-08-09T00:39:58.908143+0000","last_clean":"2024-08-09T00:39:58.908143+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:39:58.908143+0000","last_undegraded":"2024-08-09T00:39:58.908143+0000","last_fullsized":"2024-08-09T00:39:58.908143+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:34.051721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":329,"num_read_kb":471,"num_write":214,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046320+0000","last_change":"2024-08-08T23:28:32.819377+0000","last_active":"2024-08-09T00:36:03.046320+0000","last_peered":"2024-08-09T00:36:03.046320+0000","last_clean":"2024-08-09T00:36:03.046320+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:36:03.046320+0000","last_undegraded":"2024-08-09T00:36:03.046320+0000","last_fullsized":"2024-08-09T00:36:03.046320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:12.118204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'163","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.920905+0000","last_change":"2024-08-08T23:28:34.830516+0000","last_active":"2024-08-09T00:36:25.920905+0000","last_peered":"2024-08-09T00:36:25.920905+0000","last_clean":"2024-08-09T00:36:25.920905+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:36:25.920905+0000","last_undegraded":"2024-08-09T00:36:25.920905+0000","last_fullsized":"2024-08-09T00:36:25.920905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:35:24.816908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.297627+0000","last_change":"2024-08-08T23:28:26.777062+0000","last_active":"2024-08-09T00:37:55.297627+0000","last_peered":"2024-08-09T00:37:55.297627+0000","last_clean":"2024-08-09T00:37:55.297627+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:37:55.297627+0000","last_undegraded":"2024-08-09T00:37:55.297627+0000","last_fullsized":"2024-08-09T00:37:55.297627+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:50.644245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'279","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.823854+0000","last_change":"2024-08-08T23:29:01.888808+0000","last_active":"2024-08-09T00:36:57.823854+0000","last_peered":"2024-08-09T00:36:57.823854+0000","last_clean":"2024-08-09T00:36:57.823854+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:36:57.823854+0000","last_undegraded":"2024-08-09T00:36:57.823854+0000","last_fullsized":"2024-08-09T00:36:57.823854+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:10.690056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9708426,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":766,"num_read_kb":69125,"num_write":1342,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835144+0000","last_change":"2024-08-08T23:28:28.781761+0000","last_active":"2024-08-09T00:37:17.835144+0000","last_peered":"2024-08-09T00:37:17.835144+0000","last_clean":"2024-08-09T00:37:17.835144+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:37:17.835144+0000","last_undegraded":"2024-08-09T00:37:17.835144+0000","last_fullsized":"2024-08-09T00:37:17.835144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:51:42.627370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'194","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.988259+0000","last_change":"2024-08-08T23:28:30.775644+0000","last_active":"2024-08-09T00:39:10.988259+0000","last_peered":"2024-08-09T00:39:10.988259+0000","last_clean":"2024-08-09T00:39:10.988259+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:39:10.988259+0000","last_undegraded":"2024-08-09T00:39:10.988259+0000","last_fullsized":"2024-08-09T00:39:10.988259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:29:40.576029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6139,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":258,"num_read_kb":298,"num_write":166,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828941+0000","last_change":"2024-08-08T23:28:32.809931+0000","last_active":"2024-08-09T00:36:02.828941+0000","last_peered":"2024-08-09T00:36:02.828941+0000","last_clean":"2024-08-09T00:36:02.828941+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:36:02.828941+0000","last_undegraded":"2024-08-09T00:36:02.828941+0000","last_fullsized":"2024-08-09T00:36:02.828941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:04:26.809257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'178","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.059858+0000","last_change":"2024-08-08T23:28:34.836352+0000","last_active":"2024-08-09T00:39:48.059858+0000","last_peered":"2024-08-09T00:39:48.059858+0000","last_clean":"2024-08-09T00:39:48.059858+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:39:48.059858+0000","last_undegraded":"2024-08-09T00:39:48.059858+0000","last_fullsized":"2024-08-09T00:39:48.059858+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:31:46.433299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641569+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:35:57.641569+0000","last_peered":"2024-08-09T00:35:57.641569+0000","last_clean":"2024-08-09T00:35:57.641569+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:35:57.641569+0000","last_undegraded":"2024-08-09T00:35:57.641569+0000","last_fullsized":"2024-08-09T00:35:57.641569+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:31.478254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'206","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839680+0000","last_change":"2024-08-08T23:30:01.782029+0000","last_active":"2024-08-09T00:37:32.839680+0000","last_peered":"2024-08-09T00:37:32.839680+0000","last_clean":"2024-08-09T00:37:32.839680+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:37:32.839680+0000","last_undegraded":"2024-08-09T00:37:32.839680+0000","last_fullsized":"2024-08-09T00:37:32.839680+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.293628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486326,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":437,"num_read_kb":59906,"num_write":1085,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816465+0000","last_change":"2024-08-08T23:28:28.778478+0000","last_active":"2024-08-09T00:36:02.816465+0000","last_peered":"2024-08-09T00:36:02.816465+0000","last_clean":"2024-08-09T00:36:02.816465+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:36:02.816465+0000","last_undegraded":"2024-08-09T00:36:02.816465+0000","last_fullsized":"2024-08-09T00:36:02.816465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:25.183992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'165","reported_seq":776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.689420+0000","last_change":"2024-08-08T23:28:31.043004+0000","last_active":"2024-08-09T00:39:22.689420+0000","last_peered":"2024-08-09T00:39:22.689420+0000","last_clean":"2024-08-09T00:39:22.689420+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:39:22.689420+0000","last_undegraded":"2024-08-09T00:39:22.689420+0000","last_fullsized":"2024-08-09T00:39:22.689420+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:24:09.108955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11404,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":276,"num_write":120,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.838957+0000","last_change":"2024-08-08T23:28:32.802329+0000","last_active":"2024-08-09T00:36:47.838957+0000","last_peered":"2024-08-09T00:36:47.838957+0000","last_clean":"2024-08-09T00:36:47.838957+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:36:47.838957+0000","last_undegraded":"2024-08-09T00:36:47.838957+0000","last_fullsized":"2024-08-09T00:36:47.838957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:08.553685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'166","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.919419+0000","last_change":"2024-08-08T23:28:34.830880+0000","last_active":"2024-08-09T00:39:58.919419+0000","last_peered":"2024-08-09T00:39:58.919419+0000","last_clean":"2024-08-09T00:39:58.919419+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:39:58.919419+0000","last_undegraded":"2024-08-09T00:39:58.919419+0000","last_fullsized":"2024-08-09T00:39:58.919419+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:41:57.656951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.821534+0000","last_change":"2024-08-08T23:28:26.769723+0000","last_active":"2024-08-09T00:35:57.821534+0000","last_peered":"2024-08-09T00:35:57.821534+0000","last_clean":"2024-08-09T00:35:57.821534+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:35:57.821534+0000","last_undegraded":"2024-08-09T00:35:57.821534+0000","last_fullsized":"2024-08-09T00:35:57.821534+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:50:45.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'171","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813081+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:35:57.813081+0000","last_peered":"2024-08-09T00:35:57.813081+0000","last_clean":"2024-08-09T00:35:57.813081+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:35:57.813081+0000","last_undegraded":"2024-08-09T00:35:57.813081+0000","last_fullsized":"2024-08-09T00:35:57.813081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:17.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457608,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":4608,"num_write":1007,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828975+0000","last_change":"2024-08-08T23:28:28.776616+0000","last_active":"2024-08-09T00:36:02.828975+0000","last_peered":"2024-08-09T00:36:02.828975+0000","last_clean":"2024-08-09T00:36:02.828975+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:36:02.828975+0000","last_undegraded":"2024-08-09T00:36:02.828975+0000","last_fullsized":"2024-08-09T00:36:02.828975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:14:52.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'118","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.457751+0000","last_change":"2024-08-08T23:28:31.044012+0000","last_active":"2024-08-09T00:39:11.457751+0000","last_peered":"2024-08-09T00:39:11.457751+0000","last_clean":"2024-08-09T00:39:11.457751+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:39:11.457751+0000","last_undegraded":"2024-08-09T00:39:11.457751+0000","last_fullsized":"2024-08-09T00:39:11.457751+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:11.270743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'497","reported_seq":2372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.948213+0000","last_change":"2024-08-08T23:28:32.818008+0000","last_active":"2024-08-09T00:39:58.948213+0000","last_peered":"2024-08-09T00:39:58.948213+0000","last_clean":"2024-08-09T00:39:58.948213+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:39:58.948213+0000","last_undegraded":"2024-08-09T00:39:58.948213+0000","last_fullsized":"2024-08-09T00:39:58.948213+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:38.571079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.807216+0000","last_change":"2024-08-08T23:28:34.827314+0000","last_active":"2024-08-09T00:39:53.807216+0000","last_peered":"2024-08-09T00:39:53.807216+0000","last_clean":"2024-08-09T00:39:53.807216+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:39:53.807216+0000","last_undegraded":"2024-08-09T00:39:53.807216+0000","last_fullsized":"2024-08-09T00:39:53.807216+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:05.794292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:00.392022+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:37:00.392022+0000","last_peered":"2024-08-09T00:37:00.392022+0000","last_clean":"2024-08-09T00:37:00.392022+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:37:00.392022+0000","last_undegraded":"2024-08-09T00:37:00.392022+0000","last_fullsized":"2024-08-09T00:37:00.392022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:35.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'190","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:36.917105+0000","last_change":"2024-08-08T23:28:24.820992+0000","last_active":"2024-08-09T00:36:36.917105+0000","last_peered":"2024-08-09T00:36:36.917105+0000","last_clean":"2024-08-09T00:36:36.917105+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:36:36.917105+0000","last_undegraded":"2024-08-09T00:36:36.917105+0000","last_fullsized":"2024-08-09T00:36:36.917105+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:54.019037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9145639,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":50563,"num_write":1095,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843379+0000","last_change":"2024-08-08T23:28:28.790145+0000","last_active":"2024-08-09T00:36:02.843379+0000","last_peered":"2024-08-09T00:36:02.843379+0000","last_clean":"2024-08-09T00:36:02.843379+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:36:02.843379+0000","last_undegraded":"2024-08-09T00:36:02.843379+0000","last_fullsized":"2024-08-09T00:36:02.843379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:10.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'239","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.521474+0000","last_change":"2024-08-08T23:28:30.776086+0000","last_active":"2024-08-09T00:39:11.521474+0000","last_peered":"2024-08-09T00:39:11.521474+0000","last_clean":"2024-08-09T00:39:11.521474+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:39:11.521474+0000","last_undegraded":"2024-08-09T00:39:11.521474+0000","last_fullsized":"2024-08-09T00:39:11.521474+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:38.136653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18007,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":316,"num_read_kb":411,"num_write":196,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816883+0000","last_change":"2024-08-08T23:28:32.820762+0000","last_active":"2024-08-09T00:36:12.816883+0000","last_peered":"2024-08-09T00:36:12.816883+0000","last_clean":"2024-08-09T00:36:12.816883+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:36:12.816883+0000","last_undegraded":"2024-08-09T00:36:12.816883+0000","last_fullsized":"2024-08-09T00:36:12.816883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:28:00.396123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'118","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.831243+0000","last_change":"2024-08-08T23:28:34.840657+0000","last_active":"2024-08-09T00:39:51.831243+0000","last_peered":"2024-08-09T00:39:51.831243+0000","last_clean":"2024-08-09T00:39:51.831243+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:39:51.831243+0000","last_undegraded":"2024-08-09T00:39:51.831243+0000","last_fullsized":"2024-08-09T00:39:51.831243+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:16.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.121529+0000","last_change":"2024-08-08T23:28:26.750931+0000","last_active":"2024-08-09T00:39:54.121529+0000","last_peered":"2024-08-09T00:39:54.121529+0000","last_clean":"2024-08-09T00:39:54.121529+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:39:54.121529+0000","last_undegraded":"2024-08-09T00:39:54.121529+0000","last_fullsized":"2024-08-09T00:39:54.121529+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:28:50.333511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'196","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045277+0000","last_change":"2024-08-08T23:28:24.818191+0000","last_active":"2024-08-09T00:35:58.045277+0000","last_peered":"2024-08-09T00:35:58.045277+0000","last_clean":"2024-08-09T00:35:58.045277+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:35:58.045277+0000","last_undegraded":"2024-08-09T00:35:58.045277+0000","last_fullsized":"2024-08-09T00:35:58.045277+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:42.912960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2993812,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":62745,"num_write":1018,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046264+0000","last_change":"2024-08-08T23:28:28.776983+0000","last_active":"2024-08-09T00:36:03.046264+0000","last_peered":"2024-08-09T00:36:03.046264+0000","last_clean":"2024-08-09T00:36:03.046264+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:36:03.046264+0000","last_undegraded":"2024-08-09T00:36:03.046264+0000","last_fullsized":"2024-08-09T00:36:03.046264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:16.950419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'142","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.473257+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:39:08.473257+0000","last_peered":"2024-08-09T00:39:08.473257+0000","last_clean":"2024-08-09T00:39:08.473257+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:39:08.473257+0000","last_undegraded":"2024-08-09T00:39:08.473257+0000","last_fullsized":"2024-08-09T00:39:08.473257+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:37:42.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":253,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821824+0000","last_change":"2024-08-08T23:28:32.813742+0000","last_active":"2024-08-09T00:36:22.821824+0000","last_peered":"2024-08-09T00:36:22.821824+0000","last_clean":"2024-08-09T00:36:22.821824+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:36:22.821824+0000","last_undegraded":"2024-08-09T00:36:22.821824+0000","last_fullsized":"2024-08-09T00:36:22.821824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:08.279720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.679892+0000","last_change":"2024-08-08T23:28:34.830000+0000","last_active":"2024-08-09T00:38:42.679892+0000","last_peered":"2024-08-09T00:38:42.679892+0000","last_clean":"2024-08-09T00:38:42.679892+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:38:42.679892+0000","last_undegraded":"2024-08-09T00:38:42.679892+0000","last_fullsized":"2024-08-09T00:38:42.679892+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:25.028910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.647917+0000","last_change":"2024-08-08T23:28:26.762374+0000","last_active":"2024-08-09T00:36:22.647917+0000","last_peered":"2024-08-09T00:36:22.647917+0000","last_clean":"2024-08-09T00:36:22.647917+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:36:22.647917+0000","last_undegraded":"2024-08-09T00:36:22.647917+0000","last_fullsized":"2024-08-09T00:36:22.647917+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:04:01.695211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'260","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.832311+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:39:28.832311+0000","last_peered":"2024-08-09T00:39:28.832311+0000","last_clean":"2024-08-09T00:39:28.832311+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:39:28.832311+0000","last_undegraded":"2024-08-09T00:39:28.832311+0000","last_fullsized":"2024-08-09T00:39:28.832311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:58:00.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14282888,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":663,"num_read_kb":32625,"num_write":1553,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818766+0000","last_change":"2024-08-08T23:28:28.778212+0000","last_active":"2024-08-09T00:36:12.818766+0000","last_peered":"2024-08-09T00:36:12.818766+0000","last_clean":"2024-08-09T00:36:12.818766+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:36:12.818766+0000","last_undegraded":"2024-08-09T00:36:12.818766+0000","last_fullsized":"2024-08-09T00:36:12.818766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:32:33.405064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'120","reported_seq":701,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.370669+0000","last_change":"2024-08-08T23:28:30.796071+0000","last_active":"2024-08-09T00:39:09.370669+0000","last_peered":"2024-08-09T00:39:09.370669+0000","last_clean":"2024-08-09T00:39:09.370669+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:39:09.370669+0000","last_undegraded":"2024-08-09T00:39:09.370669+0000","last_fullsized":"2024-08-09T00:39:09.370669+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:29.366191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":202,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816384+0000","last_change":"2024-08-08T23:28:32.812326+0000","last_active":"2024-08-09T00:36:02.816384+0000","last_peered":"2024-08-09T00:36:02.816384+0000","last_clean":"2024-08-09T00:36:02.816384+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:36:02.816384+0000","last_undegraded":"2024-08-09T00:36:02.816384+0000","last_fullsized":"2024-08-09T00:36:02.816384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.507723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'144","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.001008+0000","last_change":"2024-08-08T23:28:34.835991+0000","last_active":"2024-08-09T00:39:48.001008+0000","last_peered":"2024-08-09T00:39:48.001008+0000","last_clean":"2024-08-09T00:39:48.001008+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:39:48.001008+0000","last_undegraded":"2024-08-09T00:39:48.001008+0000","last_fullsized":"2024-08-09T00:39:48.001008+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:43:41.405272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:46.216752+0000","last_change":"2024-08-08T23:28:26.781125+0000","last_active":"2024-08-09T00:37:46.216752+0000","last_peered":"2024-08-09T00:37:46.216752+0000","last_clean":"2024-08-09T00:37:46.216752+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:37:46.216752+0000","last_undegraded":"2024-08-09T00:37:46.216752+0000","last_fullsized":"2024-08-09T00:37:46.216752+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:49.822476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'156","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:28.247514+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:39:28.247514+0000","last_peered":"2024-08-09T00:39:28.247514+0000","last_clean":"2024-08-09T00:39:28.247514+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:39:28.247514+0000","last_undegraded":"2024-08-09T00:39:28.247514+0000","last_fullsized":"2024-08-09T00:39:28.247514+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:35.389417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6396645,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":16350,"num_write":844,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.834834+0000","last_change":"2024-08-08T23:28:28.765925+0000","last_active":"2024-08-09T00:36:27.834834+0000","last_peered":"2024-08-09T00:36:27.834834+0000","last_clean":"2024-08-09T00:36:27.834834+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:36:27.834834+0000","last_undegraded":"2024-08-09T00:36:27.834834+0000","last_fullsized":"2024-08-09T00:36:27.834834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:35.033143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'191","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.898713+0000","last_change":"2024-08-08T23:28:30.786260+0000","last_active":"2024-08-09T00:39:09.898713+0000","last_peered":"2024-08-09T00:39:09.898713+0000","last_clean":"2024-08-09T00:39:09.898713+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:39:09.898713+0000","last_undegraded":"2024-08-09T00:39:09.898713+0000","last_fullsized":"2024-08-09T00:39:09.898713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:07.104811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15323,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":328,"num_write":148,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814259+0000","last_change":"2024-08-08T23:28:32.820890+0000","last_active":"2024-08-09T00:36:02.814259+0000","last_peered":"2024-08-09T00:36:02.814259+0000","last_clean":"2024-08-09T00:36:02.814259+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:36:02.814259+0000","last_undegraded":"2024-08-09T00:36:02.814259+0000","last_fullsized":"2024-08-09T00:36:02.814259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:53.798935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'141","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823481+0000","last_change":"2024-08-08T23:28:34.832607+0000","last_active":"2024-08-09T00:36:32.823481+0000","last_peered":"2024-08-09T00:36:32.823481+0000","last_clean":"2024-08-09T00:36:32.823481+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:36:32.823481+0000","last_undegraded":"2024-08-09T00:36:32.823481+0000","last_fullsized":"2024-08-09T00:36:32.823481+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:55.224306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'225","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850396+0000","last_change":"2024-08-08T23:28:26.769233+0000","last_active":"2024-08-09T00:37:47.850396+0000","last_peered":"2024-08-09T00:37:47.850396+0000","last_clean":"2024-08-09T00:37:47.850396+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:37:47.850396+0000","last_undegraded":"2024-08-09T00:37:47.850396+0000","last_fullsized":"2024-08-09T00:37:47.850396+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:17:12.484894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.269231+0000","last_change":"2024-08-08T23:28:24.802451+0000","last_active":"2024-08-09T00:38:27.269231+0000","last_peered":"2024-08-09T00:38:27.269231+0000","last_clean":"2024-08-09T00:38:27.269231+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:38:27.269231+0000","last_undegraded":"2024-08-09T00:38:27.269231+0000","last_fullsized":"2024-08-09T00:38:27.269231+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:35.524843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13856288,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":400,"num_read_kb":16979,"num_write":1172,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'147","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048709+0000","last_change":"2024-08-08T23:29:01.584374+0000","last_active":"2024-08-09T00:36:13.048709+0000","last_peered":"2024-08-09T00:36:13.048709+0000","last_clean":"2024-08-09T00:36:13.048709+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:36:13.048709+0000","last_undegraded":"2024-08-09T00:36:13.048709+0000","last_fullsized":"2024-08-09T00:36:13.048709+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:12.686573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'205","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:36.724508+0000","last_change":"2024-08-08T23:28:24.787727+0000","last_active":"2024-08-09T00:38:36.724508+0000","last_peered":"2024-08-09T00:38:36.724508+0000","last_clean":"2024-08-09T00:38:36.724508+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:38:36.724508+0000","last_undegraded":"2024-08-09T00:38:36.724508+0000","last_fullsized":"2024-08-09T00:38:36.724508+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:30.042158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3011599,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":27391,"num_write":1077,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.508050+0000","last_change":"2024-08-08T23:28:26.789544+0000","last_active":"2024-08-09T00:39:52.508050+0000","last_peered":"2024-08-09T00:39:52.508050+0000","last_clean":"2024-08-09T00:39:52.508050+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:39:52.508050+0000","last_undegraded":"2024-08-09T00:39:52.508050+0000","last_fullsized":"2024-08-09T00:39:52.508050+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:52.896837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.996849+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:37:15.996849+0000","last_peered":"2024-08-09T00:37:15.996849+0000","last_clean":"2024-08-09T00:37:15.996849+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:37:15.996849+0000","last_undegraded":"2024-08-09T00:37:15.996849+0000","last_fullsized":"2024-08-09T00:37:15.996849+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:57:25.172421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221596,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":17234,"num_write":1186,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'69","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850284+0000","last_change":"2024-08-08T23:28:26.775062+0000","last_active":"2024-08-09T00:37:47.850284+0000","last_peered":"2024-08-09T00:37:47.850284+0000","last_clean":"2024-08-09T00:37:47.850284+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:37:47.850284+0000","last_undegraded":"2024-08-09T00:37:47.850284+0000","last_fullsized":"2024-08-09T00:37:47.850284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:06.373460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'253","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:30.807161+0000","last_change":"2024-08-08T23:29:01.885397+0000","last_active":"2024-08-09T00:39:30.807161+0000","last_peered":"2024-08-09T00:39:30.807161+0000","last_clean":"2024-08-09T00:39:30.807161+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:39:30.807161+0000","last_undegraded":"2024-08-09T00:39:30.807161+0000","last_fullsized":"2024-08-09T00:39:30.807161+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:40:13.222712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13676806,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":58241,"num_write":1236,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'129","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.958544+0000","last_change":"2024-08-08T23:28:26.776123+0000","last_active":"2024-08-09T00:38:32.958544+0000","last_peered":"2024-08-09T00:38:32.958544+0000","last_clean":"2024-08-09T00:38:32.958544+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:38:32.958544+0000","last_undegraded":"2024-08-09T00:38:32.958544+0000","last_fullsized":"2024-08-09T00:38:32.958544+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:05:18.665033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'203","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.667208+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:37:47.667208+0000","last_peered":"2024-08-09T00:37:47.667208+0000","last_clean":"2024-08-09T00:37:47.667208+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:37:47.667208+0000","last_undegraded":"2024-08-09T00:37:47.667208+0000","last_fullsized":"2024-08-09T00:37:47.667208+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:48:27.331256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1127696,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":401,"num_read_kb":7859,"num_write":1104,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833217+0000","last_change":"2024-08-08T23:28:26.779441+0000","last_active":"2024-08-09T00:37:12.833217+0000","last_peered":"2024-08-09T00:37:12.833217+0000","last_clean":"2024-08-09T00:37:12.833217+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:37:12.833217+0000","last_undegraded":"2024-08-09T00:37:12.833217+0000","last_fullsized":"2024-08-09T00:37:12.833217+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:29.987307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'234","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:10.308534+0000","last_change":"2024-08-08T23:28:24.759289+0000","last_active":"2024-08-09T00:39:10.308534+0000","last_peered":"2024-08-09T00:39:10.308534+0000","last_clean":"2024-08-09T00:39:10.308534+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:39:10.308534+0000","last_undegraded":"2024-08-09T00:39:10.308534+0000","last_fullsized":"2024-08-09T00:39:10.308534+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:07.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12876135,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":668,"num_read_kb":20658,"num_write":1113,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:56.569083+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:37:56.569083+0000","last_peered":"2024-08-09T00:37:56.569083+0000","last_clean":"2024-08-09T00:37:56.569083+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:37:56.569083+0000","last_undegraded":"2024-08-09T00:37:56.569083+0000","last_fullsized":"2024-08-09T00:37:56.569083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:23.078114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'193","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.843291+0000","last_change":"2024-08-08T23:28:24.795170+0000","last_active":"2024-08-09T00:37:47.843291+0000","last_peered":"2024-08-09T00:37:47.843291+0000","last_clean":"2024-08-09T00:37:47.843291+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:37:47.843291+0000","last_undegraded":"2024-08-09T00:37:47.843291+0000","last_fullsized":"2024-08-09T00:37:47.843291+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:54:04.809402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12695211,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":357,"num_read_kb":32922,"num_write":1091,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'232","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833591+0000","last_change":"2024-08-08T23:28:26.770453+0000","last_active":"2024-08-09T00:37:12.833591+0000","last_peered":"2024-08-09T00:37:12.833591+0000","last_clean":"2024-08-09T00:37:12.833591+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:37:12.833591+0000","last_undegraded":"2024-08-09T00:37:12.833591+0000","last_fullsized":"2024-08-09T00:37:12.833591+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:19:56.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'248","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831439+0000","last_change":"2024-08-08T23:29:01.888000+0000","last_active":"2024-08-09T00:36:12.831439+0000","last_peered":"2024-08-09T00:36:12.831439+0000","last_clean":"2024-08-09T00:36:12.831439+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:36:12.831439+0000","last_undegraded":"2024-08-09T00:36:12.831439+0000","last_fullsized":"2024-08-09T00:36:12.831439+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:43.322003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7977264,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":854,"num_read_kb":18739,"num_write":1238,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.709916+0000","last_change":"2024-08-08T23:28:26.775305+0000","last_active":"2024-08-09T00:36:13.709916+0000","last_peered":"2024-08-09T00:36:13.709916+0000","last_clean":"2024-08-09T00:36:13.709916+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:36:13.709916+0000","last_undegraded":"2024-08-09T00:36:13.709916+0000","last_fullsized":"2024-08-09T00:36:13.709916+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:15:22.024427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'183","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:03.072739+0000","last_change":"2024-08-08T23:28:24.788596+0000","last_active":"2024-08-09T00:38:03.072739+0000","last_peered":"2024-08-09T00:38:03.072739+0000","last_clean":"2024-08-09T00:38:03.072739+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:38:03.072739+0000","last_undegraded":"2024-08-09T00:38:03.072739+0000","last_fullsized":"2024-08-09T00:38:03.072739+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:22.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11383947,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":34111,"num_write":1039,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'81","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:04.076175+0000","last_change":"2024-08-08T23:28:26.763616+0000","last_active":"2024-08-09T00:38:04.076175+0000","last_peered":"2024-08-09T00:38:04.076175+0000","last_clean":"2024-08-09T00:38:04.076175+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:38:04.076175+0000","last_undegraded":"2024-08-09T00:38:04.076175+0000","last_fullsized":"2024-08-09T00:38:04.076175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:06.979294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'200","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:18.395370+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:38:18.395370+0000","last_peered":"2024-08-09T00:38:18.395370+0000","last_clean":"2024-08-09T00:38:18.395370+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:38:18.395370+0000","last_undegraded":"2024-08-09T00:38:18.395370+0000","last_fullsized":"2024-08-09T00:38:18.395370+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:23.874712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10206260,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":96889,"num_write":1095,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:04.420125+0000","last_change":"2024-08-08T23:28:26.767042+0000","last_active":"2024-08-09T00:37:04.420125+0000","last_peered":"2024-08-09T00:37:04.420125+0000","last_clean":"2024-08-09T00:37:04.420125+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:37:04.420125+0000","last_undegraded":"2024-08-09T00:37:04.420125+0000","last_fullsized":"2024-08-09T00:37:04.420125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:15.401572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'180","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:13.074959+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:38:13.074959+0000","last_peered":"2024-08-09T00:38:13.074959+0000","last_clean":"2024-08-09T00:38:13.074959+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:38:13.074959+0000","last_undegraded":"2024-08-09T00:38:13.074959+0000","last_fullsized":"2024-08-09T00:38:13.074959+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:35:20.239264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529795,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":71209,"num_write":974,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849790+0000","last_change":"2024-08-08T23:28:26.778789+0000","last_active":"2024-08-09T00:38:12.849790+0000","last_peered":"2024-08-09T00:38:12.849790+0000","last_clean":"2024-08-09T00:38:12.849790+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:38:12.849790+0000","last_undegraded":"2024-08-09T00:38:12.849790+0000","last_fullsized":"2024-08-09T00:38:12.849790+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:39.269574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'168","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843328+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:38:12.843328+0000","last_peered":"2024-08-09T00:38:12.843328+0000","last_clean":"2024-08-09T00:38:12.843328+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:38:12.843328+0000","last_undegraded":"2024-08-09T00:38:12.843328+0000","last_fullsized":"2024-08-09T00:38:12.843328+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:59:20.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13960223,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":327,"num_read_kb":31431,"num_write":988,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.855443+0000","last_change":"2024-08-08T23:28:26.782721+0000","last_active":"2024-08-09T00:39:19.855443+0000","last_peered":"2024-08-09T00:39:19.855443+0000","last_clean":"2024-08-09T00:39:19.855443+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:39:19.855443+0000","last_undegraded":"2024-08-09T00:39:19.855443+0000","last_fullsized":"2024-08-09T00:39:19.855443+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:29:54.581163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'227","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.850152+0000","last_change":"2024-08-08T23:28:24.763154+0000","last_active":"2024-08-09T00:38:12.850152+0000","last_peered":"2024-08-09T00:38:12.850152+0000","last_clean":"2024-08-09T00:38:12.850152+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:38:12.850152+0000","last_undegraded":"2024-08-09T00:38:12.850152+0000","last_fullsized":"2024-08-09T00:38:12.850152+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:09.336390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197764,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":70204,"num_write":1294,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843242+0000","last_change":"2024-08-08T23:28:26.773873+0000","last_active":"2024-08-09T00:38:12.843242+0000","last_peered":"2024-08-09T00:38:12.843242+0000","last_clean":"2024-08-09T00:38:12.843242+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:38:12.843242+0000","last_undegraded":"2024-08-09T00:38:12.843242+0000","last_fullsized":"2024-08-09T00:38:12.843242+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:24:31.308127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'208","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:26.833717+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:36:26.833717+0000","last_peered":"2024-08-09T00:36:26.833717+0000","last_clean":"2024-08-09T00:36:26.833717+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:36:26.833717+0000","last_undegraded":"2024-08-09T00:36:26.833717+0000","last_fullsized":"2024-08-09T00:36:26.833717+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:22.337895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12882300,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":469,"num_read_kb":54938,"num_write":1143,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672406+0000","last_change":"2024-08-08T23:28:26.754194+0000","last_active":"2024-08-09T00:38:12.672406+0000","last_peered":"2024-08-09T00:38:12.672406+0000","last_clean":"2024-08-09T00:38:12.672406+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:38:12.672406+0000","last_undegraded":"2024-08-09T00:38:12.672406+0000","last_fullsized":"2024-08-09T00:38:12.672406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:20.564322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'154","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:39.246999+0000","last_change":"2024-08-08T23:28:24.763602+0000","last_active":"2024-08-09T00:36:39.246999+0000","last_peered":"2024-08-09T00:36:39.246999+0000","last_clean":"2024-08-09T00:36:39.246999+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:36:39.246999+0000","last_undegraded":"2024-08-09T00:36:39.246999+0000","last_fullsized":"2024-08-09T00:36:39.246999+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:31.123341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564764,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":411,"num_read_kb":19124,"num_write":932,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870130+0000","last_change":"2024-08-08T23:28:26.782907+0000","last_active":"2024-08-09T00:37:57.870130+0000","last_peered":"2024-08-09T00:37:57.870130+0000","last_clean":"2024-08-09T00:37:57.870130+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:37:57.870130+0000","last_undegraded":"2024-08-09T00:37:57.870130+0000","last_fullsized":"2024-08-09T00:37:57.870130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:55.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'227","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047591+0000","last_change":"2024-08-08T23:28:24.815220+0000","last_active":"2024-08-09T00:36:08.047591+0000","last_peered":"2024-08-09T00:36:08.047591+0000","last_clean":"2024-08-09T00:36:08.047591+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:36:08.047591+0000","last_undegraded":"2024-08-09T00:36:08.047591+0000","last_fullsized":"2024-08-09T00:36:08.047591+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:31.780990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15599336,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":526,"num_read_kb":89533,"num_write":1163,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'217","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.012893+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:37:03.012893+0000","last_peered":"2024-08-09T00:37:03.012893+0000","last_clean":"2024-08-09T00:37:03.012893+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:37:03.012893+0000","last_undegraded":"2024-08-09T00:37:03.012893+0000","last_fullsized":"2024-08-09T00:37:03.012893+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:25.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15688548,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":157320,"num_write":1028,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819437+0000","last_change":"2024-08-08T23:28:26.766116+0000","last_active":"2024-08-09T00:36:22.819437+0000","last_peered":"2024-08-09T00:36:22.819437+0000","last_clean":"2024-08-09T00:36:22.819437+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:36:22.819437+0000","last_undegraded":"2024-08-09T00:36:22.819437+0000","last_fullsized":"2024-08-09T00:36:22.819437+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:53:40.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'181","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.684500+0000","last_change":"2024-08-08T23:28:24.777397+0000","last_active":"2024-08-09T00:38:22.684500+0000","last_peered":"2024-08-09T00:38:22.684500+0000","last_clean":"2024-08-09T00:38:22.684500+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:38:22.684500+0000","last_undegraded":"2024-08-09T00:38:22.684500+0000","last_fullsized":"2024-08-09T00:38:22.684500+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:46.812342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4167544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":488,"num_read_kb":17056,"num_write":1038,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:21.953586+0000","last_change":"2024-08-08T23:28:26.790814+0000","last_active":"2024-08-09T00:37:21.953586+0000","last_peered":"2024-08-09T00:37:21.953586+0000","last_clean":"2024-08-09T00:37:21.953586+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:37:21.953586+0000","last_undegraded":"2024-08-09T00:37:21.953586+0000","last_fullsized":"2024-08-09T00:37:21.953586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:39:18.226934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1052,"ondisk_log_size":1052,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1764,"ondisk_log_size":1764,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":569,"ondisk_log_size":569,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":425460,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9554,"num_read_kb":11556,"num_write":6725,"num_write_kb":2855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":737280,"data_stored":228824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1603,"num_read_kb":1909,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3446,"ondisk_log_size":3446,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":486920049,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":32037,"num_read_kb":2279949,"num_write":69215,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":733556736,"data_stored":733556736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4350,"ondisk_log_size":4350,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":194734,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":83982912,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":137,"num_read_kb":183422,"num_write":162,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575722,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336972,"kb_used_data":129476,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94034868,"statfs":{"total":96636764160,"available":96291704832,"internally_reserved":0,"allocated":132583424,"data_stored":130375216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575720,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415468,"kb_used_data":137188,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93956372,"statfs":{"total":96636764160,"available":96211324928,"internally_reserved":0,"allocated":140480512,"data_stored":138341905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575721,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199664,"kb_used_data":110248,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94172176,"statfs":{"total":96636764160,"available":96432308224,"internally_reserved":0,"allocated":112893952,"data_stored":110669074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575720,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218668,"kb_used_data":129188,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94153172,"statfs":{"total":96636764160,"available":96412848128,"internally_reserved":0,"allocated":132288512,"data_stored":130226726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575719,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326016,"kb_used_data":114360,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94045824,"statfs":{"total":96636764160,"available":96302923776,"internally_reserved":0,"allocated":117104640,"data_stored":114919562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575720,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214704,"kb_used_data":133608,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94157136,"statfs":{"total":96636764160,"available":96416907264,"internally_reserved":0,"allocated":136814592,"data_stored":134711966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575723,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284944,"kb_used_data":163592,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94086896,"statfs":{"total":96636764160,"available":96344981504,"internally_reserved":0,"allocated":167518208,"data_stored":165365008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575720,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378920,"kb_used_data":163104,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":93992920,"statfs":{"total":96636764160,"available":96248750080,"internally_reserved":0,"allocated":167018496,"data_stored":164829157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86249472,"data_stored":86249472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108445696,"data_stored":108445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88334336,"data_stored":88334336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":82051072,"data_stored":82051072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92254208,"data_stored":92254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77799424,"data_stored":77799424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":103501824,"data_stored":103501824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94920704,"data_stored":94920704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":26939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":27234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":44499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":47166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":16811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41992192,"data_stored":41991459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27361280,"data_stored":27359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:40:31.991 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-09T00:40:32.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:32.331 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":268,"fsid":"a06244b8-ff5b-4931-b711-c5bff452d3eb","created":"2024-08-08T23:27:54.973635+0000","modified":"2024-08-09T00:04:30.817567+0000","last_up_change":"2024-08-08T23:28:06.608801+0000","last_in_change":"2024-08-08T23:27:57.539489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-08T23:28:08.475367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-08T23:28:13.356950+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-08-08T23:28:22.727356+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-08-08T23:28:25.108954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-08-08T23:28:26.863554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-08-08T23:28:29.088094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-08-08T23:28:30.803266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-08-08T23:28:32.945859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-08-08T23:44:46.311762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-08-08T23:48:36.353393+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-08-08T23:48:40.464829+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-08-09T00:04:28.735097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e80d66f-48bc-41ec-9dbc-c24fc565982b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6825","nonce":3132935563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6827","nonce":3132935563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6831","nonce":3132935563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3132935563},{"type":"v1","addr":"172.21.15.83:6829","nonce":3132935563}]},"public_addr":"172.21.15.83:6825/3132935563","cluster_addr":"172.21.15.83:6827/3132935563","heartbeat_back_addr":"172.21.15.83:6831/3132935563","heartbeat_front_addr":"172.21.15.83:6829/3132935563","state":["exists","up"]},{"osd":1,"uuid":"7e4e1892-def2-4e57-8fc0-76c3c6467e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6817","nonce":3379310080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6819","nonce":3379310080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6823","nonce":3379310080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3379310080},{"type":"v1","addr":"172.21.15.83:6821","nonce":3379310080}]},"public_addr":"172.21.15.83:6817/3379310080","cluster_addr":"172.21.15.83:6819/3379310080","heartbeat_back_addr":"172.21.15.83:6823/3379310080","heartbeat_front_addr":"172.21.15.83:6821/3379310080","state":["exists","up"]},{"osd":2,"uuid":"d044d93e-576b-424f-995a-9a9d617505ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6801","nonce":3944119729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6803","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6805","nonce":3944119729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6811","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6813","nonce":3944119729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6807","nonce":3944119729},{"type":"v1","addr":"172.21.15.83:6809","nonce":3944119729}]},"public_addr":"172.21.15.83:6801/3944119729","cluster_addr":"172.21.15.83:6805/3944119729","heartbeat_back_addr":"172.21.15.83:6813/3944119729","heartbeat_front_addr":"172.21.15.83:6809/3944119729","state":["exists","up"]},{"osd":3,"uuid":"08787eed-34fe-4fe1-9f07-8ceb470278db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6804","nonce":3747846461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6808","nonce":3747846461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6815","nonce":3747846461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3747846461},{"type":"v1","addr":"172.21.15.83:6812","nonce":3747846461}]},"public_addr":"172.21.15.83:6804/3747846461","cluster_addr":"172.21.15.83:6808/3747846461","heartbeat_back_addr":"172.21.15.83:6815/3747846461","heartbeat_front_addr":"172.21.15.83:6812/3747846461","state":["exists","up"]},{"osd":4,"uuid":"bb7255bd-a742-4490-9dcd-09430444a014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6803","nonce":4290006386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6808","nonce":4290006386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6815","nonce":4290006386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":4290006386},{"type":"v1","addr":"172.21.15.196:6812","nonce":4290006386}]},"public_addr":"172.21.15.196:6803/4290006386","cluster_addr":"172.21.15.196:6808/4290006386","heartbeat_back_addr":"172.21.15.196:6815/4290006386","heartbeat_front_addr":"172.21.15.196:6812/4290006386","state":["exists","up"]},{"osd":5,"uuid":"3c639281-b389-4488-a4c7-aac85062e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6801","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6802","nonce":988086196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6805","nonce":988086196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6811","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6813","nonce":988086196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":988086196},{"type":"v1","addr":"172.21.15.196:6809","nonce":988086196}]},"public_addr":"172.21.15.196:6802/988086196","cluster_addr":"172.21.15.196:6805/988086196","heartbeat_back_addr":"172.21.15.196:6813/988086196","heartbeat_front_addr":"172.21.15.196:6809/988086196","state":["exists","up"]},{"osd":6,"uuid":"3bb04a5c-1ddd-40fd-b204-3955f0180a69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6818","nonce":2486835189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6821","nonce":2486835189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6828","nonce":2486835189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2486835189},{"type":"v1","addr":"172.21.15.196:6825","nonce":2486835189}]},"public_addr":"172.21.15.196:6818/2486835189","cluster_addr":"172.21.15.196:6821/2486835189","heartbeat_back_addr":"172.21.15.196:6828/2486835189","heartbeat_front_addr":"172.21.15.196:6825/2486835189","state":["exists","up"]},{"osd":7,"uuid":"fd4fc01a-92c4-48af-b6e4-b1e925461bea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6819","nonce":921234627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6824","nonce":921234627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6831","nonce":921234627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":921234627},{"type":"v1","addr":"172.21.15.196:6829","nonce":921234627}]},"public_addr":"172.21.15.196:6819/921234627","cluster_addr":"172.21.15.196:6824/921234627","heartbeat_back_addr":"172.21.15.196:6831/921234627","heartbeat_front_addr":"172.21.15.196:6829/921234627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.073646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.120684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.103877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.997039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.874510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.966339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:03.032834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-08T23:28:02.998505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":6,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"67.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-09T00:40:33.350 INFO:tasks.ceph:Scrubbing osd.0 2024-08-09T00:40:33.351 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:33.514 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:33.514 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:33.514 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:33.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-09T00:40:33.819 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 0 to deep-scrub 2024-08-09T00:40:33.837 INFO:tasks.ceph:Scrubbing osd.1 2024-08-09T00:40:33.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:33.981 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:33.981 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:33.982 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:33.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-09T00:40:34.277 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 1 to deep-scrub 2024-08-09T00:40:34.294 INFO:tasks.ceph:Scrubbing osd.2 2024-08-09T00:40:34.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:34.437 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:34.437 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:34.438 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:34.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-09T00:40:34.740 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 2 to deep-scrub 2024-08-09T00:40:34.759 INFO:tasks.ceph:Scrubbing osd.3 2024-08-09T00:40:34.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:34.901 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:34.901 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:34.902 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:34.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-09T00:40:35.208 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 3 to deep-scrub 2024-08-09T00:40:35.229 INFO:tasks.ceph:Scrubbing osd.4 2024-08-09T00:40:35.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:35.380 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:35.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-09T00:40:35.680 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 4 to deep-scrub 2024-08-09T00:40:35.699 INFO:tasks.ceph:Scrubbing osd.5 2024-08-09T00:40:35.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:35.844 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:35.844 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:35.844 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:35.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-09T00:40:36.134 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 5 to deep-scrub 2024-08-09T00:40:36.151 INFO:tasks.ceph:Scrubbing osd.6 2024-08-09T00:40:36.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:36.300 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:36.301 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:36.301 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:36.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-09T00:40:36.587 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 6 to deep-scrub 2024-08-09T00:40:36.605 INFO:tasks.ceph:Scrubbing osd.7 2024-08-09T00:40:36.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-09T00:40:36.756 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-08-09T00:40:36.756 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-09T00:40:36.757 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-08-09T00:40:36.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-09T00:40:37.064 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 7 to deep-scrub 2024-08-09T00:40:37.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:40:37.451 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:37.463 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:40:37.468 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2435,"stamp":"2024-08-09T00:40:37.308533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88958767,"num_objects":608,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":150062,"num_read_kb":2759937,"num_write":130193,"num_write_kb":2369717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13289,"ondisk_log_size":13289,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1471540,"kb_used_data":166772,"kb_used_omap":12,"kb_used_meta":1304243,"kb_avail":753503180,"statfs":{"total":773094113280,"available":771587256320,"internally_reserved":0,"allocated":170774528,"data_stored":153754026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1335545392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-566964649,"num_objects":-356,"num_object_clones":0,"num_object_copies":-1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-356,"num_whiteouts":0,"num_read":687,"num_read_kb":715,"num_write":514,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007694"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059551+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:37:03.059551+0000","last_peered":"2024-08-09T00:37:03.059551+0000","last_clean":"2024-08-09T00:37:03.059551+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:37:03.059551+0000","last_undegraded":"2024-08-09T00:37:03.059551+0000","last_fullsized":"2024-08-09T00:37:03.059551+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:30:02.130065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048604+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:36:13.048604+0000","last_peered":"2024-08-09T00:36:13.048604+0000","last_clean":"2024-08-09T00:36:13.048604+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:36:13.048604+0000","last_undegraded":"2024-08-09T00:36:13.048604+0000","last_fullsized":"2024-08-09T00:36:13.048604+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:23.793811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644232+0000","last_change":"2024-08-08T23:48:38.082677+0000","last_active":"2024-08-09T00:36:07.644232+0000","last_peered":"2024-08-09T00:36:07.644232+0000","last_clean":"2024-08-09T00:36:07.644232+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:36:07.644232+0000","last_undegraded":"2024-08-09T00:36:07.644232+0000","last_fullsized":"2024-08-09T00:36:07.644232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:45.392917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.826049+0000","last_change":"2024-08-08T23:44:47.428900+0000","last_active":"2024-08-09T00:36:52.826049+0000","last_peered":"2024-08-09T00:36:52.826049+0000","last_clean":"2024-08-09T00:36:52.826049+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:36:52.826049+0000","last_undegraded":"2024-08-09T00:36:52.826049+0000","last_fullsized":"2024-08-09T00:36:52.826049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:21:21.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834206+0000","last_change":"2024-08-09T00:04:29.843428+0000","last_active":"2024-08-09T00:37:02.834206+0000","last_peered":"2024-08-09T00:37:02.834206+0000","last_clean":"2024-08-09T00:37:02.834206+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:37:02.834206+0000","last_undegraded":"2024-08-09T00:37:02.834206+0000","last_fullsized":"2024-08-09T00:37:02.834206+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.089851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.858121+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:38:42.858121+0000","last_peered":"2024-08-09T00:38:42.858121+0000","last_clean":"2024-08-09T00:38:42.858121+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:38:42.858121+0000","last_undegraded":"2024-08-09T00:38:42.858121+0000","last_fullsized":"2024-08-09T00:38:42.858121+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.411299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'12","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.310321+0000","last_change":"2024-08-08T23:48:38.092226+0000","last_active":"2024-08-09T00:40:30.310321+0000","last_peered":"2024-08-09T00:40:30.310321+0000","last_clean":"2024-08-09T00:40:30.310321+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:40:30.310321+0000","last_undegraded":"2024-08-09T00:40:30.310321+0000","last_fullsized":"2024-08-09T00:40:30.310321+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:37.021560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4144,"num_write":22,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":216,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833279+0000","last_change":"2024-08-08T23:44:47.413408+0000","last_active":"2024-08-09T00:36:57.833279+0000","last_peered":"2024-08-09T00:36:57.833279+0000","last_clean":"2024-08-09T00:36:57.833279+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:36:57.833279+0000","last_undegraded":"2024-08-09T00:36:57.833279+0000","last_fullsized":"2024-08-09T00:36:57.833279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:17.443794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815930+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:35:57.815930+0000","last_peered":"2024-08-09T00:35:57.815930+0000","last_clean":"2024-08-09T00:35:57.815930+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:35:57.815930+0000","last_undegraded":"2024-08-09T00:35:57.815930+0000","last_fullsized":"2024-08-09T00:35:57.815930+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:26:55.553956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.573132+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:40:30.573132+0000","last_peered":"2024-08-09T00:40:30.573132+0000","last_clean":"2024-08-09T00:40:30.573132+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:40:30.573132+0000","last_undegraded":"2024-08-09T00:40:30.573132+0000","last_fullsized":"2024-08-09T00:40:30.573132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:03:58.706204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:47.854944+0000","last_change":"2024-08-08T23:48:38.096960+0000","last_active":"2024-08-09T00:38:47.854944+0000","last_peered":"2024-08-09T00:38:47.854944+0000","last_clean":"2024-08-09T00:38:47.854944+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:38:47.854944+0000","last_undegraded":"2024-08-09T00:38:47.854944+0000","last_fullsized":"2024-08-09T00:38:47.854944+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:44:59.425002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831661+0000","last_change":"2024-08-08T23:44:47.415903+0000","last_active":"2024-08-09T00:37:17.831661+0000","last_peered":"2024-08-09T00:37:17.831661+0000","last_clean":"2024-08-09T00:37:17.831661+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:37:17.831661+0000","last_undegraded":"2024-08-09T00:37:17.831661+0000","last_fullsized":"2024-08-09T00:37:17.831661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:31.219458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644103+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:36:07.644103+0000","last_peered":"2024-08-09T00:36:07.644103+0000","last_clean":"2024-08-09T00:36:07.644103+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:36:07.644103+0000","last_undegraded":"2024-08-09T00:36:07.644103+0000","last_fullsized":"2024-08-09T00:36:07.644103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:47.348267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654897+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:36:52.654897+0000","last_peered":"2024-08-09T00:36:52.654897+0000","last_clean":"2024-08-09T00:36:52.654897+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:36:52.654897+0000","last_undegraded":"2024-08-09T00:36:52.654897+0000","last_fullsized":"2024-08-09T00:36:52.654897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:15.853173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'6","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.304523+0000","last_change":"2024-08-08T23:48:38.064262+0000","last_active":"2024-08-09T00:40:30.304523+0000","last_peered":"2024-08-09T00:40:30.304523+0000","last_clean":"2024-08-09T00:40:30.304523+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:40:30.304523+0000","last_undegraded":"2024-08-09T00:40:30.304523+0000","last_fullsized":"2024-08-09T00:40:30.304523+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:08.321374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660513+0000","last_change":"2024-08-08T23:44:47.404876+0000","last_active":"2024-08-09T00:37:17.660513+0000","last_peered":"2024-08-09T00:37:17.660513+0000","last_clean":"2024-08-09T00:37:17.660513+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:37:17.660513+0000","last_undegraded":"2024-08-09T00:37:17.660513+0000","last_fullsized":"2024-08-09T00:37:17.660513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:44.526394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652649+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:36:42.652649+0000","last_peered":"2024-08-09T00:36:42.652649+0000","last_clean":"2024-08-09T00:36:42.652649+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:36:42.652649+0000","last_undegraded":"2024-08-09T00:36:42.652649+0000","last_fullsized":"2024-08-09T00:36:42.652649+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:16:17.115238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'11","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.209566+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:40:30.209566+0000","last_peered":"2024-08-09T00:40:30.209566+0000","last_clean":"2024-08-09T00:40:30.209566+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:40:30.209566+0000","last_undegraded":"2024-08-09T00:40:30.209566+0000","last_fullsized":"2024-08-09T00:40:30.209566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:31.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17458,"num_write":16,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.859799+0000","last_change":"2024-08-08T23:48:38.059017+0000","last_active":"2024-08-09T00:39:22.859799+0000","last_peered":"2024-08-09T00:39:22.859799+0000","last_clean":"2024-08-09T00:39:22.859799+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:39:22.859799+0000","last_undegraded":"2024-08-09T00:39:22.859799+0000","last_fullsized":"2024-08-09T00:39:22.859799+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:57.310351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660430+0000","last_change":"2024-08-08T23:44:47.424336+0000","last_active":"2024-08-09T00:37:17.660430+0000","last_peered":"2024-08-09T00:37:17.660430+0000","last_clean":"2024-08-09T00:37:17.660430+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:37:17.660430+0000","last_undegraded":"2024-08-09T00:37:17.660430+0000","last_fullsized":"2024-08-09T00:37:17.660430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:30:34.660972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.851421+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:37:52.851421+0000","last_peered":"2024-08-09T00:37:52.851421+0000","last_clean":"2024-08-09T00:37:52.851421+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:37:52.851421+0000","last_undegraded":"2024-08-09T00:37:52.851421+0000","last_fullsized":"2024-08-09T00:37:52.851421+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:40:37.743717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831092+0000","last_change":"2024-08-08T23:48:42.099507+0000","last_active":"2024-08-09T00:37:02.831092+0000","last_peered":"2024-08-09T00:37:02.831092+0000","last_clean":"2024-08-09T00:37:02.831092+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:37:02.831092+0000","last_undegraded":"2024-08-09T00:37:02.831092+0000","last_fullsized":"2024-08-09T00:37:02.831092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:58:00.113274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833107+0000","last_change":"2024-08-08T23:48:38.063345+0000","last_active":"2024-08-09T00:37:12.833107+0000","last_peered":"2024-08-09T00:37:12.833107+0000","last_clean":"2024-08-09T00:37:12.833107+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:37:12.833107+0000","last_undegraded":"2024-08-09T00:37:12.833107+0000","last_fullsized":"2024-08-09T00:37:12.833107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:22:39.743227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834919+0000","last_change":"2024-08-08T23:44:47.415691+0000","last_active":"2024-08-09T00:37:17.834919+0000","last_peered":"2024-08-09T00:37:17.834919+0000","last_clean":"2024-08-09T00:37:17.834919+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:37:17.834919+0000","last_undegraded":"2024-08-09T00:37:17.834919+0000","last_fullsized":"2024-08-09T00:37:17.834919+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:32.215875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857873+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:37:02.857873+0000","last_peered":"2024-08-09T00:37:02.857873+0000","last_clean":"2024-08-09T00:37:02.857873+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:37:02.857873+0000","last_undegraded":"2024-08-09T00:37:02.857873+0000","last_fullsized":"2024-08-09T00:37:02.857873+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:42.897370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.857314+0000","last_change":"2024-08-08T23:48:42.104797+0000","last_active":"2024-08-09T00:38:42.857314+0000","last_peered":"2024-08-09T00:38:42.857314+0000","last_clean":"2024-08-09T00:38:42.857314+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:38:42.857314+0000","last_undegraded":"2024-08-09T00:38:42.857314+0000","last_fullsized":"2024-08-09T00:38:42.857314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:25:12.169302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.856602+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:38:37.856602+0000","last_peered":"2024-08-09T00:38:37.856602+0000","last_clean":"2024-08-09T00:38:37.856602+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:38:37.856602+0000","last_undegraded":"2024-08-09T00:38:37.856602+0000","last_fullsized":"2024-08-09T00:38:37.856602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:13.656553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.842078+0000","last_change":"2024-08-08T23:44:47.418893+0000","last_active":"2024-08-09T00:38:07.842078+0000","last_peered":"2024-08-09T00:38:07.842078+0000","last_clean":"2024-08-09T00:38:07.842078+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:38:07.842078+0000","last_undegraded":"2024-08-09T00:38:07.842078+0000","last_fullsized":"2024-08-09T00:38:07.842078+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:10.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857956+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:37:02.857956+0000","last_peered":"2024-08-09T00:37:02.857956+0000","last_clean":"2024-08-09T00:37:02.857956+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:37:02.857956+0000","last_undegraded":"2024-08-09T00:37:02.857956+0000","last_fullsized":"2024-08-09T00:37:02.857956+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:54.964878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.679702+0000","last_change":"2024-08-08T23:48:42.093531+0000","last_active":"2024-08-09T00:38:42.679702+0000","last_peered":"2024-08-09T00:38:42.679702+0000","last_clean":"2024-08-09T00:38:42.679702+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:38:42.679702+0000","last_undegraded":"2024-08-09T00:38:42.679702+0000","last_fullsized":"2024-08-09T00:38:42.679702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:15:00.417914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.849023+0000","last_change":"2024-08-08T23:48:38.070086+0000","last_active":"2024-08-09T00:38:37.849023+0000","last_peered":"2024-08-09T00:38:37.849023+0000","last_clean":"2024-08-09T00:38:37.849023+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:38:37.849023+0000","last_undegraded":"2024-08-09T00:38:37.849023+0000","last_fullsized":"2024-08-09T00:38:37.849023+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:09.001506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.852322+0000","last_change":"2024-08-08T23:44:47.401774+0000","last_active":"2024-08-09T00:37:57.852322+0000","last_peered":"2024-08-09T00:37:57.852322+0000","last_clean":"2024-08-09T00:37:57.852322+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:37:57.852322+0000","last_undegraded":"2024-08-09T00:37:57.852322+0000","last_fullsized":"2024-08-09T00:37:57.852322+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:30.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843286+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:37:12.843286+0000","last_peered":"2024-08-09T00:37:12.843286+0000","last_clean":"2024-08-09T00:37:12.843286+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:37:12.843286+0000","last_undegraded":"2024-08-09T00:37:12.843286+0000","last_fullsized":"2024-08-09T00:37:12.843286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:35.805429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.206653+0000","last_change":"2024-08-08T23:48:42.569594+0000","last_active":"2024-08-09T00:40:30.206653+0000","last_peered":"2024-08-09T00:40:30.206653+0000","last_clean":"2024-08-09T00:40:30.206653+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:40:30.206653+0000","last_undegraded":"2024-08-09T00:40:30.206653+0000","last_fullsized":"2024-08-09T00:40:30.206653+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:05:00.915075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.215103+0000","last_change":"2024-08-08T23:48:38.078390+0000","last_active":"2024-08-09T00:40:30.215103+0000","last_peered":"2024-08-09T00:40:30.215103+0000","last_clean":"2024-08-09T00:40:30.215103+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:40:30.215103+0000","last_undegraded":"2024-08-09T00:40:30.215103+0000","last_fullsized":"2024-08-09T00:40:30.215103+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:32.220322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.840117+0000","last_change":"2024-08-08T23:44:47.428042+0000","last_active":"2024-08-09T00:37:57.840117+0000","last_peered":"2024-08-09T00:37:57.840117+0000","last_clean":"2024-08-09T00:37:57.840117+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:37:57.840117+0000","last_undegraded":"2024-08-09T00:37:57.840117+0000","last_fullsized":"2024-08-09T00:37:57.840117+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:18.129270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836193+0000","last_change":"2024-08-09T00:04:29.838090+0000","last_active":"2024-08-09T00:37:12.836193+0000","last_peered":"2024-08-09T00:37:12.836193+0000","last_clean":"2024-08-09T00:37:12.836193+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:37:12.836193+0000","last_undegraded":"2024-08-09T00:37:12.836193+0000","last_fullsized":"2024-08-09T00:37:12.836193+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:20.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.668499+0000","last_change":"2024-08-08T23:48:42.571114+0000","last_active":"2024-08-09T00:37:52.668499+0000","last_peered":"2024-08-09T00:37:52.668499+0000","last_clean":"2024-08-09T00:37:52.668499+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:37:52.668499+0000","last_undegraded":"2024-08-09T00:37:52.668499+0000","last_fullsized":"2024-08-09T00:37:52.668499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:19:04.633722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.890992+0000","last_change":"2024-08-08T23:48:38.081638+0000","last_active":"2024-08-09T00:39:22.890992+0000","last_peered":"2024-08-09T00:39:22.890992+0000","last_clean":"2024-08-09T00:39:22.890992+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:39:22.890992+0000","last_undegraded":"2024-08-09T00:39:22.890992+0000","last_fullsized":"2024-08-09T00:39:22.890992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:27:56.987204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.669657+0000","last_change":"2024-08-08T23:44:47.418443+0000","last_active":"2024-08-09T00:37:57.669657+0000","last_peered":"2024-08-09T00:37:57.669657+0000","last_clean":"2024-08-09T00:37:57.669657+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:37:57.669657+0000","last_undegraded":"2024-08-09T00:37:57.669657+0000","last_fullsized":"2024-08-09T00:37:57.669657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:00.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.859886+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:37:12.859886+0000","last_peered":"2024-08-09T00:37:12.859886+0000","last_clean":"2024-08-09T00:37:12.859886+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:37:12.859886+0000","last_undegraded":"2024-08-09T00:37:12.859886+0000","last_fullsized":"2024-08-09T00:37:12.859886+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:54.135762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.657135+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:37:02.657135+0000","last_peered":"2024-08-09T00:37:02.657135+0000","last_clean":"2024-08-09T00:37:02.657135+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:37:02.657135+0000","last_undegraded":"2024-08-09T00:37:02.657135+0000","last_fullsized":"2024-08-09T00:37:02.657135+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:37:02.420547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.833259+0000","last_change":"2024-08-08T23:48:38.069892+0000","last_active":"2024-08-09T00:36:57.833259+0000","last_peered":"2024-08-09T00:36:57.833259+0000","last_clean":"2024-08-09T00:36:57.833259+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:36:57.833259+0000","last_undegraded":"2024-08-09T00:36:57.833259+0000","last_fullsized":"2024-08-09T00:36:57.833259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:56:09.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.845044+0000","last_change":"2024-08-08T23:44:47.403895+0000","last_active":"2024-08-09T00:37:57.845044+0000","last_peered":"2024-08-09T00:37:57.845044+0000","last_clean":"2024-08-09T00:37:57.845044+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:37:57.845044+0000","last_undegraded":"2024-08-09T00:37:57.845044+0000","last_fullsized":"2024-08-09T00:37:57.845044+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:20:56.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:13.061641+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:37:13.061641+0000","last_peered":"2024-08-09T00:37:13.061641+0000","last_clean":"2024-08-09T00:37:13.061641+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:37:13.061641+0000","last_undegraded":"2024-08-09T00:37:13.061641+0000","last_fullsized":"2024-08-09T00:37:13.061641+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:35.438575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'4","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.868791+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:39:27.868791+0000","last_peered":"2024-08-09T00:39:27.868791+0000","last_clean":"2024-08-09T00:39:27.868791+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:39:27.868791+0000","last_undegraded":"2024-08-09T00:39:27.868791+0000","last_fullsized":"2024-08-09T00:39:27.868791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:31.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.860097+0000","last_change":"2024-08-08T23:48:38.073422+0000","last_active":"2024-08-09T00:39:22.860097+0000","last_peered":"2024-08-09T00:39:22.860097+0000","last_clean":"2024-08-09T00:39:22.860097+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:39:22.860097+0000","last_undegraded":"2024-08-09T00:39:22.860097+0000","last_fullsized":"2024-08-09T00:39:22.860097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:06.420714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846240+0000","last_change":"2024-08-08T23:44:47.416042+0000","last_active":"2024-08-09T00:36:12.846240+0000","last_peered":"2024-08-09T00:36:12.846240+0000","last_clean":"2024-08-09T00:36:12.846240+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:36:12.846240+0000","last_undegraded":"2024-08-09T00:36:12.846240+0000","last_fullsized":"2024-08-09T00:36:12.846240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:18.630574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641678+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:35:57.641678+0000","last_peered":"2024-08-09T00:35:57.641678+0000","last_clean":"2024-08-09T00:35:57.641678+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:35:57.641678+0000","last_undegraded":"2024-08-09T00:35:57.641678+0000","last_fullsized":"2024-08-09T00:35:57.641678+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:48:51.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.849230+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:37:42.849230+0000","last_peered":"2024-08-09T00:37:42.849230+0000","last_clean":"2024-08-09T00:37:42.849230+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:37:42.849230+0000","last_undegraded":"2024-08-09T00:37:42.849230+0000","last_fullsized":"2024-08-09T00:37:42.849230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:37.725025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840154+0000","last_change":"2024-08-08T23:48:38.068093+0000","last_active":"2024-08-09T00:37:37.840154+0000","last_peered":"2024-08-09T00:37:37.840154+0000","last_clean":"2024-08-09T00:37:37.840154+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:37:37.840154+0000","last_undegraded":"2024-08-09T00:37:37.840154+0000","last_fullsized":"2024-08-09T00:37:37.840154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:31:07.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844757+0000","last_change":"2024-08-08T23:44:47.417665+0000","last_active":"2024-08-09T00:36:07.844757+0000","last_peered":"2024-08-09T00:36:07.844757+0000","last_clean":"2024-08-09T00:36:07.844757+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:36:07.844757+0000","last_undegraded":"2024-08-09T00:36:07.844757+0000","last_fullsized":"2024-08-09T00:36:07.844757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:54.697542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.813256+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:35:57.813256+0000","last_peered":"2024-08-09T00:35:57.813256+0000","last_clean":"2024-08-09T00:35:57.813256+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:35:57.813256+0000","last_undegraded":"2024-08-09T00:35:57.813256+0000","last_fullsized":"2024-08-09T00:35:57.813256+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:53.142711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.878977+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:40:02.878977+0000","last_peered":"2024-08-09T00:40:02.878977+0000","last_clean":"2024-08-09T00:40:02.878977+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:40:02.878977+0000","last_undegraded":"2024-08-09T00:40:02.878977+0000","last_fullsized":"2024-08-09T00:40:02.878977+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:49:05.916828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.697148+0000","last_change":"2024-08-08T23:48:38.082209+0000","last_active":"2024-08-09T00:39:57.697148+0000","last_peered":"2024-08-09T00:39:57.697148+0000","last_clean":"2024-08-09T00:39:57.697148+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:39:57.697148+0000","last_undegraded":"2024-08-09T00:39:57.697148+0000","last_fullsized":"2024-08-09T00:39:57.697148+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:19.106154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.815548+0000","last_change":"2024-08-08T23:44:47.414517+0000","last_active":"2024-08-09T00:36:07.815548+0000","last_peered":"2024-08-09T00:36:07.815548+0000","last_clean":"2024-08-09T00:36:07.815548+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:36:07.815548+0000","last_undegraded":"2024-08-09T00:36:07.815548+0000","last_fullsized":"2024-08-09T00:36:07.815548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:24.856912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.832729+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:37:22.832729+0000","last_peered":"2024-08-09T00:37:22.832729+0000","last_clean":"2024-08-09T00:37:22.832729+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:37:22.832729+0000","last_undegraded":"2024-08-09T00:37:22.832729+0000","last_fullsized":"2024-08-09T00:37:22.832729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:11.805690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'4","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:22.876369+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:40:22.876369+0000","last_peered":"2024-08-09T00:40:22.876369+0000","last_clean":"2024-08-09T00:40:22.876369+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:40:22.876369+0000","last_undegraded":"2024-08-09T00:40:22.876369+0000","last_fullsized":"2024-08-09T00:40:22.876369+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:34:17.911780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.211405+0000","last_change":"2024-08-08T23:48:38.094796+0000","last_active":"2024-08-09T00:40:30.211405+0000","last_peered":"2024-08-09T00:40:30.211405+0000","last_clean":"2024-08-09T00:40:30.211405+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:40:30.211405+0000","last_undegraded":"2024-08-09T00:40:30.211405+0000","last_fullsized":"2024-08-09T00:40:30.211405+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:24.637100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10240,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817622+0000","last_change":"2024-08-08T23:44:47.394560+0000","last_active":"2024-08-09T00:36:07.817622+0000","last_peered":"2024-08-09T00:36:07.817622+0000","last_clean":"2024-08-09T00:36:07.817622+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:36:07.817622+0000","last_undegraded":"2024-08-09T00:36:07.817622+0000","last_fullsized":"2024-08-09T00:36:07.817622+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:27:00.732298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641490+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:35:57.641490+0000","last_peered":"2024-08-09T00:35:57.641490+0000","last_clean":"2024-08-09T00:35:57.641490+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:35:57.641490+0000","last_undegraded":"2024-08-09T00:35:57.641490+0000","last_fullsized":"2024-08-09T00:35:57.641490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:42.318744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:42.841717+0000","last_change":"2024-08-08T23:48:42.119272+0000","last_active":"2024-08-09T00:37:42.841717+0000","last_peered":"2024-08-09T00:37:42.841717+0000","last_clean":"2024-08-09T00:37:42.841717+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:37:42.841717+0000","last_undegraded":"2024-08-09T00:37:42.841717+0000","last_fullsized":"2024-08-09T00:37:42.841717+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:12.818880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.098515+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:39:58.098515+0000","last_peered":"2024-08-09T00:39:58.098515+0000","last_clean":"2024-08-09T00:39:58.098515+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:39:58.098515+0000","last_undegraded":"2024-08-09T00:39:58.098515+0000","last_fullsized":"2024-08-09T00:39:58.098515+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:13.879567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.643947+0000","last_change":"2024-08-08T23:44:47.404724+0000","last_active":"2024-08-09T00:36:07.643947+0000","last_peered":"2024-08-09T00:36:07.643947+0000","last_clean":"2024-08-09T00:36:07.643947+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:36:07.643947+0000","last_undegraded":"2024-08-09T00:36:07.643947+0000","last_fullsized":"2024-08-09T00:36:07.643947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:52:50.706903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:07.835155+0000","last_change":"2024-08-09T00:04:29.835767+0000","last_active":"2024-08-09T00:37:07.835155+0000","last_peered":"2024-08-09T00:37:07.835155+0000","last_clean":"2024-08-09T00:37:07.835155+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:37:07.835155+0000","last_undegraded":"2024-08-09T00:37:07.835155+0000","last_fullsized":"2024-08-09T00:37:07.835155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.738421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.704276+0000","last_change":"2024-08-08T23:48:42.111533+0000","last_active":"2024-08-09T00:40:27.704276+0000","last_peered":"2024-08-09T00:40:27.704276+0000","last_clean":"2024-08-09T00:40:27.704276+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:40:27.704276+0000","last_undegraded":"2024-08-09T00:40:27.704276+0000","last_fullsized":"2024-08-09T00:40:27.704276+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:24.814125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.872421+0000","last_change":"2024-08-08T23:48:38.087296+0000","last_active":"2024-08-09T00:38:07.872421+0000","last_peered":"2024-08-09T00:38:07.872421+0000","last_clean":"2024-08-09T00:38:07.872421+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:38:07.872421+0000","last_undegraded":"2024-08-09T00:38:07.872421+0000","last_fullsized":"2024-08-09T00:38:07.872421+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:01:04.545816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.652733+0000","last_change":"2024-08-08T23:44:47.428169+0000","last_active":"2024-08-09T00:36:42.652733+0000","last_peered":"2024-08-09T00:36:42.652733+0000","last_clean":"2024-08-09T00:36:42.652733+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:36:42.652733+0000","last_undegraded":"2024-08-09T00:36:42.652733+0000","last_fullsized":"2024-08-09T00:36:42.652733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:49.375073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.874693+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:38:17.874693+0000","last_peered":"2024-08-09T00:38:17.874693+0000","last_clean":"2024-08-09T00:38:17.874693+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:38:17.874693+0000","last_undegraded":"2024-08-09T00:38:17.874693+0000","last_fullsized":"2024-08-09T00:38:17.874693+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:32.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'15","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.594625+0000","last_change":"2024-08-08T23:48:42.099382+0000","last_active":"2024-08-09T00:40:30.594625+0000","last_peered":"2024-08-09T00:40:30.594625+0000","last_clean":"2024-08-09T00:40:30.594625+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:40:30.594625+0000","last_undegraded":"2024-08-09T00:40:30.594625+0000","last_fullsized":"2024-08-09T00:40:30.594625+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:02:20.657160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21602,"num_write":20,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.847395+0000","last_change":"2024-08-08T23:48:38.060640+0000","last_active":"2024-08-09T00:38:07.847395+0000","last_peered":"2024-08-09T00:38:07.847395+0000","last_clean":"2024-08-09T00:38:07.847395+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:38:07.847395+0000","last_undegraded":"2024-08-09T00:38:07.847395+0000","last_fullsized":"2024-08-09T00:38:07.847395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:37.913237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:33.053185+0000","last_change":"2024-08-08T23:44:47.403129+0000","last_active":"2024-08-09T00:36:33.053185+0000","last_peered":"2024-08-09T00:36:33.053185+0000","last_clean":"2024-08-09T00:36:33.053185+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:36:33.053185+0000","last_undegraded":"2024-08-09T00:36:33.053185+0000","last_fullsized":"2024-08-09T00:36:33.053185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:39.986809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.831148+0000","last_change":"2024-08-09T00:04:29.861378+0000","last_active":"2024-08-09T00:37:02.831148+0000","last_peered":"2024-08-09T00:37:02.831148+0000","last_clean":"2024-08-09T00:37:02.831148+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:37:02.831148+0000","last_undegraded":"2024-08-09T00:37:02.831148+0000","last_fullsized":"2024-08-09T00:37:02.831148+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:00.665233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'6","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410943+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:40:30.410943+0000","last_peered":"2024-08-09T00:40:30.410943+0000","last_clean":"2024-08-09T00:40:30.410943+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:40:30.410943+0000","last_undegraded":"2024-08-09T00:40:30.410943+0000","last_fullsized":"2024-08-09T00:40:30.410943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:27:45.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:22.876513+0000","last_change":"2024-08-08T23:48:38.085232+0000","last_active":"2024-08-09T00:40:22.876513+0000","last_peered":"2024-08-09T00:40:22.876513+0000","last_clean":"2024-08-09T00:40:22.876513+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:40:22.876513+0000","last_undegraded":"2024-08-09T00:40:22.876513+0000","last_fullsized":"2024-08-09T00:40:22.876513+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:15.159124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824087+0000","last_change":"2024-08-08T23:44:47.399086+0000","last_active":"2024-08-09T00:36:32.824087+0000","last_peered":"2024-08-09T00:36:32.824087+0000","last_clean":"2024-08-09T00:36:32.824087+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:36:32.824087+0000","last_undegraded":"2024-08-09T00:36:32.824087+0000","last_fullsized":"2024-08-09T00:36:32.824087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:59.479905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.857757+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:37:02.857757+0000","last_peered":"2024-08-09T00:37:02.857757+0000","last_clean":"2024-08-09T00:37:02.857757+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:37:02.857757+0000","last_undegraded":"2024-08-09T00:37:02.857757+0000","last_fullsized":"2024-08-09T00:37:02.857757+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:37:09.466033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672556+0000","last_change":"2024-08-08T23:48:42.109080+0000","last_active":"2024-08-09T00:38:12.672556+0000","last_peered":"2024-08-09T00:38:12.672556+0000","last_clean":"2024-08-09T00:38:12.672556+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:38:12.672556+0000","last_undegraded":"2024-08-09T00:38:12.672556+0000","last_fullsized":"2024-08-09T00:38:12.672556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:13.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.573236+0000","last_change":"2024-08-08T23:48:38.092262+0000","last_active":"2024-08-09T00:40:30.573236+0000","last_peered":"2024-08-09T00:40:30.573236+0000","last_clean":"2024-08-09T00:40:30.573236+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:40:30.573236+0000","last_undegraded":"2024-08-09T00:40:30.573236+0000","last_fullsized":"2024-08-09T00:40:30.573236+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:52:00.439329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.828951+0000","last_change":"2024-08-08T23:44:47.399289+0000","last_active":"2024-08-09T00:36:32.828951+0000","last_peered":"2024-08-09T00:36:32.828951+0000","last_clean":"2024-08-09T00:36:32.828951+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:36:32.828951+0000","last_undegraded":"2024-08-09T00:36:32.828951+0000","last_fullsized":"2024-08-09T00:36:32.828951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:04.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.673683+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:38:17.673683+0000","last_peered":"2024-08-09T00:38:17.673683+0000","last_clean":"2024-08-09T00:38:17.673683+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:38:17.673683+0000","last_undegraded":"2024-08-09T00:38:17.673683+0000","last_fullsized":"2024-08-09T00:38:17.673683+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:08.530056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821001+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:36:22.821001+0000","last_peered":"2024-08-09T00:36:22.821001+0000","last_clean":"2024-08-09T00:36:22.821001+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:36:22.821001+0000","last_undegraded":"2024-08-09T00:36:22.821001+0000","last_fullsized":"2024-08-09T00:36:22.821001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:18:01.697005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.846504+0000","last_change":"2024-08-08T23:48:38.084236+0000","last_active":"2024-08-09T00:38:27.846504+0000","last_peered":"2024-08-09T00:38:27.846504+0000","last_clean":"2024-08-09T00:38:27.846504+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:38:27.846504+0000","last_undegraded":"2024-08-09T00:38:27.846504+0000","last_fullsized":"2024-08-09T00:38:27.846504+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:54.693443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.821527+0000","last_change":"2024-08-08T23:44:47.408356+0000","last_active":"2024-08-09T00:36:32.821527+0000","last_peered":"2024-08-09T00:36:32.821527+0000","last_clean":"2024-08-09T00:36:32.821527+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:36:32.821527+0000","last_undegraded":"2024-08-09T00:36:32.821527+0000","last_fullsized":"2024-08-09T00:36:32.821527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:09.358087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.845039+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:36:07.845039+0000","last_peered":"2024-08-09T00:36:07.845039+0000","last_clean":"2024-08-09T00:36:07.845039+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:36:07.845039+0000","last_undegraded":"2024-08-09T00:36:07.845039+0000","last_fullsized":"2024-08-09T00:36:07.845039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:02:05.119656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.848531+0000","last_change":"2024-08-08T23:48:42.570789+0000","last_active":"2024-08-09T00:36:22.848531+0000","last_peered":"2024-08-09T00:36:22.848531+0000","last_clean":"2024-08-09T00:36:22.848531+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:36:22.848531+0000","last_undegraded":"2024-08-09T00:36:22.848531+0000","last_fullsized":"2024-08-09T00:36:22.848531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:16:34.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'8","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.858418+0000","last_change":"2024-08-08T23:48:38.092188+0000","last_active":"2024-08-09T00:38:27.858418+0000","last_peered":"2024-08-09T00:38:27.858418+0000","last_clean":"2024-08-09T00:38:27.858418+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:38:27.858418+0000","last_undegraded":"2024-08-09T00:38:27.858418+0000","last_fullsized":"2024-08-09T00:38:27.858418+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:33.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855435+0000","last_change":"2024-08-08T23:44:47.396027+0000","last_active":"2024-08-09T00:36:52.855435+0000","last_peered":"2024-08-09T00:36:52.855435+0000","last_clean":"2024-08-09T00:36:52.855435+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:36:52.855435+0000","last_undegraded":"2024-08-09T00:36:52.855435+0000","last_fullsized":"2024-08-09T00:36:52.855435+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:49:52.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.874752+0000","last_change":"2024-08-09T00:04:29.877623+0000","last_active":"2024-08-09T00:38:17.874752+0000","last_peered":"2024-08-09T00:38:17.874752+0000","last_clean":"2024-08-09T00:38:17.874752+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:38:17.874752+0000","last_undegraded":"2024-08-09T00:38:17.874752+0000","last_fullsized":"2024-08-09T00:38:17.874752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:58.415040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855444+0000","last_change":"2024-08-08T23:48:42.117970+0000","last_active":"2024-08-09T00:38:12.855444+0000","last_peered":"2024-08-09T00:38:12.855444+0000","last_clean":"2024-08-09T00:38:12.855444+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:38:12.855444+0000","last_undegraded":"2024-08-09T00:38:12.855444+0000","last_fullsized":"2024-08-09T00:38:12.855444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:08.226037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.342388+0000","last_change":"2024-08-08T23:48:38.070526+0000","last_active":"2024-08-09T00:40:30.342388+0000","last_peered":"2024-08-09T00:40:30.342388+0000","last_clean":"2024-08-09T00:40:30.342388+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:40:30.342388+0000","last_undegraded":"2024-08-09T00:40:30.342388+0000","last_fullsized":"2024-08-09T00:40:30.342388+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:04.766563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.653651+0000","last_change":"2024-08-08T23:44:47.397051+0000","last_active":"2024-08-09T00:36:47.653651+0000","last_peered":"2024-08-09T00:36:47.653651+0000","last_clean":"2024-08-09T00:36:47.653651+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:36:47.653651+0000","last_undegraded":"2024-08-09T00:36:47.653651+0000","last_fullsized":"2024-08-09T00:36:47.653651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:05:19.891906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.844422+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:38:17.844422+0000","last_peered":"2024-08-09T00:38:17.844422+0000","last_clean":"2024-08-09T00:38:17.844422+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:38:17.844422+0000","last_undegraded":"2024-08-09T00:38:17.844422+0000","last_fullsized":"2024-08-09T00:38:17.844422+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:18:12.990248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.880440+0000","last_change":"2024-08-08T23:48:42.107127+0000","last_active":"2024-08-09T00:38:37.880440+0000","last_peered":"2024-08-09T00:38:37.880440+0000","last_clean":"2024-08-09T00:38:37.880440+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:38:37.880440+0000","last_undegraded":"2024-08-09T00:38:37.880440+0000","last_fullsized":"2024-08-09T00:38:37.880440+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:54:09.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.848661+0000","last_change":"2024-08-08T23:48:38.063944+0000","last_active":"2024-08-09T00:38:07.848661+0000","last_peered":"2024-08-09T00:38:07.848661+0000","last_clean":"2024-08-09T00:38:07.848661+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:38:07.848661+0000","last_undegraded":"2024-08-09T00:38:07.848661+0000","last_fullsized":"2024-08-09T00:38:07.848661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:06:32.473872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827506+0000","last_change":"2024-08-08T23:44:47.398875+0000","last_active":"2024-08-09T00:36:47.827506+0000","last_peered":"2024-08-09T00:36:47.827506+0000","last_clean":"2024-08-09T00:36:47.827506+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:36:47.827506+0000","last_undegraded":"2024-08-09T00:36:47.827506+0000","last_fullsized":"2024-08-09T00:36:47.827506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:43:26.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868969+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:37:52.868969+0000","last_peered":"2024-08-09T00:37:52.868969+0000","last_clean":"2024-08-09T00:37:52.868969+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:37:52.868969+0000","last_undegraded":"2024-08-09T00:37:52.868969+0000","last_fullsized":"2024-08-09T00:37:52.868969+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:57:10.837360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'7","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.411314+0000","last_change":"2024-08-08T23:48:42.101066+0000","last_active":"2024-08-09T00:40:30.411314+0000","last_peered":"2024-08-09T00:40:30.411314+0000","last_clean":"2024-08-09T00:40:30.411314+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:40:30.411314+0000","last_undegraded":"2024-08-09T00:40:30.411314+0000","last_fullsized":"2024-08-09T00:40:30.411314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:06.491271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'9","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.880499+0000","last_change":"2024-08-08T23:48:38.078556+0000","last_active":"2024-08-09T00:38:37.880499+0000","last_peered":"2024-08-09T00:38:37.880499+0000","last_clean":"2024-08-09T00:38:37.880499+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:38:37.880499+0000","last_undegraded":"2024-08-09T00:38:37.880499+0000","last_fullsized":"2024-08-09T00:38:37.880499+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:01.058350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.825020+0000","last_change":"2024-08-08T23:44:47.428182+0000","last_active":"2024-08-09T00:36:47.825020+0000","last_peered":"2024-08-09T00:36:47.825020+0000","last_clean":"2024-08-09T00:36:47.825020+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:36:47.825020+0000","last_undegraded":"2024-08-09T00:36:47.825020+0000","last_fullsized":"2024-08-09T00:36:47.825020+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:23.238421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070601+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:37:53.070601+0000","last_peered":"2024-08-09T00:37:53.070601+0000","last_clean":"2024-08-09T00:37:53.070601+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:37:53.070601+0000","last_undegraded":"2024-08-09T00:37:53.070601+0000","last_fullsized":"2024-08-09T00:37:53.070601+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:59:54.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'7","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.850249+0000","last_change":"2024-08-08T23:48:42.574733+0000","last_active":"2024-08-09T00:38:42.850249+0000","last_peered":"2024-08-09T00:38:42.850249+0000","last_clean":"2024-08-09T00:38:42.850249+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:38:42.850249+0000","last_undegraded":"2024-08-09T00:38:42.850249+0000","last_fullsized":"2024-08-09T00:38:42.850249+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:12.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:42.830892+0000","last_change":"2024-08-08T23:48:38.060729+0000","last_active":"2024-08-09T00:36:42.830892+0000","last_peered":"2024-08-09T00:36:42.830892+0000","last_clean":"2024-08-09T00:36:42.830892+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:36:42.830892+0000","last_undegraded":"2024-08-09T00:36:42.830892+0000","last_fullsized":"2024-08-09T00:36:42.830892+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:21.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'85","reported_seq":328,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.827642+0000","last_change":"2024-08-08T23:44:47.407071+0000","last_active":"2024-08-09T00:36:47.827642+0000","last_peered":"2024-08-09T00:36:47.827642+0000","last_clean":"2024-08-09T00:36:47.827642+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:36:47.827642+0000","last_undegraded":"2024-08-09T00:36:47.827642+0000","last_fullsized":"2024-08-09T00:36:47.827642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:20.171645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.836281+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:36:37.836281+0000","last_peered":"2024-08-09T00:36:37.836281+0000","last_clean":"2024-08-09T00:36:37.836281+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:36:37.836281+0000","last_undegraded":"2024-08-09T00:36:37.836281+0000","last_fullsized":"2024-08-09T00:36:37.836281+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:00.019365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.498633+0000","last_change":"2024-08-08T23:48:42.574649+0000","last_active":"2024-08-09T00:40:30.498633+0000","last_peered":"2024-08-09T00:40:30.498633+0000","last_clean":"2024-08-09T00:40:30.498633+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:40:30.498633+0000","last_undegraded":"2024-08-09T00:40:30.498633+0000","last_fullsized":"2024-08-09T00:40:30.498633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:27.719355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'7","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:28.078417+0000","last_change":"2024-08-08T23:48:38.074200+0000","last_active":"2024-08-09T00:38:28.078417+0000","last_peered":"2024-08-09T00:38:28.078417+0000","last_clean":"2024-08-09T00:38:28.078417+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:38:28.078417+0000","last_undegraded":"2024-08-09T00:38:28.078417+0000","last_fullsized":"2024-08-09T00:38:28.078417+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:00.327462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:57.856642+0000","last_change":"2024-08-08T23:44:47.409012+0000","last_active":"2024-08-09T00:36:57.856642+0000","last_peered":"2024-08-09T00:36:57.856642+0000","last_clean":"2024-08-09T00:36:57.856642+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:36:57.856642+0000","last_undegraded":"2024-08-09T00:36:57.856642+0000","last_fullsized":"2024-08-09T00:36:57.856642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:41:17.851838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844591+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:37:52.844591+0000","last_peered":"2024-08-09T00:37:52.844591+0000","last_clean":"2024-08-09T00:37:52.844591+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:37:52.844591+0000","last_undegraded":"2024-08-09T00:37:52.844591+0000","last_fullsized":"2024-08-09T00:37:52.844591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:26:53.664350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.855444+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:38:32.855444+0000","last_peered":"2024-08-09T00:38:32.855444+0000","last_clean":"2024-08-09T00:38:32.855444+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:38:32.855444+0000","last_undegraded":"2024-08-09T00:38:32.855444+0000","last_fullsized":"2024-08-09T00:38:32.855444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:57.922645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7184,"num_write":6,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.847687+0000","last_change":"2024-08-08T23:48:38.078416+0000","last_active":"2024-08-09T00:36:17.847687+0000","last_peered":"2024-08-09T00:36:17.847687+0000","last_clean":"2024-08-09T00:36:17.847687+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:36:17.847687+0000","last_undegraded":"2024-08-09T00:36:17.847687+0000","last_fullsized":"2024-08-09T00:36:17.847687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:01:01.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.839733+0000","last_change":"2024-08-08T23:44:47.401342+0000","last_active":"2024-08-09T00:36:52.839733+0000","last_peered":"2024-08-09T00:36:52.839733+0000","last_clean":"2024-08-09T00:36:52.839733+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:36:52.839733+0000","last_undegraded":"2024-08-09T00:36:52.839733+0000","last_fullsized":"2024-08-09T00:36:52.839733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:44.529457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834315+0000","last_change":"2024-08-09T00:04:29.863724+0000","last_active":"2024-08-09T00:37:02.834315+0000","last_peered":"2024-08-09T00:37:02.834315+0000","last_clean":"2024-08-09T00:37:02.834315+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:37:02.834315+0000","last_undegraded":"2024-08-09T00:37:02.834315+0000","last_fullsized":"2024-08-09T00:37:02.834315+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:29.579952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'8","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.861909+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:38:42.861909+0000","last_peered":"2024-08-09T00:38:42.861909+0000","last_clean":"2024-08-09T00:38:42.861909+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:38:42.861909+0000","last_undegraded":"2024-08-09T00:38:42.861909+0000","last_fullsized":"2024-08-09T00:38:42.861909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:10.329411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.286784+0000","last_change":"2024-08-08T23:48:38.072020+0000","last_active":"2024-08-09T00:40:30.286784+0000","last_peered":"2024-08-09T00:40:30.286784+0000","last_clean":"2024-08-09T00:40:30.286784+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:40:30.286784+0000","last_undegraded":"2024-08-09T00:40:30.286784+0000","last_fullsized":"2024-08-09T00:40:30.286784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.841674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057480+0000","last_change":"2024-08-08T23:44:47.415563+0000","last_active":"2024-08-09T00:36:53.057480+0000","last_peered":"2024-08-09T00:36:53.057480+0000","last_clean":"2024-08-09T00:36:53.057480+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:36:53.057480+0000","last_undegraded":"2024-08-09T00:36:53.057480+0000","last_fullsized":"2024-08-09T00:36:53.057480+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:14.499630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.828240+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:37:02.828240+0000","last_peered":"2024-08-09T00:37:02.828240+0000","last_clean":"2024-08-09T00:37:02.828240+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:37:02.828240+0000","last_undegraded":"2024-08-09T00:37:02.828240+0000","last_fullsized":"2024-08-09T00:37:02.828240+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:48.269801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:53.057343+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:36:53.057343+0000","last_peered":"2024-08-09T00:36:53.057343+0000","last_clean":"2024-08-09T00:36:53.057343+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:36:53.057343+0000","last_undegraded":"2024-08-09T00:36:53.057343+0000","last_fullsized":"2024-08-09T00:36:53.057343+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:22.736751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'4","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.880396+0000","last_change":"2024-08-08T23:48:38.073918+0000","last_active":"2024-08-09T00:38:37.880396+0000","last_peered":"2024-08-09T00:38:37.880396+0000","last_clean":"2024-08-09T00:38:37.880396+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:38:37.880396+0000","last_undegraded":"2024-08-09T00:38:37.880396+0000","last_fullsized":"2024-08-09T00:38:37.880396+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:54:36.717576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828053+0000","last_change":"2024-08-08T23:44:47.396682+0000","last_active":"2024-08-09T00:36:52.828053+0000","last_peered":"2024-08-09T00:36:52.828053+0000","last_clean":"2024-08-09T00:36:52.828053+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:36:52.828053+0000","last_undegraded":"2024-08-09T00:36:52.828053+0000","last_fullsized":"2024-08-09T00:36:52.828053+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:54.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.838905+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:37:52.838905+0000","last_peered":"2024-08-09T00:37:52.838905+0000","last_clean":"2024-08-09T00:37:52.838905+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:37:52.838905+0000","last_undegraded":"2024-08-09T00:37:52.838905+0000","last_fullsized":"2024-08-09T00:37:52.838905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:40.806416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825081+0000","last_change":"2024-08-08T23:48:42.101703+0000","last_active":"2024-08-09T00:36:37.825081+0000","last_peered":"2024-08-09T00:36:37.825081+0000","last_clean":"2024-08-09T00:36:37.825081+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:36:37.825081+0000","last_undegraded":"2024-08-09T00:36:37.825081+0000","last_fullsized":"2024-08-09T00:36:37.825081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:28:20.232434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.835642+0000","last_change":"2024-08-08T23:48:38.094574+0000","last_active":"2024-08-09T00:36:32.835642+0000","last_peered":"2024-08-09T00:36:32.835642+0000","last_clean":"2024-08-09T00:36:32.835642+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:36:32.835642+0000","last_undegraded":"2024-08-09T00:36:32.835642+0000","last_fullsized":"2024-08-09T00:36:32.835642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:54:58.203802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.828719+0000","last_change":"2024-08-08T23:44:47.406106+0000","last_active":"2024-08-09T00:36:52.828719+0000","last_peered":"2024-08-09T00:36:52.828719+0000","last_clean":"2024-08-09T00:36:52.828719+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:36:52.828719+0000","last_undegraded":"2024-08-09T00:36:52.828719+0000","last_fullsized":"2024-08-09T00:36:52.828719+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:06.460517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870272+0000","last_change":"2024-08-09T00:04:29.876240+0000","last_active":"2024-08-09T00:37:57.870272+0000","last_peered":"2024-08-09T00:37:57.870272+0000","last_clean":"2024-08-09T00:37:57.870272+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:37:57.870272+0000","last_undegraded":"2024-08-09T00:37:57.870272+0000","last_fullsized":"2024-08-09T00:37:57.870272+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:16.600617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.857988+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:38:42.857988+0000","last_peered":"2024-08-09T00:38:42.857988+0000","last_clean":"2024-08-09T00:38:42.857988+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:38:42.857988+0000","last_undegraded":"2024-08-09T00:38:42.857988+0000","last_fullsized":"2024-08-09T00:38:42.857988+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:25:48.483740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.824034+0000","last_change":"2024-08-08T23:48:38.075180+0000","last_active":"2024-08-09T00:36:32.824034+0000","last_peered":"2024-08-09T00:36:32.824034+0000","last_clean":"2024-08-09T00:36:32.824034+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:36:32.824034+0000","last_undegraded":"2024-08-09T00:36:32.824034+0000","last_fullsized":"2024-08-09T00:36:32.824034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:33:20.643494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'75","reported_seq":297,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.855332+0000","last_change":"2024-08-08T23:44:47.393129+0000","last_active":"2024-08-09T00:36:52.855332+0000","last_peered":"2024-08-09T00:36:52.855332+0000","last_clean":"2024-08-09T00:36:52.855332+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:36:52.855332+0000","last_undegraded":"2024-08-09T00:36:52.855332+0000","last_fullsized":"2024-08-09T00:36:52.855332+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:52.154862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'160","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.220228+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:40:30.220228+0000","last_peered":"2024-08-09T00:40:30.220228+0000","last_clean":"2024-08-09T00:40:30.220228+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:40:30.220228+0000","last_undegraded":"2024-08-09T00:40:30.220228+0000","last_fullsized":"2024-08-09T00:40:30.220228+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:02:46.763933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850193,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":340,"num_read_kb":12258,"num_write":951,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:58.045046+0000","last_change":"2024-08-08T23:28:26.788360+0000","last_active":"2024-08-09T00:35:58.045046+0000","last_peered":"2024-08-09T00:35:58.045046+0000","last_clean":"2024-08-09T00:35:58.045046+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:35:58.045046+0000","last_undegraded":"2024-08-09T00:35:58.045046+0000","last_fullsized":"2024-08-09T00:35:58.045046+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:04.030286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'191","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.646270+0000","last_change":"2024-08-08T23:28:24.771874+0000","last_active":"2024-08-09T00:40:30.646270+0000","last_peered":"2024-08-09T00:40:30.646270+0000","last_clean":"2024-08-09T00:40:30.646270+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:40:30.646270+0000","last_undegraded":"2024-08-09T00:40:30.646270+0000","last_fullsized":"2024-08-09T00:40:30.646270+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:27:05.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":3384,"num_write":904,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'233","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.842052+0000","last_change":"2024-08-08T23:28:26.783710+0000","last_active":"2024-08-09T00:35:57.842052+0000","last_peered":"2024-08-09T00:35:57.842052+0000","last_clean":"2024-08-09T00:35:57.842052+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:35:57.842052+0000","last_undegraded":"2024-08-09T00:35:57.842052+0000","last_fullsized":"2024-08-09T00:35:57.842052+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:28.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'216","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587746+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:40:30.587746+0000","last_peered":"2024-08-09T00:40:30.587746+0000","last_clean":"2024-08-09T00:40:30.587746+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:40:30.587746+0000","last_undegraded":"2024-08-09T00:40:30.587746+0000","last_fullsized":"2024-08-09T00:40:30.587746+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:18.881767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":22668,"num_write":1178,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.815161+0000","last_change":"2024-08-08T23:28:26.764063+0000","last_active":"2024-08-09T00:35:57.815161+0000","last_peered":"2024-08-09T00:35:57.815161+0000","last_clean":"2024-08-09T00:35:57.815161+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:35:57.815161+0000","last_undegraded":"2024-08-09T00:35:57.815161+0000","last_fullsized":"2024-08-09T00:35:57.815161+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:02.226948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'200","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.368531+0000","last_change":"2024-08-08T23:28:24.820523+0000","last_active":"2024-08-09T00:40:30.368531+0000","last_peered":"2024-08-09T00:40:30.368531+0000","last_clean":"2024-08-09T00:40:30.368531+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:40:30.368531+0000","last_undegraded":"2024-08-09T00:40:30.368531+0000","last_fullsized":"2024-08-09T00:40:30.368531+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:09.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568643,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":448,"num_read_kb":38040,"num_write":1155,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:54.879381+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:38:54.879381+0000","last_peered":"2024-08-09T00:38:54.879381+0000","last_clean":"2024-08-09T00:38:54.879381+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:38:54.879381+0000","last_undegraded":"2024-08-09T00:38:54.879381+0000","last_fullsized":"2024-08-09T00:38:54.879381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:03.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'215","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.418923+0000","last_change":"2024-08-08T23:29:01.888800+0000","last_active":"2024-08-09T00:40:30.418923+0000","last_peered":"2024-08-09T00:40:30.418923+0000","last_clean":"2024-08-09T00:40:30.418923+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:40:30.418923+0000","last_undegraded":"2024-08-09T00:40:30.418923+0000","last_fullsized":"2024-08-09T00:40:30.418923+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:13.683511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8746313,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":21778,"num_write":1217,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:37.825152+0000","last_change":"2024-08-08T23:28:26.768598+0000","last_active":"2024-08-09T00:36:37.825152+0000","last_peered":"2024-08-09T00:36:37.825152+0000","last_clean":"2024-08-09T00:36:37.825152+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:36:37.825152+0000","last_undegraded":"2024-08-09T00:36:37.825152+0000","last_fullsized":"2024-08-09T00:36:37.825152+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:56:38.114726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'189","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.611742+0000","last_change":"2024-08-08T23:28:24.817326+0000","last_active":"2024-08-09T00:40:30.611742+0000","last_peered":"2024-08-09T00:40:30.611742+0000","last_clean":"2024-08-09T00:40:30.611742+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:40:30.611742+0000","last_undegraded":"2024-08-09T00:40:30.611742+0000","last_fullsized":"2024-08-09T00:40:30.611742+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:00.886762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49415,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":54098,"num_write":1119,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833361+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:37:12.833361+0000","last_peered":"2024-08-09T00:37:12.833361+0000","last_clean":"2024-08-09T00:37:12.833361+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:37:12.833361+0000","last_undegraded":"2024-08-09T00:37:12.833361+0000","last_fullsized":"2024-08-09T00:37:12.833361+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:31.362319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'197","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.433296+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:40:30.433296+0000","last_peered":"2024-08-09T00:40:30.433296+0000","last_clean":"2024-08-09T00:40:30.433296+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:40:30.433296+0000","last_undegraded":"2024-08-09T00:40:30.433296+0000","last_fullsized":"2024-08-09T00:40:30.433296+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:11.097799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743987,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":11259,"num_write":1113,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'106","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:23.806748+0000","last_change":"2024-08-08T23:28:26.777046+0000","last_active":"2024-08-09T00:38:23.806748+0000","last_peered":"2024-08-09T00:38:23.806748+0000","last_clean":"2024-08-09T00:38:23.806748+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:38:23.806748+0000","last_undegraded":"2024-08-09T00:38:23.806748+0000","last_fullsized":"2024-08-09T00:38:23.806748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:14.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'155","reported_seq":788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.576562+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:40:30.576562+0000","last_peered":"2024-08-09T00:40:30.576562+0000","last_clean":"2024-08-09T00:40:30.576562+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:40:30.576562+0000","last_undegraded":"2024-08-09T00:40:30.576562+0000","last_fullsized":"2024-08-09T00:40:30.576562+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:02:01.420135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":32780,"num_write":887,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'208","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.836345+0000","last_change":"2024-08-08T23:28:26.768844+0000","last_active":"2024-08-09T00:37:12.836345+0000","last_peered":"2024-08-09T00:37:12.836345+0000","last_clean":"2024-08-09T00:37:12.836345+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:37:12.836345+0000","last_undegraded":"2024-08-09T00:37:12.836345+0000","last_fullsized":"2024-08-09T00:37:12.836345+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:09.349357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'33","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817514+0000","last_change":"2024-08-08T23:28:26.764534+0000","last_active":"2024-08-09T00:36:07.817514+0000","last_peered":"2024-08-09T00:36:07.817514+0000","last_clean":"2024-08-09T00:36:07.817514+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:36:07.817514+0000","last_undegraded":"2024-08-09T00:36:07.817514+0000","last_fullsized":"2024-08-09T00:36:07.817514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:18.335354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'172","reported_seq":781,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.387289+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:40:30.387289+0000","last_peered":"2024-08-09T00:40:30.387289+0000","last_clean":"2024-08-09T00:40:30.387289+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:40:30.387289+0000","last_undegraded":"2024-08-09T00:40:30.387289+0000","last_fullsized":"2024-08-09T00:40:30.387289+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:16.221071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":8171,"num_write":1047,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.844698+0000","last_change":"2024-08-08T23:28:26.784260+0000","last_active":"2024-08-09T00:36:07.844698+0000","last_peered":"2024-08-09T00:36:07.844698+0000","last_clean":"2024-08-09T00:36:07.844698+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:36:07.844698+0000","last_undegraded":"2024-08-09T00:36:07.844698+0000","last_fullsized":"2024-08-09T00:36:07.844698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:39:01.299632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'198","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.423617+0000","last_change":"2024-08-08T23:29:01.887779+0000","last_active":"2024-08-09T00:40:30.423617+0000","last_peered":"2024-08-09T00:40:30.423617+0000","last_clean":"2024-08-09T00:40:30.423617+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:40:30.423617+0000","last_undegraded":"2024-08-09T00:40:30.423617+0000","last_fullsized":"2024-08-09T00:40:30.423617+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:42.436187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":6729,"num_write":999,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.006860+0000","last_change":"2024-08-08T23:28:26.788985+0000","last_active":"2024-08-09T00:38:30.006860+0000","last_peered":"2024-08-09T00:38:30.006860+0000","last_clean":"2024-08-09T00:38:30.006860+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:38:30.006860+0000","last_undegraded":"2024-08-09T00:38:30.006860+0000","last_fullsized":"2024-08-09T00:38:30.006860+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:17:32.725693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'246","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.356712+0000","last_change":"2024-08-08T23:28:24.818699+0000","last_active":"2024-08-09T00:40:30.356712+0000","last_peered":"2024-08-09T00:40:30.356712+0000","last_clean":"2024-08-09T00:40:30.356712+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:40:30.356712+0000","last_undegraded":"2024-08-09T00:40:30.356712+0000","last_fullsized":"2024-08-09T00:40:30.356712+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:59:40.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":13197,"num_write":1122,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'21","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823766+0000","last_change":"2024-08-08T23:28:26.768040+0000","last_active":"2024-08-09T00:36:07.823766+0000","last_peered":"2024-08-09T00:36:07.823766+0000","last_clean":"2024-08-09T00:36:07.823766+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:36:07.823766+0000","last_undegraded":"2024-08-09T00:36:07.823766+0000","last_fullsized":"2024-08-09T00:36:07.823766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:37.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'176","reported_seq":769,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.646657+0000","last_change":"2024-08-08T23:29:01.581302+0000","last_active":"2024-08-09T00:40:30.646657+0000","last_peered":"2024-08-09T00:40:30.646657+0000","last_clean":"2024-08-09T00:40:30.646657+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:40:30.646657+0000","last_undegraded":"2024-08-09T00:40:30.646657+0000","last_fullsized":"2024-08-09T00:40:30.646657+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:24.899484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":29619,"num_write":952,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.823828+0000","last_change":"2024-08-08T23:28:26.771260+0000","last_active":"2024-08-09T00:36:07.823828+0000","last_peered":"2024-08-09T00:36:07.823828+0000","last_clean":"2024-08-09T00:36:07.823828+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:36:07.823828+0000","last_undegraded":"2024-08-09T00:36:07.823828+0000","last_fullsized":"2024-08-09T00:36:07.823828+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:20:43.254989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'166","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.347481+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:40:30.347481+0000","last_peered":"2024-08-09T00:40:30.347481+0000","last_clean":"2024-08-09T00:40:30.347481+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:40:30.347481+0000","last_undegraded":"2024-08-09T00:40:30.347481+0000","last_fullsized":"2024-08-09T00:40:30.347481+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:25:13.214512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146116,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":37287,"num_write":965,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817822+0000","last_change":"2024-08-08T23:28:26.767880+0000","last_active":"2024-08-09T00:36:07.817822+0000","last_peered":"2024-08-09T00:36:07.817822+0000","last_clean":"2024-08-09T00:36:07.817822+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:36:07.817822+0000","last_undegraded":"2024-08-09T00:36:07.817822+0000","last_fullsized":"2024-08-09T00:36:07.817822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:43:28.316031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'222","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.628020+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:40:30.628020+0000","last_peered":"2024-08-09T00:40:30.628020+0000","last_clean":"2024-08-09T00:40:30.628020+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:40:30.628020+0000","last_undegraded":"2024-08-09T00:40:30.628020+0000","last_fullsized":"2024-08-09T00:40:30.628020+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:57:29.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":428,"num_read_kb":738,"num_write":1172,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.385719+0000","last_change":"2024-08-08T23:28:34.831960+0000","last_active":"2024-08-09T00:39:54.385719+0000","last_peered":"2024-08-09T00:39:54.385719+0000","last_clean":"2024-08-09T00:39:54.385719+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:39:54.385719+0000","last_undegraded":"2024-08-09T00:39:54.385719+0000","last_fullsized":"2024-08-09T00:39:54.385719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:01:36.286772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:28.137781+0000","last_change":"2024-08-08T23:29:01.588729+0000","last_active":"2024-08-09T00:37:28.137781+0000","last_peered":"2024-08-09T00:37:28.137781+0000","last_clean":"2024-08-09T00:37:28.137781+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:37:28.137781+0000","last_undegraded":"2024-08-09T00:37:28.137781+0000","last_fullsized":"2024-08-09T00:37:28.137781+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:04.343684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'178","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.461812+0000","last_change":"2024-08-08T23:29:01.582685+0000","last_active":"2024-08-09T00:40:30.461812+0000","last_peered":"2024-08-09T00:40:30.461812+0000","last_clean":"2024-08-09T00:40:30.461812+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:40:30.461812+0000","last_undegraded":"2024-08-09T00:40:30.461812+0000","last_fullsized":"2024-08-09T00:40:30.461812+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:29:26.156857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":22191,"num_write":1038,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048658+0000","last_change":"2024-08-08T23:28:28.771835+0000","last_active":"2024-08-09T00:36:13.048658+0000","last_peered":"2024-08-09T00:36:13.048658+0000","last_clean":"2024-08-09T00:36:13.048658+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:36:13.048658+0000","last_undegraded":"2024-08-09T00:36:13.048658+0000","last_fullsized":"2024-08-09T00:36:13.048658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'220","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.545944+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:40:30.545944+0000","last_peered":"2024-08-09T00:40:30.545944+0000","last_clean":"2024-08-09T00:40:30.545944+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:40:30.545944+0000","last_undegraded":"2024-08-09T00:40:30.545944+0000","last_fullsized":"2024-08-09T00:40:30.545944+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:08:57.234564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":290,"num_write":170,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846496+0000","last_change":"2024-08-08T23:28:32.817763+0000","last_active":"2024-08-09T00:36:12.846496+0000","last_peered":"2024-08-09T00:36:12.846496+0000","last_clean":"2024-08-09T00:36:12.846496+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:36:12.846496+0000","last_undegraded":"2024-08-09T00:36:12.846496+0000","last_fullsized":"2024-08-09T00:36:12.846496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:21:08.427418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2399","reported_seq":4282,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.107418+0000","last_change":"2024-08-08T23:28:34.824612+0000","last_active":"2024-08-09T00:39:54.107418+0000","last_peered":"2024-08-09T00:39:54.107418+0000","last_clean":"2024-08-09T00:39:54.107418+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:39:54.107418+0000","last_undegraded":"2024-08-09T00:39:54.107418+0000","last_fullsized":"2024-08-09T00:39:54.107418+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":2300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:14:35.095843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:08.047473+0000","last_change":"2024-08-08T23:28:26.791324+0000","last_active":"2024-08-09T00:36:08.047473+0000","last_peered":"2024-08-09T00:36:08.047473+0000","last_clean":"2024-08-09T00:36:08.047473+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:36:08.047473+0000","last_undegraded":"2024-08-09T00:36:08.047473+0000","last_fullsized":"2024-08-09T00:36:08.047473+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:25:56.405552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'184","reported_seq":804,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.440140+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:40:30.440140+0000","last_peered":"2024-08-09T00:40:30.440140+0000","last_clean":"2024-08-09T00:40:30.440140+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:40:30.440140+0000","last_undegraded":"2024-08-09T00:40:30.440140+0000","last_fullsized":"2024-08-09T00:40:30.440140+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:27:48.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311673,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":392,"num_read_kb":16280,"num_write":970,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.649204+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:36:27.649204+0000","last_peered":"2024-08-09T00:36:27.649204+0000","last_clean":"2024-08-09T00:36:27.649204+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:36:27.649204+0000","last_undegraded":"2024-08-09T00:36:27.649204+0000","last_fullsized":"2024-08-09T00:36:27.649204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:59.953494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.254771+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:39:11.254771+0000","last_peered":"2024-08-09T00:39:11.254771+0000","last_clean":"2024-08-09T00:39:11.254771+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:39:11.254771+0000","last_undegraded":"2024-08-09T00:39:11.254771+0000","last_fullsized":"2024-08-09T00:39:11.254771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:58:11.384265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819027+0000","last_change":"2024-08-08T23:28:32.826736+0000","last_active":"2024-08-09T00:36:12.819027+0000","last_peered":"2024-08-09T00:36:12.819027+0000","last_clean":"2024-08-09T00:36:12.819027+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:36:12.819027+0000","last_undegraded":"2024-08-09T00:36:12.819027+0000","last_fullsized":"2024-08-09T00:36:12.819027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:45:43.822368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'134","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.448507+0000","last_change":"2024-08-08T23:28:34.836179+0000","last_active":"2024-08-09T00:39:52.448507+0000","last_peered":"2024-08-09T00:39:52.448507+0000","last_clean":"2024-08-09T00:39:52.448507+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:39:52.448507+0000","last_undegraded":"2024-08-09T00:39:52.448507+0000","last_fullsized":"2024-08-09T00:39:52.448507+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:00:42.899329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:24.902450+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:36:24.902450+0000","last_peered":"2024-08-09T00:36:24.902450+0000","last_clean":"2024-08-09T00:36:24.902450+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:36:24.902450+0000","last_undegraded":"2024-08-09T00:36:24.902450+0000","last_fullsized":"2024-08-09T00:36:24.902450+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:07:42.497596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'232","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.605223+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:40:30.605223+0000","last_peered":"2024-08-09T00:40:30.605223+0000","last_clean":"2024-08-09T00:40:30.605223+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:40:30.605223+0000","last_undegraded":"2024-08-09T00:40:30.605223+0000","last_fullsized":"2024-08-09T00:40:30.605223+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:42:05.542806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":26858,"num_write":1144,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645614+0000","last_change":"2024-08-08T23:28:28.771848+0000","last_active":"2024-08-09T00:36:12.645614+0000","last_peered":"2024-08-09T00:36:12.645614+0000","last_clean":"2024-08-09T00:36:12.645614+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:36:12.645614+0000","last_undegraded":"2024-08-09T00:36:12.645614+0000","last_fullsized":"2024-08-09T00:36:12.645614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:28.078906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'147","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.365433+0000","last_change":"2024-08-08T23:28:30.779574+0000","last_active":"2024-08-09T00:39:11.365433+0000","last_peered":"2024-08-09T00:39:11.365433+0000","last_clean":"2024-08-09T00:39:11.365433+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:39:11.365433+0000","last_undegraded":"2024-08-09T00:39:11.365433+0000","last_fullsized":"2024-08-09T00:39:11.365433+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:33:41.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'514","reported_seq":2619,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.456511+0000","last_change":"2024-08-08T23:28:32.809653+0000","last_active":"2024-08-09T00:40:30.456511+0000","last_peered":"2024-08-09T00:40:30.456511+0000","last_clean":"2024-08-09T00:40:30.456511+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:40:30.456511+0000","last_undegraded":"2024-08-09T00:40:30.456511+0000","last_fullsized":"2024-08-09T00:40:30.456511+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:24:46.048044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'202","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.763064+0000","last_change":"2024-08-08T23:28:34.809979+0000","last_active":"2024-08-09T00:39:52.763064+0000","last_peered":"2024-08-09T00:39:52.763064+0000","last_clean":"2024-08-09T00:39:52.763064+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:39:52.763064+0000","last_undegraded":"2024-08-09T00:39:52.763064+0000","last_fullsized":"2024-08-09T00:39:52.763064+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:31.899889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'197","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644339+0000","last_change":"2024-08-08T23:28:26.776218+0000","last_active":"2024-08-09T00:36:07.644339+0000","last_peered":"2024-08-09T00:36:07.644339+0000","last_clean":"2024-08-09T00:36:07.644339+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:36:07.644339+0000","last_undegraded":"2024-08-09T00:36:07.644339+0000","last_fullsized":"2024-08-09T00:36:07.644339+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:48.787304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'184","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.613771+0000","last_change":"2024-08-08T23:28:24.782432+0000","last_active":"2024-08-09T00:40:30.613771+0000","last_peered":"2024-08-09T00:40:30.613771+0000","last_clean":"2024-08-09T00:40:30.613771+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:40:30.613771+0000","last_undegraded":"2024-08-09T00:40:30.613771+0000","last_fullsized":"2024-08-09T00:40:30.613771+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:18.496718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":349,"num_read_kb":11144,"num_write":998,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.048748+0000","last_change":"2024-08-08T23:28:28.772715+0000","last_active":"2024-08-09T00:36:13.048748+0000","last_peered":"2024-08-09T00:36:13.048748+0000","last_clean":"2024-08-09T00:36:13.048748+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:36:13.048748+0000","last_undegraded":"2024-08-09T00:36:13.048748+0000","last_fullsized":"2024-08-09T00:36:13.048748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:38.667154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'147","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.500465+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:40:30.500465+0000","last_peered":"2024-08-09T00:40:30.500465+0000","last_clean":"2024-08-09T00:40:30.500465+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:40:30.500465+0000","last_undegraded":"2024-08-09T00:40:30.500465+0000","last_fullsized":"2024-08-09T00:40:30.500465+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:25:51.738224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":269,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'525","reported_seq":2426,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.092965+0000","last_change":"2024-08-08T23:28:32.811070+0000","last_active":"2024-08-09T00:40:30.092965+0000","last_peered":"2024-08-09T00:40:30.092965+0000","last_clean":"2024-08-09T00:40:30.092965+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:40:30.092965+0000","last_undegraded":"2024-08-09T00:40:30.092965+0000","last_fullsized":"2024-08-09T00:40:30.092965+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:13.801094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.775798+0000","last_change":"2024-08-08T23:28:26.793556+0000","last_active":"2024-08-09T00:38:37.775798+0000","last_peered":"2024-08-09T00:38:37.775798+0000","last_clean":"2024-08-09T00:38:37.775798+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:38:37.775798+0000","last_undegraded":"2024-08-09T00:38:37.775798+0000","last_fullsized":"2024-08-09T00:38:37.775798+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:58:15.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'202","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.418002+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:40:30.418002+0000","last_peered":"2024-08-09T00:40:30.418002+0000","last_clean":"2024-08-09T00:40:30.418002+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:40:30.418002+0000","last_undegraded":"2024-08-09T00:40:30.418002+0000","last_fullsized":"2024-08-09T00:40:30.418002+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:39.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":38000,"num_write":1175,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.868934+0000","last_change":"2024-08-08T23:28:28.785365+0000","last_active":"2024-08-09T00:37:52.868934+0000","last_peered":"2024-08-09T00:37:52.868934+0000","last_clean":"2024-08-09T00:37:52.868934+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:37:52.868934+0000","last_undegraded":"2024-08-09T00:37:52.868934+0000","last_fullsized":"2024-08-09T00:37:52.868934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:37.826252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'267","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.590668+0000","last_change":"2024-08-08T23:28:31.043616+0000","last_active":"2024-08-09T00:40:30.590668+0000","last_peered":"2024-08-09T00:40:30.590668+0000","last_clean":"2024-08-09T00:40:30.590668+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:40:30.590668+0000","last_undegraded":"2024-08-09T00:40:30.590668+0000","last_fullsized":"2024-08-09T00:40:30.590668+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:10:22.767945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":369,"num_read_kb":429,"num_write":224,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.856410+0000","last_change":"2024-08-08T23:28:32.806513+0000","last_active":"2024-08-09T00:38:17.856410+0000","last_peered":"2024-08-09T00:38:17.856410+0000","last_clean":"2024-08-09T00:38:17.856410+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:38:17.856410+0000","last_undegraded":"2024-08-09T00:38:17.856410+0000","last_fullsized":"2024-08-09T00:38:17.856410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:39:46.925794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'551","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.923595+0000","last_change":"2024-08-08T23:28:34.840230+0000","last_active":"2024-08-09T00:39:58.923595+0000","last_peered":"2024-08-09T00:39:58.923595+0000","last_clean":"2024-08-09T00:39:58.923595+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:39:58.923595+0000","last_undegraded":"2024-08-09T00:39:58.923595+0000","last_fullsized":"2024-08-09T00:39:58.923595+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:31:37.941097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4315","reported_seq":4942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.368667+0000","last_change":"2024-08-08T23:28:26.754321+0000","last_active":"2024-08-09T00:39:09.368667+0000","last_peered":"2024-08-09T00:39:09.368667+0000","last_clean":"2024-08-09T00:39:09.368667+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:39:09.368667+0000","last_undegraded":"2024-08-09T00:39:09.368667+0000","last_fullsized":"2024-08-09T00:39:09.368667+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:13.192471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'233","reported_seq":1093,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.485533+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:40:30.485533+0000","last_peered":"2024-08-09T00:40:30.485533+0000","last_clean":"2024-08-09T00:40:30.485533+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:40:30.485533+0000","last_undegraded":"2024-08-09T00:40:30.485533+0000","last_fullsized":"2024-08-09T00:40:30.485533+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:53.700576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1254,"num_read_kb":40415,"num_write":1272,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843723+0000","last_change":"2024-08-08T23:28:28.772465+0000","last_active":"2024-08-09T00:37:52.843723+0000","last_peered":"2024-08-09T00:37:52.843723+0000","last_clean":"2024-08-09T00:37:52.843723+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:37:52.843723+0000","last_undegraded":"2024-08-09T00:37:52.843723+0000","last_fullsized":"2024-08-09T00:37:52.843723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:08.165167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'146","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.381419+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:40:30.381419+0000","last_peered":"2024-08-09T00:40:30.381419+0000","last_clean":"2024-08-09T00:40:30.381419+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:40:30.381419+0000","last_undegraded":"2024-08-09T00:40:30.381419+0000","last_fullsized":"2024-08-09T00:40:30.381419+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:47.333462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5295,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":256,"num_write":102,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:07.671591+0000","last_change":"2024-08-08T23:28:32.799931+0000","last_active":"2024-08-09T00:38:07.671591+0000","last_peered":"2024-08-09T00:38:07.671591+0000","last_clean":"2024-08-09T00:38:07.671591+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:38:07.671591+0000","last_undegraded":"2024-08-09T00:38:07.671591+0000","last_fullsized":"2024-08-09T00:38:07.671591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:18.351011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'95","reported_seq":601,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.839035+0000","last_change":"2024-08-08T23:28:34.829500+0000","last_active":"2024-08-09T00:37:32.839035+0000","last_peered":"2024-08-09T00:37:32.839035+0000","last_clean":"2024-08-09T00:37:32.839035+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:37:32.839035+0000","last_undegraded":"2024-08-09T00:37:32.839035+0000","last_fullsized":"2024-08-09T00:37:32.839035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:50.511772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'226","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:09.757893+0000","last_change":"2024-08-08T23:28:26.774608+0000","last_active":"2024-08-09T00:38:09.757893+0000","last_peered":"2024-08-09T00:38:09.757893+0000","last_clean":"2024-08-09T00:38:09.757893+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:38:09.757893+0000","last_undegraded":"2024-08-09T00:38:09.757893+0000","last_fullsized":"2024-08-09T00:38:09.757893+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:00:42.181061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'160","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.324944+0000","last_change":"2024-08-08T23:28:24.823026+0000","last_active":"2024-08-09T00:40:30.324944+0000","last_peered":"2024-08-09T00:40:30.324944+0000","last_clean":"2024-08-09T00:40:30.324944+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:40:30.324944+0000","last_undegraded":"2024-08-09T00:40:30.324944+0000","last_fullsized":"2024-08-09T00:40:30.324944+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:44.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317190,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":142181,"num_write":944,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.849253+0000","last_change":"2024-08-08T23:28:28.775239+0000","last_active":"2024-08-09T00:38:17.849253+0000","last_peered":"2024-08-09T00:38:17.849253+0000","last_clean":"2024-08-09T00:38:17.849253+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:38:17.849253+0000","last_undegraded":"2024-08-09T00:38:17.849253+0000","last_fullsized":"2024-08-09T00:38:17.849253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:13:33.333304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'211","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.622054+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:40:30.622054+0000","last_peered":"2024-08-09T00:40:30.622054+0000","last_clean":"2024-08-09T00:40:30.622054+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:40:30.622054+0000","last_undegraded":"2024-08-09T00:40:30.622054+0000","last_fullsized":"2024-08-09T00:40:30.622054+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:08.571641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":290,"num_read_kb":376,"num_write":174,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'509","reported_seq":4397,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.095813+0000","last_change":"2024-08-08T23:28:32.823537+0000","last_active":"2024-08-09T00:40:30.095813+0000","last_peered":"2024-08-09T00:40:30.095813+0000","last_clean":"2024-08-09T00:40:30.095813+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:30.095813+0000","last_undegraded":"2024-08-09T00:40:30.095813+0000","last_fullsized":"2024-08-09T00:40:30.095813+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:09:05.891948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'109","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.861091+0000","last_change":"2024-08-08T23:28:34.837367+0000","last_active":"2024-08-09T00:39:19.861091+0000","last_peered":"2024-08-09T00:39:19.861091+0000","last_clean":"2024-08-09T00:39:19.861091+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:39:19.861091+0000","last_undegraded":"2024-08-09T00:39:19.861091+0000","last_fullsized":"2024-08-09T00:39:19.861091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:08.993869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843304+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:38:12.843304+0000","last_peered":"2024-08-09T00:38:12.843304+0000","last_clean":"2024-08-09T00:38:12.843304+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:38:12.843304+0000","last_undegraded":"2024-08-09T00:38:12.843304+0000","last_fullsized":"2024-08-09T00:38:12.843304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:37:06.665341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'251","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.649290+0000","last_change":"2024-08-08T23:28:24.819082+0000","last_active":"2024-08-09T00:40:30.649290+0000","last_peered":"2024-08-09T00:40:30.649290+0000","last_clean":"2024-08-09T00:40:30.649290+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:40:30.649290+0000","last_undegraded":"2024-08-09T00:40:30.649290+0000","last_fullsized":"2024-08-09T00:40:30.649290+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:51:31.096067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":20334,"num_write":1169,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"37'3","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:29.818745+0000","last_change":"2024-08-08T23:28:28.779663+0000","last_active":"2024-08-09T00:40:29.818745+0000","last_peered":"2024-08-09T00:40:29.818745+0000","last_clean":"2024-08-09T00:40:29.818745+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:40:29.818745+0000","last_undegraded":"2024-08-09T00:40:29.818745+0000","last_fullsized":"2024-08-09T00:40:29.818745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:47:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":486,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'252","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.640012+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:40:30.640012+0000","last_peered":"2024-08-09T00:40:30.640012+0000","last_clean":"2024-08-09T00:40:30.640012+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:40:30.640012+0000","last_undegraded":"2024-08-09T00:40:30.640012+0000","last_fullsized":"2024-08-09T00:40:30.640012+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:59.690242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41629,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":626,"num_write":204,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843661+0000","last_change":"2024-08-08T23:28:32.808451+0000","last_active":"2024-08-09T00:37:52.843661+0000","last_peered":"2024-08-09T00:37:52.843661+0000","last_clean":"2024-08-09T00:37:52.843661+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:37:52.843661+0000","last_undegraded":"2024-08-09T00:37:52.843661+0000","last_fullsized":"2024-08-09T00:37:52.843661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:52:53.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'102","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:30.011905+0000","last_change":"2024-08-08T23:28:34.833803+0000","last_active":"2024-08-09T00:38:30.011905+0000","last_peered":"2024-08-09T00:38:30.011905+0000","last_clean":"2024-08-09T00:38:30.011905+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:38:30.011905+0000","last_undegraded":"2024-08-09T00:38:30.011905+0000","last_fullsized":"2024-08-09T00:38:30.011905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:59:23.748669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849839+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:38:12.849839+0000","last_peered":"2024-08-09T00:38:12.849839+0000","last_clean":"2024-08-09T00:38:12.849839+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:38:12.849839+0000","last_undegraded":"2024-08-09T00:38:12.849839+0000","last_fullsized":"2024-08-09T00:38:12.849839+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:55:09.973740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'169","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.324130+0000","last_change":"2024-08-08T23:30:01.784156+0000","last_active":"2024-08-09T00:40:30.324130+0000","last_peered":"2024-08-09T00:40:30.324130+0000","last_clean":"2024-08-09T00:40:30.324130+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:40:30.324130+0000","last_undegraded":"2024-08-09T00:40:30.324130+0000","last_fullsized":"2024-08-09T00:40:30.324130+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:26.083283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055036,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":365,"num_read_kb":5320,"num_write":980,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.849352+0000","last_change":"2024-08-08T23:28:28.780395+0000","last_active":"2024-08-09T00:38:17.849352+0000","last_peered":"2024-08-09T00:38:17.849352+0000","last_clean":"2024-08-09T00:38:17.849352+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:38:17.849352+0000","last_undegraded":"2024-08-09T00:38:17.849352+0000","last_fullsized":"2024-08-09T00:38:17.849352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:52.579128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'174","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.435988+0000","last_change":"2024-08-08T23:28:30.784352+0000","last_active":"2024-08-09T00:40:30.435988+0000","last_peered":"2024-08-09T00:40:30.435988+0000","last_clean":"2024-08-09T00:40:30.435988+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:40:30.435988+0000","last_undegraded":"2024-08-09T00:40:30.435988+0000","last_fullsized":"2024-08-09T00:40:30.435988+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:59:35.310017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8780,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":256,"num_read_kb":313,"num_write":192,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:17.818266+0000","last_change":"2024-08-08T23:28:32.827076+0000","last_active":"2024-08-09T00:36:17.818266+0000","last_peered":"2024-08-09T00:36:17.818266+0000","last_clean":"2024-08-09T00:36:17.818266+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:36:17.818266+0000","last_undegraded":"2024-08-09T00:36:17.818266+0000","last_fullsized":"2024-08-09T00:36:17.818266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.028693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'134","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:09.323973+0000","last_change":"2024-08-08T23:28:34.836409+0000","last_active":"2024-08-09T00:39:09.323973+0000","last_peered":"2024-08-09T00:39:09.323973+0000","last_clean":"2024-08-09T00:39:09.323973+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:39:09.323973+0000","last_undegraded":"2024-08-09T00:39:09.323973+0000","last_fullsized":"2024-08-09T00:39:09.323973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:52:23.979940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'185","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849875+0000","last_change":"2024-08-08T23:28:26.768527+0000","last_active":"2024-08-09T00:38:12.849875+0000","last_peered":"2024-08-09T00:38:12.849875+0000","last_clean":"2024-08-09T00:38:12.849875+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:38:12.849875+0000","last_undegraded":"2024-08-09T00:38:12.849875+0000","last_fullsized":"2024-08-09T00:38:12.849875+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:49:57.863036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'205","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:07.875971+0000","last_change":"2024-08-08T23:28:24.767491+0000","last_active":"2024-08-09T00:40:07.875971+0000","last_peered":"2024-08-09T00:40:07.875971+0000","last_clean":"2024-08-09T00:40:07.875971+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:40:07.875971+0000","last_undegraded":"2024-08-09T00:40:07.875971+0000","last_fullsized":"2024-08-09T00:40:07.875971+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:24:23.880570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":34331,"num_write":1087,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.856466+0000","last_change":"2024-08-08T23:28:28.777081+0000","last_active":"2024-08-09T00:38:17.856466+0000","last_peered":"2024-08-09T00:38:17.856466+0000","last_clean":"2024-08-09T00:38:17.856466+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:38:17.856466+0000","last_undegraded":"2024-08-09T00:38:17.856466+0000","last_fullsized":"2024-08-09T00:38:17.856466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:29.639169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'198","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.331340+0000","last_change":"2024-08-08T23:28:30.783664+0000","last_active":"2024-08-09T00:40:30.331340+0000","last_peered":"2024-08-09T00:40:30.331340+0000","last_clean":"2024-08-09T00:40:30.331340+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:40:30.331340+0000","last_undegraded":"2024-08-09T00:40:30.331340+0000","last_fullsized":"2024-08-09T00:40:30.331340+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:54:08.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14461,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":384,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'493","reported_seq":2258,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.661191+0000","last_change":"2024-08-08T23:28:32.806321+0000","last_active":"2024-08-09T00:40:30.661191+0000","last_peered":"2024-08-09T00:40:30.661191+0000","last_clean":"2024-08-09T00:40:30.661191+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:40:30.661191+0000","last_undegraded":"2024-08-09T00:40:30.661191+0000","last_fullsized":"2024-08-09T00:40:30.661191+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:35:07.612864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.871072+0000","last_change":"2024-08-08T23:28:34.837840+0000","last_active":"2024-08-09T00:39:27.871072+0000","last_peered":"2024-08-09T00:39:27.871072+0000","last_clean":"2024-08-09T00:39:27.871072+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:39:27.871072+0000","last_undegraded":"2024-08-09T00:39:27.871072+0000","last_fullsized":"2024-08-09T00:39:27.871072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:51.523658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849903+0000","last_change":"2024-08-08T23:28:26.779476+0000","last_active":"2024-08-09T00:38:12.849903+0000","last_peered":"2024-08-09T00:38:12.849903+0000","last_clean":"2024-08-09T00:38:12.849903+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:38:12.849903+0000","last_undegraded":"2024-08-09T00:38:12.849903+0000","last_fullsized":"2024-08-09T00:38:12.849903+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:31:06.993378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'205","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.480066+0000","last_change":"2024-08-08T23:28:24.790265+0000","last_active":"2024-08-09T00:40:30.480066+0000","last_peered":"2024-08-09T00:40:30.480066+0000","last_clean":"2024-08-09T00:40:30.480066+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:40:30.480066+0000","last_undegraded":"2024-08-09T00:40:30.480066+0000","last_fullsized":"2024-08-09T00:40:30.480066+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:21.811375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":23703,"num_write":1091,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:29.831021+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:40:29.831021+0000","last_peered":"2024-08-09T00:40:29.831021+0000","last_clean":"2024-08-09T00:40:29.831021+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:40:29.831021+0000","last_undegraded":"2024-08-09T00:40:29.831021+0000","last_fullsized":"2024-08-09T00:40:29.831021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:45.142309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":638,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'105","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.110641+0000","last_change":"2024-08-08T23:28:31.048124+0000","last_active":"2024-08-09T00:39:11.110641+0000","last_peered":"2024-08-09T00:39:11.110641+0000","last_clean":"2024-08-09T00:39:11.110641+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:39:11.110641+0000","last_undegraded":"2024-08-09T00:39:11.110641+0000","last_fullsized":"2024-08-09T00:39:11.110641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:47:38.686500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'500","reported_seq":2261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.662669+0000","last_change":"2024-08-08T23:28:32.814344+0000","last_active":"2024-08-09T00:40:30.662669+0000","last_peered":"2024-08-09T00:40:30.662669+0000","last_clean":"2024-08-09T00:40:30.662669+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:40:30.662669+0000","last_undegraded":"2024-08-09T00:40:30.662669+0000","last_fullsized":"2024-08-09T00:40:30.662669+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:20.130194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836068+0000","last_change":"2024-08-08T23:28:34.832392+0000","last_active":"2024-08-09T00:37:22.836068+0000","last_peered":"2024-08-09T00:37:22.836068+0000","last_clean":"2024-08-09T00:37:22.836068+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:37:22.836068+0000","last_undegraded":"2024-08-09T00:37:22.836068+0000","last_fullsized":"2024-08-09T00:37:22.836068+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:53:39.542207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'461","reported_seq":1174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831471+0000","last_change":"2024-08-08T23:28:26.762100+0000","last_active":"2024-08-09T00:36:12.831471+0000","last_peered":"2024-08-09T00:36:12.831471+0000","last_clean":"2024-08-09T00:36:12.831471+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:36:12.831471+0000","last_undegraded":"2024-08-09T00:36:12.831471+0000","last_fullsized":"2024-08-09T00:36:12.831471+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:31:41.700529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'181","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.488530+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:40:30.488530+0000","last_peered":"2024-08-09T00:40:30.488530+0000","last_clean":"2024-08-09T00:40:30.488530+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:40:30.488530+0000","last_undegraded":"2024-08-09T00:40:30.488530+0000","last_fullsized":"2024-08-09T00:40:30.488530+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:55.568959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":4543,"num_write":1045,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.851245+0000","last_change":"2024-08-08T23:28:28.778804+0000","last_active":"2024-08-09T00:38:17.851245+0000","last_peered":"2024-08-09T00:38:17.851245+0000","last_clean":"2024-08-09T00:38:17.851245+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:38:17.851245+0000","last_undegraded":"2024-08-09T00:38:17.851245+0000","last_fullsized":"2024-08-09T00:38:17.851245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:09:24.525056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'303","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.557621+0000","last_change":"2024-08-08T23:28:30.776772+0000","last_active":"2024-08-09T00:40:30.557621+0000","last_peered":"2024-08-09T00:40:30.557621+0000","last_clean":"2024-08-09T00:40:30.557621+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:40:30.557621+0000","last_undegraded":"2024-08-09T00:40:30.557621+0000","last_fullsized":"2024-08-09T00:40:30.557621+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:54.049825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":996,"num_read_kb":1052,"num_write":1534,"num_write_kb":1360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:17.851226+0000","last_change":"2024-08-08T23:28:32.821436+0000","last_active":"2024-08-09T00:38:17.851226+0000","last_peered":"2024-08-09T00:38:17.851226+0000","last_clean":"2024-08-09T00:38:17.851226+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:38:17.851226+0000","last_undegraded":"2024-08-09T00:38:17.851226+0000","last_fullsized":"2024-08-09T00:38:17.851226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:21:40.233740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'102","reported_seq":609,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.944405+0000","last_change":"2024-08-08T23:28:34.822628+0000","last_active":"2024-08-09T00:39:51.944405+0000","last_peered":"2024-08-09T00:39:51.944405+0000","last_clean":"2024-08-09T00:39:51.944405+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:39:51.944405+0000","last_undegraded":"2024-08-09T00:39:51.944405+0000","last_fullsized":"2024-08-09T00:39:51.944405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:13.362222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:22.836399+0000","last_change":"2024-08-08T23:28:26.782849+0000","last_active":"2024-08-09T00:37:22.836399+0000","last_peered":"2024-08-09T00:37:22.836399+0000","last_clean":"2024-08-09T00:37:22.836399+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:37:22.836399+0000","last_undegraded":"2024-08-09T00:37:22.836399+0000","last_fullsized":"2024-08-09T00:37:22.836399+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:32:36.999822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.875811+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:38:22.875811+0000","last_peered":"2024-08-09T00:38:22.875811+0000","last_clean":"2024-08-09T00:38:22.875811+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:38:22.875811+0000","last_undegraded":"2024-08-09T00:38:22.875811+0000","last_fullsized":"2024-08-09T00:38:22.875811+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:35:04.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059673+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-09T00:37:03.059673+0000","last_peered":"2024-08-09T00:37:03.059673+0000","last_clean":"2024-08-09T00:37:03.059673+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:37:03.059673+0000","last_undegraded":"2024-08-09T00:37:03.059673+0000","last_fullsized":"2024-08-09T00:37:03.059673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:39.880093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'173","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.577363+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:40:30.577363+0000","last_peered":"2024-08-09T00:40:30.577363+0000","last_clean":"2024-08-09T00:40:30.577363+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:40:30.577363+0000","last_undegraded":"2024-08-09T00:40:30.577363+0000","last_fullsized":"2024-08-09T00:40:30.577363+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:08.383791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":19880,"num_write":949,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.861276+0000","last_change":"2024-08-08T23:28:28.785997+0000","last_active":"2024-08-09T00:37:17.861276+0000","last_peered":"2024-08-09T00:37:17.861276+0000","last_clean":"2024-08-09T00:37:17.861276+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:37:17.861276+0000","last_undegraded":"2024-08-09T00:37:17.861276+0000","last_fullsized":"2024-08-09T00:37:17.861276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:19.940501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'334","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.581982+0000","last_change":"2024-08-08T23:28:30.788180+0000","last_active":"2024-08-09T00:40:30.581982+0000","last_peered":"2024-08-09T00:40:30.581982+0000","last_clean":"2024-08-09T00:40:30.581982+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:40:30.581982+0000","last_undegraded":"2024-08-09T00:40:30.581982+0000","last_fullsized":"2024-08-09T00:40:30.581982+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:08.134619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":648,"num_read_kb":915,"num_write":594,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.839007+0000","last_change":"2024-08-08T23:28:32.821568+0000","last_active":"2024-08-09T00:37:52.839007+0000","last_peered":"2024-08-09T00:37:52.839007+0000","last_clean":"2024-08-09T00:37:52.839007+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:37:52.839007+0000","last_undegraded":"2024-08-09T00:37:52.839007+0000","last_fullsized":"2024-08-09T00:37:52.839007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:04:45.502986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'206","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.227768+0000","last_change":"2024-08-08T23:28:34.829682+0000","last_active":"2024-08-09T00:39:54.227768+0000","last_peered":"2024-08-09T00:39:54.227768+0000","last_clean":"2024-08-09T00:39:54.227768+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:39:54.227768+0000","last_undegraded":"2024-08-09T00:39:54.227768+0000","last_fullsized":"2024-08-09T00:39:54.227768+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:20:02.874767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'188","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:08.036140+0000","last_change":"2024-08-08T23:28:26.775022+0000","last_active":"2024-08-09T00:38:08.036140+0000","last_peered":"2024-08-09T00:38:08.036140+0000","last_clean":"2024-08-09T00:38:08.036140+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:38:08.036140+0000","last_undegraded":"2024-08-09T00:38:08.036140+0000","last_fullsized":"2024-08-09T00:38:08.036140+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:54.073153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.877188+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:38:27.877188+0000","last_peered":"2024-08-09T00:38:27.877188+0000","last_clean":"2024-08-09T00:38:27.877188+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:38:27.877188+0000","last_undegraded":"2024-08-09T00:38:27.877188+0000","last_fullsized":"2024-08-09T00:38:27.877188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:24:02.828272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'203","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.487168+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:40:30.487168+0000","last_peered":"2024-08-09T00:40:30.487168+0000","last_clean":"2024-08-09T00:40:30.487168+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:40:30.487168+0000","last_undegraded":"2024-08-09T00:40:30.487168+0000","last_fullsized":"2024-08-09T00:40:30.487168+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:09.134864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":17063,"num_write":1110,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:53.070776+0000","last_change":"2024-08-08T23:28:28.772772+0000","last_active":"2024-08-09T00:37:53.070776+0000","last_peered":"2024-08-09T00:37:53.070776+0000","last_clean":"2024-08-09T00:37:53.070776+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:37:53.070776+0000","last_undegraded":"2024-08-09T00:37:53.070776+0000","last_fullsized":"2024-08-09T00:37:53.070776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:35:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'693","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.565208+0000","last_change":"2024-08-08T23:28:30.774420+0000","last_active":"2024-08-09T00:40:30.565208+0000","last_peered":"2024-08-09T00:40:30.565208+0000","last_clean":"2024-08-09T00:40:30.565208+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:40:30.565208+0000","last_undegraded":"2024-08-09T00:40:30.565208+0000","last_fullsized":"2024-08-09T00:40:30.565208+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:41.556054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33400,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1006,"num_read_kb":1225,"num_write":322,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:27.863596+0000","last_change":"2024-08-08T23:28:32.810173+0000","last_active":"2024-08-09T00:37:27.863596+0000","last_peered":"2024-08-09T00:37:27.863596+0000","last_clean":"2024-08-09T00:37:27.863596+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:37:27.863596+0000","last_undegraded":"2024-08-09T00:37:27.863596+0000","last_fullsized":"2024-08-09T00:37:27.863596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:44.557649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'129","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.855394+0000","last_change":"2024-08-08T23:28:34.828009+0000","last_active":"2024-08-09T00:38:12.855394+0000","last_peered":"2024-08-09T00:38:12.855394+0000","last_clean":"2024-08-09T00:38:12.855394+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:38:12.855394+0000","last_undegraded":"2024-08-09T00:38:12.855394+0000","last_fullsized":"2024-08-09T00:38:12.855394+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:16:30.650076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:19.246847+0000","last_change":"2024-08-08T23:28:26.777388+0000","last_active":"2024-08-09T00:38:19.246847+0000","last_peered":"2024-08-09T00:38:19.246847+0000","last_clean":"2024-08-09T00:38:19.246847+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:38:19.246847+0000","last_undegraded":"2024-08-09T00:38:19.246847+0000","last_fullsized":"2024-08-09T00:38:19.246847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:00:11.706140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.834117+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-09T00:37:02.834117+0000","last_peered":"2024-08-09T00:37:02.834117+0000","last_clean":"2024-08-09T00:37:02.834117+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:37:02.834117+0000","last_undegraded":"2024-08-09T00:37:02.834117+0000","last_fullsized":"2024-08-09T00:37:02.834117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:58.529806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'159","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.611862+0000","last_change":"2024-08-08T23:28:24.757810+0000","last_active":"2024-08-09T00:40:30.611862+0000","last_peered":"2024-08-09T00:40:30.611862+0000","last_clean":"2024-08-09T00:40:30.611862+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:40:30.611862+0000","last_undegraded":"2024-08-09T00:40:30.611862+0000","last_fullsized":"2024-08-09T00:40:30.611862+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:24:35.709380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5883424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":29266,"num_write":862,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.843917+0000","last_change":"2024-08-08T23:28:28.775991+0000","last_active":"2024-08-09T00:37:52.843917+0000","last_peered":"2024-08-09T00:37:52.843917+0000","last_clean":"2024-08-09T00:37:52.843917+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:37:52.843917+0000","last_undegraded":"2024-08-09T00:37:52.843917+0000","last_fullsized":"2024-08-09T00:37:52.843917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:48.817766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.141922+0000","last_change":"2024-08-08T23:28:31.049356+0000","last_active":"2024-08-09T00:39:59.141922+0000","last_peered":"2024-08-09T00:39:59.141922+0000","last_clean":"2024-08-09T00:39:59.141922+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:39:59.141922+0000","last_undegraded":"2024-08-09T00:39:59.141922+0000","last_fullsized":"2024-08-09T00:39:59.141922+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:56:10.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831629+0000","last_change":"2024-08-08T23:28:32.827179+0000","last_active":"2024-08-09T00:37:17.831629+0000","last_peered":"2024-08-09T00:37:17.831629+0000","last_clean":"2024-08-09T00:37:17.831629+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:37:17.831629+0000","last_undegraded":"2024-08-09T00:37:17.831629+0000","last_fullsized":"2024-08-09T00:37:17.831629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:18.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'277","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.918904+0000","last_change":"2024-08-08T23:28:34.830435+0000","last_active":"2024-08-09T00:39:52.918904+0000","last_peered":"2024-08-09T00:39:52.918904+0000","last_clean":"2024-08-09T00:39:52.918904+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:39:52.918904+0000","last_undegraded":"2024-08-09T00:39:52.918904+0000","last_fullsized":"2024-08-09T00:39:52.918904+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:09.607368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.843420+0000","last_change":"2024-08-08T23:28:26.762755+0000","last_active":"2024-08-09T00:37:12.843420+0000","last_peered":"2024-08-09T00:37:12.843420+0000","last_clean":"2024-08-09T00:37:12.843420+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:37:12.843420+0000","last_undegraded":"2024-08-09T00:37:12.843420+0000","last_fullsized":"2024-08-09T00:37:12.843420+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:23:47.959221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:03.059606+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-09T00:37:03.059606+0000","last_peered":"2024-08-09T00:37:03.059606+0000","last_clean":"2024-08-09T00:37:03.059606+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:37:03.059606+0000","last_undegraded":"2024-08-09T00:37:03.059606+0000","last_fullsized":"2024-08-09T00:37:03.059606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:19.252900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'200","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.617548+0000","last_change":"2024-08-08T23:28:24.760341+0000","last_active":"2024-08-09T00:40:30.617548+0000","last_peered":"2024-08-09T00:40:30.617548+0000","last_clean":"2024-08-09T00:40:30.617548+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:40:30.617548+0000","last_undegraded":"2024-08-09T00:40:30.617548+0000","last_fullsized":"2024-08-09T00:40:30.617548+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:36:38.374476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":7644,"num_write":1044,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:32.834591+0000","last_change":"2024-08-08T23:28:28.778088+0000","last_active":"2024-08-09T00:37:32.834591+0000","last_peered":"2024-08-09T00:37:32.834591+0000","last_clean":"2024-08-09T00:37:32.834591+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:37:32.834591+0000","last_undegraded":"2024-08-09T00:37:32.834591+0000","last_fullsized":"2024-08-09T00:37:32.834591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:59:46.282271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.518432+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:39:52.518432+0000","last_peered":"2024-08-09T00:39:52.518432+0000","last_clean":"2024-08-09T00:39:52.518432+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:39:52.518432+0000","last_undegraded":"2024-08-09T00:39:52.518432+0000","last_fullsized":"2024-08-09T00:39:52.518432+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:19.698033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:52.844707+0000","last_change":"2024-08-08T23:28:32.831075+0000","last_active":"2024-08-09T00:37:52.844707+0000","last_peered":"2024-08-09T00:37:52.844707+0000","last_clean":"2024-08-09T00:37:52.844707+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:37:52.844707+0000","last_undegraded":"2024-08-09T00:37:52.844707+0000","last_fullsized":"2024-08-09T00:37:52.844707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:55:52.866081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'113","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:58.071702+0000","last_change":"2024-08-08T23:28:34.834032+0000","last_active":"2024-08-09T00:37:58.071702+0000","last_peered":"2024-08-09T00:37:58.071702+0000","last_clean":"2024-08-09T00:37:58.071702+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:37:58.071702+0000","last_undegraded":"2024-08-09T00:37:58.071702+0000","last_fullsized":"2024-08-09T00:37:58.071702+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:41.070436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'155","reported_seq":753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:21.963237+0000","last_change":"2024-08-08T23:28:26.777411+0000","last_active":"2024-08-09T00:38:21.963237+0000","last_peered":"2024-08-09T00:38:21.963237+0000","last_clean":"2024-08-09T00:38:21.963237+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:38:21.963237+0000","last_undegraded":"2024-08-09T00:38:21.963237+0000","last_fullsized":"2024-08-09T00:38:21.963237+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:18.021856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'228","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.285039+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:40:30.285039+0000","last_peered":"2024-08-09T00:40:30.285039+0000","last_clean":"2024-08-09T00:40:30.285039+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:40:30.285039+0000","last_undegraded":"2024-08-09T00:40:30.285039+0000","last_fullsized":"2024-08-09T00:40:30.285039+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:17.537000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":62351,"num_write":1160,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:02.841587+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-09T00:37:02.841587+0000","last_peered":"2024-08-09T00:37:02.841587+0000","last_clean":"2024-08-09T00:37:02.841587+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:37:02.841587+0000","last_undegraded":"2024-08-09T00:37:02.841587+0000","last_fullsized":"2024-08-09T00:37:02.841587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:12:37.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.831582+0000","last_change":"2024-08-08T23:28:28.783451+0000","last_active":"2024-08-09T00:37:17.831582+0000","last_peered":"2024-08-09T00:37:17.831582+0000","last_clean":"2024-08-09T00:37:17.831582+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:37:17.831582+0000","last_undegraded":"2024-08-09T00:37:17.831582+0000","last_fullsized":"2024-08-09T00:37:17.831582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:47:09.084557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'310","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.505713+0000","last_change":"2024-08-08T23:28:30.784027+0000","last_active":"2024-08-09T00:40:30.505713+0000","last_peered":"2024-08-09T00:40:30.505713+0000","last_clean":"2024-08-09T00:40:30.505713+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:40:30.505713+0000","last_undegraded":"2024-08-09T00:40:30.505713+0000","last_fullsized":"2024-08-09T00:40:30.505713+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:56:56.170296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29428,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":629,"num_write":258,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834636+0000","last_change":"2024-08-08T23:28:32.814130+0000","last_active":"2024-08-09T00:37:17.834636+0000","last_peered":"2024-08-09T00:37:17.834636+0000","last_clean":"2024-08-09T00:37:17.834636+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:37:17.834636+0000","last_undegraded":"2024-08-09T00:37:17.834636+0000","last_fullsized":"2024-08-09T00:37:17.834636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:24:28.569706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'117","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.476580+0000","last_change":"2024-08-08T23:28:34.838026+0000","last_active":"2024-08-09T00:39:53.476580+0000","last_peered":"2024-08-09T00:39:53.476580+0000","last_clean":"2024-08-09T00:39:53.476580+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:39:53.476580+0000","last_undegraded":"2024-08-09T00:39:53.476580+0000","last_fullsized":"2024-08-09T00:39:53.476580+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:23.463646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.431957+0000","last_change":"2024-08-08T23:28:26.780124+0000","last_active":"2024-08-09T00:39:27.431957+0000","last_peered":"2024-08-09T00:39:27.431957+0000","last_clean":"2024-08-09T00:39:27.431957+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:39:27.431957+0000","last_undegraded":"2024-08-09T00:39:27.431957+0000","last_fullsized":"2024-08-09T00:39:27.431957+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:11.326856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'317","reported_seq":1110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.423051+0000","last_change":"2024-08-08T23:28:24.764595+0000","last_active":"2024-08-09T00:40:30.423051+0000","last_peered":"2024-08-09T00:40:30.423051+0000","last_clean":"2024-08-09T00:40:30.423051+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:40:30.423051+0000","last_undegraded":"2024-08-09T00:40:30.423051+0000","last_fullsized":"2024-08-09T00:40:30.423051+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:13.394500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1025,"num_read_kb":185751,"num_write":1335,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.860057+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:37:12.860057+0000","last_peered":"2024-08-09T00:37:12.860057+0000","last_clean":"2024-08-09T00:37:12.860057+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:37:12.860057+0000","last_undegraded":"2024-08-09T00:37:12.860057+0000","last_fullsized":"2024-08-09T00:37:12.860057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:04:01.495818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835003+0000","last_change":"2024-08-08T23:28:28.779571+0000","last_active":"2024-08-09T00:37:17.835003+0000","last_peered":"2024-08-09T00:37:17.835003+0000","last_clean":"2024-08-09T00:37:17.835003+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:37:17.835003+0000","last_undegraded":"2024-08-09T00:37:17.835003+0000","last_fullsized":"2024-08-09T00:37:17.835003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:59:20.339670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'221","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.327545+0000","last_change":"2024-08-08T23:28:31.042472+0000","last_active":"2024-08-09T00:39:48.327545+0000","last_peered":"2024-08-09T00:39:48.327545+0000","last_clean":"2024-08-09T00:39:48.327545+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:39:48.327545+0000","last_undegraded":"2024-08-09T00:39:48.327545+0000","last_fullsized":"2024-08-09T00:39:48.327545+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:24.658995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'528","reported_seq":4401,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.075737+0000","last_change":"2024-08-08T23:28:32.815950+0000","last_active":"2024-08-09T00:40:30.075737+0000","last_peered":"2024-08-09T00:40:30.075737+0000","last_clean":"2024-08-09T00:40:30.075737+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:40:30.075737+0000","last_undegraded":"2024-08-09T00:40:30.075737+0000","last_fullsized":"2024-08-09T00:40:30.075737+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:11.787941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'164","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.453818+0000","last_change":"2024-08-08T23:28:34.830158+0000","last_active":"2024-08-09T00:39:54.453818+0000","last_peered":"2024-08-09T00:39:54.453818+0000","last_clean":"2024-08-09T00:39:54.453818+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:39:54.453818+0000","last_undegraded":"2024-08-09T00:39:54.453818+0000","last_fullsized":"2024-08-09T00:39:54.453818+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:25.038657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":713,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:15.619859+0000","last_change":"2024-08-08T23:28:26.776845+0000","last_active":"2024-08-09T00:37:15.619859+0000","last_peered":"2024-08-09T00:37:15.619859+0000","last_clean":"2024-08-09T00:37:15.619859+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:37:15.619859+0000","last_undegraded":"2024-08-09T00:37:15.619859+0000","last_fullsized":"2024-08-09T00:37:15.619859+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:55:03.906562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'273","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.604772+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:40:30.604772+0000","last_peered":"2024-08-09T00:40:30.604772+0000","last_clean":"2024-08-09T00:40:30.604772+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:40:30.604772+0000","last_undegraded":"2024-08-09T00:40:30.604772+0000","last_fullsized":"2024-08-09T00:40:30.604772+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:17:13.919060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311694,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1095,"num_read_kb":6569,"num_write":1298,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.848189+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-09T00:37:37.848189+0000","last_peered":"2024-08-09T00:37:37.848189+0000","last_clean":"2024-08-09T00:37:37.848189+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:37:37.848189+0000","last_undegraded":"2024-08-09T00:37:37.848189+0000","last_fullsized":"2024-08-09T00:37:37.848189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:14:42.557407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.834567+0000","last_change":"2024-08-08T23:28:28.777156+0000","last_active":"2024-08-09T00:37:17.834567+0000","last_peered":"2024-08-09T00:37:17.834567+0000","last_clean":"2024-08-09T00:37:17.834567+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:37:17.834567+0000","last_undegraded":"2024-08-09T00:37:17.834567+0000","last_fullsized":"2024-08-09T00:37:17.834567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:42.927296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'148","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.398773+0000","last_change":"2024-08-08T23:28:30.790179+0000","last_active":"2024-08-09T00:39:11.398773+0000","last_peered":"2024-08-09T00:39:11.398773+0000","last_clean":"2024-08-09T00:39:11.398773+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:39:11.398773+0000","last_undegraded":"2024-08-09T00:39:11.398773+0000","last_fullsized":"2024-08-09T00:39:11.398773+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:38.377166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'525","reported_seq":2299,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.090220+0000","last_change":"2024-08-08T23:28:32.808377+0000","last_active":"2024-08-09T00:40:30.090220+0000","last_peered":"2024-08-09T00:40:30.090220+0000","last_clean":"2024-08-09T00:40:30.090220+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:40:30.090220+0000","last_undegraded":"2024-08-09T00:40:30.090220+0000","last_fullsized":"2024-08-09T00:40:30.090220+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:26:13.925905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'236","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:22.845482+0000","last_change":"2024-08-08T23:28:34.832992+0000","last_active":"2024-08-09T00:38:22.845482+0000","last_peered":"2024-08-09T00:38:22.845482+0000","last_clean":"2024-08-09T00:38:22.845482+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:38:22.845482+0000","last_undegraded":"2024-08-09T00:38:22.845482+0000","last_fullsized":"2024-08-09T00:38:22.845482+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:40:38.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:57.761692+0000","last_change":"2024-08-08T23:28:26.770700+0000","last_active":"2024-08-09T00:38:57.761692+0000","last_peered":"2024-08-09T00:38:57.761692+0000","last_clean":"2024-08-09T00:38:57.761692+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:38:57.761692+0000","last_undegraded":"2024-08-09T00:38:57.761692+0000","last_fullsized":"2024-08-09T00:38:57.761692+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:15:02.492992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'219","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.618367+0000","last_change":"2024-08-08T23:29:01.887794+0000","last_active":"2024-08-09T00:40:30.618367+0000","last_peered":"2024-08-09T00:40:30.618367+0000","last_clean":"2024-08-09T00:40:30.618367+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:40:30.618367+0000","last_undegraded":"2024-08-09T00:40:30.618367+0000","last_fullsized":"2024-08-09T00:40:30.618367+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:49:04.725884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37546,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":443,"num_read_kb":66311,"num_write":1073,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:37.840460+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-09T00:37:37.840460+0000","last_peered":"2024-08-09T00:37:37.840460+0000","last_clean":"2024-08-09T00:37:37.840460+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:37:37.840460+0000","last_undegraded":"2024-08-09T00:37:37.840460+0000","last_fullsized":"2024-08-09T00:37:37.840460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:05.082864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:29.817242+0000","last_change":"2024-08-08T23:28:28.771236+0000","last_active":"2024-08-09T00:40:29.817242+0000","last_peered":"2024-08-09T00:40:29.817242+0000","last_clean":"2024-08-09T00:40:29.817242+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:40:29.817242+0000","last_undegraded":"2024-08-09T00:40:29.817242+0000","last_fullsized":"2024-08-09T00:40:29.817242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:20:10.952107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":797,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'350","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.539548+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:40:30.539548+0000","last_peered":"2024-08-09T00:40:30.539548+0000","last_clean":"2024-08-09T00:40:30.539548+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:40:30.539548+0000","last_undegraded":"2024-08-09T00:40:30.539548+0000","last_fullsized":"2024-08-09T00:40:30.539548+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:47.586741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24443,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":707,"num_write":276,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.660385+0000","last_change":"2024-08-08T23:28:32.805174+0000","last_active":"2024-08-09T00:37:17.660385+0000","last_peered":"2024-08-09T00:37:17.660385+0000","last_clean":"2024-08-09T00:37:17.660385+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:37:17.660385+0000","last_undegraded":"2024-08-09T00:37:17.660385+0000","last_fullsized":"2024-08-09T00:37:17.660385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:59.962337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'123","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.746561+0000","last_change":"2024-08-08T23:28:34.830149+0000","last_active":"2024-08-09T00:38:37.746561+0000","last_peered":"2024-08-09T00:38:37.746561+0000","last_clean":"2024-08-09T00:38:37.746561+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:38:37.746561+0000","last_undegraded":"2024-08-09T00:38:37.746561+0000","last_fullsized":"2024-08-09T00:38:37.746561+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:14.678670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'138","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.814333+0000","last_change":"2024-08-08T23:28:34.836373+0000","last_active":"2024-08-09T00:39:52.814333+0000","last_peered":"2024-08-09T00:39:52.814333+0000","last_clean":"2024-08-09T00:39:52.814333+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:39:52.814333+0000","last_undegraded":"2024-08-09T00:39:52.814333+0000","last_fullsized":"2024-08-09T00:39:52.814333+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:53:20.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.817769+0000","last_change":"2024-08-08T23:28:26.776818+0000","last_active":"2024-08-09T00:36:07.817769+0000","last_peered":"2024-08-09T00:36:07.817769+0000","last_clean":"2024-08-09T00:36:07.817769+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:36:07.817769+0000","last_undegraded":"2024-08-09T00:36:07.817769+0000","last_fullsized":"2024-08-09T00:36:07.817769+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:01.090667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'229","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.607314+0000","last_change":"2024-08-08T23:28:24.798893+0000","last_active":"2024-08-09T00:40:30.607314+0000","last_peered":"2024-08-09T00:40:30.607314+0000","last_clean":"2024-08-09T00:40:30.607314+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:40:30.607314+0000","last_undegraded":"2024-08-09T00:40:30.607314+0000","last_fullsized":"2024-08-09T00:40:30.607314+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:08:59.221674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":23490,"num_write":1170,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.831284+0000","last_change":"2024-08-08T23:28:28.765882+0000","last_active":"2024-08-09T00:36:12.831284+0000","last_peered":"2024-08-09T00:36:12.831284+0000","last_clean":"2024-08-09T00:36:12.831284+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:36:12.831284+0000","last_undegraded":"2024-08-09T00:36:12.831284+0000","last_fullsized":"2024-08-09T00:36:12.831284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:17:59.984218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'165","reported_seq":776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.595886+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:40:30.595886+0000","last_peered":"2024-08-09T00:40:30.595886+0000","last_clean":"2024-08-09T00:40:30.595886+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:40:30.595886+0000","last_undegraded":"2024-08-09T00:40:30.595886+0000","last_fullsized":"2024-08-09T00:40:30.595886+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:39:49.869700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":265,"num_write":116,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645239+0000","last_change":"2024-08-08T23:28:32.810146+0000","last_active":"2024-08-09T00:36:12.645239+0000","last_peered":"2024-08-09T00:36:12.645239+0000","last_clean":"2024-08-09T00:36:12.645239+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:36:12.645239+0000","last_undegraded":"2024-08-09T00:36:12.645239+0000","last_fullsized":"2024-08-09T00:36:12.645239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:08.379082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:52.654865+0000","last_change":"2024-08-08T23:28:34.828599+0000","last_active":"2024-08-09T00:36:52.654865+0000","last_peered":"2024-08-09T00:36:52.654865+0000","last_clean":"2024-08-09T00:36:52.654865+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:36:52.654865+0000","last_undegraded":"2024-08-09T00:36:52.654865+0000","last_fullsized":"2024-08-09T00:36:52.654865+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:45.153446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.830175+0000","last_change":"2024-08-08T23:28:26.775873+0000","last_active":"2024-08-09T00:36:07.830175+0000","last_peered":"2024-08-09T00:36:07.830175+0000","last_clean":"2024-08-09T00:36:07.830175+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:36:07.830175+0000","last_undegraded":"2024-08-09T00:36:07.830175+0000","last_fullsized":"2024-08-09T00:36:07.830175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:52:27.431250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'183","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.267916+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:40:30.267916+0000","last_peered":"2024-08-09T00:40:30.267916+0000","last_clean":"2024-08-09T00:40:30.267916+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:40:30.267916+0000","last_undegraded":"2024-08-09T00:40:30.267916+0000","last_fullsized":"2024-08-09T00:40:30.267916+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:56:26.350323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661190,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":16787,"num_write":983,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.645488+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:36:12.645488+0000","last_peered":"2024-08-09T00:36:12.645488+0000","last_clean":"2024-08-09T00:36:12.645488+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:36:12.645488+0000","last_undegraded":"2024-08-09T00:36:12.645488+0000","last_fullsized":"2024-08-09T00:36:12.645488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:21.712748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'54","reported_seq":572,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.811769+0000","last_change":"2024-08-08T23:28:30.783385+0000","last_active":"2024-08-09T00:39:08.811769+0000","last_peered":"2024-08-09T00:39:08.811769+0000","last_clean":"2024-08-09T00:39:08.811769+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:39:08.811769+0000","last_undegraded":"2024-08-09T00:39:08.811769+0000","last_fullsized":"2024-08-09T00:39:08.811769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:25.686308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846097+0000","last_change":"2024-08-08T23:28:32.810977+0000","last_active":"2024-08-09T00:36:12.846097+0000","last_peered":"2024-08-09T00:36:12.846097+0000","last_clean":"2024-08-09T00:36:12.846097+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:36:12.846097+0000","last_undegraded":"2024-08-09T00:36:12.846097+0000","last_fullsized":"2024-08-09T00:36:12.846097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:46:30.450790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'187","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.463217+0000","last_change":"2024-08-08T23:28:34.841150+0000","last_active":"2024-08-09T00:39:52.463217+0000","last_peered":"2024-08-09T00:39:52.463217+0000","last_clean":"2024-08-09T00:39:52.463217+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:39:52.463217+0000","last_undegraded":"2024-08-09T00:39:52.463217+0000","last_fullsized":"2024-08-09T00:39:52.463217+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:15.845980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644070+0000","last_change":"2024-08-08T23:28:26.776192+0000","last_active":"2024-08-09T00:36:07.644070+0000","last_peered":"2024-08-09T00:36:07.644070+0000","last_clean":"2024-08-09T00:36:07.644070+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:36:07.644070+0000","last_undegraded":"2024-08-09T00:36:07.644070+0000","last_fullsized":"2024-08-09T00:36:07.644070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:40:01.464080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'202","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.352424+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:40:30.352424+0000","last_peered":"2024-08-09T00:40:30.352424+0000","last_clean":"2024-08-09T00:40:30.352424+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:40:30.352424+0000","last_undegraded":"2024-08-09T00:40:30.352424+0000","last_fullsized":"2024-08-09T00:40:30.352424+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:13.784247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110897,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":499,"num_read_kb":9686,"num_write":1123,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.846034+0000","last_change":"2024-08-08T23:28:28.781246+0000","last_active":"2024-08-09T00:36:12.846034+0000","last_peered":"2024-08-09T00:36:12.846034+0000","last_clean":"2024-08-09T00:36:12.846034+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:36:12.846034+0000","last_undegraded":"2024-08-09T00:36:12.846034+0000","last_fullsized":"2024-08-09T00:36:12.846034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:01.140883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'200","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.490465+0000","last_change":"2024-08-08T23:28:30.796061+0000","last_active":"2024-08-09T00:40:30.490465+0000","last_peered":"2024-08-09T00:40:30.490465+0000","last_clean":"2024-08-09T00:40:30.490465+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:40:30.490465+0000","last_undegraded":"2024-08-09T00:40:30.490465+0000","last_fullsized":"2024-08-09T00:40:30.490465+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:56:58.690952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":367,"num_write":158,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819418+0000","last_change":"2024-08-08T23:28:32.828831+0000","last_active":"2024-08-09T00:36:12.819418+0000","last_peered":"2024-08-09T00:36:12.819418+0000","last_clean":"2024-08-09T00:36:12.819418+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:36:12.819418+0000","last_undegraded":"2024-08-09T00:36:12.819418+0000","last_fullsized":"2024-08-09T00:36:12.819418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:56:10.147406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'114","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:50.542493+0000","last_change":"2024-08-08T23:28:34.830478+0000","last_active":"2024-08-09T00:39:50.542493+0000","last_peered":"2024-08-09T00:39:50.542493+0000","last_clean":"2024-08-09T00:39:50.542493+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:39:50.542493+0000","last_undegraded":"2024-08-09T00:39:50.542493+0000","last_fullsized":"2024-08-09T00:39:50.542493+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:39.468849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:07.644019+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:36:07.644019+0000","last_peered":"2024-08-09T00:36:07.644019+0000","last_clean":"2024-08-09T00:36:07.644019+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:36:07.644019+0000","last_undegraded":"2024-08-09T00:36:07.644019+0000","last_fullsized":"2024-08-09T00:36:07.644019+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:02:52.706658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'167","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.511975+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:40:30.511975+0000","last_peered":"2024-08-09T00:40:30.511975+0000","last_clean":"2024-08-09T00:40:30.511975+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:40:30.511975+0000","last_undegraded":"2024-08-09T00:40:30.511975+0000","last_fullsized":"2024-08-09T00:40:30.511975+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:18:24.065006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":317,"num_read_kb":1399,"num_write":881,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.819359+0000","last_change":"2024-08-08T23:28:28.781772+0000","last_active":"2024-08-09T00:36:12.819359+0000","last_peered":"2024-08-09T00:36:12.819359+0000","last_clean":"2024-08-09T00:36:12.819359+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:36:12.819359+0000","last_undegraded":"2024-08-09T00:36:12.819359+0000","last_fullsized":"2024-08-09T00:36:12.819359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:15:35.500922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'137","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.453451+0000","last_change":"2024-08-08T23:28:30.780651+0000","last_active":"2024-08-09T00:40:30.453451+0000","last_peered":"2024-08-09T00:40:30.453451+0000","last_clean":"2024-08-09T00:40:30.453451+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:40:30.453451+0000","last_undegraded":"2024-08-09T00:40:30.453451+0000","last_fullsized":"2024-08-09T00:40:30.453451+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:41:26.754888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":239,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816952+0000","last_change":"2024-08-08T23:28:32.826903+0000","last_active":"2024-08-09T00:36:12.816952+0000","last_peered":"2024-08-09T00:36:12.816952+0000","last_clean":"2024-08-09T00:36:12.816952+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:36:12.816952+0000","last_undegraded":"2024-08-09T00:36:12.816952+0000","last_fullsized":"2024-08-09T00:36:12.816952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:15.508038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:11.641070+0000","last_change":"2024-08-08T23:28:26.774602+0000","last_active":"2024-08-09T00:38:11.641070+0000","last_peered":"2024-08-09T00:38:11.641070+0000","last_clean":"2024-08-09T00:38:11.641070+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:38:11.641070+0000","last_undegraded":"2024-08-09T00:38:11.641070+0000","last_fullsized":"2024-08-09T00:38:11.641070+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:48.235356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'160","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.524450+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:40:30.524450+0000","last_peered":"2024-08-09T00:40:30.524450+0000","last_clean":"2024-08-09T00:40:30.524450+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:40:30.524450+0000","last_undegraded":"2024-08-09T00:40:30.524450+0000","last_fullsized":"2024-08-09T00:40:30.524450+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:46:45.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540766,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":18716,"num_write":872,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.824970+0000","last_change":"2024-08-08T23:28:28.783884+0000","last_active":"2024-08-09T00:36:47.824970+0000","last_peered":"2024-08-09T00:36:47.824970+0000","last_clean":"2024-08-09T00:36:47.824970+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:36:47.824970+0000","last_undegraded":"2024-08-09T00:36:47.824970+0000","last_fullsized":"2024-08-09T00:36:47.824970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:35.459983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'222","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.446023+0000","last_change":"2024-08-08T23:28:30.780333+0000","last_active":"2024-08-09T00:40:30.446023+0000","last_peered":"2024-08-09T00:40:30.446023+0000","last_clean":"2024-08-09T00:40:30.446023+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:40:30.446023+0000","last_undegraded":"2024-08-09T00:40:30.446023+0000","last_fullsized":"2024-08-09T00:40:30.446023+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:34.051721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17674,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":513,"num_write":222,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046320+0000","last_change":"2024-08-08T23:28:32.819377+0000","last_active":"2024-08-09T00:36:03.046320+0000","last_peered":"2024-08-09T00:36:03.046320+0000","last_clean":"2024-08-09T00:36:03.046320+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:36:03.046320+0000","last_undegraded":"2024-08-09T00:36:03.046320+0000","last_fullsized":"2024-08-09T00:36:03.046320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:12.118204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'163","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:25.920905+0000","last_change":"2024-08-08T23:28:34.830516+0000","last_active":"2024-08-09T00:36:25.920905+0000","last_peered":"2024-08-09T00:36:25.920905+0000","last_clean":"2024-08-09T00:36:25.920905+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:36:25.920905+0000","last_undegraded":"2024-08-09T00:36:25.920905+0000","last_fullsized":"2024-08-09T00:36:25.920905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:35:24.816908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:55.297627+0000","last_change":"2024-08-08T23:28:26.777062+0000","last_active":"2024-08-09T00:37:55.297627+0000","last_peered":"2024-08-09T00:37:55.297627+0000","last_clean":"2024-08-09T00:37:55.297627+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:37:55.297627+0000","last_undegraded":"2024-08-09T00:37:55.297627+0000","last_fullsized":"2024-08-09T00:37:55.297627+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:50.644245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'284","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.521438+0000","last_change":"2024-08-08T23:29:01.888808+0000","last_active":"2024-08-09T00:40:30.521438+0000","last_peered":"2024-08-09T00:40:30.521438+0000","last_clean":"2024-08-09T00:40:30.521438+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:40:30.521438+0000","last_undegraded":"2024-08-09T00:40:30.521438+0000","last_fullsized":"2024-08-09T00:40:30.521438+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:10.690056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":69125,"num_write":1347,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:17.835144+0000","last_change":"2024-08-08T23:28:28.781761+0000","last_active":"2024-08-09T00:37:17.835144+0000","last_peered":"2024-08-09T00:37:17.835144+0000","last_clean":"2024-08-09T00:37:17.835144+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:37:17.835144+0000","last_undegraded":"2024-08-09T00:37:17.835144+0000","last_fullsized":"2024-08-09T00:37:17.835144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:51:42.627370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'198","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.463765+0000","last_change":"2024-08-08T23:28:30.775644+0000","last_active":"2024-08-09T00:40:30.463765+0000","last_peered":"2024-08-09T00:40:30.463765+0000","last_clean":"2024-08-09T00:40:30.463765+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:40:30.463765+0000","last_undegraded":"2024-08-09T00:40:30.463765+0000","last_fullsized":"2024-08-09T00:40:30.463765+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:29:40.576029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":267,"num_read_kb":315,"num_write":170,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828941+0000","last_change":"2024-08-08T23:28:32.809931+0000","last_active":"2024-08-09T00:36:02.828941+0000","last_peered":"2024-08-09T00:36:02.828941+0000","last_clean":"2024-08-09T00:36:02.828941+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:36:02.828941+0000","last_undegraded":"2024-08-09T00:36:02.828941+0000","last_fullsized":"2024-08-09T00:36:02.828941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:04:26.809257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'178","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.059858+0000","last_change":"2024-08-08T23:28:34.836352+0000","last_active":"2024-08-09T00:39:48.059858+0000","last_peered":"2024-08-09T00:39:48.059858+0000","last_clean":"2024-08-09T00:39:48.059858+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:39:48.059858+0000","last_undegraded":"2024-08-09T00:39:48.059858+0000","last_fullsized":"2024-08-09T00:39:48.059858+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:31:46.433299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.641569+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:35:57.641569+0000","last_peered":"2024-08-09T00:35:57.641569+0000","last_clean":"2024-08-09T00:35:57.641569+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:35:57.641569+0000","last_undegraded":"2024-08-09T00:35:57.641569+0000","last_fullsized":"2024-08-09T00:35:57.641569+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:31.478254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'213","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.608269+0000","last_change":"2024-08-08T23:30:01.782029+0000","last_active":"2024-08-09T00:40:30.608269+0000","last_peered":"2024-08-09T00:40:30.608269+0000","last_clean":"2024-08-09T00:40:30.608269+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:40:30.608269+0000","last_undegraded":"2024-08-09T00:40:30.608269+0000","last_fullsized":"2024-08-09T00:40:30.608269+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.293628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":59906,"num_write":1092,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816465+0000","last_change":"2024-08-08T23:28:28.778478+0000","last_active":"2024-08-09T00:36:02.816465+0000","last_peered":"2024-08-09T00:36:02.816465+0000","last_clean":"2024-08-09T00:36:02.816465+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:36:02.816465+0000","last_undegraded":"2024-08-09T00:36:02.816465+0000","last_fullsized":"2024-08-09T00:36:02.816465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:25.183992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'169","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.653646+0000","last_change":"2024-08-08T23:28:31.043004+0000","last_active":"2024-08-09T00:40:30.653646+0000","last_peered":"2024-08-09T00:40:30.653646+0000","last_clean":"2024-08-09T00:40:30.653646+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:40:30.653646+0000","last_undegraded":"2024-08-09T00:40:30.653646+0000","last_fullsized":"2024-08-09T00:40:30.653646+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:24:09.108955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":299,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:47.838957+0000","last_change":"2024-08-08T23:28:32.802329+0000","last_active":"2024-08-09T00:36:47.838957+0000","last_peered":"2024-08-09T00:36:47.838957+0000","last_clean":"2024-08-09T00:36:47.838957+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:36:47.838957+0000","last_undegraded":"2024-08-09T00:36:47.838957+0000","last_fullsized":"2024-08-09T00:36:47.838957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:11:08.553685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'166","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.919419+0000","last_change":"2024-08-08T23:28:34.830880+0000","last_active":"2024-08-09T00:39:58.919419+0000","last_peered":"2024-08-09T00:39:58.919419+0000","last_clean":"2024-08-09T00:39:58.919419+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:39:58.919419+0000","last_undegraded":"2024-08-09T00:39:58.919419+0000","last_fullsized":"2024-08-09T00:39:58.919419+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:41:57.656951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:35:57.821534+0000","last_change":"2024-08-08T23:28:26.769723+0000","last_active":"2024-08-09T00:35:57.821534+0000","last_peered":"2024-08-09T00:35:57.821534+0000","last_clean":"2024-08-09T00:35:57.821534+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:35:57.821534+0000","last_undegraded":"2024-08-09T00:35:57.821534+0000","last_fullsized":"2024-08-09T00:35:57.821534+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:50:45.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'174","reported_seq":843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.520823+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:40:30.520823+0000","last_peered":"2024-08-09T00:40:30.520823+0000","last_clean":"2024-08-09T00:40:30.520823+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:40:30.520823+0000","last_undegraded":"2024-08-09T00:40:30.520823+0000","last_fullsized":"2024-08-09T00:40:30.520823+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:34:17.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":4608,"num_write":1010,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.828975+0000","last_change":"2024-08-08T23:28:28.776616+0000","last_active":"2024-08-09T00:36:02.828975+0000","last_peered":"2024-08-09T00:36:02.828975+0000","last_clean":"2024-08-09T00:36:02.828975+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:36:02.828975+0000","last_undegraded":"2024-08-09T00:36:02.828975+0000","last_fullsized":"2024-08-09T00:36:02.828975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:14:52.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'118","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.457751+0000","last_change":"2024-08-08T23:28:31.044012+0000","last_active":"2024-08-09T00:39:11.457751+0000","last_peered":"2024-08-09T00:39:11.457751+0000","last_clean":"2024-08-09T00:39:11.457751+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:39:11.457751+0000","last_undegraded":"2024-08-09T00:39:11.457751+0000","last_fullsized":"2024-08-09T00:39:11.457751+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:11.270743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'500","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.072980+0000","last_change":"2024-08-08T23:28:32.818008+0000","last_active":"2024-08-09T00:40:30.072980+0000","last_peered":"2024-08-09T00:40:30.072980+0000","last_clean":"2024-08-09T00:40:30.072980+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:40:30.072980+0000","last_undegraded":"2024-08-09T00:40:30.072980+0000","last_fullsized":"2024-08-09T00:40:30.072980+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:38.571079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:53.807216+0000","last_change":"2024-08-08T23:28:34.827314+0000","last_active":"2024-08-09T00:39:53.807216+0000","last_peered":"2024-08-09T00:39:53.807216+0000","last_clean":"2024-08-09T00:39:53.807216+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:39:53.807216+0000","last_undegraded":"2024-08-09T00:39:53.807216+0000","last_fullsized":"2024-08-09T00:39:53.807216+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:05.794292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:00.392022+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:37:00.392022+0000","last_peered":"2024-08-09T00:37:00.392022+0000","last_clean":"2024-08-09T00:37:00.392022+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:37:00.392022+0000","last_undegraded":"2024-08-09T00:37:00.392022+0000","last_fullsized":"2024-08-09T00:37:00.392022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:59:35.202725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'193","reported_seq":813,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.319009+0000","last_change":"2024-08-08T23:28:24.820992+0000","last_active":"2024-08-09T00:40:30.319009+0000","last_peered":"2024-08-09T00:40:30.319009+0000","last_clean":"2024-08-09T00:40:30.319009+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:40:30.319009+0000","last_undegraded":"2024-08-09T00:40:30.319009+0000","last_fullsized":"2024-08-09T00:40:30.319009+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:05:54.019037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755945,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":50563,"num_write":1098,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.843379+0000","last_change":"2024-08-08T23:28:28.790145+0000","last_active":"2024-08-09T00:36:02.843379+0000","last_peered":"2024-08-09T00:36:02.843379+0000","last_clean":"2024-08-09T00:36:02.843379+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:36:02.843379+0000","last_undegraded":"2024-08-09T00:36:02.843379+0000","last_fullsized":"2024-08-09T00:36:02.843379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:10.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'243","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.359950+0000","last_change":"2024-08-08T23:28:30.776086+0000","last_active":"2024-08-09T00:40:30.359950+0000","last_peered":"2024-08-09T00:40:30.359950+0000","last_clean":"2024-08-09T00:40:30.359950+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:40:30.359950+0000","last_undegraded":"2024-08-09T00:40:30.359950+0000","last_fullsized":"2024-08-09T00:40:30.359950+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:50:38.136653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10001,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":440,"num_write":200,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.816883+0000","last_change":"2024-08-08T23:28:32.820762+0000","last_active":"2024-08-09T00:36:12.816883+0000","last_peered":"2024-08-09T00:36:12.816883+0000","last_clean":"2024-08-09T00:36:12.816883+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:36:12.816883+0000","last_undegraded":"2024-08-09T00:36:12.816883+0000","last_fullsized":"2024-08-09T00:36:12.816883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:28:00.396123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'118","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:51.831243+0000","last_change":"2024-08-08T23:28:34.840657+0000","last_active":"2024-08-09T00:39:51.831243+0000","last_peered":"2024-08-09T00:39:51.831243+0000","last_clean":"2024-08-09T00:39:51.831243+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:39:51.831243+0000","last_undegraded":"2024-08-09T00:39:51.831243+0000","last_fullsized":"2024-08-09T00:39:51.831243+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:16.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.121529+0000","last_change":"2024-08-08T23:28:26.750931+0000","last_active":"2024-08-09T00:39:54.121529+0000","last_peered":"2024-08-09T00:39:54.121529+0000","last_clean":"2024-08-09T00:39:54.121529+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:39:54.121529+0000","last_undegraded":"2024-08-09T00:39:54.121529+0000","last_fullsized":"2024-08-09T00:39:54.121529+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:28:50.333511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'198","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.319137+0000","last_change":"2024-08-08T23:28:24.818191+0000","last_active":"2024-08-09T00:40:30.319137+0000","last_peered":"2024-08-09T00:40:30.319137+0000","last_clean":"2024-08-09T00:40:30.319137+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:40:30.319137+0000","last_undegraded":"2024-08-09T00:40:30.319137+0000","last_fullsized":"2024-08-09T00:40:30.319137+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:42.912960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":62745,"num_write":1020,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:03.046264+0000","last_change":"2024-08-08T23:28:28.776983+0000","last_active":"2024-08-09T00:36:03.046264+0000","last_peered":"2024-08-09T00:36:03.046264+0000","last_clean":"2024-08-09T00:36:03.046264+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:36:03.046264+0000","last_undegraded":"2024-08-09T00:36:03.046264+0000","last_fullsized":"2024-08-09T00:36:03.046264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:16.950419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'146","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.370097+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:40:30.370097+0000","last_peered":"2024-08-09T00:40:30.370097+0000","last_clean":"2024-08-09T00:40:30.370097+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:40:30.370097+0000","last_undegraded":"2024-08-09T00:40:30.370097+0000","last_fullsized":"2024-08-09T00:40:30.370097+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:37:42.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":272,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.821824+0000","last_change":"2024-08-08T23:28:32.813742+0000","last_active":"2024-08-09T00:36:22.821824+0000","last_peered":"2024-08-09T00:36:22.821824+0000","last_clean":"2024-08-09T00:36:22.821824+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:36:22.821824+0000","last_undegraded":"2024-08-09T00:36:22.821824+0000","last_fullsized":"2024-08-09T00:36:22.821824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:08.279720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:42.679892+0000","last_change":"2024-08-08T23:28:34.830000+0000","last_active":"2024-08-09T00:38:42.679892+0000","last_peered":"2024-08-09T00:38:42.679892+0000","last_clean":"2024-08-09T00:38:42.679892+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:38:42.679892+0000","last_undegraded":"2024-08-09T00:38:42.679892+0000","last_fullsized":"2024-08-09T00:38:42.679892+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:19:25.028910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.647917+0000","last_change":"2024-08-08T23:28:26.762374+0000","last_active":"2024-08-09T00:36:22.647917+0000","last_peered":"2024-08-09T00:36:22.647917+0000","last_clean":"2024-08-09T00:36:22.647917+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:36:22.647917+0000","last_undegraded":"2024-08-09T00:36:22.647917+0000","last_fullsized":"2024-08-09T00:36:22.647917+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:04:01.695211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'266","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.478261+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:40:30.478261+0000","last_peered":"2024-08-09T00:40:30.478261+0000","last_clean":"2024-08-09T00:40:30.478261+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:40:30.478261+0000","last_undegraded":"2024-08-09T00:40:30.478261+0000","last_fullsized":"2024-08-09T00:40:30.478261+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:58:00.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":32625,"num_write":1559,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:12.818766+0000","last_change":"2024-08-08T23:28:28.778212+0000","last_active":"2024-08-09T00:36:12.818766+0000","last_peered":"2024-08-09T00:36:12.818766+0000","last_clean":"2024-08-09T00:36:12.818766+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:36:12.818766+0000","last_undegraded":"2024-08-09T00:36:12.818766+0000","last_fullsized":"2024-08-09T00:36:12.818766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:32:33.405064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'124","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.630601+0000","last_change":"2024-08-08T23:28:30.796071+0000","last_active":"2024-08-09T00:40:30.630601+0000","last_peered":"2024-08-09T00:40:30.630601+0000","last_clean":"2024-08-09T00:40:30.630601+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:40:30.630601+0000","last_undegraded":"2024-08-09T00:40:30.630601+0000","last_fullsized":"2024-08-09T00:40:30.630601+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:16:29.366191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":219,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.816384+0000","last_change":"2024-08-08T23:28:32.812326+0000","last_active":"2024-08-09T00:36:02.816384+0000","last_peered":"2024-08-09T00:36:02.816384+0000","last_clean":"2024-08-09T00:36:02.816384+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:36:02.816384+0000","last_undegraded":"2024-08-09T00:36:02.816384+0000","last_fullsized":"2024-08-09T00:36:02.816384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.507723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'144","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.001008+0000","last_change":"2024-08-08T23:28:34.835991+0000","last_active":"2024-08-09T00:39:48.001008+0000","last_peered":"2024-08-09T00:39:48.001008+0000","last_clean":"2024-08-09T00:39:48.001008+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:39:48.001008+0000","last_undegraded":"2024-08-09T00:39:48.001008+0000","last_fullsized":"2024-08-09T00:39:48.001008+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:43:41.405272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:46.216752+0000","last_change":"2024-08-08T23:28:26.781125+0000","last_active":"2024-08-09T00:37:46.216752+0000","last_peered":"2024-08-09T00:37:46.216752+0000","last_clean":"2024-08-09T00:37:46.216752+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:37:46.216752+0000","last_undegraded":"2024-08-09T00:37:46.216752+0000","last_fullsized":"2024-08-09T00:37:46.216752+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:49.822476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'159","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.367791+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:40:30.367791+0000","last_peered":"2024-08-09T00:40:30.367791+0000","last_clean":"2024-08-09T00:40:30.367791+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:40:30.367791+0000","last_undegraded":"2024-08-09T00:40:30.367791+0000","last_fullsized":"2024-08-09T00:40:30.367791+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:35.389417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4272291,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":403,"num_read_kb":16350,"num_write":847,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:27.834834+0000","last_change":"2024-08-08T23:28:28.765925+0000","last_active":"2024-08-09T00:36:27.834834+0000","last_peered":"2024-08-09T00:36:27.834834+0000","last_clean":"2024-08-09T00:36:27.834834+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:36:27.834834+0000","last_undegraded":"2024-08-09T00:36:27.834834+0000","last_fullsized":"2024-08-09T00:36:27.834834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:42:35.033143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'195","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.224907+0000","last_change":"2024-08-08T23:28:30.786260+0000","last_active":"2024-08-09T00:40:30.224907+0000","last_peered":"2024-08-09T00:40:30.224907+0000","last_clean":"2024-08-09T00:40:30.224907+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:40:30.224907+0000","last_undegraded":"2024-08-09T00:40:30.224907+0000","last_fullsized":"2024-08-09T00:40:30.224907+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:39:07.104811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":353,"num_write":152,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:02.814259+0000","last_change":"2024-08-08T23:28:32.820890+0000","last_active":"2024-08-09T00:36:02.814259+0000","last_peered":"2024-08-09T00:36:02.814259+0000","last_clean":"2024-08-09T00:36:02.814259+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:36:02.814259+0000","last_undegraded":"2024-08-09T00:36:02.814259+0000","last_fullsized":"2024-08-09T00:36:02.814259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:53.798935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'141","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:32.823481+0000","last_change":"2024-08-08T23:28:34.832607+0000","last_active":"2024-08-09T00:36:32.823481+0000","last_peered":"2024-08-09T00:36:32.823481+0000","last_clean":"2024-08-09T00:36:32.823481+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:36:32.823481+0000","last_undegraded":"2024-08-09T00:36:32.823481+0000","last_fullsized":"2024-08-09T00:36:32.823481+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:01:55.224306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'225","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850396+0000","last_change":"2024-08-08T23:28:26.769233+0000","last_active":"2024-08-09T00:37:47.850396+0000","last_peered":"2024-08-09T00:37:47.850396+0000","last_clean":"2024-08-09T00:37:47.850396+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:37:47.850396+0000","last_undegraded":"2024-08-09T00:37:47.850396+0000","last_fullsized":"2024-08-09T00:37:47.850396+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:17:12.484894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'212","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.614147+0000","last_change":"2024-08-08T23:28:24.802451+0000","last_active":"2024-08-09T00:40:30.614147+0000","last_peered":"2024-08-09T00:40:30.614147+0000","last_clean":"2024-08-09T00:40:30.614147+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:40:30.614147+0000","last_undegraded":"2024-08-09T00:40:30.614147+0000","last_fullsized":"2024-08-09T00:40:30.614147+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:35.524843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170402,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":16985,"num_write":1184,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'147","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:23.077274+0000","last_change":"2024-08-08T23:29:01.584374+0000","last_active":"2024-08-09T00:38:23.077274+0000","last_peered":"2024-08-09T00:38:23.077274+0000","last_clean":"2024-08-09T00:38:23.077274+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:38:23.077274+0000","last_undegraded":"2024-08-09T00:38:23.077274+0000","last_fullsized":"2024-08-09T00:38:23.077274+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:12.686573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'209","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.314906+0000","last_change":"2024-08-08T23:28:24.787727+0000","last_active":"2024-08-09T00:40:30.314906+0000","last_peered":"2024-08-09T00:40:30.314906+0000","last_clean":"2024-08-09T00:40:30.314906+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:40:30.314906+0000","last_undegraded":"2024-08-09T00:40:30.314906+0000","last_fullsized":"2024-08-09T00:40:30.314906+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:38:30.042158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906586,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":27391,"num_write":1081,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.508050+0000","last_change":"2024-08-08T23:28:26.789544+0000","last_active":"2024-08-09T00:39:52.508050+0000","last_peered":"2024-08-09T00:39:52.508050+0000","last_clean":"2024-08-09T00:39:52.508050+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:39:52.508050+0000","last_undegraded":"2024-08-09T00:39:52.508050+0000","last_fullsized":"2024-08-09T00:39:52.508050+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:10:52.896837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'208","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.552977+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:40:30.552977+0000","last_peered":"2024-08-09T00:40:30.552977+0000","last_clean":"2024-08-09T00:40:30.552977+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:40:30.552977+0000","last_undegraded":"2024-08-09T00:40:30.552977+0000","last_fullsized":"2024-08-09T00:40:30.552977+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:57:25.172421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":17234,"num_write":1189,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'69","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:47.850284+0000","last_change":"2024-08-08T23:28:26.775062+0000","last_active":"2024-08-09T00:37:47.850284+0000","last_peered":"2024-08-09T00:37:47.850284+0000","last_clean":"2024-08-09T00:37:47.850284+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:37:47.850284+0000","last_undegraded":"2024-08-09T00:37:47.850284+0000","last_fullsized":"2024-08-09T00:37:47.850284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:06.373460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'258","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.527566+0000","last_change":"2024-08-08T23:29:01.885397+0000","last_active":"2024-08-09T00:40:30.527566+0000","last_peered":"2024-08-09T00:40:30.527566+0000","last_clean":"2024-08-09T00:40:30.527566+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:40:30.527566+0000","last_undegraded":"2024-08-09T00:40:30.527566+0000","last_fullsized":"2024-08-09T00:40:30.527566+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:40:13.222712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":548,"num_read_kb":58241,"num_write":1241,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'129","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.958544+0000","last_change":"2024-08-08T23:28:26.776123+0000","last_active":"2024-08-09T00:38:32.958544+0000","last_peered":"2024-08-09T00:38:32.958544+0000","last_clean":"2024-08-09T00:38:32.958544+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:38:32.958544+0000","last_undegraded":"2024-08-09T00:38:32.958544+0000","last_fullsized":"2024-08-09T00:38:32.958544+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:05:18.665033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587946+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:40:30.587946+0000","last_peered":"2024-08-09T00:40:30.587946+0000","last_clean":"2024-08-09T00:40:30.587946+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:40:30.587946+0000","last_undegraded":"2024-08-09T00:40:30.587946+0000","last_fullsized":"2024-08-09T00:40:30.587946+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:48:27.331256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":406,"num_read_kb":7859,"num_write":1109,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833217+0000","last_change":"2024-08-08T23:28:26.779441+0000","last_active":"2024-08-09T00:37:12.833217+0000","last_peered":"2024-08-09T00:37:12.833217+0000","last_clean":"2024-08-09T00:37:12.833217+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:37:12.833217+0000","last_undegraded":"2024-08-09T00:37:12.833217+0000","last_fullsized":"2024-08-09T00:37:12.833217+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:59:29.987307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'239","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.602611+0000","last_change":"2024-08-08T23:28:24.759289+0000","last_active":"2024-08-09T00:40:30.602611+0000","last_peered":"2024-08-09T00:40:30.602611+0000","last_clean":"2024-08-09T00:40:30.602611+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:40:30.602611+0000","last_undegraded":"2024-08-09T00:40:30.602611+0000","last_fullsized":"2024-08-09T00:40:30.602611+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:55:07.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4141181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":20658,"num_write":1118,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:56.569083+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:37:56.569083+0000","last_peered":"2024-08-09T00:37:56.569083+0000","last_clean":"2024-08-09T00:37:56.569083+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:37:56.569083+0000","last_undegraded":"2024-08-09T00:37:56.569083+0000","last_fullsized":"2024-08-09T00:37:56.569083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:23.078114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'200","reported_seq":816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.357574+0000","last_change":"2024-08-08T23:28:24.795170+0000","last_active":"2024-08-09T00:40:30.357574+0000","last_peered":"2024-08-09T00:40:30.357574+0000","last_clean":"2024-08-09T00:40:30.357574+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:40:30.357574+0000","last_undegraded":"2024-08-09T00:40:30.357574+0000","last_fullsized":"2024-08-09T00:40:30.357574+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:54:04.809402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":364,"num_read_kb":32922,"num_write":1098,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'232","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:12.833591+0000","last_change":"2024-08-08T23:28:26.770453+0000","last_active":"2024-08-09T00:37:12.833591+0000","last_peered":"2024-08-09T00:37:12.833591+0000","last_clean":"2024-08-09T00:37:12.833591+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:37:12.833591+0000","last_undegraded":"2024-08-09T00:37:12.833591+0000","last_fullsized":"2024-08-09T00:37:12.833591+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:19:56.100383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'255","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.617479+0000","last_change":"2024-08-08T23:29:01.888000+0000","last_active":"2024-08-09T00:40:30.617479+0000","last_peered":"2024-08-09T00:40:30.617479+0000","last_clean":"2024-08-09T00:40:30.617479+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:40:30.617479+0000","last_undegraded":"2024-08-09T00:40:30.617479+0000","last_fullsized":"2024-08-09T00:40:30.617479+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:43.322003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":18739,"num_write":1245,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:13.709916+0000","last_change":"2024-08-08T23:28:26.775305+0000","last_active":"2024-08-09T00:36:13.709916+0000","last_peered":"2024-08-09T00:36:13.709916+0000","last_clean":"2024-08-09T00:36:13.709916+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:36:13.709916+0000","last_undegraded":"2024-08-09T00:36:13.709916+0000","last_fullsized":"2024-08-09T00:36:13.709916+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:15:22.024427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'189","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.544915+0000","last_change":"2024-08-08T23:28:24.788596+0000","last_active":"2024-08-09T00:40:30.544915+0000","last_peered":"2024-08-09T00:40:30.544915+0000","last_clean":"2024-08-09T00:40:30.544915+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:40:30.544915+0000","last_undegraded":"2024-08-09T00:40:30.544915+0000","last_fullsized":"2024-08-09T00:40:30.544915+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:22.391786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917966,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":400,"num_read_kb":34111,"num_write":1045,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'81","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:04.076175+0000","last_change":"2024-08-08T23:28:26.763616+0000","last_active":"2024-08-09T00:38:04.076175+0000","last_peered":"2024-08-09T00:38:04.076175+0000","last_clean":"2024-08-09T00:38:04.076175+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:38:04.076175+0000","last_undegraded":"2024-08-09T00:38:04.076175+0000","last_fullsized":"2024-08-09T00:38:04.076175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:06.979294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'206","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.628965+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:40:30.628965+0000","last_peered":"2024-08-09T00:40:30.628965+0000","last_clean":"2024-08-09T00:40:30.628965+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:40:30.628965+0000","last_undegraded":"2024-08-09T00:40:30.628965+0000","last_fullsized":"2024-08-09T00:40:30.628965+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:23.874712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":96889,"num_write":1101,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:04.420125+0000","last_change":"2024-08-08T23:28:26.767042+0000","last_active":"2024-08-09T00:37:04.420125+0000","last_peered":"2024-08-09T00:37:04.420125+0000","last_clean":"2024-08-09T00:37:04.420125+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:37:04.420125+0000","last_undegraded":"2024-08-09T00:37:04.420125+0000","last_fullsized":"2024-08-09T00:37:04.420125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:08:15.401572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'184","reported_seq":826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.310145+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:40:30.310145+0000","last_peered":"2024-08-09T00:40:30.310145+0000","last_clean":"2024-08-09T00:40:30.310145+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:40:30.310145+0000","last_undegraded":"2024-08-09T00:40:30.310145+0000","last_fullsized":"2024-08-09T00:40:30.310145+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:35:20.239264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":443,"num_read_kb":71209,"num_write":978,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.849790+0000","last_change":"2024-08-08T23:28:26.778789+0000","last_active":"2024-08-09T00:38:12.849790+0000","last_peered":"2024-08-09T00:38:12.849790+0000","last_clean":"2024-08-09T00:38:12.849790+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:38:12.849790+0000","last_undegraded":"2024-08-09T00:38:12.849790+0000","last_fullsized":"2024-08-09T00:38:12.849790+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:52:39.269574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'175","reported_seq":791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.484787+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:40:30.484787+0000","last_peered":"2024-08-09T00:40:30.484787+0000","last_clean":"2024-08-09T00:40:30.484787+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:40:30.484787+0000","last_undegraded":"2024-08-09T00:40:30.484787+0000","last_fullsized":"2024-08-09T00:40:30.484787+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:59:20.066552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":31431,"num_write":995,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:19.855443+0000","last_change":"2024-08-08T23:28:26.782721+0000","last_active":"2024-08-09T00:39:19.855443+0000","last_peered":"2024-08-09T00:39:19.855443+0000","last_clean":"2024-08-09T00:39:19.855443+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:39:19.855443+0000","last_undegraded":"2024-08-09T00:39:19.855443+0000","last_fullsized":"2024-08-09T00:39:19.855443+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:29:54.581163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'231","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.357579+0000","last_change":"2024-08-08T23:28:24.763154+0000","last_active":"2024-08-09T00:40:30.357579+0000","last_peered":"2024-08-09T00:40:30.357579+0000","last_clean":"2024-08-09T00:40:30.357579+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:40:30.357579+0000","last_undegraded":"2024-08-09T00:40:30.357579+0000","last_fullsized":"2024-08-09T00:40:30.357579+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:09.336390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":70204,"num_write":1298,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.843242+0000","last_change":"2024-08-08T23:28:26.773873+0000","last_active":"2024-08-09T00:38:12.843242+0000","last_peered":"2024-08-09T00:38:12.843242+0000","last_clean":"2024-08-09T00:38:12.843242+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:38:12.843242+0000","last_undegraded":"2024-08-09T00:38:12.843242+0000","last_fullsized":"2024-08-09T00:38:12.843242+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:24:31.308127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'214","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.577766+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:40:30.577766+0000","last_peered":"2024-08-09T00:40:30.577766+0000","last_clean":"2024-08-09T00:40:30.577766+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:40:30.577766+0000","last_undegraded":"2024-08-09T00:40:30.577766+0000","last_fullsized":"2024-08-09T00:40:30.577766+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:22.337895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":54938,"num_write":1149,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:12.672406+0000","last_change":"2024-08-08T23:28:26.754194+0000","last_active":"2024-08-09T00:38:12.672406+0000","last_peered":"2024-08-09T00:38:12.672406+0000","last_clean":"2024-08-09T00:38:12.672406+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:38:12.672406+0000","last_undegraded":"2024-08-09T00:38:12.672406+0000","last_fullsized":"2024-08-09T00:38:12.672406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:36:20.564322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'161","reported_seq":791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.614942+0000","last_change":"2024-08-08T23:28:24.763602+0000","last_active":"2024-08-09T00:40:30.614942+0000","last_peered":"2024-08-09T00:40:30.614942+0000","last_clean":"2024-08-09T00:40:30.614942+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:40:30.614942+0000","last_undegraded":"2024-08-09T00:40:30.614942+0000","last_fullsized":"2024-08-09T00:40:30.614942+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:31.123341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029153,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":19124,"num_write":939,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:57.870130+0000","last_change":"2024-08-08T23:28:26.782907+0000","last_active":"2024-08-09T00:37:57.870130+0000","last_peered":"2024-08-09T00:37:57.870130+0000","last_clean":"2024-08-09T00:37:57.870130+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:37:57.870130+0000","last_undegraded":"2024-08-09T00:37:57.870130+0000","last_fullsized":"2024-08-09T00:37:57.870130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:17:55.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'233","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.612027+0000","last_change":"2024-08-08T23:28:24.815220+0000","last_active":"2024-08-09T00:40:30.612027+0000","last_peered":"2024-08-09T00:40:30.612027+0000","last_clean":"2024-08-09T00:40:30.612027+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:40:30.612027+0000","last_undegraded":"2024-08-09T00:40:30.612027+0000","last_fullsized":"2024-08-09T00:40:30.612027+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:20:31.780990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":89533,"num_write":1169,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'222","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.571762+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:40:30.571762+0000","last_peered":"2024-08-09T00:40:30.571762+0000","last_clean":"2024-08-09T00:40:30.571762+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:40:30.571762+0000","last_undegraded":"2024-08-09T00:40:30.571762+0000","last_fullsized":"2024-08-09T00:40:30.571762+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:25.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055020,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":157320,"num_write":1033,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:36:22.819437+0000","last_change":"2024-08-08T23:28:26.766116+0000","last_active":"2024-08-09T00:36:22.819437+0000","last_peered":"2024-08-09T00:36:22.819437+0000","last_clean":"2024-08-09T00:36:22.819437+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:36:22.819437+0000","last_undegraded":"2024-08-09T00:36:22.819437+0000","last_fullsized":"2024-08-09T00:36:22.819437+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:53:40.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'185","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.355947+0000","last_change":"2024-08-08T23:28:24.777397+0000","last_active":"2024-08-09T00:40:30.355947+0000","last_peered":"2024-08-09T00:40:30.355947+0000","last_clean":"2024-08-09T00:40:30.355947+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:40:30.355947+0000","last_undegraded":"2024-08-09T00:40:30.355947+0000","last_fullsized":"2024-08-09T00:40:30.355947+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-09T23:58:46.812342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":17056,"num_write":1042,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:37:21.953586+0000","last_change":"2024-08-08T23:28:26.790814+0000","last_active":"2024-08-09T00:37:21.953586+0000","last_peered":"2024-08-09T00:37:21.953586+0000","last_clean":"2024-08-09T00:37:21.953586+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:37:21.953586+0000","last_undegraded":"2024-08-09T00:37:21.953586+0000","last_fullsized":"2024-08-09T00:37:21.953586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:39:18.226934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1052,"ondisk_log_size":1052,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1764,"ondisk_log_size":1764,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":494,"ondisk_log_size":494,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314750,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9845,"num_read_kb":12223,"num_write":6853,"num_write_kb":2887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1912,"ondisk_log_size":1912,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1613,"num_read_kb":1921,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3446,"ondisk_log_size":3446,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":88031934,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":32363,"num_read_kb":2279985,"num_write":69541,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134025216,"data_stored":134025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4276,"ondisk_log_size":4276,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":194734,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":183422,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575723,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246872,"kb_used_data":21248,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94124968,"statfs":{"total":96636764160,"available":96383967232,"internally_reserved":0,"allocated":21757952,"data_stored":19593835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575721,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284116,"kb_used_data":22436,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94087724,"statfs":{"total":96636764160,"available":96345829376,"internally_reserved":0,"allocated":22974464,"data_stored":20860820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575722,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107272,"kb_used_data":17760,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264568,"statfs":{"total":96636764160,"available":96526917632,"internally_reserved":0,"allocated":18186240,"data_stored":16015430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575721,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110220,"kb_used_data":20728,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94261620,"statfs":{"total":96636764160,"available":96523898880,"internally_reserved":0,"allocated":21225472,"data_stored":19169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575720,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235316,"kb_used_data":23576,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94136524,"statfs":{"total":96636764160,"available":96395800576,"internally_reserved":0,"allocated":24141824,"data_stored":22000945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575721,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105916,"kb_used_data":20632,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265924,"statfs":{"total":96636764160,"available":96528306176,"internally_reserved":0,"allocated":21127168,"data_stored":19032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575724,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145184,"kb_used_data":19616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94226656,"statfs":{"total":96636764160,"available":96488095744,"internally_reserved":0,"allocated":20086784,"data_stored":17965451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575721,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236644,"kb_used_data":20776,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94135196,"statfs":{"total":96636764160,"available":96394440704,"internally_reserved":0,"allocated":21274624,"data_stored":19114679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16203776,"data_stored":16203776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16715776,"data_stored":16715776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19681280,"data_stored":19681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18542592,"data_stored":18542592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":16683008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:40:37.485 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.485 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.485 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.485 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.486 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.487 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.488 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.489 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.490 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.490 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.490 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.490 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.490 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.491 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.492 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.493 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.494 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.495 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.496 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.497 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.498 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.499 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.500 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.501 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.502 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.503 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.504 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.505 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.506 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.507 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.508 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.508 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.508 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.508 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.508 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.509 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.510 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.511 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.512 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.513 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.514 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.515 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.516 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.517 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.518 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.519 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.520 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.521 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.521 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.521 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.521 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.522 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-08T23:28:08.717706+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=8, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.523 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.524 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.525 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.526 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.527 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.528 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.529 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.530 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.531 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.531 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.531 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.531 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.531 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.532 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.533 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.534 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.535 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.535 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.535 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.538 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.539 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.539 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.539 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.539 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.539 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.540 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.541 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.542 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.543 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.543 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.543 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.543 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.543 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.544 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.545 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.546 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.547 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.548 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.549 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.550 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.550 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.550 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.550 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.551 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.552 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.552 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.552 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.552 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.552 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:37.553 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-09T00:40:57.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:40:57.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:40:57.947 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:40:57.950 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2445,"stamp":"2024-08-09T00:40:57.322709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88958767,"num_objects":608,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":150062,"num_read_kb":2759937,"num_write":130193,"num_write_kb":2369717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":570978,"num_omap_keys":1423,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13243,"ondisk_log_size":13243,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1471092,"kb_used_data":166772,"kb_used_omap":12,"kb_used_meta":1304243,"kb_avail":753503628,"statfs":{"total":773094113280,"available":771587715072,"internally_reserved":0,"allocated":170774528,"data_stored":153754026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1335545392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":563346,"num_omap_keys":1396,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007709"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:33.092751+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:39:33.092751+0000","last_peered":"2024-08-09T00:39:33.092751+0000","last_clean":"2024-08-09T00:39:33.092751+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:39:33.092751+0000","last_undegraded":"2024-08-09T00:39:33.092751+0000","last_fullsized":"2024-08-09T00:39:33.092751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:43.081838+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:38:43.081838+0000","last_peered":"2024-08-09T00:38:43.081838+0000","last_clean":"2024-08-09T00:38:43.081838+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:38:43.081838+0000","last_undegraded":"2024-08-09T00:38:43.081838+0000","last_fullsized":"2024-08-09T00:38:43.081838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.271065+0000","last_change":"2024-08-09T00:40:39.271122+0000","last_active":"2024-08-09T00:40:39.271065+0000","last_peered":"2024-08-09T00:40:39.271065+0000","last_clean":"2024-08-09T00:40:39.271065+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:40:39.271065+0000","last_undegraded":"2024-08-09T00:40:39.271065+0000","last_fullsized":"2024-08-09T00:40:39.271065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.270864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:38.071300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.658655+0000","last_change":"2024-08-09T00:40:35.658714+0000","last_active":"2024-08-09T00:40:35.658655+0000","last_peered":"2024-08-09T00:40:35.658655+0000","last_clean":"2024-08-09T00:40:35.658655+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:40:35.658655+0000","last_undegraded":"2024-08-09T00:40:35.658655+0000","last_fullsized":"2024-08-09T00:40:35.658655+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.658455+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:16.669438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.863928+0000","last_change":"2024-08-09T00:04:29.843428+0000","last_active":"2024-08-09T00:39:32.863928+0000","last_peered":"2024-08-09T00:39:32.863928+0000","last_clean":"2024-08-09T00:39:32.863928+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:39:32.863928+0000","last_undegraded":"2024-08-09T00:39:32.863928+0000","last_fullsized":"2024-08-09T00:39:32.863928+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.638804+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:40:30.638804+0000","last_peered":"2024-08-09T00:40:30.638804+0000","last_clean":"2024-08-09T00:40:30.638804+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:40:30.638804+0000","last_undegraded":"2024-08-09T00:40:30.638804+0000","last_fullsized":"2024-08-09T00:40:30.638804+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'12","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.802312+0000","last_change":"2024-08-09T00:40:34.802356+0000","last_active":"2024-08-09T00:40:34.802312+0000","last_peered":"2024-08-09T00:40:34.802312+0000","last_clean":"2024-08-09T00:40:34.802312+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:40:34.802312+0000","last_undegraded":"2024-08-09T00:40:34.802312+0000","last_fullsized":"2024-08-09T00:40:34.802312+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.802208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:12.870620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4144,"num_write":22,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.185297+0000","last_change":"2024-08-09T00:40:35.185356+0000","last_active":"2024-08-09T00:40:35.185297+0000","last_peered":"2024-08-09T00:40:35.185297+0000","last_clean":"2024-08-09T00:40:35.185297+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:40:35.185297+0000","last_undegraded":"2024-08-09T00:40:35.185297+0000","last_fullsized":"2024-08-09T00:40:35.185297+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.185085+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:13:40.941525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.590499+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:40:36.590499+0000","last_peered":"2024-08-09T00:40:36.590499+0000","last_clean":"2024-08-09T00:40:36.590499+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:40:36.590499+0000","last_undegraded":"2024-08-09T00:40:36.590499+0000","last_fullsized":"2024-08-09T00:40:36.590499+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822503+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:40:33.822503+0000","last_peered":"2024-08-09T00:40:33.822503+0000","last_clean":"2024-08-09T00:40:33.822503+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:40:33.822503+0000","last_undegraded":"2024-08-09T00:40:33.822503+0000","last_fullsized":"2024-08-09T00:40:33.822503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.742978+0000","last_change":"2024-08-08T23:48:38.096960+0000","last_active":"2024-08-09T00:40:34.742978+0000","last_peered":"2024-08-09T00:40:34.742978+0000","last_clean":"2024-08-09T00:40:34.742978+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:40:34.742978+0000","last_undegraded":"2024-08-09T00:40:34.742978+0000","last_fullsized":"2024-08-09T00:40:34.742978+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.643998+0000","last_change":"2024-08-09T00:40:41.644063+0000","last_active":"2024-08-09T00:40:41.643998+0000","last_peered":"2024-08-09T00:40:41.643998+0000","last_clean":"2024-08-09T00:40:41.643998+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:40:41.643998+0000","last_undegraded":"2024-08-09T00:40:41.643998+0000","last_fullsized":"2024-08-09T00:40:41.643998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.643807+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:22.863068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.677276+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:38:32.677276+0000","last_peered":"2024-08-09T00:38:32.677276+0000","last_clean":"2024-08-09T00:38:32.677276+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:38:32.677276+0000","last_undegraded":"2024-08-09T00:38:32.677276+0000","last_fullsized":"2024-08-09T00:38:32.677276+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210762+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:40:35.210762+0000","last_peered":"2024-08-09T00:40:35.210762+0000","last_clean":"2024-08-09T00:40:35.210762+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:40:35.210762+0000","last_undegraded":"2024-08-09T00:40:35.210762+0000","last_fullsized":"2024-08-09T00:40:35.210762+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.137960+0000","last_change":"2024-08-09T00:40:46.138108+0000","last_active":"2024-08-09T00:40:46.137960+0000","last_peered":"2024-08-09T00:40:46.137960+0000","last_clean":"2024-08-09T00:40:46.137960+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:40:46.137960+0000","last_undegraded":"2024-08-09T00:40:46.137960+0000","last_fullsized":"2024-08-09T00:40:46.137960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.137726+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:04.630323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.280270+0000","last_change":"2024-08-09T00:40:41.280331+0000","last_active":"2024-08-09T00:40:41.280270+0000","last_peered":"2024-08-09T00:40:41.280270+0000","last_clean":"2024-08-09T00:40:41.280270+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:40:41.280270+0000","last_undegraded":"2024-08-09T00:40:41.280270+0000","last_fullsized":"2024-08-09T00:40:41.280270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.280078+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:02:07.630638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210912+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:40:35.210912+0000","last_peered":"2024-08-09T00:40:35.210912+0000","last_clean":"2024-08-09T00:40:35.210912+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:40:35.210912+0000","last_undegraded":"2024-08-09T00:40:35.210912+0000","last_fullsized":"2024-08-09T00:40:35.210912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.285006+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:40:30.285006+0000","last_peered":"2024-08-09T00:40:30.285006+0000","last_clean":"2024-08-09T00:40:30.285006+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:40:30.285006+0000","last_undegraded":"2024-08-09T00:40:30.285006+0000","last_fullsized":"2024-08-09T00:40:30.285006+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17458,"num_write":16,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.633589+0000","last_change":"2024-08-09T00:40:34.633632+0000","last_active":"2024-08-09T00:40:34.633589+0000","last_peered":"2024-08-09T00:40:34.633589+0000","last_clean":"2024-08-09T00:40:34.633589+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:40:34.633589+0000","last_undegraded":"2024-08-09T00:40:34.633589+0000","last_fullsized":"2024-08-09T00:40:34.633589+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.633469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:40.040241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.238228+0000","last_change":"2024-08-09T00:40:38.238357+0000","last_active":"2024-08-09T00:40:38.238228+0000","last_peered":"2024-08-09T00:40:38.238228+0000","last_clean":"2024-08-09T00:40:38.238228+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:40:38.238228+0000","last_undegraded":"2024-08-09T00:40:38.238228+0000","last_fullsized":"2024-08-09T00:40:38.238228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.237982+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:45.723779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.878057+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:39:57.878057+0000","last_peered":"2024-08-09T00:39:57.878057+0000","last_clean":"2024-08-09T00:39:57.878057+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:39:57.878057+0000","last_undegraded":"2024-08-09T00:39:57.878057+0000","last_fullsized":"2024-08-09T00:39:57.878057+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.867179+0000","last_change":"2024-08-08T23:48:42.099507+0000","last_active":"2024-08-09T00:39:27.867179+0000","last_peered":"2024-08-09T00:39:27.867179+0000","last_clean":"2024-08-09T00:39:27.867179+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:39:27.867179+0000","last_undegraded":"2024-08-09T00:39:27.867179+0000","last_fullsized":"2024-08-09T00:39:27.867179+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.913495+0000","last_change":"2024-08-09T00:40:37.913550+0000","last_active":"2024-08-09T00:40:37.913495+0000","last_peered":"2024-08-09T00:40:37.913495+0000","last_clean":"2024-08-09T00:40:37.913495+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:40:37.913495+0000","last_undegraded":"2024-08-09T00:40:37.913495+0000","last_fullsized":"2024-08-09T00:40:37.913495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.913298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:15.804242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.915549+0000","last_change":"2024-08-09T00:40:36.915685+0000","last_active":"2024-08-09T00:40:36.915549+0000","last_peered":"2024-08-09T00:40:36.915549+0000","last_clean":"2024-08-09T00:40:36.915549+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:40:36.915549+0000","last_undegraded":"2024-08-09T00:40:36.915549+0000","last_fullsized":"2024-08-09T00:40:36.915549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.915302+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:49:03.528537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893168+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:39:32.893168+0000","last_peered":"2024-08-09T00:39:32.893168+0000","last_clean":"2024-08-09T00:39:32.893168+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:39:32.893168+0000","last_undegraded":"2024-08-09T00:39:32.893168+0000","last_fullsized":"2024-08-09T00:39:32.893168+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410045+0000","last_change":"2024-08-08T23:48:42.104797+0000","last_active":"2024-08-09T00:40:30.410045+0000","last_peered":"2024-08-09T00:40:30.410045+0000","last_clean":"2024-08-09T00:40:30.410045+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:40:30.410045+0000","last_undegraded":"2024-08-09T00:40:30.410045+0000","last_fullsized":"2024-08-09T00:40:30.410045+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.286994+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:40:30.286994+0000","last_peered":"2024-08-09T00:40:30.286994+0000","last_clean":"2024-08-09T00:40:30.286994+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:40:30.286994+0000","last_undegraded":"2024-08-09T00:40:30.286994+0000","last_fullsized":"2024-08-09T00:40:30.286994+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.707450+0000","last_change":"2024-08-09T00:40:39.707514+0000","last_active":"2024-08-09T00:40:39.707450+0000","last_peered":"2024-08-09T00:40:39.707450+0000","last_clean":"2024-08-09T00:40:39.707450+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:40:39.707450+0000","last_undegraded":"2024-08-09T00:40:39.707450+0000","last_fullsized":"2024-08-09T00:40:39.707450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.707247+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:07.954822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893277+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:39:32.893277+0000","last_peered":"2024-08-09T00:39:32.893277+0000","last_clean":"2024-08-09T00:39:32.893277+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:39:32.893277+0000","last_undegraded":"2024-08-09T00:39:32.893277+0000","last_fullsized":"2024-08-09T00:39:32.893277+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.308280+0000","last_change":"2024-08-09T00:40:43.308345+0000","last_active":"2024-08-09T00:40:43.308280+0000","last_peered":"2024-08-09T00:40:43.308280+0000","last_clean":"2024-08-09T00:40:43.308280+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:40:43.308280+0000","last_undegraded":"2024-08-09T00:40:43.308280+0000","last_fullsized":"2024-08-09T00:40:43.308280+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.308076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:30.144196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.660830+0000","last_change":"2024-08-09T00:40:36.660858+0000","last_active":"2024-08-09T00:40:36.660830+0000","last_peered":"2024-08-09T00:40:36.660830+0000","last_clean":"2024-08-09T00:40:36.660830+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:40:36.660830+0000","last_undegraded":"2024-08-09T00:40:36.660830+0000","last_fullsized":"2024-08-09T00:40:36.660830+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.660732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:31:02.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.833334+0000","last_change":"2024-08-09T00:40:36.833359+0000","last_active":"2024-08-09T00:40:36.833334+0000","last_peered":"2024-08-09T00:40:36.833334+0000","last_clean":"2024-08-09T00:40:36.833334+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:40:36.833334+0000","last_undegraded":"2024-08-09T00:40:36.833334+0000","last_fullsized":"2024-08-09T00:40:36.833334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.833241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:35:54.834498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.872351+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:39:32.872351+0000","last_peered":"2024-08-09T00:39:32.872351+0000","last_clean":"2024-08-09T00:39:32.872351+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:39:32.872351+0000","last_undegraded":"2024-08-09T00:39:32.872351+0000","last_fullsized":"2024-08-09T00:39:32.872351+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'7","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.572470+0000","last_change":"2024-08-08T23:48:42.569594+0000","last_active":"2024-08-09T00:40:30.572470+0000","last_peered":"2024-08-09T00:40:30.572470+0000","last_clean":"2024-08-09T00:40:30.572470+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:40:30.572470+0000","last_undegraded":"2024-08-09T00:40:30.572470+0000","last_fullsized":"2024-08-09T00:40:30.572470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.264682+0000","last_change":"2024-08-09T00:40:52.264744+0000","last_active":"2024-08-09T00:40:52.264682+0000","last_peered":"2024-08-09T00:40:52.264682+0000","last_clean":"2024-08-09T00:40:52.264682+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:40:52.264682+0000","last_undegraded":"2024-08-09T00:40:52.264682+0000","last_fullsized":"2024-08-09T00:40:52.264682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.264488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:36:28.875953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.729225+0000","last_change":"2024-08-09T00:40:38.729357+0000","last_active":"2024-08-09T00:40:38.729225+0000","last_peered":"2024-08-09T00:40:38.729225+0000","last_clean":"2024-08-09T00:40:38.729225+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:40:38.729225+0000","last_undegraded":"2024-08-09T00:40:38.729225+0000","last_fullsized":"2024-08-09T00:40:38.729225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.728971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:46:20.124323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.863885+0000","last_change":"2024-08-09T00:04:29.838090+0000","last_active":"2024-08-09T00:39:32.863885+0000","last_peered":"2024-08-09T00:39:32.863885+0000","last_clean":"2024-08-09T00:39:32.863885+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:39:32.863885+0000","last_undegraded":"2024-08-09T00:39:32.863885+0000","last_fullsized":"2024-08-09T00:39:32.863885+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:12.700766+0000","last_change":"2024-08-08T23:48:42.571114+0000","last_active":"2024-08-09T00:40:12.700766+0000","last_peered":"2024-08-09T00:40:12.700766+0000","last_clean":"2024-08-09T00:40:12.700766+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:40:12.700766+0000","last_undegraded":"2024-08-09T00:40:12.700766+0000","last_fullsized":"2024-08-09T00:40:12.700766+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.602304+0000","last_change":"2024-08-09T00:40:37.602366+0000","last_active":"2024-08-09T00:40:37.602304+0000","last_peered":"2024-08-09T00:40:37.602304+0000","last_clean":"2024-08-09T00:40:37.602304+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:40:37.602304+0000","last_undegraded":"2024-08-09T00:40:37.602304+0000","last_fullsized":"2024-08-09T00:40:37.602304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.602099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:43:52.947621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.237531+0000","last_change":"2024-08-09T00:40:40.237588+0000","last_active":"2024-08-09T00:40:40.237531+0000","last_peered":"2024-08-09T00:40:40.237531+0000","last_clean":"2024-08-09T00:40:40.237531+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:40:40.237531+0000","last_undegraded":"2024-08-09T00:40:40.237531+0000","last_fullsized":"2024-08-09T00:40:40.237531+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.237342+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:46:29.023191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893029+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:39:32.893029+0000","last_peered":"2024-08-09T00:39:32.893029+0000","last_clean":"2024-08-09T00:39:32.893029+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:39:32.893029+0000","last_undegraded":"2024-08-09T00:39:32.893029+0000","last_fullsized":"2024-08-09T00:39:32.893029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.690595+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:39:27.690595+0000","last_peered":"2024-08-09T00:39:27.690595+0000","last_clean":"2024-08-09T00:39:27.690595+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:39:27.690595+0000","last_undegraded":"2024-08-09T00:39:27.690595+0000","last_fullsized":"2024-08-09T00:39:27.690595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.862339+0000","last_change":"2024-08-08T23:48:38.069892+0000","last_active":"2024-08-09T00:39:22.862339+0000","last_peered":"2024-08-09T00:39:22.862339+0000","last_clean":"2024-08-09T00:39:22.862339+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:39:22.862339+0000","last_undegraded":"2024-08-09T00:39:22.862339+0000","last_fullsized":"2024-08-09T00:39:22.862339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.232009+0000","last_change":"2024-08-09T00:40:37.232034+0000","last_active":"2024-08-09T00:40:37.232009+0000","last_peered":"2024-08-09T00:40:37.232009+0000","last_clean":"2024-08-09T00:40:37.232009+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:40:37.232009+0000","last_undegraded":"2024-08-09T00:40:37.232009+0000","last_fullsized":"2024-08-09T00:40:37.232009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.231936+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:46.987261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:33.092698+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:39:33.092698+0000","last_peered":"2024-08-09T00:39:33.092698+0000","last_clean":"2024-08-09T00:39:33.092698+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:39:33.092698+0000","last_undegraded":"2024-08-09T00:39:33.092698+0000","last_fullsized":"2024-08-09T00:39:33.092698+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'4","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.648028+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:40:30.648028+0000","last_peered":"2024-08-09T00:40:30.648028+0000","last_clean":"2024-08-09T00:40:30.648028+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:40:30.648028+0000","last_undegraded":"2024-08-09T00:40:30.648028+0000","last_fullsized":"2024-08-09T00:40:30.648028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.636164+0000","last_change":"2024-08-09T00:40:44.636229+0000","last_active":"2024-08-09T00:40:44.636164+0000","last_peered":"2024-08-09T00:40:44.636164+0000","last_clean":"2024-08-09T00:40:44.636164+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:40:44.636164+0000","last_undegraded":"2024-08-09T00:40:44.636164+0000","last_fullsized":"2024-08-09T00:40:44.636164+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.635966+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:22.290779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.541223+0000","last_change":"2024-08-09T00:40:45.541393+0000","last_active":"2024-08-09T00:40:45.541223+0000","last_peered":"2024-08-09T00:40:45.541223+0000","last_clean":"2024-08-09T00:40:45.541223+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:40:45.541223+0000","last_undegraded":"2024-08-09T00:40:45.541223+0000","last_fullsized":"2024-08-09T00:40:45.541223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.540982+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:27:18.363747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210877+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:40:35.210877+0000","last_peered":"2024-08-09T00:40:35.210877+0000","last_clean":"2024-08-09T00:40:35.210877+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:40:35.210877+0000","last_undegraded":"2024-08-09T00:40:35.210877+0000","last_fullsized":"2024-08-09T00:40:35.210877+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.879051+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:40:02.879051+0000","last_peered":"2024-08-09T00:40:02.879051+0000","last_clean":"2024-08-09T00:40:02.879051+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:40:02.879051+0000","last_undegraded":"2024-08-09T00:40:02.879051+0000","last_fullsized":"2024-08-09T00:40:02.879051+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.024780+0000","last_change":"2024-08-09T00:40:50.024835+0000","last_active":"2024-08-09T00:40:50.024780+0000","last_peered":"2024-08-09T00:40:50.024780+0000","last_clean":"2024-08-09T00:40:50.024780+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:40:50.024780+0000","last_undegraded":"2024-08-09T00:40:50.024780+0000","last_fullsized":"2024-08-09T00:40:50.024780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.024567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:42:36.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":195,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.540116+0000","last_change":"2024-08-09T00:40:43.540116+0000","last_active":"2024-08-09T00:40:43.540116+0000","last_peered":"2024-08-09T00:40:43.540116+0000","last_clean":"2024-08-09T00:40:43.540116+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:40:43.540116+0000","last_undegraded":"2024-08-09T00:40:43.540116+0000","last_fullsized":"2024-08-09T00:40:43.540116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'47","last_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_deep_scrub":"268'47","last_deep_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.539854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:53:56.070084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822645+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:40:33.822645+0000","last_peered":"2024-08-09T00:40:33.822645+0000","last_clean":"2024-08-09T00:40:33.822645+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:40:33.822645+0000","last_undegraded":"2024-08-09T00:40:33.822645+0000","last_fullsized":"2024-08-09T00:40:33.822645+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410627+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:40:30.410627+0000","last_peered":"2024-08-09T00:40:30.410627+0000","last_clean":"2024-08-09T00:40:30.410627+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:40:30.410627+0000","last_undegraded":"2024-08-09T00:40:30.410627+0000","last_fullsized":"2024-08-09T00:40:30.410627+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.189314+0000","last_change":"2024-08-09T00:40:36.189393+0000","last_active":"2024-08-09T00:40:36.189314+0000","last_peered":"2024-08-09T00:40:36.189314+0000","last_clean":"2024-08-09T00:40:36.189314+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:40:36.189314+0000","last_undegraded":"2024-08-09T00:40:36.189314+0000","last_fullsized":"2024-08-09T00:40:36.189314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.189163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:32.228273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.680167+0000","last_change":"2024-08-09T00:40:42.680167+0000","last_active":"2024-08-09T00:40:42.680167+0000","last_peered":"2024-08-09T00:40:42.680167+0000","last_clean":"2024-08-09T00:40:42.680167+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:40:42.680167+0000","last_undegraded":"2024-08-09T00:40:42.680167+0000","last_fullsized":"2024-08-09T00:40:42.680167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.679754+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:38.367106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:42.864927+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:39:42.864927+0000","last_peered":"2024-08-09T00:39:42.864927+0000","last_clean":"2024-08-09T00:39:42.864927+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:39:42.864927+0000","last_undegraded":"2024-08-09T00:39:42.864927+0000","last_fullsized":"2024-08-09T00:39:42.864927+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'4","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410359+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:40:30.410359+0000","last_peered":"2024-08-09T00:40:30.410359+0000","last_clean":"2024-08-09T00:40:30.410359+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:40:30.410359+0000","last_undegraded":"2024-08-09T00:40:30.410359+0000","last_fullsized":"2024-08-09T00:40:30.410359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.562660+0000","last_change":"2024-08-08T23:48:38.094796+0000","last_active":"2024-08-09T00:40:30.562660+0000","last_peered":"2024-08-09T00:40:30.562660+0000","last_clean":"2024-08-09T00:40:30.562660+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:40:30.562660+0000","last_undegraded":"2024-08-09T00:40:30.562660+0000","last_fullsized":"2024-08-09T00:40:30.562660+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10240,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.953904+0000","last_change":"2024-08-09T00:40:36.953904+0000","last_active":"2024-08-09T00:40:36.953904+0000","last_peered":"2024-08-09T00:40:36.953904+0000","last_clean":"2024-08-09T00:40:36.953904+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:40:36.953904+0000","last_undegraded":"2024-08-09T00:40:36.953904+0000","last_fullsized":"2024-08-09T00:40:36.953904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.953505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:31:08.054694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210860+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:40:35.210860+0000","last_peered":"2024-08-09T00:40:35.210860+0000","last_clean":"2024-08-09T00:40:35.210860+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:40:35.210860+0000","last_undegraded":"2024-08-09T00:40:35.210860+0000","last_fullsized":"2024-08-09T00:40:35.210860+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.874813+0000","last_change":"2024-08-08T23:48:42.119272+0000","last_active":"2024-08-09T00:40:02.874813+0000","last_peered":"2024-08-09T00:40:02.874813+0000","last_clean":"2024-08-09T00:40:02.874813+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:40:02.874813+0000","last_undegraded":"2024-08-09T00:40:02.874813+0000","last_fullsized":"2024-08-09T00:40:02.874813+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.513485+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:40:30.513485+0000","last_peered":"2024-08-09T00:40:30.513485+0000","last_clean":"2024-08-09T00:40:30.513485+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:40:30.513485+0000","last_undegraded":"2024-08-09T00:40:30.513485+0000","last_fullsized":"2024-08-09T00:40:30.513485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.290222+0000","last_change":"2024-08-09T00:40:42.290222+0000","last_active":"2024-08-09T00:40:42.290222+0000","last_peered":"2024-08-09T00:40:42.290222+0000","last_clean":"2024-08-09T00:40:42.290222+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:40:42.290222+0000","last_undegraded":"2024-08-09T00:40:42.290222+0000","last_fullsized":"2024-08-09T00:40:42.290222+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.289963+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:20.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.861321+0000","last_change":"2024-08-09T00:04:29.835767+0000","last_active":"2024-08-09T00:39:17.861321+0000","last_peered":"2024-08-09T00:39:17.861321+0000","last_clean":"2024-08-09T00:39:17.861321+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:39:17.861321+0000","last_undegraded":"2024-08-09T00:39:17.861321+0000","last_fullsized":"2024-08-09T00:39:17.861321+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.496698+0000","last_change":"2024-08-08T23:48:42.111533+0000","last_active":"2024-08-09T00:40:30.496698+0000","last_peered":"2024-08-09T00:40:30.496698+0000","last_clean":"2024-08-09T00:40:30.496698+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:40:30.496698+0000","last_undegraded":"2024-08-09T00:40:30.496698+0000","last_fullsized":"2024-08-09T00:40:30.496698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.617885+0000","last_change":"2024-08-09T00:40:40.617947+0000","last_active":"2024-08-09T00:40:40.617885+0000","last_peered":"2024-08-09T00:40:40.617885+0000","last_clean":"2024-08-09T00:40:40.617885+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:40:40.617885+0000","last_undegraded":"2024-08-09T00:40:40.617885+0000","last_fullsized":"2024-08-09T00:40:40.617885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.617682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:12:17.390972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.221511+0000","last_change":"2024-08-09T00:40:37.221534+0000","last_active":"2024-08-09T00:40:37.221511+0000","last_peered":"2024-08-09T00:40:37.221511+0000","last_clean":"2024-08-09T00:40:37.221511+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:40:37.221511+0000","last_undegraded":"2024-08-09T00:40:37.221511+0000","last_fullsized":"2024-08-09T00:40:37.221511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.221435+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:15.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.693352+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:40:32.693352+0000","last_peered":"2024-08-09T00:40:32.693352+0000","last_clean":"2024-08-09T00:40:32.693352+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:40:32.693352+0000","last_undegraded":"2024-08-09T00:40:32.693352+0000","last_fullsized":"2024-08-09T00:40:32.693352+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.291641+0000","last_change":"2024-08-09T00:40:47.291758+0000","last_active":"2024-08-09T00:40:47.291641+0000","last_peered":"2024-08-09T00:40:47.291641+0000","last_clean":"2024-08-09T00:40:47.291641+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:40:47.291641+0000","last_undegraded":"2024-08-09T00:40:47.291641+0000","last_fullsized":"2024-08-09T00:40:47.291641+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.291419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:22.686399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21602,"num_write":20,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.187960+0000","last_change":"2024-08-09T00:40:36.187987+0000","last_active":"2024-08-09T00:40:36.187960+0000","last_peered":"2024-08-09T00:40:36.187960+0000","last_clean":"2024-08-09T00:40:36.187960+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:40:36.187960+0000","last_undegraded":"2024-08-09T00:40:36.187960+0000","last_fullsized":"2024-08-09T00:40:36.187960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.187856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:49.116286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.267749+0000","last_change":"2024-08-09T00:40:40.267812+0000","last_active":"2024-08-09T00:40:40.267749+0000","last_peered":"2024-08-09T00:40:40.267749+0000","last_clean":"2024-08-09T00:40:40.267749+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:40:40.267749+0000","last_undegraded":"2024-08-09T00:40:40.267749+0000","last_fullsized":"2024-08-09T00:40:40.267749+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.267563+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:43:32.319577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.863915+0000","last_change":"2024-08-09T00:04:29.861378+0000","last_active":"2024-08-09T00:39:12.863915+0000","last_peered":"2024-08-09T00:39:12.863915+0000","last_clean":"2024-08-09T00:39:12.863915+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:39:12.863915+0000","last_undegraded":"2024-08-09T00:39:12.863915+0000","last_fullsized":"2024-08-09T00:39:12.863915+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279875+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:40:34.279875+0000","last_peered":"2024-08-09T00:40:34.279875+0000","last_clean":"2024-08-09T00:40:34.279875+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:40:34.279875+0000","last_undegraded":"2024-08-09T00:40:34.279875+0000","last_fullsized":"2024-08-09T00:40:34.279875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.617301+0000","last_change":"2024-08-09T00:40:52.617361+0000","last_active":"2024-08-09T00:40:52.617301+0000","last_peered":"2024-08-09T00:40:52.617301+0000","last_clean":"2024-08-09T00:40:52.617301+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:40:52.617301+0000","last_undegraded":"2024-08-09T00:40:52.617301+0000","last_fullsized":"2024-08-09T00:40:52.617301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.617100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:13:44.945362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.872169+0000","last_change":"2024-08-09T00:40:40.872232+0000","last_active":"2024-08-09T00:40:40.872169+0000","last_peered":"2024-08-09T00:40:40.872169+0000","last_clean":"2024-08-09T00:40:40.872169+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:40:40.872169+0000","last_undegraded":"2024-08-09T00:40:40.872169+0000","last_fullsized":"2024-08-09T00:40:40.872169+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.871937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:00:56.402314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.888413+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:39:12.888413+0000","last_peered":"2024-08-09T00:39:12.888413+0000","last_clean":"2024-08-09T00:39:12.888413+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:39:12.888413+0000","last_undegraded":"2024-08-09T00:39:12.888413+0000","last_fullsized":"2024-08-09T00:39:12.888413+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.321654+0000","last_change":"2024-08-09T00:40:51.321769+0000","last_active":"2024-08-09T00:40:51.321654+0000","last_peered":"2024-08-09T00:40:51.321654+0000","last_clean":"2024-08-09T00:40:51.321654+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:40:51.321654+0000","last_undegraded":"2024-08-09T00:40:51.321654+0000","last_fullsized":"2024-08-09T00:40:51.321654+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.321317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:07.828364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.818946+0000","last_change":"2024-08-09T00:40:37.819109+0000","last_active":"2024-08-09T00:40:37.818946+0000","last_peered":"2024-08-09T00:40:37.818946+0000","last_clean":"2024-08-09T00:40:37.818946+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:40:37.818946+0000","last_undegraded":"2024-08-09T00:40:37.818946+0000","last_fullsized":"2024-08-09T00:40:37.818946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.818705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:34.295358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:47.854839+0000","last_change":"2024-08-08T23:44:47.399289+0000","last_active":"2024-08-09T00:38:47.854839+0000","last_peered":"2024-08-09T00:38:47.854839+0000","last_clean":"2024-08-09T00:38:47.854839+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:38:47.854839+0000","last_undegraded":"2024-08-09T00:38:47.854839+0000","last_fullsized":"2024-08-09T00:38:47.854839+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705514+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:40:32.705514+0000","last_peered":"2024-08-09T00:40:32.705514+0000","last_clean":"2024-08-09T00:40:32.705514+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:40:32.705514+0000","last_undegraded":"2024-08-09T00:40:32.705514+0000","last_fullsized":"2024-08-09T00:40:32.705514+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684932+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:40:35.684932+0000","last_peered":"2024-08-09T00:40:35.684932+0000","last_clean":"2024-08-09T00:40:35.684932+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:40:35.684932+0000","last_undegraded":"2024-08-09T00:40:35.684932+0000","last_fullsized":"2024-08-09T00:40:35.684932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.641196+0000","last_change":"2024-08-09T00:40:48.641266+0000","last_active":"2024-08-09T00:40:48.641196+0000","last_peered":"2024-08-09T00:40:48.641196+0000","last_clean":"2024-08-09T00:40:48.641196+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:40:48.641196+0000","last_undegraded":"2024-08-09T00:40:48.641196+0000","last_fullsized":"2024-08-09T00:40:48.641196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.640998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:55:08.396765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.681097+0000","last_change":"2024-08-09T00:40:43.681164+0000","last_active":"2024-08-09T00:40:43.681097+0000","last_peered":"2024-08-09T00:40:43.681097+0000","last_clean":"2024-08-09T00:40:43.681097+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:40:43.681097+0000","last_undegraded":"2024-08-09T00:40:43.681097+0000","last_fullsized":"2024-08-09T00:40:43.681097+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.680900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:05.167122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.068530+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:40:37.068530+0000","last_peered":"2024-08-09T00:40:37.068530+0000","last_clean":"2024-08-09T00:40:37.068530+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:40:37.068530+0000","last_undegraded":"2024-08-09T00:40:37.068530+0000","last_fullsized":"2024-08-09T00:40:37.068530+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.492000+0000","last_change":"2024-08-09T00:40:48.492064+0000","last_active":"2024-08-09T00:40:48.492000+0000","last_peered":"2024-08-09T00:40:48.492000+0000","last_clean":"2024-08-09T00:40:48.492000+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:40:48.492000+0000","last_undegraded":"2024-08-09T00:40:48.492000+0000","last_fullsized":"2024-08-09T00:40:48.492000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.491783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:04:46.088876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.785042+0000","last_change":"2024-08-09T00:40:35.785042+0000","last_active":"2024-08-09T00:40:35.785042+0000","last_peered":"2024-08-09T00:40:35.785042+0000","last_clean":"2024-08-09T00:40:35.785042+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:40:35.785042+0000","last_undegraded":"2024-08-09T00:40:35.785042+0000","last_fullsized":"2024-08-09T00:40:35.785042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.784595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:17:51.280650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.531722+0000","last_change":"2024-08-09T00:40:47.531782+0000","last_active":"2024-08-09T00:40:47.531722+0000","last_peered":"2024-08-09T00:40:47.531722+0000","last_clean":"2024-08-09T00:40:47.531722+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:40:47.531722+0000","last_undegraded":"2024-08-09T00:40:47.531722+0000","last_fullsized":"2024-08-09T00:40:47.531722+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.531527+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:25.997420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.693401+0000","last_change":"2024-08-09T00:04:29.877623+0000","last_active":"2024-08-09T00:40:32.693401+0000","last_peered":"2024-08-09T00:40:32.693401+0000","last_clean":"2024-08-09T00:40:32.693401+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:40:32.693401+0000","last_undegraded":"2024-08-09T00:40:32.693401+0000","last_fullsized":"2024-08-09T00:40:32.693401+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.750685+0000","last_change":"2024-08-09T00:40:45.750799+0000","last_active":"2024-08-09T00:40:45.750685+0000","last_peered":"2024-08-09T00:40:45.750685+0000","last_clean":"2024-08-09T00:40:45.750685+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:40:45.750685+0000","last_undegraded":"2024-08-09T00:40:45.750685+0000","last_fullsized":"2024-08-09T00:40:45.750685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.750417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:11.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.685218+0000","last_change":"2024-08-09T00:40:40.685218+0000","last_active":"2024-08-09T00:40:40.685218+0000","last_peered":"2024-08-09T00:40:40.685218+0000","last_clean":"2024-08-09T00:40:40.685218+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:40:40.685218+0000","last_undegraded":"2024-08-09T00:40:40.685218+0000","last_fullsized":"2024-08-09T00:40:40.685218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.684961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:53.340721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.348779+0000","last_change":"2024-08-09T00:40:44.348843+0000","last_active":"2024-08-09T00:40:44.348779+0000","last_peered":"2024-08-09T00:40:44.348779+0000","last_clean":"2024-08-09T00:40:44.348779+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:40:44.348779+0000","last_undegraded":"2024-08-09T00:40:44.348779+0000","last_fullsized":"2024-08-09T00:40:44.348779+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.348587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:09:49.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.879575+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:40:32.879575+0000","last_peered":"2024-08-09T00:40:32.879575+0000","last_clean":"2024-08-09T00:40:32.879575+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:40:32.879575+0000","last_undegraded":"2024-08-09T00:40:32.879575+0000","last_fullsized":"2024-08-09T00:40:32.879575+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.504759+0000","last_change":"2024-08-09T00:40:44.504759+0000","last_active":"2024-08-09T00:40:44.504759+0000","last_peered":"2024-08-09T00:40:44.504759+0000","last_clean":"2024-08-09T00:40:44.504759+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:40:44.504759+0000","last_undegraded":"2024-08-09T00:40:44.504759+0000","last_fullsized":"2024-08-09T00:40:44.504759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.504500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:10.357467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.012427+0000","last_change":"2024-08-09T00:40:42.012589+0000","last_active":"2024-08-09T00:40:42.012427+0000","last_peered":"2024-08-09T00:40:42.012427+0000","last_clean":"2024-08-09T00:40:42.012427+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:40:42.012427+0000","last_undegraded":"2024-08-09T00:40:42.012427+0000","last_fullsized":"2024-08-09T00:40:42.012427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.012179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:37.853605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:57.860870+0000","last_change":"2024-08-08T23:44:47.398875+0000","last_active":"2024-08-09T00:38:57.860870+0000","last_peered":"2024-08-09T00:38:57.860870+0000","last_clean":"2024-08-09T00:38:57.860870+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:38:57.860870+0000","last_undegraded":"2024-08-09T00:38:57.860870+0000","last_fullsized":"2024-08-09T00:38:57.860870+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:44:46.361952+0000","last_clean_scrub_stamp":"2024-08-08T23:44:46.361952+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.685295+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:39:57.685295+0000","last_peered":"2024-08-09T00:39:57.685295+0000","last_clean":"2024-08-09T00:39:57.685295+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:39:57.685295+0000","last_undegraded":"2024-08-09T00:39:57.685295+0000","last_fullsized":"2024-08-09T00:39:57.685295+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'7","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.412736+0000","last_change":"2024-08-08T23:48:42.101066+0000","last_active":"2024-08-09T00:40:30.412736+0000","last_peered":"2024-08-09T00:40:30.412736+0000","last_clean":"2024-08-09T00:40:30.412736+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:40:30.412736+0000","last_undegraded":"2024-08-09T00:40:30.412736+0000","last_fullsized":"2024-08-09T00:40:30.412736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.639579+0000","last_change":"2024-08-09T00:40:38.639579+0000","last_active":"2024-08-09T00:40:38.639579+0000","last_peered":"2024-08-09T00:40:38.639579+0000","last_clean":"2024-08-09T00:40:38.639579+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:40:38.639579+0000","last_undegraded":"2024-08-09T00:40:38.639579+0000","last_fullsized":"2024-08-09T00:40:38.639579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.639308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:48.995525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.691578+0000","last_change":"2024-08-09T00:40:37.691644+0000","last_active":"2024-08-09T00:40:37.691578+0000","last_peered":"2024-08-09T00:40:37.691578+0000","last_clean":"2024-08-09T00:40:37.691578+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:40:37.691578+0000","last_undegraded":"2024-08-09T00:40:37.691578+0000","last_fullsized":"2024-08-09T00:40:37.691578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.691368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:15:07.123436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.098490+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:39:58.098490+0000","last_peered":"2024-08-09T00:39:58.098490+0000","last_clean":"2024-08-09T00:39:58.098490+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:39:58.098490+0000","last_undegraded":"2024-08-09T00:39:58.098490+0000","last_fullsized":"2024-08-09T00:39:58.098490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822184+0000","last_change":"2024-08-08T23:48:42.574733+0000","last_active":"2024-08-09T00:40:33.822184+0000","last_peered":"2024-08-09T00:40:33.822184+0000","last_clean":"2024-08-09T00:40:33.822184+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:40:33.822184+0000","last_undegraded":"2024-08-09T00:40:33.822184+0000","last_fullsized":"2024-08-09T00:40:33.822184+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.742652+0000","last_change":"2024-08-08T23:48:38.060729+0000","last_active":"2024-08-09T00:40:34.742652+0000","last_peered":"2024-08-09T00:40:34.742652+0000","last_clean":"2024-08-09T00:40:34.742652+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:40:34.742652+0000","last_undegraded":"2024-08-09T00:40:34.742652+0000","last_fullsized":"2024-08-09T00:40:34.742652+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'86","reported_seq":338,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.895840+0000","last_change":"2024-08-09T00:40:37.895905+0000","last_active":"2024-08-09T00:40:37.895840+0000","last_peered":"2024-08-09T00:40:37.895840+0000","last_clean":"2024-08-09T00:40:37.895840+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:40:37.895840+0000","last_undegraded":"2024-08-09T00:40:37.895840+0000","last_fullsized":"2024-08-09T00:40:37.895840+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.895611+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:36:13.014150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3248,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279958+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:40:34.279958+0000","last_peered":"2024-08-09T00:40:34.279958+0000","last_clean":"2024-08-09T00:40:34.279958+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:40:34.279958+0000","last_undegraded":"2024-08-09T00:40:34.279958+0000","last_fullsized":"2024-08-09T00:40:34.279958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.614833+0000","last_change":"2024-08-09T00:40:52.614893+0000","last_active":"2024-08-09T00:40:52.614833+0000","last_peered":"2024-08-09T00:40:52.614833+0000","last_clean":"2024-08-09T00:40:52.614833+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:40:52.614833+0000","last_undegraded":"2024-08-09T00:40:52.614833+0000","last_fullsized":"2024-08-09T00:40:52.614833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.614638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:19.525948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'7","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.214947+0000","last_change":"2024-08-09T00:40:48.215013+0000","last_active":"2024-08-09T00:40:48.214947+0000","last_peered":"2024-08-09T00:40:48.214947+0000","last_clean":"2024-08-09T00:40:48.214947+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:40:48.214947+0000","last_undegraded":"2024-08-09T00:40:48.214947+0000","last_fullsized":"2024-08-09T00:40:48.214947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.214757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:00.067724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.530005+0000","last_change":"2024-08-09T00:40:46.530066+0000","last_active":"2024-08-09T00:40:46.530005+0000","last_peered":"2024-08-09T00:40:46.530005+0000","last_clean":"2024-08-09T00:40:46.530005+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:40:46.530005+0000","last_undegraded":"2024-08-09T00:40:46.530005+0000","last_fullsized":"2024-08-09T00:40:46.530005+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.529798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:28.838684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.875645+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:39:57.875645+0000","last_peered":"2024-08-09T00:39:57.875645+0000","last_clean":"2024-08-09T00:39:57.875645+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:39:57.875645+0000","last_undegraded":"2024-08-09T00:39:57.875645+0000","last_fullsized":"2024-08-09T00:39:57.875645+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'6","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684774+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:40:35.684774+0000","last_peered":"2024-08-09T00:40:35.684774+0000","last_clean":"2024-08-09T00:40:35.684774+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:40:35.684774+0000","last_undegraded":"2024-08-09T00:40:35.684774+0000","last_fullsized":"2024-08-09T00:40:35.684774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7184,"num_write":6,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.642345+0000","last_change":"2024-08-09T00:40:39.642407+0000","last_active":"2024-08-09T00:40:39.642345+0000","last_peered":"2024-08-09T00:40:39.642345+0000","last_clean":"2024-08-09T00:40:39.642345+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:40:39.642345+0000","last_undegraded":"2024-08-09T00:40:39.642345+0000","last_fullsized":"2024-08-09T00:40:39.642345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.642111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:06:21.202789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.771451+0000","last_change":"2024-08-09T00:40:38.771514+0000","last_active":"2024-08-09T00:40:38.771451+0000","last_peered":"2024-08-09T00:40:38.771451+0000","last_clean":"2024-08-09T00:40:38.771451+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:40:38.771451+0000","last_undegraded":"2024-08-09T00:40:38.771451+0000","last_fullsized":"2024-08-09T00:40:38.771451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.771257+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:13.221977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.860739+0000","last_change":"2024-08-09T00:04:29.863724+0000","last_active":"2024-08-09T00:39:12.860739+0000","last_peered":"2024-08-09T00:39:12.860739+0000","last_clean":"2024-08-09T00:39:12.860739+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:39:12.860739+0000","last_undegraded":"2024-08-09T00:39:12.860739+0000","last_fullsized":"2024-08-09T00:39:12.860739+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'8","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279835+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:40:34.279835+0000","last_peered":"2024-08-09T00:40:34.279835+0000","last_clean":"2024-08-09T00:40:34.279835+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:40:34.279835+0000","last_undegraded":"2024-08-09T00:40:34.279835+0000","last_fullsized":"2024-08-09T00:40:34.279835+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.563040+0000","last_change":"2024-08-09T00:40:42.563040+0000","last_active":"2024-08-09T00:40:42.563040+0000","last_peered":"2024-08-09T00:40:42.563040+0000","last_clean":"2024-08-09T00:40:42.563040+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:40:42.563040+0000","last_undegraded":"2024-08-09T00:40:42.563040+0000","last_fullsized":"2024-08-09T00:40:42.563040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.562784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:16.829344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.262152+0000","last_change":"2024-08-09T00:40:44.262213+0000","last_active":"2024-08-09T00:40:44.262152+0000","last_peered":"2024-08-09T00:40:44.262152+0000","last_clean":"2024-08-09T00:40:44.262152+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:40:44.262152+0000","last_undegraded":"2024-08-09T00:40:44.262152+0000","last_fullsized":"2024-08-09T00:40:44.262152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.261956+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:37.462204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.857749+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:39:12.857749+0000","last_peered":"2024-08-09T00:39:12.857749+0000","last_clean":"2024-08-09T00:39:12.857749+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:39:12.857749+0000","last_undegraded":"2024-08-09T00:39:12.857749+0000","last_fullsized":"2024-08-09T00:39:12.857749+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.137635+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:40:36.137635+0000","last_peered":"2024-08-09T00:40:36.137635+0000","last_clean":"2024-08-09T00:40:36.137635+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:40:36.137635+0000","last_undegraded":"2024-08-09T00:40:36.137635+0000","last_fullsized":"2024-08-09T00:40:36.137635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.595802+0000","last_change":"2024-08-09T00:40:41.595802+0000","last_active":"2024-08-09T00:40:41.595802+0000","last_peered":"2024-08-09T00:40:41.595802+0000","last_clean":"2024-08-09T00:40:41.595802+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:40:41.595802+0000","last_undegraded":"2024-08-09T00:40:41.595802+0000","last_fullsized":"2024-08-09T00:40:41.595802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.595540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:00.572160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.906929+0000","last_change":"2024-08-09T00:40:35.906989+0000","last_active":"2024-08-09T00:40:35.906929+0000","last_peered":"2024-08-09T00:40:35.906929+0000","last_clean":"2024-08-09T00:40:35.906929+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:40:35.906929+0000","last_undegraded":"2024-08-09T00:40:35.906929+0000","last_fullsized":"2024-08-09T00:40:35.906929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.906730+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:03:23.261597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.868829+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:39:57.868829+0000","last_peered":"2024-08-09T00:39:57.868829+0000","last_clean":"2024-08-09T00:39:57.868829+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:39:57.868829+0000","last_undegraded":"2024-08-09T00:39:57.868829+0000","last_fullsized":"2024-08-09T00:39:57.868829+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.590191+0000","last_change":"2024-08-08T23:48:42.101703+0000","last_active":"2024-08-09T00:40:36.590191+0000","last_peered":"2024-08-09T00:40:36.590191+0000","last_clean":"2024-08-09T00:40:36.590191+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:40:36.590191+0000","last_undegraded":"2024-08-09T00:40:36.590191+0000","last_fullsized":"2024-08-09T00:40:36.590191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.691491+0000","last_change":"2024-08-09T00:40:41.691491+0000","last_active":"2024-08-09T00:40:41.691491+0000","last_peered":"2024-08-09T00:40:41.691491+0000","last_clean":"2024-08-09T00:40:41.691491+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:40:41.691491+0000","last_undegraded":"2024-08-09T00:40:41.691491+0000","last_fullsized":"2024-08-09T00:40:41.691491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.691090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:04:50.076445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.899859+0000","last_change":"2024-08-09T00:40:38.899972+0000","last_active":"2024-08-09T00:40:38.899859+0000","last_peered":"2024-08-09T00:40:38.899859+0000","last_clean":"2024-08-09T00:40:38.899859+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:40:38.899859+0000","last_undegraded":"2024-08-09T00:40:38.899859+0000","last_fullsized":"2024-08-09T00:40:38.899859+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.899571+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:03.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:07.687600+0000","last_change":"2024-08-09T00:04:29.876240+0000","last_active":"2024-08-09T00:40:07.687600+0000","last_peered":"2024-08-09T00:40:07.687600+0000","last_clean":"2024-08-09T00:40:07.687600+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:40:07.687600+0000","last_undegraded":"2024-08-09T00:40:07.687600+0000","last_fullsized":"2024-08-09T00:40:07.687600+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684801+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:40:35.684801+0000","last_peered":"2024-08-09T00:40:35.684801+0000","last_clean":"2024-08-09T00:40:35.684801+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:40:35.684801+0000","last_undegraded":"2024-08-09T00:40:35.684801+0000","last_fullsized":"2024-08-09T00:40:35.684801+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.889285+0000","last_change":"2024-08-09T00:40:39.889285+0000","last_active":"2024-08-09T00:40:39.889285+0000","last_peered":"2024-08-09T00:40:39.889285+0000","last_clean":"2024-08-09T00:40:39.889285+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:40:39.889285+0000","last_undegraded":"2024-08-09T00:40:39.889285+0000","last_fullsized":"2024-08-09T00:40:39.889285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.889006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:10.545546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'76","reported_seq":307,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.502797+0000","last_change":"2024-08-09T00:40:49.502863+0000","last_active":"2024-08-09T00:40:49.502797+0000","last_peered":"2024-08-09T00:40:49.502797+0000","last_clean":"2024-08-09T00:40:49.502797+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:40:49.502797+0000","last_undegraded":"2024-08-09T00:40:49.502797+0000","last_fullsized":"2024-08-09T00:40:49.502797+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.502595+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:44:42.439163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2970,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'160","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.238105+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:40:30.238105+0000","last_peered":"2024-08-09T00:40:30.238105+0000","last_clean":"2024-08-09T00:40:30.238105+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:40:30.238105+0000","last_undegraded":"2024-08-09T00:40:30.238105+0000","last_fullsized":"2024-08-09T00:40:30.238105+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850193,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":340,"num_read_kb":12258,"num_write":951,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:28.078207+0000","last_change":"2024-08-08T23:28:26.788360+0000","last_active":"2024-08-09T00:38:28.078207+0000","last_peered":"2024-08-09T00:38:28.078207+0000","last_clean":"2024-08-09T00:38:28.078207+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:38:28.078207+0000","last_undegraded":"2024-08-09T00:38:28.078207+0000","last_fullsized":"2024-08-09T00:38:28.078207+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'191","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.648880+0000","last_change":"2024-08-08T23:28:24.771874+0000","last_active":"2024-08-09T00:40:30.648880+0000","last_peered":"2024-08-09T00:40:30.648880+0000","last_clean":"2024-08-09T00:40:30.648880+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:40:30.648880+0000","last_undegraded":"2024-08-09T00:40:30.648880+0000","last_fullsized":"2024-08-09T00:40:30.648880+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":3384,"num_write":904,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'233","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.877387+0000","last_change":"2024-08-08T23:28:26.783710+0000","last_active":"2024-08-09T00:38:27.877387+0000","last_peered":"2024-08-09T00:38:27.877387+0000","last_clean":"2024-08-09T00:38:27.877387+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:38:27.877387+0000","last_undegraded":"2024-08-09T00:38:27.877387+0000","last_fullsized":"2024-08-09T00:38:27.877387+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'216","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.646071+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:40:30.646071+0000","last_peered":"2024-08-09T00:40:30.646071+0000","last_clean":"2024-08-09T00:40:30.646071+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:40:30.646071+0000","last_undegraded":"2024-08-09T00:40:30.646071+0000","last_fullsized":"2024-08-09T00:40:30.646071+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":22668,"num_write":1178,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.853570+0000","last_change":"2024-08-08T23:28:26.764063+0000","last_active":"2024-08-09T00:38:27.853570+0000","last_peered":"2024-08-09T00:38:27.853570+0000","last_clean":"2024-08-09T00:38:27.853570+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:38:27.853570+0000","last_undegraded":"2024-08-09T00:38:27.853570+0000","last_fullsized":"2024-08-09T00:38:27.853570+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'200","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.136445+0000","last_change":"2024-08-08T23:28:24.820523+0000","last_active":"2024-08-09T00:40:36.136445+0000","last_peered":"2024-08-09T00:40:36.136445+0000","last_clean":"2024-08-09T00:40:36.136445+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:40:36.136445+0000","last_undegraded":"2024-08-09T00:40:36.136445+0000","last_fullsized":"2024-08-09T00:40:36.136445+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568643,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":448,"num_read_kb":38040,"num_write":1155,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:54.916407+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:38:54.916407+0000","last_peered":"2024-08-09T00:38:54.916407+0000","last_clean":"2024-08-09T00:38:54.916407+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:38:54.916407+0000","last_undegraded":"2024-08-09T00:38:54.916407+0000","last_fullsized":"2024-08-09T00:38:54.916407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'215","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.766491+0000","last_change":"2024-08-09T00:40:39.766664+0000","last_active":"2024-08-09T00:40:39.766491+0000","last_peered":"2024-08-09T00:40:39.766491+0000","last_clean":"2024-08-09T00:40:39.766491+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:40:39.766491+0000","last_undegraded":"2024-08-09T00:40:39.766491+0000","last_fullsized":"2024-08-09T00:40:39.766491+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.766288+0000","objects_scrubbed":10,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:26:32.617815+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8746313,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":21778,"num_write":1217,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.589508+0000","last_change":"2024-08-08T23:28:26.768598+0000","last_active":"2024-08-09T00:40:36.589508+0000","last_peered":"2024-08-09T00:40:36.589508+0000","last_clean":"2024-08-09T00:40:36.589508+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:40:36.589508+0000","last_undegraded":"2024-08-09T00:40:36.589508+0000","last_fullsized":"2024-08-09T00:40:36.589508+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'189","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.652456+0000","last_change":"2024-08-08T23:28:24.817326+0000","last_active":"2024-08-09T00:40:30.652456+0000","last_peered":"2024-08-09T00:40:30.652456+0000","last_clean":"2024-08-09T00:40:30.652456+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:40:30.652456+0000","last_undegraded":"2024-08-09T00:40:30.652456+0000","last_fullsized":"2024-08-09T00:40:30.652456+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49415,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":54098,"num_write":1119,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.866304+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:39:17.866304+0000","last_peered":"2024-08-09T00:39:17.866304+0000","last_clean":"2024-08-09T00:39:17.866304+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:39:17.866304+0000","last_undegraded":"2024-08-09T00:39:17.866304+0000","last_fullsized":"2024-08-09T00:39:17.866304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'197","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.469725+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:40:30.469725+0000","last_peered":"2024-08-09T00:40:30.469725+0000","last_clean":"2024-08-09T00:40:30.469725+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:40:30.469725+0000","last_undegraded":"2024-08-09T00:40:30.469725+0000","last_fullsized":"2024-08-09T00:40:30.469725+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743987,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":11259,"num_write":1113,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'106","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:18.089638+0000","last_change":"2024-08-08T23:28:26.777046+0000","last_active":"2024-08-09T00:39:18.089638+0000","last_peered":"2024-08-09T00:39:18.089638+0000","last_clean":"2024-08-09T00:39:18.089638+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:39:18.089638+0000","last_undegraded":"2024-08-09T00:39:18.089638+0000","last_fullsized":"2024-08-09T00:39:18.089638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'155","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.577108+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:40:30.577108+0000","last_peered":"2024-08-09T00:40:30.577108+0000","last_clean":"2024-08-09T00:40:30.577108+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:40:30.577108+0000","last_undegraded":"2024-08-09T00:40:30.577108+0000","last_fullsized":"2024-08-09T00:40:30.577108+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":32780,"num_write":887,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'208","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.861421+0000","last_change":"2024-08-08T23:28:26.768844+0000","last_active":"2024-08-09T00:39:17.861421+0000","last_peered":"2024-08-09T00:39:17.861421+0000","last_clean":"2024-08-09T00:39:17.861421+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:39:17.861421+0000","last_undegraded":"2024-08-09T00:39:17.861421+0000","last_fullsized":"2024-08-09T00:39:17.861421+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'33","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.683526+0000","last_change":"2024-08-08T23:28:26.764534+0000","last_active":"2024-08-09T00:40:35.683526+0000","last_peered":"2024-08-09T00:40:35.683526+0000","last_clean":"2024-08-09T00:40:35.683526+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:40:35.683526+0000","last_undegraded":"2024-08-09T00:40:35.683526+0000","last_fullsized":"2024-08-09T00:40:35.683526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'172","reported_seq":782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.603645+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:40:30.603645+0000","last_peered":"2024-08-09T00:40:30.603645+0000","last_clean":"2024-08-09T00:40:30.603645+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:40:30.603645+0000","last_undegraded":"2024-08-09T00:40:30.603645+0000","last_fullsized":"2024-08-09T00:40:30.603645+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":8171,"num_write":1047,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066988+0000","last_change":"2024-08-08T23:28:26.784260+0000","last_active":"2024-08-09T00:40:37.066988+0000","last_peered":"2024-08-09T00:40:37.066988+0000","last_clean":"2024-08-09T00:40:37.066988+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:40:37.066988+0000","last_undegraded":"2024-08-09T00:40:37.066988+0000","last_fullsized":"2024-08-09T00:40:37.066988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'198","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.231804+0000","last_change":"2024-08-09T00:40:46.231893+0000","last_active":"2024-08-09T00:40:46.231804+0000","last_peered":"2024-08-09T00:40:46.231804+0000","last_clean":"2024-08-09T00:40:46.231804+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:40:46.231804+0000","last_undegraded":"2024-08-09T00:40:46.231804+0000","last_fullsized":"2024-08-09T00:40:46.231804+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.231597+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:55.781502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":6729,"num_write":999,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1090,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:43.081715+0000","last_change":"2024-08-08T23:28:26.788985+0000","last_active":"2024-08-09T00:38:43.081715+0000","last_peered":"2024-08-09T00:38:43.081715+0000","last_clean":"2024-08-09T00:38:43.081715+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:38:43.081715+0000","last_undegraded":"2024-08-09T00:38:43.081715+0000","last_fullsized":"2024-08-09T00:38:43.081715+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'246","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.612326+0000","last_change":"2024-08-08T23:28:24.818699+0000","last_active":"2024-08-09T00:40:30.612326+0000","last_peered":"2024-08-09T00:40:30.612326+0000","last_clean":"2024-08-09T00:40:30.612326+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:40:30.612326+0000","last_undegraded":"2024-08-09T00:40:30.612326+0000","last_fullsized":"2024-08-09T00:40:30.612326+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":13197,"num_write":1122,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'21","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.851842+0000","last_change":"2024-08-08T23:28:26.768040+0000","last_active":"2024-08-09T00:38:32.851842+0000","last_peered":"2024-08-09T00:38:32.851842+0000","last_clean":"2024-08-09T00:38:32.851842+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:38:32.851842+0000","last_undegraded":"2024-08-09T00:38:32.851842+0000","last_fullsized":"2024-08-09T00:38:32.851842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'176","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.219293+0000","last_change":"2024-08-09T00:40:40.219376+0000","last_active":"2024-08-09T00:40:40.219293+0000","last_peered":"2024-08-09T00:40:40.219293+0000","last_clean":"2024-08-09T00:40:40.219293+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:40:40.219293+0000","last_undegraded":"2024-08-09T00:40:40.219293+0000","last_fullsized":"2024-08-09T00:40:40.219293+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.219095+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:19.550329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":29619,"num_write":952,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.851886+0000","last_change":"2024-08-08T23:28:26.771260+0000","last_active":"2024-08-09T00:38:32.851886+0000","last_peered":"2024-08-09T00:38:32.851886+0000","last_clean":"2024-08-09T00:38:32.851886+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:38:32.851886+0000","last_undegraded":"2024-08-09T00:38:32.851886+0000","last_fullsized":"2024-08-09T00:38:32.851886+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'166","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.619831+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:40:30.619831+0000","last_peered":"2024-08-09T00:40:30.619831+0000","last_clean":"2024-08-09T00:40:30.619831+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:40:30.619831+0000","last_undegraded":"2024-08-09T00:40:30.619831+0000","last_fullsized":"2024-08-09T00:40:30.619831+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146116,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":37287,"num_write":965,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":701,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.855406+0000","last_change":"2024-08-08T23:28:26.767880+0000","last_active":"2024-08-09T00:38:32.855406+0000","last_peered":"2024-08-09T00:38:32.855406+0000","last_clean":"2024-08-09T00:38:32.855406+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:38:32.855406+0000","last_undegraded":"2024-08-09T00:38:32.855406+0000","last_fullsized":"2024-08-09T00:38:32.855406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'222","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.652049+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:40:30.652049+0000","last_peered":"2024-08-09T00:40:30.652049+0000","last_clean":"2024-08-09T00:40:30.652049+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:40:30.652049+0000","last_undegraded":"2024-08-09T00:40:30.652049+0000","last_fullsized":"2024-08-09T00:40:30.652049+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":428,"num_read_kb":738,"num_write":1172,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.001415+0000","last_change":"2024-08-09T00:40:41.001523+0000","last_active":"2024-08-09T00:40:41.001415+0000","last_peered":"2024-08-09T00:40:41.001415+0000","last_clean":"2024-08-09T00:40:41.001415+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:40:41.001415+0000","last_undegraded":"2024-08-09T00:40:41.001415+0000","last_fullsized":"2024-08-09T00:40:41.001415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.001229+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:58:15.431511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.262057+0000","last_change":"2024-08-09T00:40:42.262175+0000","last_active":"2024-08-09T00:40:42.262057+0000","last_peered":"2024-08-09T00:40:42.262057+0000","last_clean":"2024-08-09T00:40:42.262057+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:40:42.262057+0000","last_undegraded":"2024-08-09T00:40:42.262057+0000","last_fullsized":"2024-08-09T00:40:42.262057+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.261780+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:47.848829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'178","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.553323+0000","last_change":"2024-08-09T00:40:50.553409+0000","last_active":"2024-08-09T00:40:50.553323+0000","last_peered":"2024-08-09T00:40:50.553323+0000","last_clean":"2024-08-09T00:40:50.553323+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:40:50.553323+0000","last_undegraded":"2024-08-09T00:40:50.553323+0000","last_fullsized":"2024-08-09T00:40:50.553323+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.553124+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:04.843417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":22191,"num_write":1038,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:38.080670+0000","last_change":"2024-08-08T23:28:28.771835+0000","last_active":"2024-08-09T00:38:38.080670+0000","last_peered":"2024-08-09T00:38:38.080670+0000","last_clean":"2024-08-09T00:38:38.080670+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:38:38.080670+0000","last_undegraded":"2024-08-09T00:38:38.080670+0000","last_fullsized":"2024-08-09T00:38:38.080670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'220","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.546940+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:40:30.546940+0000","last_peered":"2024-08-09T00:40:30.546940+0000","last_clean":"2024-08-09T00:40:30.546940+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:40:30.546940+0000","last_undegraded":"2024-08-09T00:40:30.546940+0000","last_fullsized":"2024-08-09T00:40:30.546940+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":290,"num_write":170,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.880701+0000","last_change":"2024-08-08T23:28:32.817763+0000","last_active":"2024-08-09T00:38:37.880701+0000","last_peered":"2024-08-09T00:38:37.880701+0000","last_clean":"2024-08-09T00:38:37.880701+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:38:37.880701+0000","last_undegraded":"2024-08-09T00:38:37.880701+0000","last_fullsized":"2024-08-09T00:38:37.880701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2401","reported_seq":4293,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.236072+0000","last_change":"2024-08-09T00:40:43.236142+0000","last_active":"2024-08-09T00:40:43.236072+0000","last_peered":"2024-08-09T00:40:43.236072+0000","last_clean":"2024-08-09T00:40:43.236072+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:40:43.236072+0000","last_undegraded":"2024-08-09T00:40:43.236072+0000","last_fullsized":"2024-08-09T00:40:43.236072+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2401","last_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_deep_scrub":"268'2401","last_deep_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.235885+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":2300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:26:55.409086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:33.079503+0000","last_change":"2024-08-08T23:28:26.791324+0000","last_active":"2024-08-09T00:38:33.079503+0000","last_peered":"2024-08-09T00:38:33.079503+0000","last_clean":"2024-08-09T00:38:33.079503+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:38:33.079503+0000","last_undegraded":"2024-08-09T00:38:33.079503+0000","last_fullsized":"2024-08-09T00:38:33.079503+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'184","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821137+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:40:33.821137+0000","last_peered":"2024-08-09T00:40:33.821137+0000","last_clean":"2024-08-09T00:40:33.821137+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:40:33.821137+0000","last_undegraded":"2024-08-09T00:40:33.821137+0000","last_fullsized":"2024-08-09T00:40:33.821137+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311673,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":392,"num_read_kb":16280,"num_write":970,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:47.681077+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:38:47.681077+0000","last_peered":"2024-08-09T00:38:47.681077+0000","last_clean":"2024-08-09T00:38:47.681077+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:38:47.681077+0000","last_undegraded":"2024-08-09T00:38:47.681077+0000","last_fullsized":"2024-08-09T00:38:47.681077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:11.261727+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:39:11.261727+0000","last_peered":"2024-08-09T00:39:11.261727+0000","last_clean":"2024-08-09T00:39:11.261727+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:39:11.261727+0000","last_undegraded":"2024-08-09T00:39:11.261727+0000","last_fullsized":"2024-08-09T00:39:11.261727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.057653+0000","last_change":"2024-08-09T00:40:44.057708+0000","last_active":"2024-08-09T00:40:44.057653+0000","last_peered":"2024-08-09T00:40:44.057653+0000","last_clean":"2024-08-09T00:40:44.057653+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:40:44.057653+0000","last_undegraded":"2024-08-09T00:40:44.057653+0000","last_fullsized":"2024-08-09T00:40:44.057653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.057369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:45.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'140","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.618208+0000","last_change":"2024-08-09T00:40:50.618287+0000","last_active":"2024-08-09T00:40:50.618208+0000","last_peered":"2024-08-09T00:40:50.618208+0000","last_clean":"2024-08-09T00:40:50.618208+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:40:50.618208+0000","last_undegraded":"2024-08-09T00:40:50.618208+0000","last_fullsized":"2024-08-09T00:40:50.618208+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.618030+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:01.456614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.847868+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:38:32.847868+0000","last_peered":"2024-08-09T00:38:32.847868+0000","last_clean":"2024-08-09T00:38:32.847868+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:38:32.847868+0000","last_undegraded":"2024-08-09T00:38:32.847868+0000","last_fullsized":"2024-08-09T00:38:32.847868+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'232","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066802+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:40:37.066802+0000","last_peered":"2024-08-09T00:40:37.066802+0000","last_clean":"2024-08-09T00:40:37.066802+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:40:37.066802+0000","last_undegraded":"2024-08-09T00:40:37.066802+0000","last_fullsized":"2024-08-09T00:40:37.066802+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":26858,"num_write":1144,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.678710+0000","last_change":"2024-08-08T23:28:28.771848+0000","last_active":"2024-08-09T00:38:37.678710+0000","last_peered":"2024-08-09T00:38:37.678710+0000","last_clean":"2024-08-09T00:38:37.678710+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:38:37.678710+0000","last_undegraded":"2024-08-09T00:38:37.678710+0000","last_fullsized":"2024-08-09T00:38:37.678710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'154","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.250334+0000","last_change":"2024-08-09T00:40:43.250412+0000","last_active":"2024-08-09T00:40:43.250334+0000","last_peered":"2024-08-09T00:40:43.250334+0000","last_clean":"2024-08-09T00:40:43.250334+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:40:43.250334+0000","last_undegraded":"2024-08-09T00:40:43.250334+0000","last_fullsized":"2024-08-09T00:40:43.250334+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.250137+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:26.394703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'514","reported_seq":2620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.660363+0000","last_change":"2024-08-08T23:28:32.809653+0000","last_active":"2024-08-09T00:40:30.660363+0000","last_peered":"2024-08-09T00:40:30.660363+0000","last_clean":"2024-08-09T00:40:30.660363+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:40:30.660363+0000","last_undegraded":"2024-08-09T00:40:30.660363+0000","last_fullsized":"2024-08-09T00:40:30.660363+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'205","reported_seq":1033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.032880+0000","last_change":"2024-08-09T00:40:43.032946+0000","last_active":"2024-08-09T00:40:43.032880+0000","last_peered":"2024-08-09T00:40:43.032880+0000","last_clean":"2024-08-09T00:40:43.032880+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:40:43.032880+0000","last_undegraded":"2024-08-09T00:40:43.032880+0000","last_fullsized":"2024-08-09T00:40:43.032880+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.032703+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.934858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'197","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.677533+0000","last_change":"2024-08-08T23:28:26.776218+0000","last_active":"2024-08-09T00:38:32.677533+0000","last_peered":"2024-08-09T00:38:32.677533+0000","last_clean":"2024-08-09T00:38:32.677533+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:38:32.677533+0000","last_undegraded":"2024-08-09T00:38:32.677533+0000","last_fullsized":"2024-08-09T00:38:32.677533+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'184","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.589614+0000","last_change":"2024-08-08T23:28:24.782432+0000","last_active":"2024-08-09T00:40:36.589614+0000","last_peered":"2024-08-09T00:40:36.589614+0000","last_clean":"2024-08-09T00:40:36.589614+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:40:36.589614+0000","last_undegraded":"2024-08-09T00:40:36.589614+0000","last_fullsized":"2024-08-09T00:40:36.589614+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":349,"num_read_kb":11144,"num_write":998,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:38.080718+0000","last_change":"2024-08-08T23:28:28.772715+0000","last_active":"2024-08-09T00:38:38.080718+0000","last_peered":"2024-08-09T00:38:38.080718+0000","last_clean":"2024-08-09T00:38:38.080718+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:38:38.080718+0000","last_undegraded":"2024-08-09T00:38:38.080718+0000","last_fullsized":"2024-08-09T00:38:38.080718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'147","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.501580+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:40:30.501580+0000","last_peered":"2024-08-09T00:40:30.501580+0000","last_clean":"2024-08-09T00:40:30.501580+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:40:30.501580+0000","last_undegraded":"2024-08-09T00:40:30.501580+0000","last_fullsized":"2024-08-09T00:40:30.501580+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":269,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'525","reported_seq":2427,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.664279+0000","last_change":"2024-08-08T23:28:32.811070+0000","last_active":"2024-08-09T00:40:30.664279+0000","last_peered":"2024-08-09T00:40:30.664279+0000","last_clean":"2024-08-09T00:40:30.664279+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:40:30.664279+0000","last_undegraded":"2024-08-09T00:40:30.664279+0000","last_fullsized":"2024-08-09T00:40:30.664279+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.098395+0000","last_change":"2024-08-08T23:28:26.793556+0000","last_active":"2024-08-09T00:39:58.098395+0000","last_peered":"2024-08-09T00:39:58.098395+0000","last_clean":"2024-08-09T00:39:58.098395+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:39:58.098395+0000","last_undegraded":"2024-08-09T00:39:58.098395+0000","last_fullsized":"2024-08-09T00:39:58.098395+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'202","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066734+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:40:37.066734+0000","last_peered":"2024-08-09T00:40:37.066734+0000","last_clean":"2024-08-09T00:40:37.066734+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:40:37.066734+0000","last_undegraded":"2024-08-09T00:40:37.066734+0000","last_fullsized":"2024-08-09T00:40:37.066734+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":38000,"num_write":1175,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.686439+0000","last_change":"2024-08-08T23:28:28.785365+0000","last_active":"2024-08-09T00:40:02.686439+0000","last_peered":"2024-08-09T00:40:02.686439+0000","last_clean":"2024-08-09T00:40:02.686439+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:40:02.686439+0000","last_undegraded":"2024-08-09T00:40:02.686439+0000","last_fullsized":"2024-08-09T00:40:02.686439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'276","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.227188+0000","last_change":"2024-08-09T00:40:47.227392+0000","last_active":"2024-08-09T00:40:47.227188+0000","last_peered":"2024-08-09T00:40:47.227188+0000","last_clean":"2024-08-09T00:40:47.227188+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:40:47.227188+0000","last_undegraded":"2024-08-09T00:40:47.227188+0000","last_fullsized":"2024-08-09T00:40:47.227188+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'276","last_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_deep_scrub":"268'276","last_deep_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.226937+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:10.282050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":369,"num_read_kb":429,"num_write":224,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.885094+0000","last_change":"2024-08-08T23:28:32.806513+0000","last_active":"2024-08-09T00:40:32.885094+0000","last_peered":"2024-08-09T00:40:32.885094+0000","last_clean":"2024-08-09T00:40:32.885094+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:40:32.885094+0000","last_undegraded":"2024-08-09T00:40:32.885094+0000","last_fullsized":"2024-08-09T00:40:32.885094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'554","reported_seq":1380,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.235374+0000","last_change":"2024-08-09T00:40:37.235454+0000","last_active":"2024-08-09T00:40:37.235374+0000","last_peered":"2024-08-09T00:40:37.235374+0000","last_clean":"2024-08-09T00:40:37.235374+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:40:37.235374+0000","last_undegraded":"2024-08-09T00:40:37.235374+0000","last_fullsized":"2024-08-09T00:40:37.235374+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'554","last_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_deep_scrub":"268'554","last_deep_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.235172+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:51.183078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4315","reported_seq":4943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.875759+0000","last_change":"2024-08-08T23:28:26.754321+0000","last_active":"2024-08-09T00:39:57.875759+0000","last_peered":"2024-08-09T00:39:57.875759+0000","last_clean":"2024-08-09T00:39:57.875759+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:39:57.875759+0000","last_undegraded":"2024-08-09T00:39:57.875759+0000","last_fullsized":"2024-08-09T00:39:57.875759+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":3000,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'233","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.637091+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:40:30.637091+0000","last_peered":"2024-08-09T00:40:30.637091+0000","last_clean":"2024-08-09T00:40:30.637091+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:40:30.637091+0000","last_undegraded":"2024-08-09T00:40:30.637091+0000","last_fullsized":"2024-08-09T00:40:30.637091+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1254,"num_read_kb":40415,"num_write":1272,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.870640+0000","last_change":"2024-08-08T23:28:28.772465+0000","last_active":"2024-08-09T00:40:02.870640+0000","last_peered":"2024-08-09T00:40:02.870640+0000","last_clean":"2024-08-09T00:40:02.870640+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:40:02.870640+0000","last_undegraded":"2024-08-09T00:40:02.870640+0000","last_fullsized":"2024-08-09T00:40:02.870640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'146","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705353+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:40:32.705353+0000","last_peered":"2024-08-09T00:40:32.705353+0000","last_clean":"2024-08-09T00:40:32.705353+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:40:32.705353+0000","last_undegraded":"2024-08-09T00:40:32.705353+0000","last_fullsized":"2024-08-09T00:40:32.705353+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5295,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":256,"num_write":102,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:17.701915+0000","last_change":"2024-08-08T23:28:32.799931+0000","last_active":"2024-08-09T00:40:17.701915+0000","last_peered":"2024-08-09T00:40:17.701915+0000","last_clean":"2024-08-09T00:40:17.701915+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:40:17.701915+0000","last_undegraded":"2024-08-09T00:40:17.701915+0000","last_fullsized":"2024-08-09T00:40:17.701915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'95","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:37.869527+0000","last_change":"2024-08-08T23:28:34.829500+0000","last_active":"2024-08-09T00:39:37.869527+0000","last_peered":"2024-08-09T00:39:37.869527+0000","last_clean":"2024-08-09T00:39:37.869527+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:39:37.869527+0000","last_undegraded":"2024-08-09T00:39:37.869527+0000","last_fullsized":"2024-08-09T00:39:37.869527+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'226","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:07.875998+0000","last_change":"2024-08-08T23:28:26.774608+0000","last_active":"2024-08-09T00:40:07.875998+0000","last_peered":"2024-08-09T00:40:07.875998+0000","last_clean":"2024-08-09T00:40:07.875998+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:40:07.875998+0000","last_undegraded":"2024-08-09T00:40:07.875998+0000","last_fullsized":"2024-08-09T00:40:07.875998+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'160","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.618151+0000","last_change":"2024-08-08T23:28:24.823026+0000","last_active":"2024-08-09T00:40:30.618151+0000","last_peered":"2024-08-09T00:40:30.618151+0000","last_clean":"2024-08-09T00:40:30.618151+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:40:30.618151+0000","last_undegraded":"2024-08-09T00:40:30.618151+0000","last_fullsized":"2024-08-09T00:40:30.618151+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317190,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":142181,"num_write":944,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.214568+0000","last_change":"2024-08-09T00:40:51.214679+0000","last_active":"2024-08-09T00:40:51.214568+0000","last_peered":"2024-08-09T00:40:51.214568+0000","last_clean":"2024-08-09T00:40:51.214568+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:40:51.214568+0000","last_undegraded":"2024-08-09T00:40:51.214568+0000","last_fullsized":"2024-08-09T00:40:51.214568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.214333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:45:12.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'211","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.624004+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:40:30.624004+0000","last_peered":"2024-08-09T00:40:30.624004+0000","last_clean":"2024-08-09T00:40:30.624004+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:40:30.624004+0000","last_undegraded":"2024-08-09T00:40:30.624004+0000","last_fullsized":"2024-08-09T00:40:30.624004+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":290,"num_read_kb":376,"num_write":174,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'509","reported_seq":4398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.665384+0000","last_change":"2024-08-08T23:28:32.823537+0000","last_active":"2024-08-09T00:40:30.665384+0000","last_peered":"2024-08-09T00:40:30.665384+0000","last_clean":"2024-08-09T00:40:30.665384+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:30.665384+0000","last_undegraded":"2024-08-09T00:40:30.665384+0000","last_fullsized":"2024-08-09T00:40:30.665384+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'112","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.643203+0000","last_change":"2024-08-09T00:40:47.643278+0000","last_active":"2024-08-09T00:40:47.643203+0000","last_peered":"2024-08-09T00:40:47.643203+0000","last_clean":"2024-08-09T00:40:47.643203+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:40:47.643203+0000","last_undegraded":"2024-08-09T00:40:47.643203+0000","last_fullsized":"2024-08-09T00:40:47.643203+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.643006+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:42.442342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.877980+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:40:27.877980+0000","last_peered":"2024-08-09T00:40:27.877980+0000","last_clean":"2024-08-09T00:40:27.877980+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:40:27.877980+0000","last_undegraded":"2024-08-09T00:40:27.877980+0000","last_fullsized":"2024-08-09T00:40:27.877980+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'251","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.649961+0000","last_change":"2024-08-08T23:28:24.819082+0000","last_active":"2024-08-09T00:40:30.649961+0000","last_peered":"2024-08-09T00:40:30.649961+0000","last_clean":"2024-08-09T00:40:30.649961+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:40:30.649961+0000","last_undegraded":"2024-08-09T00:40:30.649961+0000","last_fullsized":"2024-08-09T00:40:30.649961+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":20334,"num_write":1169,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.236924+0000","last_change":"2024-08-09T00:40:47.236992+0000","last_active":"2024-08-09T00:40:47.236924+0000","last_peered":"2024-08-09T00:40:47.236924+0000","last_clean":"2024-08-09T00:40:47.236924+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:40:47.236924+0000","last_undegraded":"2024-08-09T00:40:47.236924+0000","last_fullsized":"2024-08-09T00:40:47.236924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.236732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:54.921678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":486,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'252","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.640989+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:40:30.640989+0000","last_peered":"2024-08-09T00:40:30.640989+0000","last_clean":"2024-08-09T00:40:30.640989+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:40:30.640989+0000","last_undegraded":"2024-08-09T00:40:30.640989+0000","last_fullsized":"2024-08-09T00:40:30.640989+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41629,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":626,"num_write":204,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.251368+0000","last_change":"2024-08-09T00:40:38.251420+0000","last_active":"2024-08-09T00:40:38.251368+0000","last_peered":"2024-08-09T00:40:38.251368+0000","last_clean":"2024-08-09T00:40:38.251368+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:40:38.251368+0000","last_undegraded":"2024-08-09T00:40:38.251368+0000","last_fullsized":"2024-08-09T00:40:38.251368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.251160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:52:01.992409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'103","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.716990+0000","last_change":"2024-08-09T00:40:44.717155+0000","last_active":"2024-08-09T00:40:44.716990+0000","last_peered":"2024-08-09T00:40:44.716990+0000","last_clean":"2024-08-09T00:40:44.716990+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:40:44.716990+0000","last_undegraded":"2024-08-09T00:40:44.716990+0000","last_fullsized":"2024-08-09T00:40:44.716990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.716722+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.554310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.882365+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:40:27.882365+0000","last_peered":"2024-08-09T00:40:27.882365+0000","last_clean":"2024-08-09T00:40:27.882365+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:40:27.882365+0000","last_undegraded":"2024-08-09T00:40:27.882365+0000","last_fullsized":"2024-08-09T00:40:27.882365+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'169","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.205826+0000","last_change":"2024-08-09T00:40:52.205935+0000","last_active":"2024-08-09T00:40:52.205826+0000","last_peered":"2024-08-09T00:40:52.205826+0000","last_clean":"2024-08-09T00:40:52.205826+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:40:52.205826+0000","last_undegraded":"2024-08-09T00:40:52.205826+0000","last_fullsized":"2024-08-09T00:40:52.205826+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'169","last_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_deep_scrub":"268'169","last_deep_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.205600+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:53.896377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055036,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":365,"num_read_kb":5320,"num_write":980,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.203522+0000","last_change":"2024-08-09T00:40:45.203576+0000","last_active":"2024-08-09T00:40:45.203522+0000","last_peered":"2024-08-09T00:40:45.203522+0000","last_clean":"2024-08-09T00:40:45.203522+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:40:45.203522+0000","last_undegraded":"2024-08-09T00:40:45.203522+0000","last_fullsized":"2024-08-09T00:40:45.203522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.203322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:04:32.071267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'174","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.883612+0000","last_change":"2024-08-08T23:28:30.784352+0000","last_active":"2024-08-09T00:40:32.883612+0000","last_peered":"2024-08-09T00:40:32.883612+0000","last_clean":"2024-08-09T00:40:32.883612+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:40:32.883612+0000","last_undegraded":"2024-08-09T00:40:32.883612+0000","last_fullsized":"2024-08-09T00:40:32.883612+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8780,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":256,"num_read_kb":313,"num_write":192,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821551+0000","last_change":"2024-08-08T23:28:32.827076+0000","last_active":"2024-08-09T00:40:33.821551+0000","last_peered":"2024-08-09T00:40:33.821551+0000","last_clean":"2024-08-09T00:40:33.821551+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:40:33.821551+0000","last_undegraded":"2024-08-09T00:40:33.821551+0000","last_fullsized":"2024-08-09T00:40:33.821551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'138","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.387779+0000","last_change":"2024-08-09T00:40:45.387779+0000","last_active":"2024-08-09T00:40:45.387779+0000","last_peered":"2024-08-09T00:40:45.387779+0000","last_clean":"2024-08-09T00:40:45.387779+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:40:45.387779+0000","last_undegraded":"2024-08-09T00:40:45.387779+0000","last_fullsized":"2024-08-09T00:40:45.387779+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.387511+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:18.812396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'185","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.882429+0000","last_change":"2024-08-08T23:28:26.768527+0000","last_active":"2024-08-09T00:40:27.882429+0000","last_peered":"2024-08-09T00:40:27.882429+0000","last_clean":"2024-08-09T00:40:27.882429+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:40:27.882429+0000","last_undegraded":"2024-08-09T00:40:27.882429+0000","last_fullsized":"2024-08-09T00:40:27.882429+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'205","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.420065+0000","last_change":"2024-08-08T23:28:24.767491+0000","last_active":"2024-08-09T00:40:30.420065+0000","last_peered":"2024-08-09T00:40:30.420065+0000","last_clean":"2024-08-09T00:40:30.420065+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:40:30.420065+0000","last_undegraded":"2024-08-09T00:40:30.420065+0000","last_fullsized":"2024-08-09T00:40:30.420065+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":34331,"num_write":1087,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.794304+0000","last_change":"2024-08-09T00:40:49.794358+0000","last_active":"2024-08-09T00:40:49.794304+0000","last_peered":"2024-08-09T00:40:49.794304+0000","last_clean":"2024-08-09T00:40:49.794304+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:40:49.794304+0000","last_undegraded":"2024-08-09T00:40:49.794304+0000","last_fullsized":"2024-08-09T00:40:49.794304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.794107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:44.283341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'204","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.244661+0000","last_change":"2024-08-09T00:40:41.244661+0000","last_active":"2024-08-09T00:40:41.244661+0000","last_peered":"2024-08-09T00:40:41.244661+0000","last_clean":"2024-08-09T00:40:41.244661+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:40:41.244661+0000","last_undegraded":"2024-08-09T00:40:41.244661+0000","last_fullsized":"2024-08-09T00:40:41.244661+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'204","last_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_deep_scrub":"268'204","last_deep_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.244364+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:23.051092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14461,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":384,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'493","reported_seq":2267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.206039+0000","last_change":"2024-08-09T00:40:39.206104+0000","last_active":"2024-08-09T00:40:39.206039+0000","last_peered":"2024-08-09T00:40:39.206039+0000","last_clean":"2024-08-09T00:40:39.206039+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:40:39.206039+0000","last_undegraded":"2024-08-09T00:40:39.206039+0000","last_fullsized":"2024-08-09T00:40:39.206039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'493","last_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_deep_scrub":"268'493","last_deep_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.205835+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:20:27.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'124","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.732586+0000","last_change":"2024-08-09T00:40:43.732680+0000","last_active":"2024-08-09T00:40:43.732586+0000","last_peered":"2024-08-09T00:40:43.732586+0000","last_clean":"2024-08-09T00:40:43.732586+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:40:43.732586+0000","last_undegraded":"2024-08-09T00:40:43.732586+0000","last_fullsized":"2024-08-09T00:40:43.732586+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.732377+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:57.582089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.882477+0000","last_change":"2024-08-08T23:28:26.779476+0000","last_active":"2024-08-09T00:40:27.882477+0000","last_peered":"2024-08-09T00:40:27.882477+0000","last_clean":"2024-08-09T00:40:27.882477+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:40:27.882477+0000","last_undegraded":"2024-08-09T00:40:27.882477+0000","last_fullsized":"2024-08-09T00:40:27.882477+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'205","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.577781+0000","last_change":"2024-08-08T23:28:24.790265+0000","last_active":"2024-08-09T00:40:30.577781+0000","last_peered":"2024-08-09T00:40:30.577781+0000","last_clean":"2024-08-09T00:40:30.577781+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:40:30.577781+0000","last_undegraded":"2024-08-09T00:40:30.577781+0000","last_fullsized":"2024-08-09T00:40:30.577781+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":23703,"num_write":1091,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.137127+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:40:36.137127+0000","last_peered":"2024-08-09T00:40:36.137127+0000","last_clean":"2024-08-09T00:40:36.137127+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:40:36.137127+0000","last_undegraded":"2024-08-09T00:40:36.137127+0000","last_fullsized":"2024-08-09T00:40:36.137127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":638,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'105","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705441+0000","last_change":"2024-08-08T23:28:31.048124+0000","last_active":"2024-08-09T00:40:32.705441+0000","last_peered":"2024-08-09T00:40:32.705441+0000","last_clean":"2024-08-09T00:40:32.705441+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:40:32.705441+0000","last_undegraded":"2024-08-09T00:40:32.705441+0000","last_fullsized":"2024-08-09T00:40:32.705441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'500","reported_seq":2270,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.915039+0000","last_change":"2024-08-09T00:40:41.915107+0000","last_active":"2024-08-09T00:40:41.915039+0000","last_peered":"2024-08-09T00:40:41.915039+0000","last_clean":"2024-08-09T00:40:41.915039+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:40:41.915039+0000","last_undegraded":"2024-08-09T00:40:41.915039+0000","last_fullsized":"2024-08-09T00:40:41.915039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.914818+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:19.244826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.954086+0000","last_change":"2024-08-09T00:40:39.954144+0000","last_active":"2024-08-09T00:40:39.954086+0000","last_peered":"2024-08-09T00:40:39.954086+0000","last_clean":"2024-08-09T00:40:39.954086+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:40:39.954086+0000","last_undegraded":"2024-08-09T00:40:39.954086+0000","last_fullsized":"2024-08-09T00:40:39.954086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.953890+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:35:41.399127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'461","reported_seq":1176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279108+0000","last_change":"2024-08-08T23:28:26.762100+0000","last_active":"2024-08-09T00:40:34.279108+0000","last_peered":"2024-08-09T00:40:34.279108+0000","last_clean":"2024-08-09T00:40:34.279108+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:40:34.279108+0000","last_undegraded":"2024-08-09T00:40:34.279108+0000","last_fullsized":"2024-08-09T00:40:34.279108+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'181","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.528840+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:40:30.528840+0000","last_peered":"2024-08-09T00:40:30.528840+0000","last_clean":"2024-08-09T00:40:30.528840+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:40:30.528840+0000","last_undegraded":"2024-08-09T00:40:30.528840+0000","last_fullsized":"2024-08-09T00:40:30.528840+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":4543,"num_write":1045,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.883674+0000","last_change":"2024-08-08T23:28:28.778804+0000","last_active":"2024-08-09T00:40:32.883674+0000","last_peered":"2024-08-09T00:40:32.883674+0000","last_clean":"2024-08-09T00:40:32.883674+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:40:32.883674+0000","last_undegraded":"2024-08-09T00:40:32.883674+0000","last_fullsized":"2024-08-09T00:40:32.883674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'311","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.290776+0000","last_change":"2024-08-09T00:40:50.290869+0000","last_active":"2024-08-09T00:40:50.290776+0000","last_peered":"2024-08-09T00:40:50.290776+0000","last_clean":"2024-08-09T00:40:50.290776+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:40:50.290776+0000","last_undegraded":"2024-08-09T00:40:50.290776+0000","last_fullsized":"2024-08-09T00:40:50.290776+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.290582+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:57.971956+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":996,"num_read_kb":1052,"num_write":1534,"num_write_kb":1360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455368,"num_omap_keys":1106,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.917979+0000","last_change":"2024-08-09T00:40:45.918031+0000","last_active":"2024-08-09T00:40:45.917979+0000","last_peered":"2024-08-09T00:40:45.917979+0000","last_clean":"2024-08-09T00:40:45.917979+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:40:45.917979+0000","last_undegraded":"2024-08-09T00:40:45.917979+0000","last_fullsized":"2024-08-09T00:40:45.917979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.917777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:46:24.483454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'102","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:52.476454+0000","last_change":"2024-08-08T23:28:34.822628+0000","last_active":"2024-08-09T00:39:52.476454+0000","last_peered":"2024-08-09T00:39:52.476454+0000","last_clean":"2024-08-09T00:39:52.476454+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:39:52.476454+0000","last_undegraded":"2024-08-09T00:39:52.476454+0000","last_fullsized":"2024-08-09T00:39:52.476454+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.933962+0000","last_change":"2024-08-09T00:40:50.934023+0000","last_active":"2024-08-09T00:40:50.933962+0000","last_peered":"2024-08-09T00:40:50.933962+0000","last_clean":"2024-08-09T00:40:50.933962+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:40:50.933962+0000","last_undegraded":"2024-08-09T00:40:50.933962+0000","last_fullsized":"2024-08-09T00:40:50.933962+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.933771+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:53:51.224009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.692047+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:40:27.692047+0000","last_peered":"2024-08-09T00:40:27.692047+0000","last_clean":"2024-08-09T00:40:27.692047+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:40:27.692047+0000","last_undegraded":"2024-08-09T00:40:27.692047+0000","last_fullsized":"2024-08-09T00:40:27.692047+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.087420+0000","last_change":"2024-08-08T23:28:16.802147+0000","last_active":"2024-08-09T00:39:08.087420+0000","last_peered":"2024-08-09T00:39:08.087420+0000","last_clean":"2024-08-09T00:39:08.087420+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:39:08.087420+0000","last_undegraded":"2024-08-09T00:39:08.087420+0000","last_fullsized":"2024-08-09T00:39:08.087420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'173","reported_seq":815,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.617880+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:40:30.617880+0000","last_peered":"2024-08-09T00:40:30.617880+0000","last_clean":"2024-08-09T00:40:30.617880+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:40:30.617880+0000","last_undegraded":"2024-08-09T00:40:30.617880+0000","last_fullsized":"2024-08-09T00:40:30.617880+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":19880,"num_write":949,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.890945+0000","last_change":"2024-08-08T23:28:28.785997+0000","last_active":"2024-08-09T00:39:22.890945+0000","last_peered":"2024-08-09T00:39:22.890945+0000","last_clean":"2024-08-09T00:39:22.890945+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:39:22.890945+0000","last_undegraded":"2024-08-09T00:39:22.890945+0000","last_fullsized":"2024-08-09T00:39:22.890945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'338","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276959+0000","last_change":"2024-08-09T00:40:49.277114+0000","last_active":"2024-08-09T00:40:49.276959+0000","last_peered":"2024-08-09T00:40:49.276959+0000","last_clean":"2024-08-09T00:40:49.276959+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:40:49.276959+0000","last_undegraded":"2024-08-09T00:40:49.276959+0000","last_fullsized":"2024-08-09T00:40:49.276959+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.276690+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:18:38.872577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":648,"num_read_kb":915,"num_write":594,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94900,"num_omap_keys":244,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.870439+0000","last_change":"2024-08-08T23:28:32.821568+0000","last_active":"2024-08-09T00:40:02.870439+0000","last_peered":"2024-08-09T00:40:02.870439+0000","last_clean":"2024-08-09T00:40:02.870439+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:40:02.870439+0000","last_undegraded":"2024-08-09T00:40:02.870439+0000","last_fullsized":"2024-08-09T00:40:02.870439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'208","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.967571+0000","last_change":"2024-08-09T00:40:51.967654+0000","last_active":"2024-08-09T00:40:51.967571+0000","last_peered":"2024-08-09T00:40:51.967571+0000","last_clean":"2024-08-09T00:40:51.967571+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:40:51.967571+0000","last_undegraded":"2024-08-09T00:40:51.967571+0000","last_fullsized":"2024-08-09T00:40:51.967571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.967362+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:19:16.020869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'188","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.868955+0000","last_change":"2024-08-08T23:28:26.775022+0000","last_active":"2024-08-09T00:39:57.868955+0000","last_peered":"2024-08-09T00:39:57.868955+0000","last_clean":"2024-08-09T00:39:57.868955+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:39:57.868955+0000","last_undegraded":"2024-08-09T00:39:57.868955+0000","last_fullsized":"2024-08-09T00:39:57.868955+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.693251+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:40:32.693251+0000","last_peered":"2024-08-09T00:40:32.693251+0000","last_clean":"2024-08-09T00:40:32.693251+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:40:32.693251+0000","last_undegraded":"2024-08-09T00:40:32.693251+0000","last_fullsized":"2024-08-09T00:40:32.693251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'203","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587945+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:40:30.587945+0000","last_peered":"2024-08-09T00:40:30.587945+0000","last_clean":"2024-08-09T00:40:30.587945+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:40:30.587945+0000","last_undegraded":"2024-08-09T00:40:30.587945+0000","last_fullsized":"2024-08-09T00:40:30.587945+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":17063,"num_write":1110,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:03.099843+0000","last_change":"2024-08-08T23:28:28.772772+0000","last_active":"2024-08-09T00:40:03.099843+0000","last_peered":"2024-08-09T00:40:03.099843+0000","last_clean":"2024-08-09T00:40:03.099843+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:40:03.099843+0000","last_undegraded":"2024-08-09T00:40:03.099843+0000","last_fullsized":"2024-08-09T00:40:03.099843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'701","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.822170+0000","last_change":"2024-08-09T00:40:51.822263+0000","last_active":"2024-08-09T00:40:51.822170+0000","last_peered":"2024-08-09T00:40:51.822170+0000","last_clean":"2024-08-09T00:40:51.822170+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:40:51.822170+0000","last_undegraded":"2024-08-09T00:40:51.822170+0000","last_fullsized":"2024-08-09T00:40:51.822170+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'701","last_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_deep_scrub":"268'701","last_deep_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.821968+0000","objects_scrubbed":12,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:09.857257+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33400,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1006,"num_read_kb":1225,"num_write":322,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5370,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893299+0000","last_change":"2024-08-08T23:28:32.810173+0000","last_active":"2024-08-09T00:39:32.893299+0000","last_peered":"2024-08-09T00:39:32.893299+0000","last_clean":"2024-08-09T00:39:32.893299+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:39:32.893299+0000","last_undegraded":"2024-08-09T00:39:32.893299+0000","last_fullsized":"2024-08-09T00:39:32.893299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'131","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.756535+0000","last_change":"2024-08-09T00:40:46.756610+0000","last_active":"2024-08-09T00:40:46.756535+0000","last_peered":"2024-08-09T00:40:46.756535+0000","last_clean":"2024-08-09T00:40:46.756535+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:40:46.756535+0000","last_undegraded":"2024-08-09T00:40:46.756535+0000","last_fullsized":"2024-08-09T00:40:46.756535+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.756345+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:00:48.329420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.878120+0000","last_change":"2024-08-08T23:28:26.777388+0000","last_active":"2024-08-09T00:39:57.878120+0000","last_peered":"2024-08-09T00:39:57.878120+0000","last_clean":"2024-08-09T00:39:57.878120+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:39:57.878120+0000","last_undegraded":"2024-08-09T00:39:57.878120+0000","last_fullsized":"2024-08-09T00:39:57.878120+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:07.859736+0000","last_change":"2024-08-08T23:28:16.887363+0000","last_active":"2024-08-09T00:39:07.859736+0000","last_peered":"2024-08-09T00:39:07.859736+0000","last_clean":"2024-08-09T00:39:07.859736+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:39:07.859736+0000","last_undegraded":"2024-08-09T00:39:07.859736+0000","last_fullsized":"2024-08-09T00:39:07.859736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'159","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.278824+0000","last_change":"2024-08-08T23:28:24.757810+0000","last_active":"2024-08-09T00:40:34.278824+0000","last_peered":"2024-08-09T00:40:34.278824+0000","last_clean":"2024-08-09T00:40:34.278824+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:40:34.278824+0000","last_undegraded":"2024-08-09T00:40:34.278824+0000","last_fullsized":"2024-08-09T00:40:34.278824+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5883424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":29266,"num_write":862,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.201294+0000","last_change":"2024-08-09T00:40:49.201356+0000","last_active":"2024-08-09T00:40:49.201294+0000","last_peered":"2024-08-09T00:40:49.201294+0000","last_clean":"2024-08-09T00:40:49.201294+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:40:49.201294+0000","last_undegraded":"2024-08-09T00:40:49.201294+0000","last_fullsized":"2024-08-09T00:40:49.201294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.201098+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:48.803444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.180265+0000","last_change":"2024-08-08T23:28:31.049356+0000","last_active":"2024-08-09T00:39:59.180265+0000","last_peered":"2024-08-09T00:39:59.180265+0000","last_clean":"2024-08-09T00:39:59.180265+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:39:59.180265+0000","last_undegraded":"2024-08-09T00:39:59.180265+0000","last_fullsized":"2024-08-09T00:39:59.180265+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.859989+0000","last_change":"2024-08-08T23:28:32.827179+0000","last_active":"2024-08-09T00:39:22.859989+0000","last_peered":"2024-08-09T00:39:22.859989+0000","last_clean":"2024-08-09T00:39:22.859989+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:39:22.859989+0000","last_undegraded":"2024-08-09T00:39:22.859989+0000","last_fullsized":"2024-08-09T00:39:22.859989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'279","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.246939+0000","last_change":"2024-08-09T00:40:48.247034+0000","last_active":"2024-08-09T00:40:48.246939+0000","last_peered":"2024-08-09T00:40:48.246939+0000","last_clean":"2024-08-09T00:40:48.246939+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:40:48.246939+0000","last_undegraded":"2024-08-09T00:40:48.246939+0000","last_fullsized":"2024-08-09T00:40:48.246939+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.246734+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:27.053825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.869222+0000","last_change":"2024-08-08T23:28:26.762755+0000","last_active":"2024-08-09T00:39:17.869222+0000","last_peered":"2024-08-09T00:39:17.869222+0000","last_clean":"2024-08-09T00:39:17.869222+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:39:17.869222+0000","last_undegraded":"2024-08-09T00:39:17.869222+0000","last_fullsized":"2024-08-09T00:39:17.869222+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:08.087323+0000","last_change":"2024-08-08T23:28:16.803821+0000","last_active":"2024-08-09T00:39:08.087323+0000","last_peered":"2024-08-09T00:39:08.087323+0000","last_clean":"2024-08-09T00:39:08.087323+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:39:08.087323+0000","last_undegraded":"2024-08-09T00:39:08.087323+0000","last_fullsized":"2024-08-09T00:39:08.087323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'200","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.637951+0000","last_change":"2024-08-08T23:28:24.760341+0000","last_active":"2024-08-09T00:40:30.637951+0000","last_peered":"2024-08-09T00:40:30.637951+0000","last_clean":"2024-08-09T00:40:30.637951+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:40:30.637951+0000","last_undegraded":"2024-08-09T00:40:30.637951+0000","last_fullsized":"2024-08-09T00:40:30.637951+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":7644,"num_write":1044,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:37.863506+0000","last_change":"2024-08-08T23:28:28.778088+0000","last_active":"2024-08-09T00:39:37.863506+0000","last_peered":"2024-08-09T00:39:37.863506+0000","last_clean":"2024-08-09T00:39:37.863506+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:39:37.863506+0000","last_undegraded":"2024-08-09T00:39:37.863506+0000","last_fullsized":"2024-08-09T00:39:37.863506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.698485+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:40:02.698485+0000","last_peered":"2024-08-09T00:40:02.698485+0000","last_clean":"2024-08-09T00:40:02.698485+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:40:02.698485+0000","last_undegraded":"2024-08-09T00:40:02.698485+0000","last_fullsized":"2024-08-09T00:40:02.698485+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.890179+0000","last_change":"2024-08-09T00:40:49.890232+0000","last_active":"2024-08-09T00:40:49.890179+0000","last_peered":"2024-08-09T00:40:49.890179+0000","last_clean":"2024-08-09T00:40:49.890179+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:40:49.890179+0000","last_undegraded":"2024-08-09T00:40:49.890179+0000","last_fullsized":"2024-08-09T00:40:49.890179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.889984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:45.090932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'114","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.232361+0000","last_change":"2024-08-09T00:40:38.232557+0000","last_active":"2024-08-09T00:40:38.232361+0000","last_peered":"2024-08-09T00:40:38.232361+0000","last_clean":"2024-08-09T00:40:38.232361+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:40:38.232361+0000","last_undegraded":"2024-08-09T00:40:38.232361+0000","last_fullsized":"2024-08-09T00:40:38.232361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.232120+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:00.159201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.776641+0000","last_change":"2024-08-09T00:40:52.776705+0000","last_active":"2024-08-09T00:40:52.776641+0000","last_peered":"2024-08-09T00:40:52.776641+0000","last_clean":"2024-08-09T00:40:52.776641+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:40:52.776641+0000","last_undegraded":"2024-08-09T00:40:52.776641+0000","last_fullsized":"2024-08-09T00:40:52.776641+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.776448+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.985569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'228","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.339653+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:40:30.339653+0000","last_peered":"2024-08-09T00:40:30.339653+0000","last_clean":"2024-08-09T00:40:30.339653+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:40:30.339653+0000","last_undegraded":"2024-08-09T00:40:30.339653+0000","last_fullsized":"2024-08-09T00:40:30.339653+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":62351,"num_write":1160,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:07.867285+0000","last_change":"2024-08-08T23:28:16.804605+0000","last_active":"2024-08-09T00:39:07.867285+0000","last_peered":"2024-08-09T00:39:07.867285+0000","last_clean":"2024-08-09T00:39:07.867285+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:39:07.867285+0000","last_undegraded":"2024-08-09T00:39:07.867285+0000","last_fullsized":"2024-08-09T00:39:07.867285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.859936+0000","last_change":"2024-08-08T23:28:28.783451+0000","last_active":"2024-08-09T00:39:22.859936+0000","last_peered":"2024-08-09T00:39:22.859936+0000","last_clean":"2024-08-09T00:39:22.859936+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:39:22.859936+0000","last_undegraded":"2024-08-09T00:39:22.859936+0000","last_fullsized":"2024-08-09T00:39:22.859936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'310","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821401+0000","last_change":"2024-08-08T23:28:30.784027+0000","last_active":"2024-08-09T00:40:33.821401+0000","last_peered":"2024-08-09T00:40:33.821401+0000","last_clean":"2024-08-09T00:40:33.821401+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:40:33.821401+0000","last_undegraded":"2024-08-09T00:40:33.821401+0000","last_fullsized":"2024-08-09T00:40:33.821401+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29428,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":629,"num_write":258,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.097242+0000","last_change":"2024-08-09T00:40:45.097347+0000","last_active":"2024-08-09T00:40:45.097242+0000","last_peered":"2024-08-09T00:40:45.097242+0000","last_clean":"2024-08-09T00:40:45.097242+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:40:45.097242+0000","last_undegraded":"2024-08-09T00:40:45.097242+0000","last_fullsized":"2024-08-09T00:40:45.097242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.097011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:27:33.586520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'120","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.618159+0000","last_change":"2024-08-09T00:40:46.618231+0000","last_active":"2024-08-09T00:40:46.618159+0000","last_peered":"2024-08-09T00:40:46.618159+0000","last_clean":"2024-08-09T00:40:46.618159+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:40:46.618159+0000","last_undegraded":"2024-08-09T00:40:46.618159+0000","last_fullsized":"2024-08-09T00:40:46.618159+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.617950+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.403990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'156","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.554453+0000","last_change":"2024-08-08T23:28:26.780124+0000","last_active":"2024-08-09T00:39:27.554453+0000","last_peered":"2024-08-09T00:39:27.554453+0000","last_clean":"2024-08-09T00:39:27.554453+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:39:27.554453+0000","last_undegraded":"2024-08-09T00:39:27.554453+0000","last_fullsized":"2024-08-09T00:39:27.554453+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'317","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.521753+0000","last_change":"2024-08-08T23:28:24.764595+0000","last_active":"2024-08-09T00:40:30.521753+0000","last_peered":"2024-08-09T00:40:30.521753+0000","last_clean":"2024-08-09T00:40:30.521753+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:40:30.521753+0000","last_undegraded":"2024-08-09T00:40:30.521753+0000","last_fullsized":"2024-08-09T00:40:30.521753+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1025,"num_read_kb":185751,"num_write":1335,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.889721+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:39:17.889721+0000","last_peered":"2024-08-09T00:39:17.889721+0000","last_clean":"2024-08-09T00:39:17.889721+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:39:17.889721+0000","last_undegraded":"2024-08-09T00:39:17.889721+0000","last_fullsized":"2024-08-09T00:39:17.889721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.926833+0000","last_change":"2024-08-09T00:40:48.926892+0000","last_active":"2024-08-09T00:40:48.926833+0000","last_peered":"2024-08-09T00:40:48.926833+0000","last_clean":"2024-08-09T00:40:48.926833+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:40:48.926833+0000","last_undegraded":"2024-08-09T00:40:48.926833+0000","last_fullsized":"2024-08-09T00:40:48.926833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.926628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:36:47.294692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'221","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:59.185461+0000","last_change":"2024-08-08T23:28:31.042472+0000","last_active":"2024-08-09T00:39:59.185461+0000","last_peered":"2024-08-09T00:39:59.185461+0000","last_clean":"2024-08-09T00:39:59.185461+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:39:59.185461+0000","last_undegraded":"2024-08-09T00:39:59.185461+0000","last_fullsized":"2024-08-09T00:39:59.185461+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'528","reported_seq":4411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.223881+0000","last_change":"2024-08-09T00:40:46.223881+0000","last_active":"2024-08-09T00:40:46.223881+0000","last_peered":"2024-08-09T00:40:46.223881+0000","last_clean":"2024-08-09T00:40:46.223881+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:40:46.223881+0000","last_undegraded":"2024-08-09T00:40:46.223881+0000","last_fullsized":"2024-08-09T00:40:46.223881+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'528","last_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_deep_scrub":"268'528","last_deep_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.223619+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:52.863127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'168","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276198+0000","last_change":"2024-08-09T00:40:49.276198+0000","last_active":"2024-08-09T00:40:49.276198+0000","last_peered":"2024-08-09T00:40:49.276198+0000","last_clean":"2024-08-09T00:40:49.276198+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:40:49.276198+0000","last_undegraded":"2024-08-09T00:40:49.276198+0000","last_fullsized":"2024-08-09T00:40:49.276198+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.275905+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:14.189142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209904+0000","last_change":"2024-08-08T23:28:26.776845+0000","last_active":"2024-08-09T00:40:35.209904+0000","last_peered":"2024-08-09T00:40:35.209904+0000","last_clean":"2024-08-09T00:40:35.209904+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:40:35.209904+0000","last_undegraded":"2024-08-09T00:40:35.209904+0000","last_fullsized":"2024-08-09T00:40:35.209904+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'273","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.648337+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:40:30.648337+0000","last_peered":"2024-08-09T00:40:30.648337+0000","last_clean":"2024-08-09T00:40:30.648337+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:40:30.648337+0000","last_undegraded":"2024-08-09T00:40:30.648337+0000","last_fullsized":"2024-08-09T00:40:30.648337+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311694,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1095,"num_read_kb":6569,"num_write":1298,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:47.875536+0000","last_change":"2024-08-08T23:28:16.804804+0000","last_active":"2024-08-09T00:39:47.875536+0000","last_peered":"2024-08-09T00:39:47.875536+0000","last_clean":"2024-08-09T00:39:47.875536+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:39:47.875536+0000","last_undegraded":"2024-08-09T00:39:47.875536+0000","last_fullsized":"2024-08-09T00:39:47.875536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.867381+0000","last_change":"2024-08-08T23:28:28.777156+0000","last_active":"2024-08-09T00:39:22.867381+0000","last_peered":"2024-08-09T00:39:22.867381+0000","last_clean":"2024-08-09T00:39:22.867381+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:39:22.867381+0000","last_undegraded":"2024-08-09T00:39:22.867381+0000","last_fullsized":"2024-08-09T00:39:22.867381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'154","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.047156+0000","last_change":"2024-08-09T00:40:49.047234+0000","last_active":"2024-08-09T00:40:49.047156+0000","last_peered":"2024-08-09T00:40:49.047156+0000","last_clean":"2024-08-09T00:40:49.047156+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:40:49.047156+0000","last_undegraded":"2024-08-09T00:40:49.047156+0000","last_fullsized":"2024-08-09T00:40:49.047156+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.046957+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:48:46.019855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'525","reported_seq":2300,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.663301+0000","last_change":"2024-08-08T23:28:32.808377+0000","last_active":"2024-08-09T00:40:30.663301+0000","last_peered":"2024-08-09T00:40:30.663301+0000","last_clean":"2024-08-09T00:40:30.663301+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:40:30.663301+0000","last_undegraded":"2024-08-09T00:40:30.663301+0000","last_fullsized":"2024-08-09T00:40:30.663301+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'240","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.635026+0000","last_change":"2024-08-09T00:40:51.635097+0000","last_active":"2024-08-09T00:40:51.635026+0000","last_peered":"2024-08-09T00:40:51.635026+0000","last_clean":"2024-08-09T00:40:51.635026+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:40:51.635026+0000","last_undegraded":"2024-08-09T00:40:51.635026+0000","last_fullsized":"2024-08-09T00:40:51.635026+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.634826+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:56.897177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.866043+0000","last_change":"2024-08-08T23:28:26.770700+0000","last_active":"2024-08-09T00:39:17.866043+0000","last_peered":"2024-08-09T00:39:17.866043+0000","last_clean":"2024-08-09T00:39:17.866043+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:39:17.866043+0000","last_undegraded":"2024-08-09T00:39:17.866043+0000","last_fullsized":"2024-08-09T00:39:17.866043+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'219","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.222329+0000","last_change":"2024-08-09T00:40:48.222507+0000","last_active":"2024-08-09T00:40:48.222329+0000","last_peered":"2024-08-09T00:40:48.222329+0000","last_clean":"2024-08-09T00:40:48.222329+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:40:48.222329+0000","last_undegraded":"2024-08-09T00:40:48.222329+0000","last_fullsized":"2024-08-09T00:40:48.222329+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.222109+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:43.098443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37546,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":443,"num_read_kb":66311,"num_write":1073,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:47.871691+0000","last_change":"2024-08-08T23:28:17.170232+0000","last_active":"2024-08-09T00:39:47.871691+0000","last_peered":"2024-08-09T00:39:47.871691+0000","last_clean":"2024-08-09T00:39:47.871691+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:39:47.871691+0000","last_undegraded":"2024-08-09T00:39:47.871691+0000","last_fullsized":"2024-08-09T00:39:47.871691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210143+0000","last_change":"2024-08-08T23:28:28.771236+0000","last_active":"2024-08-09T00:40:35.210143+0000","last_peered":"2024-08-09T00:40:35.210143+0000","last_clean":"2024-08-09T00:40:35.210143+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:40:35.210143+0000","last_undegraded":"2024-08-09T00:40:35.210143+0000","last_fullsized":"2024-08-09T00:40:35.210143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":797,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'350","reported_seq":1100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.540583+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:40:30.540583+0000","last_peered":"2024-08-09T00:40:30.540583+0000","last_clean":"2024-08-09T00:40:30.540583+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:40:30.540583+0000","last_undegraded":"2024-08-09T00:40:30.540583+0000","last_fullsized":"2024-08-09T00:40:30.540583+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24443,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":707,"num_write":276,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:22.689245+0000","last_change":"2024-08-08T23:28:32.805174+0000","last_active":"2024-08-09T00:39:22.689245+0000","last_peered":"2024-08-09T00:39:22.689245+0000","last_clean":"2024-08-09T00:39:22.689245+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:39:22.689245+0000","last_undegraded":"2024-08-09T00:39:22.689245+0000","last_fullsized":"2024-08-09T00:39:22.689245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'127","reported_seq":629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.236617+0000","last_change":"2024-08-09T00:40:42.236705+0000","last_active":"2024-08-09T00:40:42.236617+0000","last_peered":"2024-08-09T00:40:42.236617+0000","last_clean":"2024-08-09T00:40:42.236617+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:40:42.236617+0000","last_undegraded":"2024-08-09T00:40:42.236617+0000","last_fullsized":"2024-08-09T00:40:42.236617+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.236387+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:25:28.423291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.636251+0000","last_change":"2024-08-09T00:40:49.636334+0000","last_active":"2024-08-09T00:40:49.636251+0000","last_peered":"2024-08-09T00:40:49.636251+0000","last_clean":"2024-08-09T00:40:49.636251+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:40:49.636251+0000","last_undegraded":"2024-08-09T00:40:49.636251+0000","last_fullsized":"2024-08-09T00:40:49.636251+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.636047+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:31:23.809790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.683093+0000","last_change":"2024-08-08T23:28:26.776818+0000","last_active":"2024-08-09T00:40:35.683093+0000","last_peered":"2024-08-09T00:40:35.683093+0000","last_clean":"2024-08-09T00:40:35.683093+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:40:35.683093+0000","last_undegraded":"2024-08-09T00:40:35.683093+0000","last_fullsized":"2024-08-09T00:40:35.683093+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'229","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.650685+0000","last_change":"2024-08-08T23:28:24.798893+0000","last_active":"2024-08-09T00:40:30.650685+0000","last_peered":"2024-08-09T00:40:30.650685+0000","last_clean":"2024-08-09T00:40:30.650685+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:40:30.650685+0000","last_undegraded":"2024-08-09T00:40:30.650685+0000","last_fullsized":"2024-08-09T00:40:30.650685+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":23490,"num_write":1170,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.838789+0000","last_change":"2024-08-09T00:40:50.838789+0000","last_active":"2024-08-09T00:40:50.838789+0000","last_peered":"2024-08-09T00:40:50.838789+0000","last_clean":"2024-08-09T00:40:50.838789+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:40:50.838789+0000","last_undegraded":"2024-08-09T00:40:50.838789+0000","last_fullsized":"2024-08-09T00:40:50.838789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.838517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:22:43.037726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'165","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210114+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:40:35.210114+0000","last_peered":"2024-08-09T00:40:35.210114+0000","last_clean":"2024-08-09T00:40:35.210114+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:40:35.210114+0000","last_undegraded":"2024-08-09T00:40:35.210114+0000","last_fullsized":"2024-08-09T00:40:35.210114+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":265,"num_write":116,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210275+0000","last_change":"2024-08-08T23:28:32.810146+0000","last_active":"2024-08-09T00:40:35.210275+0000","last_peered":"2024-08-09T00:40:35.210275+0000","last_clean":"2024-08-09T00:40:35.210275+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:40:35.210275+0000","last_undegraded":"2024-08-09T00:40:35.210275+0000","last_fullsized":"2024-08-09T00:40:35.210275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'118","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.310577+0000","last_change":"2024-08-09T00:40:52.310577+0000","last_active":"2024-08-09T00:40:52.310577+0000","last_peered":"2024-08-09T00:40:52.310577+0000","last_clean":"2024-08-09T00:40:52.310577+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:40:52.310577+0000","last_undegraded":"2024-08-09T00:40:52.310577+0000","last_fullsized":"2024-08-09T00:40:52.310577+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.310328+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:58:03.731104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279133+0000","last_change":"2024-08-08T23:28:26.775873+0000","last_active":"2024-08-09T00:40:34.279133+0000","last_peered":"2024-08-09T00:40:34.279133+0000","last_clean":"2024-08-09T00:40:34.279133+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:40:34.279133+0000","last_undegraded":"2024-08-09T00:40:34.279133+0000","last_fullsized":"2024-08-09T00:40:34.279133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'183","reported_seq":788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.588363+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:40:30.588363+0000","last_peered":"2024-08-09T00:40:30.588363+0000","last_clean":"2024-08-09T00:40:30.588363+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:40:30.588363+0000","last_undegraded":"2024-08-09T00:40:30.588363+0000","last_fullsized":"2024-08-09T00:40:30.588363+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661190,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":16787,"num_write":983,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210018+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:40:35.210018+0000","last_peered":"2024-08-09T00:40:35.210018+0000","last_clean":"2024-08-09T00:40:35.210018+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:40:35.210018+0000","last_undegraded":"2024-08-09T00:40:35.210018+0000","last_fullsized":"2024-08-09T00:40:35.210018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'54","reported_seq":574,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821726+0000","last_change":"2024-08-08T23:28:30.783385+0000","last_active":"2024-08-09T00:40:33.821726+0000","last_peered":"2024-08-09T00:40:33.821726+0000","last_clean":"2024-08-09T00:40:33.821726+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:40:33.821726+0000","last_undegraded":"2024-08-09T00:40:33.821726+0000","last_fullsized":"2024-08-09T00:40:33.821726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067372+0000","last_change":"2024-08-08T23:28:32.810977+0000","last_active":"2024-08-09T00:40:37.067372+0000","last_peered":"2024-08-09T00:40:37.067372+0000","last_clean":"2024-08-09T00:40:37.067372+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:40:37.067372+0000","last_undegraded":"2024-08-09T00:40:37.067372+0000","last_fullsized":"2024-08-09T00:40:37.067372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'189","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.596161+0000","last_change":"2024-08-09T00:40:45.596320+0000","last_active":"2024-08-09T00:40:45.596161+0000","last_peered":"2024-08-09T00:40:45.596161+0000","last_clean":"2024-08-09T00:40:45.596161+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:40:45.596161+0000","last_undegraded":"2024-08-09T00:40:45.596161+0000","last_fullsized":"2024-08-09T00:40:45.596161+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.595931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:42:19.396170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":781,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209800+0000","last_change":"2024-08-08T23:28:26.776192+0000","last_active":"2024-08-09T00:40:35.209800+0000","last_peered":"2024-08-09T00:40:35.209800+0000","last_clean":"2024-08-09T00:40:35.209800+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:40:35.209800+0000","last_undegraded":"2024-08-09T00:40:35.209800+0000","last_fullsized":"2024-08-09T00:40:35.209800+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'202","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.461564+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:40:30.461564+0000","last_peered":"2024-08-09T00:40:30.461564+0000","last_clean":"2024-08-09T00:40:30.461564+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:40:30.461564+0000","last_undegraded":"2024-08-09T00:40:30.461564+0000","last_fullsized":"2024-08-09T00:40:30.461564+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110897,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":499,"num_read_kb":9686,"num_write":1123,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067147+0000","last_change":"2024-08-08T23:28:28.781246+0000","last_active":"2024-08-09T00:40:37.067147+0000","last_peered":"2024-08-09T00:40:37.067147+0000","last_clean":"2024-08-09T00:40:37.067147+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:40:37.067147+0000","last_undegraded":"2024-08-09T00:40:37.067147+0000","last_fullsized":"2024-08-09T00:40:37.067147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'200","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210290+0000","last_change":"2024-08-08T23:28:30.796061+0000","last_active":"2024-08-09T00:40:35.210290+0000","last_peered":"2024-08-09T00:40:35.210290+0000","last_clean":"2024-08-09T00:40:35.210290+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:40:35.210290+0000","last_undegraded":"2024-08-09T00:40:35.210290+0000","last_fullsized":"2024-08-09T00:40:35.210290+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":367,"num_write":158,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.887230+0000","last_change":"2024-08-09T00:40:47.887323+0000","last_active":"2024-08-09T00:40:47.887230+0000","last_peered":"2024-08-09T00:40:47.887230+0000","last_clean":"2024-08-09T00:40:47.887230+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:40:47.887230+0000","last_undegraded":"2024-08-09T00:40:47.887230+0000","last_fullsized":"2024-08-09T00:40:47.887230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.886949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:37.660989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'115","reported_seq":613,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.262532+0000","last_change":"2024-08-09T00:40:41.262602+0000","last_active":"2024-08-09T00:40:41.262532+0000","last_peered":"2024-08-09T00:40:41.262532+0000","last_clean":"2024-08-09T00:40:41.262532+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:40:41.262532+0000","last_undegraded":"2024-08-09T00:40:41.262532+0000","last_fullsized":"2024-08-09T00:40:41.262532+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.262339+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:46:01.693522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209931+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:40:35.209931+0000","last_peered":"2024-08-09T00:40:35.209931+0000","last_clean":"2024-08-09T00:40:35.209931+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:40:35.209931+0000","last_undegraded":"2024-08-09T00:40:35.209931+0000","last_fullsized":"2024-08-09T00:40:35.209931+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'167","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.528250+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:40:30.528250+0000","last_peered":"2024-08-09T00:40:30.528250+0000","last_clean":"2024-08-09T00:40:30.528250+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:40:30.528250+0000","last_undegraded":"2024-08-09T00:40:30.528250+0000","last_fullsized":"2024-08-09T00:40:30.528250+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":317,"num_read_kb":1399,"num_write":881,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.890394+0000","last_change":"2024-08-09T00:40:44.890394+0000","last_active":"2024-08-09T00:40:44.890394+0000","last_peered":"2024-08-09T00:40:44.890394+0000","last_clean":"2024-08-09T00:40:44.890394+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:40:44.890394+0000","last_undegraded":"2024-08-09T00:40:44.890394+0000","last_fullsized":"2024-08-09T00:40:44.890394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.890149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:41.092600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'137","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067448+0000","last_change":"2024-08-08T23:28:30.780651+0000","last_active":"2024-08-09T00:40:37.067448+0000","last_peered":"2024-08-09T00:40:37.067448+0000","last_clean":"2024-08-09T00:40:37.067448+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:40:37.067448+0000","last_undegraded":"2024-08-09T00:40:37.067448+0000","last_fullsized":"2024-08-09T00:40:37.067448+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":239,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821750+0000","last_change":"2024-08-08T23:28:32.826903+0000","last_active":"2024-08-09T00:40:33.821750+0000","last_peered":"2024-08-09T00:40:33.821750+0000","last_clean":"2024-08-09T00:40:33.821750+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:40:33.821750+0000","last_undegraded":"2024-08-09T00:40:33.821750+0000","last_fullsized":"2024-08-09T00:40:33.821750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.865099+0000","last_change":"2024-08-08T23:28:26.774602+0000","last_active":"2024-08-09T00:39:17.865099+0000","last_peered":"2024-08-09T00:39:17.865099+0000","last_clean":"2024-08-09T00:39:17.865099+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:39:17.865099+0000","last_undegraded":"2024-08-09T00:39:17.865099+0000","last_fullsized":"2024-08-09T00:39:17.865099+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'160","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.628747+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:40:30.628747+0000","last_peered":"2024-08-09T00:40:30.628747+0000","last_clean":"2024-08-09T00:40:30.628747+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:40:30.628747+0000","last_undegraded":"2024-08-09T00:40:30.628747+0000","last_fullsized":"2024-08-09T00:40:30.628747+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540766,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":18716,"num_write":872,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821323+0000","last_change":"2024-08-08T23:28:28.783884+0000","last_active":"2024-08-09T00:40:33.821323+0000","last_peered":"2024-08-09T00:40:33.821323+0000","last_clean":"2024-08-09T00:40:33.821323+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:40:33.821323+0000","last_undegraded":"2024-08-09T00:40:33.821323+0000","last_fullsized":"2024-08-09T00:40:33.821323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'222","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.447143+0000","last_change":"2024-08-08T23:28:30.780333+0000","last_active":"2024-08-09T00:40:30.447143+0000","last_peered":"2024-08-09T00:40:30.447143+0000","last_clean":"2024-08-09T00:40:30.447143+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:40:30.447143+0000","last_undegraded":"2024-08-09T00:40:30.447143+0000","last_fullsized":"2024-08-09T00:40:30.447143+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17674,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":513,"num_write":222,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.257143+0000","last_change":"2024-08-09T00:40:45.257255+0000","last_active":"2024-08-09T00:40:45.257143+0000","last_peered":"2024-08-09T00:40:45.257143+0000","last_clean":"2024-08-09T00:40:45.257143+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:40:45.257143+0000","last_undegraded":"2024-08-09T00:40:45.257143+0000","last_fullsized":"2024-08-09T00:40:45.257143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.256887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.726347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'166","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.339552+0000","last_change":"2024-08-09T00:40:46.339701+0000","last_active":"2024-08-09T00:40:46.339552+0000","last_peered":"2024-08-09T00:40:46.339552+0000","last_clean":"2024-08-09T00:40:46.339552+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:40:46.339552+0000","last_undegraded":"2024-08-09T00:40:46.339552+0000","last_fullsized":"2024-08-09T00:40:46.339552+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.339303+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:17.653047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821262+0000","last_change":"2024-08-08T23:28:26.777062+0000","last_active":"2024-08-09T00:40:33.821262+0000","last_peered":"2024-08-09T00:40:33.821262+0000","last_clean":"2024-08-09T00:40:33.821262+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:40:33.821262+0000","last_undegraded":"2024-08-09T00:40:33.821262+0000","last_fullsized":"2024-08-09T00:40:33.821262+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'284","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.724899+0000","last_change":"2024-08-09T00:40:40.725010+0000","last_active":"2024-08-09T00:40:40.724899+0000","last_peered":"2024-08-09T00:40:40.724899+0000","last_clean":"2024-08-09T00:40:40.724899+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:40:40.724899+0000","last_undegraded":"2024-08-09T00:40:40.724899+0000","last_fullsized":"2024-08-09T00:40:40.724899+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.724693+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:21.253956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":69125,"num_write":1347,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.890568+0000","last_change":"2024-08-09T00:40:46.890625+0000","last_active":"2024-08-09T00:40:46.890568+0000","last_peered":"2024-08-09T00:40:46.890568+0000","last_clean":"2024-08-09T00:40:46.890568+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:40:46.890568+0000","last_undegraded":"2024-08-09T00:40:46.890568+0000","last_fullsized":"2024-08-09T00:40:46.890568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.890298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:04:42.778225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'198","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.464939+0000","last_change":"2024-08-08T23:28:30.775644+0000","last_active":"2024-08-09T00:40:30.464939+0000","last_peered":"2024-08-09T00:40:30.464939+0000","last_clean":"2024-08-09T00:40:30.464939+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:40:30.464939+0000","last_undegraded":"2024-08-09T00:40:30.464939+0000","last_fullsized":"2024-08-09T00:40:30.464939+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":267,"num_read_kb":315,"num_write":170,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.859596+0000","last_change":"2024-08-08T23:28:32.809931+0000","last_active":"2024-08-09T00:38:32.859596+0000","last_peered":"2024-08-09T00:38:32.859596+0000","last_clean":"2024-08-09T00:38:32.859596+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:38:32.859596+0000","last_undegraded":"2024-08-09T00:38:32.859596+0000","last_fullsized":"2024-08-09T00:38:32.859596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'178","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.639827+0000","last_change":"2024-08-08T23:28:34.836352+0000","last_active":"2024-08-09T00:39:48.639827+0000","last_peered":"2024-08-09T00:39:48.639827+0000","last_clean":"2024-08-09T00:39:48.639827+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:39:48.639827+0000","last_undegraded":"2024-08-09T00:39:48.639827+0000","last_fullsized":"2024-08-09T00:39:48.639827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.676167+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:38:27.676167+0000","last_peered":"2024-08-09T00:38:27.676167+0000","last_clean":"2024-08-09T00:38:27.676167+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:38:27.676167+0000","last_undegraded":"2024-08-09T00:38:27.676167+0000","last_fullsized":"2024-08-09T00:38:27.676167+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'213","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.230094+0000","last_change":"2024-08-09T00:40:50.230251+0000","last_active":"2024-08-09T00:40:50.230094+0000","last_peered":"2024-08-09T00:40:50.230094+0000","last_clean":"2024-08-09T00:40:50.230094+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:40:50.230094+0000","last_undegraded":"2024-08-09T00:40:50.230094+0000","last_fullsized":"2024-08-09T00:40:50.230094+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.229893+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.519276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":59906,"num_write":1092,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.855367+0000","last_change":"2024-08-08T23:28:28.778478+0000","last_active":"2024-08-09T00:38:32.855367+0000","last_peered":"2024-08-09T00:38:32.855367+0000","last_clean":"2024-08-09T00:38:32.855367+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:38:32.855367+0000","last_undegraded":"2024-08-09T00:38:32.855367+0000","last_fullsized":"2024-08-09T00:38:32.855367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'169","reported_seq":785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.654637+0000","last_change":"2024-08-08T23:28:31.043004+0000","last_active":"2024-08-09T00:40:30.654637+0000","last_peered":"2024-08-09T00:40:30.654637+0000","last_clean":"2024-08-09T00:40:30.654637+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:40:30.654637+0000","last_undegraded":"2024-08-09T00:40:30.654637+0000","last_fullsized":"2024-08-09T00:40:30.654637+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":299,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279436+0000","last_change":"2024-08-08T23:28:32.802329+0000","last_active":"2024-08-09T00:40:34.279436+0000","last_peered":"2024-08-09T00:40:34.279436+0000","last_clean":"2024-08-09T00:40:34.279436+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:40:34.279436+0000","last_undegraded":"2024-08-09T00:40:34.279436+0000","last_fullsized":"2024-08-09T00:40:34.279436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'171","reported_seq":703,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.231557+0000","last_change":"2024-08-09T00:40:39.231644+0000","last_active":"2024-08-09T00:40:39.231557+0000","last_peered":"2024-08-09T00:40:39.231557+0000","last_clean":"2024-08-09T00:40:39.231557+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:40:39.231557+0000","last_undegraded":"2024-08-09T00:40:39.231557+0000","last_fullsized":"2024-08-09T00:40:39.231557+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.231346+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:32:12.225013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.851125+0000","last_change":"2024-08-08T23:28:26.769723+0000","last_active":"2024-08-09T00:38:27.851125+0000","last_peered":"2024-08-09T00:38:27.851125+0000","last_clean":"2024-08-09T00:38:27.851125+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:38:27.851125+0000","last_undegraded":"2024-08-09T00:38:27.851125+0000","last_fullsized":"2024-08-09T00:38:27.851125+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'174","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.571668+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:40:30.571668+0000","last_peered":"2024-08-09T00:40:30.571668+0000","last_clean":"2024-08-09T00:40:30.571668+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:40:30.571668+0000","last_undegraded":"2024-08-09T00:40:30.571668+0000","last_fullsized":"2024-08-09T00:40:30.571668+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":4608,"num_write":1010,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.781058+0000","last_change":"2024-08-09T00:40:47.781111+0000","last_active":"2024-08-09T00:40:47.781058+0000","last_peered":"2024-08-09T00:40:47.781058+0000","last_clean":"2024-08-09T00:40:47.781058+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:40:47.781058+0000","last_undegraded":"2024-08-09T00:40:47.781058+0000","last_fullsized":"2024-08-09T00:40:47.781058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.780862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:19.491613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'125","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.081649+0000","last_change":"2024-08-09T00:40:48.081744+0000","last_active":"2024-08-09T00:40:48.081649+0000","last_peered":"2024-08-09T00:40:48.081649+0000","last_clean":"2024-08-09T00:40:48.081649+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:40:48.081649+0000","last_undegraded":"2024-08-09T00:40:48.081649+0000","last_fullsized":"2024-08-09T00:40:48.081649+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.081431+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.399083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1648,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'500","reported_seq":2384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.928622+0000","last_change":"2024-08-09T00:40:43.928684+0000","last_active":"2024-08-09T00:40:43.928622+0000","last_peered":"2024-08-09T00:40:43.928622+0000","last_clean":"2024-08-09T00:40:43.928622+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:40:43.928622+0000","last_undegraded":"2024-08-09T00:40:43.928622+0000","last_fullsized":"2024-08-09T00:40:43.928622+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.928424+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:09:10.523694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":628,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.144898+0000","last_change":"2024-08-08T23:28:34.827314+0000","last_active":"2024-08-09T00:39:54.144898+0000","last_peered":"2024-08-09T00:39:54.144898+0000","last_clean":"2024-08-09T00:39:54.144898+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:39:54.144898+0000","last_undegraded":"2024-08-09T00:39:54.144898+0000","last_fullsized":"2024-08-09T00:39:54.144898+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:27.853642+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:38:27.853642+0000","last_peered":"2024-08-09T00:38:27.853642+0000","last_clean":"2024-08-09T00:38:27.853642+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:38:27.853642+0000","last_undegraded":"2024-08-09T00:38:27.853642+0000","last_fullsized":"2024-08-09T00:38:27.853642+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'193","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.571643+0000","last_change":"2024-08-08T23:28:24.820992+0000","last_active":"2024-08-09T00:40:30.571643+0000","last_peered":"2024-08-09T00:40:30.571643+0000","last_clean":"2024-08-09T00:40:30.571643+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:40:30.571643+0000","last_undegraded":"2024-08-09T00:40:30.571643+0000","last_fullsized":"2024-08-09T00:40:30.571643+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755945,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":50563,"num_write":1098,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.879255+0000","last_change":"2024-08-08T23:28:28.790145+0000","last_active":"2024-08-09T00:38:32.879255+0000","last_peered":"2024-08-09T00:38:32.879255+0000","last_clean":"2024-08-09T00:38:32.879255+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:38:32.879255+0000","last_undegraded":"2024-08-09T00:38:32.879255+0000","last_fullsized":"2024-08-09T00:38:32.879255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'253","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.298426+0000","last_change":"2024-08-09T00:40:51.298522+0000","last_active":"2024-08-09T00:40:51.298426+0000","last_peered":"2024-08-09T00:40:51.298426+0000","last_clean":"2024-08-09T00:40:51.298426+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:40:51.298426+0000","last_undegraded":"2024-08-09T00:40:51.298426+0000","last_fullsized":"2024-08-09T00:40:51.298426+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.298232+0000","objects_scrubbed":11,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:39.882351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10001,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":440,"num_write":200,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.848925+0000","last_change":"2024-08-08T23:28:32.820762+0000","last_active":"2024-08-09T00:38:37.848925+0000","last_peered":"2024-08-09T00:38:37.848925+0000","last_clean":"2024-08-09T00:38:37.848925+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:38:37.848925+0000","last_undegraded":"2024-08-09T00:38:37.848925+0000","last_fullsized":"2024-08-09T00:38:37.848925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'122","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.594658+0000","last_change":"2024-08-09T00:40:51.594729+0000","last_active":"2024-08-09T00:40:51.594658+0000","last_peered":"2024-08-09T00:40:51.594658+0000","last_clean":"2024-08-09T00:40:51.594658+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:40:51.594658+0000","last_undegraded":"2024-08-09T00:40:51.594658+0000","last_fullsized":"2024-08-09T00:40:51.594658+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.594473+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:11.845593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:54.160406+0000","last_change":"2024-08-08T23:28:26.750931+0000","last_active":"2024-08-09T00:39:54.160406+0000","last_peered":"2024-08-09T00:39:54.160406+0000","last_clean":"2024-08-09T00:39:54.160406+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:39:54.160406+0000","last_undegraded":"2024-08-09T00:39:54.160406+0000","last_fullsized":"2024-08-09T00:39:54.160406+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'198","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.488511+0000","last_change":"2024-08-08T23:28:24.818191+0000","last_active":"2024-08-09T00:40:30.488511+0000","last_peered":"2024-08-09T00:40:30.488511+0000","last_clean":"2024-08-09T00:40:30.488511+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:40:30.488511+0000","last_undegraded":"2024-08-09T00:40:30.488511+0000","last_fullsized":"2024-08-09T00:40:30.488511+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":62745,"num_write":1020,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:33.079409+0000","last_change":"2024-08-08T23:28:28.776983+0000","last_active":"2024-08-09T00:38:33.079409+0000","last_peered":"2024-08-09T00:38:33.079409+0000","last_clean":"2024-08-09T00:38:33.079409+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:38:33.079409+0000","last_undegraded":"2024-08-09T00:38:33.079409+0000","last_fullsized":"2024-08-09T00:38:33.079409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'146","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.371216+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:40:30.371216+0000","last_peered":"2024-08-09T00:40:30.371216+0000","last_clean":"2024-08-09T00:40:30.371216+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:40:30.371216+0000","last_undegraded":"2024-08-09T00:40:30.371216+0000","last_fullsized":"2024-08-09T00:40:30.371216+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":272,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.898046+0000","last_change":"2024-08-09T00:40:42.898098+0000","last_active":"2024-08-09T00:40:42.898046+0000","last_peered":"2024-08-09T00:40:42.898046+0000","last_clean":"2024-08-09T00:40:42.898046+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:40:42.898046+0000","last_undegraded":"2024-08-09T00:40:42.898046+0000","last_fullsized":"2024-08-09T00:40:42.898046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.897858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:14.996595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'139","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.307985+0000","last_change":"2024-08-09T00:40:50.308062+0000","last_active":"2024-08-09T00:40:50.307985+0000","last_peered":"2024-08-09T00:40:50.307985+0000","last_clean":"2024-08-09T00:40:50.307985+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:40:50.307985+0000","last_undegraded":"2024-08-09T00:40:50.307985+0000","last_fullsized":"2024-08-09T00:40:50.307985+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.307777+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:13:23.329056+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:47.680954+0000","last_change":"2024-08-08T23:28:26.762374+0000","last_active":"2024-08-09T00:38:47.680954+0000","last_peered":"2024-08-09T00:38:47.680954+0000","last_clean":"2024-08-09T00:38:47.680954+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:38:47.680954+0000","last_undegraded":"2024-08-09T00:38:47.680954+0000","last_fullsized":"2024-08-09T00:38:47.680954+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'266","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209738+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:40:35.209738+0000","last_peered":"2024-08-09T00:40:35.209738+0000","last_clean":"2024-08-09T00:40:35.209738+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:40:35.209738+0000","last_undegraded":"2024-08-09T00:40:35.209738+0000","last_fullsized":"2024-08-09T00:40:35.209738+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":32625,"num_write":1559,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:37.856471+0000","last_change":"2024-08-08T23:28:28.778212+0000","last_active":"2024-08-09T00:38:37.856471+0000","last_peered":"2024-08-09T00:38:37.856471+0000","last_clean":"2024-08-09T00:38:37.856471+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:38:37.856471+0000","last_undegraded":"2024-08-09T00:38:37.856471+0000","last_fullsized":"2024-08-09T00:38:37.856471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'124","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.631616+0000","last_change":"2024-08-08T23:28:30.796071+0000","last_active":"2024-08-09T00:40:30.631616+0000","last_peered":"2024-08-09T00:40:30.631616+0000","last_clean":"2024-08-09T00:40:30.631616+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:40:30.631616+0000","last_undegraded":"2024-08-09T00:40:30.631616+0000","last_fullsized":"2024-08-09T00:40:30.631616+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":219,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.105416+0000","last_change":"2024-08-09T00:40:47.105495+0000","last_active":"2024-08-09T00:40:47.105416+0000","last_peered":"2024-08-09T00:40:47.105416+0000","last_clean":"2024-08-09T00:40:47.105416+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:40:47.105416+0000","last_undegraded":"2024-08-09T00:40:47.105416+0000","last_fullsized":"2024-08-09T00:40:47.105416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.105221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:39.031153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'144","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:48.576700+0000","last_change":"2024-08-08T23:28:34.835991+0000","last_active":"2024-08-09T00:39:48.576700+0000","last_peered":"2024-08-09T00:39:48.576700+0000","last_clean":"2024-08-09T00:39:48.576700+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:39:48.576700+0000","last_undegraded":"2024-08-09T00:39:48.576700+0000","last_fullsized":"2024-08-09T00:39:48.576700+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:33.779395+0000","last_clean_scrub_stamp":"2024-08-08T23:28:33.779395+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.855075+0000","last_change":"2024-08-08T23:28:26.781125+0000","last_active":"2024-08-09T00:38:32.855075+0000","last_peered":"2024-08-09T00:38:32.855075+0000","last_clean":"2024-08-09T00:38:32.855075+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:38:32.855075+0000","last_undegraded":"2024-08-09T00:38:32.855075+0000","last_fullsized":"2024-08-09T00:38:32.855075+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'159","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.478153+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:40:30.478153+0000","last_peered":"2024-08-09T00:40:30.478153+0000","last_clean":"2024-08-09T00:40:30.478153+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:40:30.478153+0000","last_undegraded":"2024-08-09T00:40:30.478153+0000","last_fullsized":"2024-08-09T00:40:30.478153+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4272291,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":403,"num_read_kb":16350,"num_write":847,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.815630+0000","last_change":"2024-08-09T00:40:48.815755+0000","last_active":"2024-08-09T00:40:48.815630+0000","last_peered":"2024-08-09T00:40:48.815630+0000","last_clean":"2024-08-09T00:40:48.815630+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:40:48.815630+0000","last_undegraded":"2024-08-09T00:40:48.815630+0000","last_fullsized":"2024-08-09T00:40:48.815630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.815323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:20.269004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'200","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.035559+0000","last_change":"2024-08-09T00:40:51.035765+0000","last_active":"2024-08-09T00:40:51.035559+0000","last_peered":"2024-08-09T00:40:51.035559+0000","last_clean":"2024-08-09T00:40:51.035559+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:40:51.035559+0000","last_undegraded":"2024-08-09T00:40:51.035559+0000","last_fullsized":"2024-08-09T00:40:51.035559+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.035329+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:12:44.986718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":353,"num_write":152,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:32.847753+0000","last_change":"2024-08-08T23:28:32.820890+0000","last_active":"2024-08-09T00:38:32.847753+0000","last_peered":"2024-08-09T00:38:32.847753+0000","last_clean":"2024-08-09T00:38:32.847753+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:38:32.847753+0000","last_undegraded":"2024-08-09T00:38:32.847753+0000","last_fullsized":"2024-08-09T00:38:32.847753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:31.773193+0000","last_clean_scrub_stamp":"2024-08-08T23:28:31.773193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'143","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.959995+0000","last_change":"2024-08-09T00:40:38.960067+0000","last_active":"2024-08-09T00:40:38.959995+0000","last_peered":"2024-08-09T00:40:38.959995+0000","last_clean":"2024-08-09T00:40:38.959995+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:40:38.959995+0000","last_undegraded":"2024-08-09T00:40:38.959995+0000","last_fullsized":"2024-08-09T00:40:38.959995+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.959801+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:09.065450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'225","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.878087+0000","last_change":"2024-08-08T23:28:26.769233+0000","last_active":"2024-08-09T00:39:57.878087+0000","last_peered":"2024-08-09T00:39:57.878087+0000","last_clean":"2024-08-09T00:39:57.878087+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:39:57.878087+0000","last_undegraded":"2024-08-09T00:39:57.878087+0000","last_fullsized":"2024-08-09T00:39:57.878087+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'212","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.647501+0000","last_change":"2024-08-08T23:28:24.802451+0000","last_active":"2024-08-09T00:40:30.647501+0000","last_peered":"2024-08-09T00:40:30.647501+0000","last_clean":"2024-08-09T00:40:30.647501+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:40:30.647501+0000","last_undegraded":"2024-08-09T00:40:30.647501+0000","last_fullsized":"2024-08-09T00:40:30.647501+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170402,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":16985,"num_write":1184,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'148","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.251126+0000","last_change":"2024-08-09T00:40:36.251196+0000","last_active":"2024-08-09T00:40:36.251126+0000","last_peered":"2024-08-09T00:40:36.251126+0000","last_clean":"2024-08-09T00:40:36.251126+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:40:36.251126+0000","last_undegraded":"2024-08-09T00:40:36.251126+0000","last_fullsized":"2024-08-09T00:40:36.251126+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.250936+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:42.591313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'209","reported_seq":856,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.440027+0000","last_change":"2024-08-08T23:28:24.787727+0000","last_active":"2024-08-09T00:40:30.440027+0000","last_peered":"2024-08-09T00:40:30.440027+0000","last_clean":"2024-08-09T00:40:30.440027+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:40:30.440027+0000","last_undegraded":"2024-08-09T00:40:30.440027+0000","last_fullsized":"2024-08-09T00:40:30.440027+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906586,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":27391,"num_write":1081,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.098602+0000","last_change":"2024-08-08T23:28:26.789544+0000","last_active":"2024-08-09T00:39:58.098602+0000","last_peered":"2024-08-09T00:39:58.098602+0000","last_clean":"2024-08-09T00:39:58.098602+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:39:58.098602+0000","last_undegraded":"2024-08-09T00:39:58.098602+0000","last_fullsized":"2024-08-09T00:39:58.098602+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'208","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.628261+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:40:30.628261+0000","last_peered":"2024-08-09T00:40:30.628261+0000","last_clean":"2024-08-09T00:40:30.628261+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:40:30.628261+0000","last_undegraded":"2024-08-09T00:40:30.628261+0000","last_fullsized":"2024-08-09T00:40:30.628261+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":17234,"num_write":1189,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'69","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.877951+0000","last_change":"2024-08-08T23:28:26.775062+0000","last_active":"2024-08-09T00:39:57.877951+0000","last_peered":"2024-08-09T00:39:57.877951+0000","last_clean":"2024-08-09T00:39:57.877951+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:39:57.877951+0000","last_undegraded":"2024-08-09T00:39:57.877951+0000","last_fullsized":"2024-08-09T00:39:57.877951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'258","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.234546+0000","last_change":"2024-08-09T00:40:44.234632+0000","last_active":"2024-08-09T00:40:44.234546+0000","last_peered":"2024-08-09T00:40:44.234546+0000","last_clean":"2024-08-09T00:40:44.234546+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:40:44.234546+0000","last_undegraded":"2024-08-09T00:40:44.234546+0000","last_fullsized":"2024-08-09T00:40:44.234546+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.234346+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:03.157959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":548,"num_read_kb":58241,"num_write":1241,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'129","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.691676+0000","last_change":"2024-08-08T23:28:26.776123+0000","last_active":"2024-08-09T00:39:32.691676+0000","last_peered":"2024-08-09T00:39:32.691676+0000","last_clean":"2024-08-09T00:39:32.691676+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:39:32.691676+0000","last_undegraded":"2024-08-09T00:39:32.691676+0000","last_fullsized":"2024-08-09T00:39:32.691676+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'208","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.627881+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:40:30.627881+0000","last_peered":"2024-08-09T00:40:30.627881+0000","last_clean":"2024-08-09T00:40:30.627881+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:40:30.627881+0000","last_undegraded":"2024-08-09T00:40:30.627881+0000","last_fullsized":"2024-08-09T00:40:30.627881+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":406,"num_read_kb":7859,"num_write":1109,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.066312+0000","last_change":"2024-08-09T00:40:52.066374+0000","last_active":"2024-08-09T00:40:52.066312+0000","last_peered":"2024-08-09T00:40:52.066312+0000","last_clean":"2024-08-09T00:40:52.066312+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:40:52.066312+0000","last_undegraded":"2024-08-09T00:40:52.066312+0000","last_fullsized":"2024-08-09T00:40:52.066312+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.066127+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:09:51.014077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'239","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.619189+0000","last_change":"2024-08-08T23:28:24.759289+0000","last_active":"2024-08-09T00:40:30.619189+0000","last_peered":"2024-08-09T00:40:30.619189+0000","last_clean":"2024-08-09T00:40:30.619189+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:40:30.619189+0000","last_undegraded":"2024-08-09T00:40:30.619189+0000","last_fullsized":"2024-08-09T00:40:30.619189+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4141181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":20658,"num_write":1118,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.688044+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:39:17.688044+0000","last_peered":"2024-08-09T00:39:17.688044+0000","last_clean":"2024-08-09T00:39:17.688044+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:39:17.688044+0000","last_undegraded":"2024-08-09T00:39:17.688044+0000","last_fullsized":"2024-08-09T00:39:17.688044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'200","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.487054+0000","last_change":"2024-08-08T23:28:24.795170+0000","last_active":"2024-08-09T00:40:30.487054+0000","last_peered":"2024-08-09T00:40:30.487054+0000","last_clean":"2024-08-09T00:40:30.487054+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:40:30.487054+0000","last_undegraded":"2024-08-09T00:40:30.487054+0000","last_fullsized":"2024-08-09T00:40:30.487054+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":364,"num_read_kb":32922,"num_write":1098,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'232","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.864972+0000","last_change":"2024-08-08T23:28:26.770453+0000","last_active":"2024-08-09T00:39:17.864972+0000","last_peered":"2024-08-09T00:39:17.864972+0000","last_clean":"2024-08-09T00:39:17.864972+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:39:17.864972+0000","last_undegraded":"2024-08-09T00:39:17.864972+0000","last_fullsized":"2024-08-09T00:39:17.864972+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'255","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.689648+0000","last_change":"2024-08-09T00:40:42.689791+0000","last_active":"2024-08-09T00:40:42.689648+0000","last_peered":"2024-08-09T00:40:42.689648+0000","last_clean":"2024-08-09T00:40:42.689648+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:40:42.689648+0000","last_undegraded":"2024-08-09T00:40:42.689648+0000","last_fullsized":"2024-08-09T00:40:42.689648+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'255","last_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_deep_scrub":"268'255","last_deep_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.689455+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:26:59.280632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":18739,"num_write":1245,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821368+0000","last_change":"2024-08-08T23:28:26.775305+0000","last_active":"2024-08-09T00:40:33.821368+0000","last_peered":"2024-08-09T00:40:33.821368+0000","last_clean":"2024-08-09T00:40:33.821368+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:40:33.821368+0000","last_undegraded":"2024-08-09T00:40:33.821368+0000","last_fullsized":"2024-08-09T00:40:33.821368+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'189","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.579471+0000","last_change":"2024-08-08T23:28:24.788596+0000","last_active":"2024-08-09T00:40:30.579471+0000","last_peered":"2024-08-09T00:40:30.579471+0000","last_clean":"2024-08-09T00:40:30.579471+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:40:30.579471+0000","last_undegraded":"2024-08-09T00:40:30.579471+0000","last_fullsized":"2024-08-09T00:40:30.579471+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917966,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":400,"num_read_kb":34111,"num_write":1045,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'81","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.683505+0000","last_change":"2024-08-08T23:28:26.763616+0000","last_active":"2024-08-09T00:40:35.683505+0000","last_peered":"2024-08-09T00:40:35.683505+0000","last_clean":"2024-08-09T00:40:35.683505+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:40:35.683505+0000","last_undegraded":"2024-08-09T00:40:35.683505+0000","last_fullsized":"2024-08-09T00:40:35.683505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'206","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.637685+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:40:30.637685+0000","last_peered":"2024-08-09T00:40:30.637685+0000","last_clean":"2024-08-09T00:40:30.637685+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:40:30.637685+0000","last_undegraded":"2024-08-09T00:40:30.637685+0000","last_fullsized":"2024-08-09T00:40:30.637685+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":96889,"num_write":1101,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.742194+0000","last_change":"2024-08-08T23:28:26.767042+0000","last_active":"2024-08-09T00:40:34.742194+0000","last_peered":"2024-08-09T00:40:34.742194+0000","last_clean":"2024-08-09T00:40:34.742194+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:40:34.742194+0000","last_undegraded":"2024-08-09T00:40:34.742194+0000","last_fullsized":"2024-08-09T00:40:34.742194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'184","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587897+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:40:30.587897+0000","last_peered":"2024-08-09T00:40:30.587897+0000","last_clean":"2024-08-09T00:40:30.587897+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:40:30.587897+0000","last_undegraded":"2024-08-09T00:40:30.587897+0000","last_fullsized":"2024-08-09T00:40:30.587897+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":443,"num_read_kb":71209,"num_write":978,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":716,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.882307+0000","last_change":"2024-08-08T23:28:26.778789+0000","last_active":"2024-08-09T00:40:27.882307+0000","last_peered":"2024-08-09T00:40:27.882307+0000","last_clean":"2024-08-09T00:40:27.882307+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:40:27.882307+0000","last_undegraded":"2024-08-09T00:40:27.882307+0000","last_fullsized":"2024-08-09T00:40:27.882307+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'175","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.530493+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:40:30.530493+0000","last_peered":"2024-08-09T00:40:30.530493+0000","last_clean":"2024-08-09T00:40:30.530493+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:40:30.530493+0000","last_undegraded":"2024-08-09T00:40:30.530493+0000","last_fullsized":"2024-08-09T00:40:30.530493+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":31431,"num_write":995,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.692168+0000","last_change":"2024-08-08T23:28:26.782721+0000","last_active":"2024-08-09T00:40:27.692168+0000","last_peered":"2024-08-09T00:40:27.692168+0000","last_clean":"2024-08-09T00:40:27.692168+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:40:27.692168+0000","last_undegraded":"2024-08-09T00:40:27.692168+0000","last_fullsized":"2024-08-09T00:40:27.692168+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'231","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.484889+0000","last_change":"2024-08-08T23:28:24.763154+0000","last_active":"2024-08-09T00:40:30.484889+0000","last_peered":"2024-08-09T00:40:30.484889+0000","last_clean":"2024-08-09T00:40:30.484889+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:40:30.484889+0000","last_undegraded":"2024-08-09T00:40:30.484889+0000","last_fullsized":"2024-08-09T00:40:30.484889+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":70204,"num_write":1298,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.877877+0000","last_change":"2024-08-08T23:28:26.773873+0000","last_active":"2024-08-09T00:40:27.877877+0000","last_peered":"2024-08-09T00:40:27.877877+0000","last_clean":"2024-08-09T00:40:27.877877+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:40:27.877877+0000","last_undegraded":"2024-08-09T00:40:27.877877+0000","last_fullsized":"2024-08-09T00:40:27.877877+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'214","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067238+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:40:37.067238+0000","last_peered":"2024-08-09T00:40:37.067238+0000","last_clean":"2024-08-09T00:40:37.067238+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:40:37.067238+0000","last_undegraded":"2024-08-09T00:40:37.067238+0000","last_fullsized":"2024-08-09T00:40:37.067238+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":54938,"num_write":1149,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.704140+0000","last_change":"2024-08-08T23:28:26.754194+0000","last_active":"2024-08-09T00:40:27.704140+0000","last_peered":"2024-08-09T00:40:27.704140+0000","last_clean":"2024-08-09T00:40:27.704140+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:40:27.704140+0000","last_undegraded":"2024-08-09T00:40:27.704140+0000","last_fullsized":"2024-08-09T00:40:27.704140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'161","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.741808+0000","last_change":"2024-08-08T23:28:24.763602+0000","last_active":"2024-08-09T00:40:34.741808+0000","last_peered":"2024-08-09T00:40:34.741808+0000","last_clean":"2024-08-09T00:40:34.741808+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:40:34.741808+0000","last_undegraded":"2024-08-09T00:40:34.741808+0000","last_fullsized":"2024-08-09T00:40:34.741808+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029153,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":19124,"num_write":939,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:12.688597+0000","last_change":"2024-08-08T23:28:26.782907+0000","last_active":"2024-08-09T00:40:12.688597+0000","last_peered":"2024-08-09T00:40:12.688597+0000","last_clean":"2024-08-09T00:40:12.688597+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:40:12.688597+0000","last_undegraded":"2024-08-09T00:40:12.688597+0000","last_fullsized":"2024-08-09T00:40:12.688597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'233","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.136489+0000","last_change":"2024-08-08T23:28:24.815220+0000","last_active":"2024-08-09T00:40:36.136489+0000","last_peered":"2024-08-09T00:40:36.136489+0000","last_clean":"2024-08-09T00:40:36.136489+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:40:36.136489+0000","last_undegraded":"2024-08-09T00:40:36.136489+0000","last_fullsized":"2024-08-09T00:40:36.136489+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":89533,"num_write":1169,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'222","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.136531+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:40:36.136531+0000","last_peered":"2024-08-09T00:40:36.136531+0000","last_clean":"2024-08-09T00:40:36.136531+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:40:36.136531+0000","last_undegraded":"2024-08-09T00:40:36.136531+0000","last_fullsized":"2024-08-09T00:40:36.136531+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055020,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":157320,"num_write":1033,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:47.851790+0000","last_change":"2024-08-08T23:28:26.766116+0000","last_active":"2024-08-09T00:38:47.851790+0000","last_peered":"2024-08-09T00:38:47.851790+0000","last_clean":"2024-08-09T00:38:47.851790+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:38:47.851790+0000","last_undegraded":"2024-08-09T00:38:47.851790+0000","last_fullsized":"2024-08-09T00:38:47.851790+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'185","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.278909+0000","last_change":"2024-08-08T23:28:24.777397+0000","last_active":"2024-08-09T00:40:34.278909+0000","last_peered":"2024-08-09T00:40:34.278909+0000","last_clean":"2024-08-09T00:40:34.278909+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:40:34.278909+0000","last_undegraded":"2024-08-09T00:40:34.278909+0000","last_fullsized":"2024-08-09T00:40:34.278909+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":17056,"num_write":1042,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:38:33.079580+0000","last_change":"2024-08-08T23:28:26.790814+0000","last_active":"2024-08-09T00:38:33.079580+0000","last_peered":"2024-08-09T00:38:33.079580+0000","last_clean":"2024-08-09T00:38:33.079580+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:38:33.079580+0000","last_undegraded":"2024-08-09T00:38:33.079580+0000","last_fullsized":"2024-08-09T00:38:33.079580+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6218,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2997,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":494,"ondisk_log_size":494,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314750,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9845,"num_read_kb":12223,"num_write":6853,"num_write_kb":2887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":557286,"num_omap_keys":1372,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1613,"num_read_kb":1921,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4477,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3448,"ondisk_log_size":3448,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":88031934,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":32363,"num_read_kb":2279985,"num_write":69541,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134025216,"data_stored":134025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4276,"ondisk_log_size":4276,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":194734,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":183422,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575727,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246792,"kb_used_data":21248,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125048,"statfs":{"total":96636764160,"available":96384049152,"internally_reserved":0,"allocated":21757952,"data_stored":19593835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575725,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284076,"kb_used_data":22436,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94087764,"statfs":{"total":96636764160,"available":96345870336,"internally_reserved":0,"allocated":22974464,"data_stored":20860820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575726,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107176,"kb_used_data":17760,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264664,"statfs":{"total":96636764160,"available":96527015936,"internally_reserved":0,"allocated":18186240,"data_stored":16015430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575725,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110208,"kb_used_data":20728,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94261632,"statfs":{"total":96636764160,"available":96523911168,"internally_reserved":0,"allocated":21225472,"data_stored":19169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575724,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235232,"kb_used_data":23576,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94136608,"statfs":{"total":96636764160,"available":96395886592,"internally_reserved":0,"allocated":24141824,"data_stored":22000945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575725,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105888,"kb_used_data":20632,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265952,"statfs":{"total":96636764160,"available":96528334848,"internally_reserved":0,"allocated":21127168,"data_stored":19032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575728,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":19616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":20086784,"data_stored":17965451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575725,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236592,"kb_used_data":20776,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94135248,"statfs":{"total":96636764160,"available":96394493952,"internally_reserved":0,"allocated":21274624,"data_stored":19114679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16203776,"data_stored":16203776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16715776,"data_stored":16715776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19681280,"data_stored":19681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18542592,"data_stored":18542592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":16683008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:40:57.967 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.967 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.967 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.968 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.968 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.968 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.968 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.968 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.969 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.969 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.969 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.969 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.970 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.970 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.970 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.970 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.970 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.971 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.971 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.971 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.971 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.971 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.972 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.972 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.972 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.972 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.972 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.973 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.973 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.973 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.973 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.973 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.974 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.975 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.975 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.975 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.975 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.975 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.976 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.976 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.976 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.976 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-08-08T23:44:46.361952+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=44, tm_sec=46, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.977 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.978 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.978 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.978 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.978 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.978 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.979 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.979 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.979 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.979 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.979 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.980 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.981 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.981 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.981 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.981 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.981 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.982 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.983 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.984 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.984 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.984 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.984 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.984 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.985 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.986 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.986 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.986 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.986 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.987 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.988 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.988 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.988 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.988 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.988 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.989 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.990 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.990 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.990 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.990 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.990 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.991 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.991 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.991 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.991 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.991 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.992 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.992 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.992 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.992 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.992 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-08T23:28:08.717706+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=8, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.993 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.994 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.994 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.994 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.994 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.994 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.995 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.996 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.997 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.997 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.997 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.997 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.997 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.998 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.998 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.998 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.998 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.998 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:57.999 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.000 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.000 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.000 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.000 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.000 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.001 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.001 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.001 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.001 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.001 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.002 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.002 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.002 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.002 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.002 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.003 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.004 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.004 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.004 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.004 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.004 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.005 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.006 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.006 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.006 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.006 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.006 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.007 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.008 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.008 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.008 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.008 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-08-08T23:28:33.779395+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=33, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.008 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-08-08T23:28:31.773193+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.009 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.010 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.011 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.011 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.011 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.011 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.011 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.012 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.013 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.014 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.014 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.014 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.014 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:40:58.014 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-09T00:41:18.016 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:41:18.403 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:41:18.416 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:41:18.434 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2455,"stamp":"2024-08-09T00:41:17.336771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88958767,"num_objects":608,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":150062,"num_read_kb":2759937,"num_write":130193,"num_write_kb":2369717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":648091,"num_omap_keys":1634,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13260,"ondisk_log_size":13260,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1471092,"kb_used_data":166772,"kb_used_omap":12,"kb_used_meta":1304243,"kb_avail":753503628,"statfs":{"total":773094113280,"available":771587715072,"internally_reserved":0,"allocated":170774528,"data_stored":153754026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1335545392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34738,"num_omap_keys":95,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007690"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:33.092751+0000","last_change":"2024-08-09T00:04:29.869838+0000","last_active":"2024-08-09T00:39:33.092751+0000","last_peered":"2024-08-09T00:39:33.092751+0000","last_clean":"2024-08-09T00:39:33.092751+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:39:33.092751+0000","last_undegraded":"2024-08-09T00:39:33.092751+0000","last_fullsized":"2024-08-09T00:39:33.092751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.137734+0000","last_change":"2024-08-08T23:48:42.120350+0000","last_active":"2024-08-09T00:40:36.137734+0000","last_peered":"2024-08-09T00:40:36.137734+0000","last_clean":"2024-08-09T00:40:36.137734+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:40:36.137734+0000","last_undegraded":"2024-08-09T00:40:36.137734+0000","last_fullsized":"2024-08-09T00:40:36.137734+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.271122+0000","last_change":"2024-08-09T00:40:39.271122+0000","last_active":"2024-08-09T00:40:39.271122+0000","last_peered":"2024-08-09T00:40:39.271122+0000","last_clean":"2024-08-09T00:40:39.271122+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:40:39.271122+0000","last_undegraded":"2024-08-09T00:40:39.271122+0000","last_fullsized":"2024-08-09T00:40:39.271122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.270864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:38.071300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.658714+0000","last_change":"2024-08-09T00:40:35.658714+0000","last_active":"2024-08-09T00:40:35.658714+0000","last_peered":"2024-08-09T00:40:35.658714+0000","last_clean":"2024-08-09T00:40:35.658714+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:40:35.658714+0000","last_undegraded":"2024-08-09T00:40:35.658714+0000","last_fullsized":"2024-08-09T00:40:35.658714+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.658455+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:16.669438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.030403+0000","last_change":"2024-08-09T00:41:08.030505+0000","last_active":"2024-08-09T00:41:08.030403+0000","last_peered":"2024-08-09T00:41:08.030403+0000","last_clean":"2024-08-09T00:41:08.030403+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:41:08.030403+0000","last_undegraded":"2024-08-09T00:41:08.030403+0000","last_fullsized":"2024-08-09T00:41:08.030403+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.030171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:07:43.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684870+0000","last_change":"2024-08-08T23:48:42.109302+0000","last_active":"2024-08-09T00:40:35.684870+0000","last_peered":"2024-08-09T00:40:35.684870+0000","last_clean":"2024-08-09T00:40:35.684870+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:40:35.684870+0000","last_undegraded":"2024-08-09T00:40:35.684870+0000","last_fullsized":"2024-08-09T00:40:35.684870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'12","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.802356+0000","last_change":"2024-08-09T00:40:34.802356+0000","last_active":"2024-08-09T00:40:34.802356+0000","last_peered":"2024-08-09T00:40:34.802356+0000","last_clean":"2024-08-09T00:40:34.802356+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:40:34.802356+0000","last_undegraded":"2024-08-09T00:40:34.802356+0000","last_fullsized":"2024-08-09T00:40:34.802356+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.802208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:12.870620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4144,"num_write":22,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":226,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.185356+0000","last_change":"2024-08-09T00:40:35.185356+0000","last_active":"2024-08-09T00:40:35.185356+0000","last_peered":"2024-08-09T00:40:35.185356+0000","last_clean":"2024-08-09T00:40:35.185356+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:40:35.185356+0000","last_undegraded":"2024-08-09T00:40:35.185356+0000","last_fullsized":"2024-08-09T00:40:35.185356+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.185085+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:13:40.941525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.590499+0000","last_change":"2024-08-09T00:04:29.865977+0000","last_active":"2024-08-09T00:40:36.590499+0000","last_peered":"2024-08-09T00:40:36.590499+0000","last_clean":"2024-08-09T00:40:36.590499+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:40:36.590499+0000","last_undegraded":"2024-08-09T00:40:36.590499+0000","last_fullsized":"2024-08-09T00:40:36.590499+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822503+0000","last_change":"2024-08-08T23:48:42.577155+0000","last_active":"2024-08-09T00:40:33.822503+0000","last_peered":"2024-08-09T00:40:33.822503+0000","last_clean":"2024-08-09T00:40:33.822503+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:40:33.822503+0000","last_undegraded":"2024-08-09T00:40:33.822503+0000","last_fullsized":"2024-08-09T00:40:33.822503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.052384+0000","last_change":"2024-08-09T00:41:05.052451+0000","last_active":"2024-08-09T00:41:05.052384+0000","last_peered":"2024-08-09T00:41:05.052384+0000","last_clean":"2024-08-09T00:41:05.052384+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:41:05.052384+0000","last_undegraded":"2024-08-09T00:41:05.052384+0000","last_fullsized":"2024-08-09T00:41:05.052384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.052191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:29:43.122709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.643998+0000","last_change":"2024-08-09T00:40:41.644063+0000","last_active":"2024-08-09T00:40:41.643998+0000","last_peered":"2024-08-09T00:40:41.643998+0000","last_clean":"2024-08-09T00:40:41.643998+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:40:41.643998+0000","last_undegraded":"2024-08-09T00:40:41.643998+0000","last_fullsized":"2024-08-09T00:40:41.643998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.643807+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:22.863068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210814+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:40:35.210814+0000","last_peered":"2024-08-09T00:40:35.210814+0000","last_clean":"2024-08-09T00:40:35.210814+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:40:35.210814+0000","last_undegraded":"2024-08-09T00:40:35.210814+0000","last_fullsized":"2024-08-09T00:40:35.210814+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210762+0000","last_change":"2024-08-08T23:48:42.578126+0000","last_active":"2024-08-09T00:40:35.210762+0000","last_peered":"2024-08-09T00:40:35.210762+0000","last_clean":"2024-08-09T00:40:35.210762+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:40:35.210762+0000","last_undegraded":"2024-08-09T00:40:35.210762+0000","last_fullsized":"2024-08-09T00:40:35.210762+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.137960+0000","last_change":"2024-08-09T00:40:46.138108+0000","last_active":"2024-08-09T00:40:46.137960+0000","last_peered":"2024-08-09T00:40:46.137960+0000","last_clean":"2024-08-09T00:40:46.137960+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:40:46.137960+0000","last_undegraded":"2024-08-09T00:40:46.137960+0000","last_fullsized":"2024-08-09T00:40:46.137960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.137726+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:04.630323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.280270+0000","last_change":"2024-08-09T00:40:41.280331+0000","last_active":"2024-08-09T00:40:41.280270+0000","last_peered":"2024-08-09T00:40:41.280270+0000","last_clean":"2024-08-09T00:40:41.280270+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:40:41.280270+0000","last_undegraded":"2024-08-09T00:40:41.280270+0000","last_fullsized":"2024-08-09T00:40:41.280270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.280078+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:02:07.630638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210912+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:40:35.210912+0000","last_peered":"2024-08-09T00:40:35.210912+0000","last_clean":"2024-08-09T00:40:35.210912+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:40:35.210912+0000","last_undegraded":"2024-08-09T00:40:35.210912+0000","last_fullsized":"2024-08-09T00:40:35.210912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.285006+0000","last_change":"2024-08-08T23:48:42.113625+0000","last_active":"2024-08-09T00:40:30.285006+0000","last_peered":"2024-08-09T00:40:30.285006+0000","last_clean":"2024-08-09T00:40:30.285006+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:40:30.285006+0000","last_undegraded":"2024-08-09T00:40:30.285006+0000","last_fullsized":"2024-08-09T00:40:30.285006+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17458,"num_write":16,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.633589+0000","last_change":"2024-08-09T00:40:34.633632+0000","last_active":"2024-08-09T00:40:34.633589+0000","last_peered":"2024-08-09T00:40:34.633589+0000","last_clean":"2024-08-09T00:40:34.633589+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:40:34.633589+0000","last_undegraded":"2024-08-09T00:40:34.633589+0000","last_fullsized":"2024-08-09T00:40:34.633589+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.633469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:40.040241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.238228+0000","last_change":"2024-08-09T00:40:38.238357+0000","last_active":"2024-08-09T00:40:38.238228+0000","last_peered":"2024-08-09T00:40:38.238228+0000","last_clean":"2024-08-09T00:40:38.238228+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:40:38.238228+0000","last_undegraded":"2024-08-09T00:40:38.238228+0000","last_fullsized":"2024-08-09T00:40:38.238228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.237982+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:45.723779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.878057+0000","last_change":"2024-08-09T00:04:29.872057+0000","last_active":"2024-08-09T00:39:57.878057+0000","last_peered":"2024-08-09T00:39:57.878057+0000","last_clean":"2024-08-09T00:39:57.878057+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:39:57.878057+0000","last_undegraded":"2024-08-09T00:39:57.878057+0000","last_fullsized":"2024-08-09T00:39:57.878057+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.028175+0000","last_change":"2024-08-09T00:41:08.028228+0000","last_active":"2024-08-09T00:41:08.028175+0000","last_peered":"2024-08-09T00:41:08.028175+0000","last_clean":"2024-08-09T00:41:08.028175+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:41:08.028175+0000","last_undegraded":"2024-08-09T00:41:08.028175+0000","last_fullsized":"2024-08-09T00:41:08.028175+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.027970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:24:22.702951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.913495+0000","last_change":"2024-08-09T00:40:37.913550+0000","last_active":"2024-08-09T00:40:37.913495+0000","last_peered":"2024-08-09T00:40:37.913495+0000","last_clean":"2024-08-09T00:40:37.913495+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:40:37.913495+0000","last_undegraded":"2024-08-09T00:40:37.913495+0000","last_fullsized":"2024-08-09T00:40:37.913495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.913298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:15.804242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.915549+0000","last_change":"2024-08-09T00:40:36.915685+0000","last_active":"2024-08-09T00:40:36.915549+0000","last_peered":"2024-08-09T00:40:36.915549+0000","last_clean":"2024-08-09T00:40:36.915549+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:40:36.915549+0000","last_undegraded":"2024-08-09T00:40:36.915549+0000","last_fullsized":"2024-08-09T00:40:36.915549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.915302+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:49:03.528537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893168+0000","last_change":"2024-08-09T00:04:29.877596+0000","last_active":"2024-08-09T00:39:32.893168+0000","last_peered":"2024-08-09T00:39:32.893168+0000","last_clean":"2024-08-09T00:39:32.893168+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:39:32.893168+0000","last_undegraded":"2024-08-09T00:39:32.893168+0000","last_fullsized":"2024-08-09T00:39:32.893168+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.070337+0000","last_change":"2024-08-09T00:41:10.070337+0000","last_active":"2024-08-09T00:41:10.070337+0000","last_peered":"2024-08-09T00:41:10.070337+0000","last_clean":"2024-08-09T00:41:10.070337+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:41:10.070337+0000","last_undegraded":"2024-08-09T00:41:10.070337+0000","last_fullsized":"2024-08-09T00:41:10.070337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.070055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:52.633196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684770+0000","last_change":"2024-08-08T23:48:38.092055+0000","last_active":"2024-08-09T00:40:35.684770+0000","last_peered":"2024-08-09T00:40:35.684770+0000","last_clean":"2024-08-09T00:40:35.684770+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:40:35.684770+0000","last_undegraded":"2024-08-09T00:40:35.684770+0000","last_fullsized":"2024-08-09T00:40:35.684770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.707450+0000","last_change":"2024-08-09T00:40:39.707514+0000","last_active":"2024-08-09T00:40:39.707450+0000","last_peered":"2024-08-09T00:40:39.707450+0000","last_clean":"2024-08-09T00:40:39.707450+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:40:39.707450+0000","last_undegraded":"2024-08-09T00:40:39.707450+0000","last_fullsized":"2024-08-09T00:40:39.707450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.707247+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:07.954822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893277+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:39:32.893277+0000","last_peered":"2024-08-09T00:39:32.893277+0000","last_clean":"2024-08-09T00:39:32.893277+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:39:32.893277+0000","last_undegraded":"2024-08-09T00:39:32.893277+0000","last_fullsized":"2024-08-09T00:39:32.893277+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.308345+0000","last_change":"2024-08-09T00:40:43.308345+0000","last_active":"2024-08-09T00:40:43.308345+0000","last_peered":"2024-08-09T00:40:43.308345+0000","last_clean":"2024-08-09T00:40:43.308345+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:40:43.308345+0000","last_undegraded":"2024-08-09T00:40:43.308345+0000","last_fullsized":"2024-08-09T00:40:43.308345+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.308076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:30.144196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.660858+0000","last_change":"2024-08-09T00:40:36.660858+0000","last_active":"2024-08-09T00:40:36.660858+0000","last_peered":"2024-08-09T00:40:36.660858+0000","last_clean":"2024-08-09T00:40:36.660858+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:40:36.660858+0000","last_undegraded":"2024-08-09T00:40:36.660858+0000","last_fullsized":"2024-08-09T00:40:36.660858+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.660732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:31:02.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.833334+0000","last_change":"2024-08-09T00:40:36.833359+0000","last_active":"2024-08-09T00:40:36.833334+0000","last_peered":"2024-08-09T00:40:36.833334+0000","last_clean":"2024-08-09T00:40:36.833334+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:40:36.833334+0000","last_undegraded":"2024-08-09T00:40:36.833334+0000","last_fullsized":"2024-08-09T00:40:36.833334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.833241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:35:54.834498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.872351+0000","last_change":"2024-08-09T00:04:29.863815+0000","last_active":"2024-08-09T00:39:32.872351+0000","last_peered":"2024-08-09T00:39:32.872351+0000","last_clean":"2024-08-09T00:39:32.872351+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:39:32.872351+0000","last_undegraded":"2024-08-09T00:39:32.872351+0000","last_fullsized":"2024-08-09T00:39:32.872351+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.283034+0000","last_change":"2024-08-09T00:40:59.283093+0000","last_active":"2024-08-09T00:40:59.283034+0000","last_peered":"2024-08-09T00:40:59.283034+0000","last_clean":"2024-08-09T00:40:59.283034+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:40:59.283034+0000","last_undegraded":"2024-08-09T00:40:59.283034+0000","last_fullsized":"2024-08-09T00:40:59.283034+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.282823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:49:49.304715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.264682+0000","last_change":"2024-08-09T00:40:52.264744+0000","last_active":"2024-08-09T00:40:52.264682+0000","last_peered":"2024-08-09T00:40:52.264682+0000","last_clean":"2024-08-09T00:40:52.264682+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:40:52.264682+0000","last_undegraded":"2024-08-09T00:40:52.264682+0000","last_fullsized":"2024-08-09T00:40:52.264682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.264488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:36:28.875953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.729225+0000","last_change":"2024-08-09T00:40:38.729357+0000","last_active":"2024-08-09T00:40:38.729225+0000","last_peered":"2024-08-09T00:40:38.729225+0000","last_clean":"2024-08-09T00:40:38.729225+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:40:38.729225+0000","last_undegraded":"2024-08-09T00:40:38.729225+0000","last_fullsized":"2024-08-09T00:40:38.729225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.728971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:46:20.124323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.039472+0000","last_change":"2024-08-09T00:41:07.039540+0000","last_active":"2024-08-09T00:41:07.039472+0000","last_peered":"2024-08-09T00:41:07.039472+0000","last_clean":"2024-08-09T00:41:07.039472+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:41:07.039472+0000","last_undegraded":"2024-08-09T00:41:07.039472+0000","last_fullsized":"2024-08-09T00:41:07.039472+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.039280+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:03.469816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.370327+0000","last_change":"2024-08-09T00:41:03.370381+0000","last_active":"2024-08-09T00:41:03.370327+0000","last_peered":"2024-08-09T00:41:03.370327+0000","last_clean":"2024-08-09T00:41:03.370327+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:41:03.370327+0000","last_undegraded":"2024-08-09T00:41:03.370327+0000","last_fullsized":"2024-08-09T00:41:03.370327+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.370116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:33:18.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.602304+0000","last_change":"2024-08-09T00:40:37.602366+0000","last_active":"2024-08-09T00:40:37.602304+0000","last_peered":"2024-08-09T00:40:37.602304+0000","last_clean":"2024-08-09T00:40:37.602304+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:40:37.602304+0000","last_undegraded":"2024-08-09T00:40:37.602304+0000","last_fullsized":"2024-08-09T00:40:37.602304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.602099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:43:52.947621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.237531+0000","last_change":"2024-08-09T00:40:40.237588+0000","last_active":"2024-08-09T00:40:40.237531+0000","last_peered":"2024-08-09T00:40:40.237531+0000","last_clean":"2024-08-09T00:40:40.237531+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:40:40.237531+0000","last_undegraded":"2024-08-09T00:40:40.237531+0000","last_fullsized":"2024-08-09T00:40:40.237531+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.237342+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:46:29.023191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893029+0000","last_change":"2024-08-09T00:04:29.878393+0000","last_active":"2024-08-09T00:39:32.893029+0000","last_peered":"2024-08-09T00:39:32.893029+0000","last_clean":"2024-08-09T00:39:32.893029+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:39:32.893029+0000","last_undegraded":"2024-08-09T00:39:32.893029+0000","last_fullsized":"2024-08-09T00:39:32.893029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:27.690595+0000","last_change":"2024-08-08T23:48:42.580812+0000","last_active":"2024-08-09T00:39:27.690595+0000","last_peered":"2024-08-09T00:39:27.690595+0000","last_clean":"2024-08-09T00:39:27.690595+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:39:27.690595+0000","last_undegraded":"2024-08-09T00:39:27.690595+0000","last_fullsized":"2024-08-09T00:39:27.690595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.100393+0000","last_change":"2024-08-09T00:41:04.100452+0000","last_active":"2024-08-09T00:41:04.100393+0000","last_peered":"2024-08-09T00:41:04.100393+0000","last_clean":"2024-08-09T00:41:04.100393+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:41:04.100393+0000","last_undegraded":"2024-08-09T00:41:04.100393+0000","last_fullsized":"2024-08-09T00:41:04.100393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.100190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:42:44.280085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.232009+0000","last_change":"2024-08-09T00:40:37.232034+0000","last_active":"2024-08-09T00:40:37.232009+0000","last_peered":"2024-08-09T00:40:37.232009+0000","last_clean":"2024-08-09T00:40:37.232009+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:40:37.232009+0000","last_undegraded":"2024-08-09T00:40:37.232009+0000","last_fullsized":"2024-08-09T00:40:37.232009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.231936+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:46.987261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:33.092698+0000","last_change":"2024-08-09T00:04:29.869870+0000","last_active":"2024-08-09T00:39:33.092698+0000","last_peered":"2024-08-09T00:39:33.092698+0000","last_clean":"2024-08-09T00:39:33.092698+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:39:33.092698+0000","last_undegraded":"2024-08-09T00:39:33.092698+0000","last_fullsized":"2024-08-09T00:39:33.092698+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'4","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.648028+0000","last_change":"2024-08-08T23:48:42.105380+0000","last_active":"2024-08-09T00:40:30.648028+0000","last_peered":"2024-08-09T00:40:30.648028+0000","last_clean":"2024-08-09T00:40:30.648028+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:40:30.648028+0000","last_undegraded":"2024-08-09T00:40:30.648028+0000","last_fullsized":"2024-08-09T00:40:30.648028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.636164+0000","last_change":"2024-08-09T00:40:44.636229+0000","last_active":"2024-08-09T00:40:44.636164+0000","last_peered":"2024-08-09T00:40:44.636164+0000","last_clean":"2024-08-09T00:40:44.636164+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:40:44.636164+0000","last_undegraded":"2024-08-09T00:40:44.636164+0000","last_fullsized":"2024-08-09T00:40:44.636164+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.635966+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:22.290779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.541393+0000","last_change":"2024-08-09T00:40:45.541393+0000","last_active":"2024-08-09T00:40:45.541393+0000","last_peered":"2024-08-09T00:40:45.541393+0000","last_clean":"2024-08-09T00:40:45.541393+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:40:45.541393+0000","last_undegraded":"2024-08-09T00:40:45.541393+0000","last_fullsized":"2024-08-09T00:40:45.541393+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.540982+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:27:18.363747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210877+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:40:35.210877+0000","last_peered":"2024-08-09T00:40:35.210877+0000","last_clean":"2024-08-09T00:40:35.210877+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:40:35.210877+0000","last_undegraded":"2024-08-09T00:40:35.210877+0000","last_fullsized":"2024-08-09T00:40:35.210877+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.879051+0000","last_change":"2024-08-08T23:48:42.118305+0000","last_active":"2024-08-09T00:40:02.879051+0000","last_peered":"2024-08-09T00:40:02.879051+0000","last_clean":"2024-08-09T00:40:02.879051+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:40:02.879051+0000","last_undegraded":"2024-08-09T00:40:02.879051+0000","last_fullsized":"2024-08-09T00:40:02.879051+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.024780+0000","last_change":"2024-08-09T00:40:50.024835+0000","last_active":"2024-08-09T00:40:50.024780+0000","last_peered":"2024-08-09T00:40:50.024780+0000","last_clean":"2024-08-09T00:40:50.024780+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:40:50.024780+0000","last_undegraded":"2024-08-09T00:40:50.024780+0000","last_fullsized":"2024-08-09T00:40:50.024780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.024567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:42:36.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":195,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.540116+0000","last_change":"2024-08-09T00:40:43.540116+0000","last_active":"2024-08-09T00:40:43.540116+0000","last_peered":"2024-08-09T00:40:43.540116+0000","last_clean":"2024-08-09T00:40:43.540116+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:40:43.540116+0000","last_undegraded":"2024-08-09T00:40:43.540116+0000","last_fullsized":"2024-08-09T00:40:43.540116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'47","last_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_deep_scrub":"268'47","last_deep_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.539854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:53:56.070084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822645+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:40:33.822645+0000","last_peered":"2024-08-09T00:40:33.822645+0000","last_clean":"2024-08-09T00:40:33.822645+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:40:33.822645+0000","last_undegraded":"2024-08-09T00:40:33.822645+0000","last_fullsized":"2024-08-09T00:40:33.822645+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410627+0000","last_change":"2024-08-08T23:48:42.120343+0000","last_active":"2024-08-09T00:40:30.410627+0000","last_peered":"2024-08-09T00:40:30.410627+0000","last_clean":"2024-08-09T00:40:30.410627+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:40:30.410627+0000","last_undegraded":"2024-08-09T00:40:30.410627+0000","last_fullsized":"2024-08-09T00:40:30.410627+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.189314+0000","last_change":"2024-08-09T00:40:36.189393+0000","last_active":"2024-08-09T00:40:36.189314+0000","last_peered":"2024-08-09T00:40:36.189314+0000","last_clean":"2024-08-09T00:40:36.189314+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:40:36.189314+0000","last_undegraded":"2024-08-09T00:40:36.189314+0000","last_fullsized":"2024-08-09T00:40:36.189314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.189163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:32.228273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.680167+0000","last_change":"2024-08-09T00:40:42.680167+0000","last_active":"2024-08-09T00:40:42.680167+0000","last_peered":"2024-08-09T00:40:42.680167+0000","last_clean":"2024-08-09T00:40:42.680167+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:40:42.680167+0000","last_undegraded":"2024-08-09T00:40:42.680167+0000","last_fullsized":"2024-08-09T00:40:42.680167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.679754+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:38.367106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:42.864927+0000","last_change":"2024-08-09T00:04:29.848220+0000","last_active":"2024-08-09T00:39:42.864927+0000","last_peered":"2024-08-09T00:39:42.864927+0000","last_clean":"2024-08-09T00:39:42.864927+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:39:42.864927+0000","last_undegraded":"2024-08-09T00:39:42.864927+0000","last_fullsized":"2024-08-09T00:39:42.864927+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'4","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.410359+0000","last_change":"2024-08-08T23:49:03.199288+0000","last_active":"2024-08-09T00:40:30.410359+0000","last_peered":"2024-08-09T00:40:30.410359+0000","last_clean":"2024-08-09T00:40:30.410359+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:40:30.410359+0000","last_undegraded":"2024-08-09T00:40:30.410359+0000","last_fullsized":"2024-08-09T00:40:30.410359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'8","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.050854+0000","last_change":"2024-08-09T00:41:07.051008+0000","last_active":"2024-08-09T00:41:07.050854+0000","last_peered":"2024-08-09T00:41:07.050854+0000","last_clean":"2024-08-09T00:41:07.050854+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:41:07.050854+0000","last_undegraded":"2024-08-09T00:41:07.050854+0000","last_fullsized":"2024-08-09T00:41:07.050854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.050631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:47.276263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10240,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.953904+0000","last_change":"2024-08-09T00:40:36.953904+0000","last_active":"2024-08-09T00:40:36.953904+0000","last_peered":"2024-08-09T00:40:36.953904+0000","last_clean":"2024-08-09T00:40:36.953904+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:40:36.953904+0000","last_undegraded":"2024-08-09T00:40:36.953904+0000","last_fullsized":"2024-08-09T00:40:36.953904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.953505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:31:08.054694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210860+0000","last_change":"2024-08-09T00:04:29.864825+0000","last_active":"2024-08-09T00:40:35.210860+0000","last_peered":"2024-08-09T00:40:35.210860+0000","last_clean":"2024-08-09T00:40:35.210860+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:40:35.210860+0000","last_undegraded":"2024-08-09T00:40:35.210860+0000","last_fullsized":"2024-08-09T00:40:35.210860+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.049098+0000","last_change":"2024-08-09T00:41:11.049245+0000","last_active":"2024-08-09T00:41:11.049098+0000","last_peered":"2024-08-09T00:41:11.049098+0000","last_clean":"2024-08-09T00:41:11.049098+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:41:11.049098+0000","last_undegraded":"2024-08-09T00:41:11.049098+0000","last_fullsized":"2024-08-09T00:41:11.049098+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.048878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:07:10.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.513485+0000","last_change":"2024-08-08T23:48:38.094812+0000","last_active":"2024-08-09T00:40:30.513485+0000","last_peered":"2024-08-09T00:40:30.513485+0000","last_clean":"2024-08-09T00:40:30.513485+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:40:30.513485+0000","last_undegraded":"2024-08-09T00:40:30.513485+0000","last_fullsized":"2024-08-09T00:40:30.513485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:37.017110+0000","last_clean_scrub_stamp":"2024-08-08T23:48:37.017110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.290222+0000","last_change":"2024-08-09T00:40:42.290222+0000","last_active":"2024-08-09T00:40:42.290222+0000","last_peered":"2024-08-09T00:40:42.290222+0000","last_clean":"2024-08-09T00:40:42.290222+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:40:42.290222+0000","last_undegraded":"2024-08-09T00:40:42.290222+0000","last_fullsized":"2024-08-09T00:40:42.290222+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.289963+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:20.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.004689+0000","last_change":"2024-08-09T00:41:06.004742+0000","last_active":"2024-08-09T00:41:06.004689+0000","last_peered":"2024-08-09T00:41:06.004689+0000","last_clean":"2024-08-09T00:41:06.004689+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:41:06.004689+0000","last_undegraded":"2024-08-09T00:41:06.004689+0000","last_fullsized":"2024-08-09T00:41:06.004689+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.004500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:50:16.004969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.356428+0000","last_change":"2024-08-09T00:40:55.356491+0000","last_active":"2024-08-09T00:40:55.356428+0000","last_peered":"2024-08-09T00:40:55.356428+0000","last_clean":"2024-08-09T00:40:55.356428+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:40:55.356428+0000","last_undegraded":"2024-08-09T00:40:55.356428+0000","last_fullsized":"2024-08-09T00:40:55.356428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.356225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:19:18.875712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.617885+0000","last_change":"2024-08-09T00:40:40.617947+0000","last_active":"2024-08-09T00:40:40.617885+0000","last_peered":"2024-08-09T00:40:40.617885+0000","last_clean":"2024-08-09T00:40:40.617885+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:40:40.617885+0000","last_undegraded":"2024-08-09T00:40:40.617885+0000","last_fullsized":"2024-08-09T00:40:40.617885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.617682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:12:17.390972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.221534+0000","last_change":"2024-08-09T00:40:37.221534+0000","last_active":"2024-08-09T00:40:37.221534+0000","last_peered":"2024-08-09T00:40:37.221534+0000","last_clean":"2024-08-09T00:40:37.221534+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:40:37.221534+0000","last_undegraded":"2024-08-09T00:40:37.221534+0000","last_fullsized":"2024-08-09T00:40:37.221534+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.221435+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:15.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.693352+0000","last_change":"2024-08-09T00:04:29.880342+0000","last_active":"2024-08-09T00:40:32.693352+0000","last_peered":"2024-08-09T00:40:32.693352+0000","last_clean":"2024-08-09T00:40:32.693352+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:40:32.693352+0000","last_undegraded":"2024-08-09T00:40:32.693352+0000","last_fullsized":"2024-08-09T00:40:32.693352+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.291641+0000","last_change":"2024-08-09T00:40:47.291758+0000","last_active":"2024-08-09T00:40:47.291641+0000","last_peered":"2024-08-09T00:40:47.291641+0000","last_clean":"2024-08-09T00:40:47.291641+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:40:47.291641+0000","last_undegraded":"2024-08-09T00:40:47.291641+0000","last_fullsized":"2024-08-09T00:40:47.291641+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.291419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:22.686399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21602,"num_write":20,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.187960+0000","last_change":"2024-08-09T00:40:36.187987+0000","last_active":"2024-08-09T00:40:36.187960+0000","last_peered":"2024-08-09T00:40:36.187960+0000","last_clean":"2024-08-09T00:40:36.187960+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:40:36.187960+0000","last_undegraded":"2024-08-09T00:40:36.187960+0000","last_fullsized":"2024-08-09T00:40:36.187960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.187856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:49.116286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.267812+0000","last_change":"2024-08-09T00:40:40.267812+0000","last_active":"2024-08-09T00:40:40.267812+0000","last_peered":"2024-08-09T00:40:40.267812+0000","last_clean":"2024-08-09T00:40:40.267812+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:40:40.267812+0000","last_undegraded":"2024-08-09T00:40:40.267812+0000","last_fullsized":"2024-08-09T00:40:40.267812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.267563+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:43:32.319577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.011112+0000","last_change":"2024-08-09T00:41:12.011164+0000","last_active":"2024-08-09T00:41:12.011112+0000","last_peered":"2024-08-09T00:41:12.011112+0000","last_clean":"2024-08-09T00:41:12.011112+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:41:12.011112+0000","last_undegraded":"2024-08-09T00:41:12.011112+0000","last_fullsized":"2024-08-09T00:41:12.011112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.010911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:29.212890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'6","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279875+0000","last_change":"2024-08-08T23:48:42.577027+0000","last_active":"2024-08-09T00:40:34.279875+0000","last_peered":"2024-08-09T00:40:34.279875+0000","last_clean":"2024-08-09T00:40:34.279875+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:40:34.279875+0000","last_undegraded":"2024-08-09T00:40:34.279875+0000","last_fullsized":"2024-08-09T00:40:34.279875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.617301+0000","last_change":"2024-08-09T00:40:52.617361+0000","last_active":"2024-08-09T00:40:52.617301+0000","last_peered":"2024-08-09T00:40:52.617301+0000","last_clean":"2024-08-09T00:40:52.617301+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:40:52.617301+0000","last_undegraded":"2024-08-09T00:40:52.617301+0000","last_fullsized":"2024-08-09T00:40:52.617301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.617100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:13:44.945362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.872232+0000","last_change":"2024-08-09T00:40:40.872232+0000","last_active":"2024-08-09T00:40:40.872232+0000","last_peered":"2024-08-09T00:40:40.872232+0000","last_clean":"2024-08-09T00:40:40.872232+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:40:40.872232+0000","last_undegraded":"2024-08-09T00:40:40.872232+0000","last_fullsized":"2024-08-09T00:40:40.872232+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.871937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:00:56.402314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.888413+0000","last_change":"2024-08-09T00:04:29.880588+0000","last_active":"2024-08-09T00:39:12.888413+0000","last_peered":"2024-08-09T00:39:12.888413+0000","last_clean":"2024-08-09T00:39:12.888413+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:39:12.888413+0000","last_undegraded":"2024-08-09T00:39:12.888413+0000","last_fullsized":"2024-08-09T00:39:12.888413+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.321654+0000","last_change":"2024-08-09T00:40:51.321769+0000","last_active":"2024-08-09T00:40:51.321654+0000","last_peered":"2024-08-09T00:40:51.321654+0000","last_clean":"2024-08-09T00:40:51.321654+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:40:51.321654+0000","last_undegraded":"2024-08-09T00:40:51.321654+0000","last_fullsized":"2024-08-09T00:40:51.321654+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.321317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:07.828364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.818946+0000","last_change":"2024-08-09T00:40:37.819109+0000","last_active":"2024-08-09T00:40:37.818946+0000","last_peered":"2024-08-09T00:40:37.818946+0000","last_clean":"2024-08-09T00:40:37.818946+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:40:37.818946+0000","last_undegraded":"2024-08-09T00:40:37.818946+0000","last_fullsized":"2024-08-09T00:40:37.818946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.818705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:34.295358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.074220+0000","last_change":"2024-08-09T00:41:02.074220+0000","last_active":"2024-08-09T00:41:02.074220+0000","last_peered":"2024-08-09T00:41:02.074220+0000","last_clean":"2024-08-09T00:41:02.074220+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:41:02.074220+0000","last_undegraded":"2024-08-09T00:41:02.074220+0000","last_fullsized":"2024-08-09T00:41:02.074220+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.073969+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:30:35.961027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705514+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:40:32.705514+0000","last_peered":"2024-08-09T00:40:32.705514+0000","last_clean":"2024-08-09T00:40:32.705514+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:40:32.705514+0000","last_undegraded":"2024-08-09T00:40:32.705514+0000","last_fullsized":"2024-08-09T00:40:32.705514+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684932+0000","last_change":"2024-08-08T23:48:42.092281+0000","last_active":"2024-08-09T00:40:35.684932+0000","last_peered":"2024-08-09T00:40:35.684932+0000","last_clean":"2024-08-09T00:40:35.684932+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:40:35.684932+0000","last_undegraded":"2024-08-09T00:40:35.684932+0000","last_fullsized":"2024-08-09T00:40:35.684932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.641196+0000","last_change":"2024-08-09T00:40:48.641266+0000","last_active":"2024-08-09T00:40:48.641196+0000","last_peered":"2024-08-09T00:40:48.641196+0000","last_clean":"2024-08-09T00:40:48.641196+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:40:48.641196+0000","last_undegraded":"2024-08-09T00:40:48.641196+0000","last_fullsized":"2024-08-09T00:40:48.641196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.640998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:55:08.396765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.681164+0000","last_change":"2024-08-09T00:40:43.681164+0000","last_active":"2024-08-09T00:40:43.681164+0000","last_peered":"2024-08-09T00:40:43.681164+0000","last_clean":"2024-08-09T00:40:43.681164+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:40:43.681164+0000","last_undegraded":"2024-08-09T00:40:43.681164+0000","last_fullsized":"2024-08-09T00:40:43.681164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.680900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:05.167122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.068530+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:40:37.068530+0000","last_peered":"2024-08-09T00:40:37.068530+0000","last_clean":"2024-08-09T00:40:37.068530+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:40:37.068530+0000","last_undegraded":"2024-08-09T00:40:37.068530+0000","last_fullsized":"2024-08-09T00:40:37.068530+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.492000+0000","last_change":"2024-08-09T00:40:48.492064+0000","last_active":"2024-08-09T00:40:48.492000+0000","last_peered":"2024-08-09T00:40:48.492000+0000","last_clean":"2024-08-09T00:40:48.492000+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:40:48.492000+0000","last_undegraded":"2024-08-09T00:40:48.492000+0000","last_fullsized":"2024-08-09T00:40:48.492000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.491783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:04:46.088876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.785042+0000","last_change":"2024-08-09T00:40:35.785042+0000","last_active":"2024-08-09T00:40:35.785042+0000","last_peered":"2024-08-09T00:40:35.785042+0000","last_clean":"2024-08-09T00:40:35.785042+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:40:35.785042+0000","last_undegraded":"2024-08-09T00:40:35.785042+0000","last_fullsized":"2024-08-09T00:40:35.785042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.784595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:17:51.280650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.531722+0000","last_change":"2024-08-09T00:40:47.531782+0000","last_active":"2024-08-09T00:40:47.531722+0000","last_peered":"2024-08-09T00:40:47.531722+0000","last_clean":"2024-08-09T00:40:47.531722+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:40:47.531722+0000","last_undegraded":"2024-08-09T00:40:47.531722+0000","last_fullsized":"2024-08-09T00:40:47.531722+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.531527+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:25.997420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.590552+0000","last_change":"2024-08-09T00:41:00.590620+0000","last_active":"2024-08-09T00:41:00.590552+0000","last_peered":"2024-08-09T00:41:00.590552+0000","last_clean":"2024-08-09T00:41:00.590552+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:41:00.590552+0000","last_undegraded":"2024-08-09T00:41:00.590552+0000","last_fullsized":"2024-08-09T00:41:00.590552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.590347+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:18:27.821143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.750685+0000","last_change":"2024-08-09T00:40:45.750799+0000","last_active":"2024-08-09T00:40:45.750685+0000","last_peered":"2024-08-09T00:40:45.750685+0000","last_clean":"2024-08-09T00:40:45.750685+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:40:45.750685+0000","last_undegraded":"2024-08-09T00:40:45.750685+0000","last_fullsized":"2024-08-09T00:40:45.750685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.750417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:11.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.685218+0000","last_change":"2024-08-09T00:40:40.685218+0000","last_active":"2024-08-09T00:40:40.685218+0000","last_peered":"2024-08-09T00:40:40.685218+0000","last_clean":"2024-08-09T00:40:40.685218+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:40:40.685218+0000","last_undegraded":"2024-08-09T00:40:40.685218+0000","last_fullsized":"2024-08-09T00:40:40.685218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.684961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:53.340721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.348843+0000","last_change":"2024-08-09T00:40:44.348843+0000","last_active":"2024-08-09T00:40:44.348843+0000","last_peered":"2024-08-09T00:40:44.348843+0000","last_clean":"2024-08-09T00:40:44.348843+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:40:44.348843+0000","last_undegraded":"2024-08-09T00:40:44.348843+0000","last_fullsized":"2024-08-09T00:40:44.348843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.348587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:09:49.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.879575+0000","last_change":"2024-08-09T00:04:29.866085+0000","last_active":"2024-08-09T00:40:32.879575+0000","last_peered":"2024-08-09T00:40:32.879575+0000","last_clean":"2024-08-09T00:40:32.879575+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:40:32.879575+0000","last_undegraded":"2024-08-09T00:40:32.879575+0000","last_fullsized":"2024-08-09T00:40:32.879575+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.504759+0000","last_change":"2024-08-09T00:40:44.504759+0000","last_active":"2024-08-09T00:40:44.504759+0000","last_peered":"2024-08-09T00:40:44.504759+0000","last_clean":"2024-08-09T00:40:44.504759+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:40:44.504759+0000","last_undegraded":"2024-08-09T00:40:44.504759+0000","last_fullsized":"2024-08-09T00:40:44.504759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.504500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:10.357467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.012427+0000","last_change":"2024-08-09T00:40:42.012589+0000","last_active":"2024-08-09T00:40:42.012427+0000","last_peered":"2024-08-09T00:40:42.012427+0000","last_clean":"2024-08-09T00:40:42.012427+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:40:42.012427+0000","last_undegraded":"2024-08-09T00:40:42.012427+0000","last_fullsized":"2024-08-09T00:40:42.012427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.012179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:37.853605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.097064+0000","last_change":"2024-08-09T00:41:06.097064+0000","last_active":"2024-08-09T00:41:06.097064+0000","last_peered":"2024-08-09T00:41:06.097064+0000","last_clean":"2024-08-09T00:41:06.097064+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:41:06.097064+0000","last_undegraded":"2024-08-09T00:41:06.097064+0000","last_fullsized":"2024-08-09T00:41:06.097064+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.096779+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:14:32.896863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.685295+0000","last_change":"2024-08-09T00:04:29.879286+0000","last_active":"2024-08-09T00:39:57.685295+0000","last_peered":"2024-08-09T00:39:57.685295+0000","last_clean":"2024-08-09T00:39:57.685295+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:39:57.685295+0000","last_undegraded":"2024-08-09T00:39:57.685295+0000","last_fullsized":"2024-08-09T00:39:57.685295+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'7","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.588080+0000","last_change":"2024-08-09T00:40:56.588080+0000","last_active":"2024-08-09T00:40:56.588080+0000","last_peered":"2024-08-09T00:40:56.588080+0000","last_clean":"2024-08-09T00:40:56.588080+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:40:56.588080+0000","last_undegraded":"2024-08-09T00:40:56.588080+0000","last_fullsized":"2024-08-09T00:40:56.588080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.587815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:06.658894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.639579+0000","last_change":"2024-08-09T00:40:38.639579+0000","last_active":"2024-08-09T00:40:38.639579+0000","last_peered":"2024-08-09T00:40:38.639579+0000","last_clean":"2024-08-09T00:40:38.639579+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:40:38.639579+0000","last_undegraded":"2024-08-09T00:40:38.639579+0000","last_fullsized":"2024-08-09T00:40:38.639579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.639308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:48.995525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.691644+0000","last_change":"2024-08-09T00:40:37.691644+0000","last_active":"2024-08-09T00:40:37.691644+0000","last_peered":"2024-08-09T00:40:37.691644+0000","last_clean":"2024-08-09T00:40:37.691644+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:40:37.691644+0000","last_undegraded":"2024-08-09T00:40:37.691644+0000","last_fullsized":"2024-08-09T00:40:37.691644+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.691368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:15:07.123436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:58.098490+0000","last_change":"2024-08-09T00:04:29.881764+0000","last_active":"2024-08-09T00:39:58.098490+0000","last_peered":"2024-08-09T00:39:58.098490+0000","last_clean":"2024-08-09T00:39:58.098490+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:39:58.098490+0000","last_undegraded":"2024-08-09T00:39:58.098490+0000","last_fullsized":"2024-08-09T00:39:58.098490+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.604672+0000","last_change":"2024-08-09T00:41:00.604736+0000","last_active":"2024-08-09T00:41:00.604672+0000","last_peered":"2024-08-09T00:41:00.604672+0000","last_clean":"2024-08-09T00:41:00.604672+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:41:00.604672+0000","last_undegraded":"2024-08-09T00:41:00.604672+0000","last_fullsized":"2024-08-09T00:41:00.604672+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.604461+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:51.169699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.060533+0000","last_change":"2024-08-09T00:41:03.060593+0000","last_active":"2024-08-09T00:41:03.060533+0000","last_peered":"2024-08-09T00:41:03.060533+0000","last_clean":"2024-08-09T00:41:03.060533+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:41:03.060533+0000","last_undegraded":"2024-08-09T00:41:03.060533+0000","last_fullsized":"2024-08-09T00:41:03.060533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.060324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:13:49.765010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'86","reported_seq":339,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.895905+0000","last_change":"2024-08-09T00:40:37.895905+0000","last_active":"2024-08-09T00:40:37.895905+0000","last_peered":"2024-08-09T00:40:37.895905+0000","last_clean":"2024-08-09T00:40:37.895905+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:40:37.895905+0000","last_undegraded":"2024-08-09T00:40:37.895905+0000","last_fullsized":"2024-08-09T00:40:37.895905+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.895611+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:36:13.014150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3248,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279958+0000","last_change":"2024-08-09T00:04:29.871616+0000","last_active":"2024-08-09T00:40:34.279958+0000","last_peered":"2024-08-09T00:40:34.279958+0000","last_clean":"2024-08-09T00:40:34.279958+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:40:34.279958+0000","last_undegraded":"2024-08-09T00:40:34.279958+0000","last_fullsized":"2024-08-09T00:40:34.279958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.614833+0000","last_change":"2024-08-09T00:40:52.614893+0000","last_active":"2024-08-09T00:40:52.614833+0000","last_peered":"2024-08-09T00:40:52.614833+0000","last_clean":"2024-08-09T00:40:52.614833+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:40:52.614833+0000","last_undegraded":"2024-08-09T00:40:52.614833+0000","last_fullsized":"2024-08-09T00:40:52.614833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.614638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:19.525948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'7","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.214947+0000","last_change":"2024-08-09T00:40:48.215013+0000","last_active":"2024-08-09T00:40:48.214947+0000","last_peered":"2024-08-09T00:40:48.214947+0000","last_clean":"2024-08-09T00:40:48.214947+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:40:48.214947+0000","last_undegraded":"2024-08-09T00:40:48.214947+0000","last_fullsized":"2024-08-09T00:40:48.214947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.214757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:00.067724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.530066+0000","last_change":"2024-08-09T00:40:46.530066+0000","last_active":"2024-08-09T00:40:46.530066+0000","last_peered":"2024-08-09T00:40:46.530066+0000","last_clean":"2024-08-09T00:40:46.530066+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:40:46.530066+0000","last_undegraded":"2024-08-09T00:40:46.530066+0000","last_fullsized":"2024-08-09T00:40:46.530066+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.529798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:28.838684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.875645+0000","last_change":"2024-08-09T00:04:29.860059+0000","last_active":"2024-08-09T00:39:57.875645+0000","last_peered":"2024-08-09T00:39:57.875645+0000","last_clean":"2024-08-09T00:39:57.875645+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:39:57.875645+0000","last_undegraded":"2024-08-09T00:39:57.875645+0000","last_fullsized":"2024-08-09T00:39:57.875645+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'6","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684774+0000","last_change":"2024-08-08T23:48:42.089972+0000","last_active":"2024-08-09T00:40:35.684774+0000","last_peered":"2024-08-09T00:40:35.684774+0000","last_clean":"2024-08-09T00:40:35.684774+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:40:35.684774+0000","last_undegraded":"2024-08-09T00:40:35.684774+0000","last_fullsized":"2024-08-09T00:40:35.684774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7184,"num_write":6,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.642345+0000","last_change":"2024-08-09T00:40:39.642407+0000","last_active":"2024-08-09T00:40:39.642345+0000","last_peered":"2024-08-09T00:40:39.642345+0000","last_clean":"2024-08-09T00:40:39.642345+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:40:39.642345+0000","last_undegraded":"2024-08-09T00:40:39.642345+0000","last_fullsized":"2024-08-09T00:40:39.642345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.642111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:06:21.202789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.771514+0000","last_change":"2024-08-09T00:40:38.771514+0000","last_active":"2024-08-09T00:40:38.771514+0000","last_peered":"2024-08-09T00:40:38.771514+0000","last_clean":"2024-08-09T00:40:38.771514+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:40:38.771514+0000","last_undegraded":"2024-08-09T00:40:38.771514+0000","last_fullsized":"2024-08-09T00:40:38.771514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.771257+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:13.221977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.998652+0000","last_change":"2024-08-09T00:41:08.998721+0000","last_active":"2024-08-09T00:41:08.998652+0000","last_peered":"2024-08-09T00:41:08.998652+0000","last_clean":"2024-08-09T00:41:08.998652+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:41:08.998652+0000","last_undegraded":"2024-08-09T00:41:08.998652+0000","last_fullsized":"2024-08-09T00:41:08.998652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.998456+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:46.509152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'8","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.279835+0000","last_change":"2024-08-08T23:48:42.117648+0000","last_active":"2024-08-09T00:40:34.279835+0000","last_peered":"2024-08-09T00:40:34.279835+0000","last_clean":"2024-08-09T00:40:34.279835+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:40:34.279835+0000","last_undegraded":"2024-08-09T00:40:34.279835+0000","last_fullsized":"2024-08-09T00:40:34.279835+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.563040+0000","last_change":"2024-08-09T00:40:42.563040+0000","last_active":"2024-08-09T00:40:42.563040+0000","last_peered":"2024-08-09T00:40:42.563040+0000","last_clean":"2024-08-09T00:40:42.563040+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:40:42.563040+0000","last_undegraded":"2024-08-09T00:40:42.563040+0000","last_fullsized":"2024-08-09T00:40:42.563040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.562784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:16.829344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.262213+0000","last_change":"2024-08-09T00:40:44.262213+0000","last_active":"2024-08-09T00:40:44.262213+0000","last_peered":"2024-08-09T00:40:44.262213+0000","last_clean":"2024-08-09T00:40:44.262213+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:40:44.262213+0000","last_undegraded":"2024-08-09T00:40:44.262213+0000","last_fullsized":"2024-08-09T00:40:44.262213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.261956+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:37.462204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:12.857749+0000","last_change":"2024-08-09T00:04:29.861069+0000","last_active":"2024-08-09T00:39:12.857749+0000","last_peered":"2024-08-09T00:39:12.857749+0000","last_clean":"2024-08-09T00:39:12.857749+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:39:12.857749+0000","last_undegraded":"2024-08-09T00:39:12.857749+0000","last_fullsized":"2024-08-09T00:39:12.857749+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.137635+0000","last_change":"2024-08-08T23:48:42.112671+0000","last_active":"2024-08-09T00:40:36.137635+0000","last_peered":"2024-08-09T00:40:36.137635+0000","last_clean":"2024-08-09T00:40:36.137635+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:40:36.137635+0000","last_undegraded":"2024-08-09T00:40:36.137635+0000","last_fullsized":"2024-08-09T00:40:36.137635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.595802+0000","last_change":"2024-08-09T00:40:41.595802+0000","last_active":"2024-08-09T00:40:41.595802+0000","last_peered":"2024-08-09T00:40:41.595802+0000","last_clean":"2024-08-09T00:40:41.595802+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:40:41.595802+0000","last_undegraded":"2024-08-09T00:40:41.595802+0000","last_fullsized":"2024-08-09T00:40:41.595802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.595540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:00.572160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.906989+0000","last_change":"2024-08-09T00:40:35.906989+0000","last_active":"2024-08-09T00:40:35.906989+0000","last_peered":"2024-08-09T00:40:35.906989+0000","last_clean":"2024-08-09T00:40:35.906989+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:40:35.906989+0000","last_undegraded":"2024-08-09T00:40:35.906989+0000","last_fullsized":"2024-08-09T00:40:35.906989+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.906730+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:03:23.261597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:57.868829+0000","last_change":"2024-08-09T00:04:29.852397+0000","last_active":"2024-08-09T00:39:57.868829+0000","last_peered":"2024-08-09T00:39:57.868829+0000","last_clean":"2024-08-09T00:39:57.868829+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:39:57.868829+0000","last_undegraded":"2024-08-09T00:39:57.868829+0000","last_fullsized":"2024-08-09T00:39:57.868829+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.063238+0000","last_change":"2024-08-09T00:41:09.063328+0000","last_active":"2024-08-09T00:41:09.063238+0000","last_peered":"2024-08-09T00:41:09.063238+0000","last_clean":"2024-08-09T00:41:09.063238+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:41:09.063238+0000","last_undegraded":"2024-08-09T00:41:09.063238+0000","last_fullsized":"2024-08-09T00:41:09.063238+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.062923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:16:05.039859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.691491+0000","last_change":"2024-08-09T00:40:41.691491+0000","last_active":"2024-08-09T00:40:41.691491+0000","last_peered":"2024-08-09T00:40:41.691491+0000","last_clean":"2024-08-09T00:40:41.691491+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:40:41.691491+0000","last_undegraded":"2024-08-09T00:40:41.691491+0000","last_fullsized":"2024-08-09T00:40:41.691491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.691090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:04:50.076445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.899972+0000","last_change":"2024-08-09T00:40:38.899972+0000","last_active":"2024-08-09T00:40:38.899972+0000","last_peered":"2024-08-09T00:40:38.899972+0000","last_clean":"2024-08-09T00:40:38.899972+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:40:38.899972+0000","last_undegraded":"2024-08-09T00:40:38.899972+0000","last_fullsized":"2024-08-09T00:40:38.899972+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.899571+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:03.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.697082+0000","last_change":"2024-08-09T00:40:56.697187+0000","last_active":"2024-08-09T00:40:56.697082+0000","last_peered":"2024-08-09T00:40:56.697082+0000","last_clean":"2024-08-09T00:40:56.697082+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:40:56.697082+0000","last_undegraded":"2024-08-09T00:40:56.697082+0000","last_fullsized":"2024-08-09T00:40:56.697082+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.696850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:28:39.200712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684801+0000","last_change":"2024-08-08T23:48:42.103451+0000","last_active":"2024-08-09T00:40:35.684801+0000","last_peered":"2024-08-09T00:40:35.684801+0000","last_clean":"2024-08-09T00:40:35.684801+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:40:35.684801+0000","last_undegraded":"2024-08-09T00:40:35.684801+0000","last_fullsized":"2024-08-09T00:40:35.684801+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:48:41.056576+0000","last_clean_scrub_stamp":"2024-08-08T23:48:41.056576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.889285+0000","last_change":"2024-08-09T00:40:39.889285+0000","last_active":"2024-08-09T00:40:39.889285+0000","last_peered":"2024-08-09T00:40:39.889285+0000","last_clean":"2024-08-09T00:40:39.889285+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:40:39.889285+0000","last_undegraded":"2024-08-09T00:40:39.889285+0000","last_fullsized":"2024-08-09T00:40:39.889285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.889006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:10.545546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'76","reported_seq":308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.502863+0000","last_change":"2024-08-09T00:40:49.502863+0000","last_active":"2024-08-09T00:40:49.502863+0000","last_peered":"2024-08-09T00:40:49.502863+0000","last_clean":"2024-08-09T00:40:49.502863+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:40:49.502863+0000","last_undegraded":"2024-08-09T00:40:49.502863+0000","last_fullsized":"2024-08-09T00:40:49.502863+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.502595+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:44:42.439163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2970,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'160","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.238105+0000","last_change":"2024-08-08T23:28:24.800974+0000","last_active":"2024-08-09T00:40:30.238105+0000","last_peered":"2024-08-09T00:40:30.238105+0000","last_clean":"2024-08-09T00:40:30.238105+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:40:30.238105+0000","last_undegraded":"2024-08-09T00:40:30.238105+0000","last_fullsized":"2024-08-09T00:40:30.238105+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850193,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":340,"num_read_kb":12258,"num_write":951,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.203061+0000","last_change":"2024-08-09T00:40:55.203061+0000","last_active":"2024-08-09T00:40:55.203061+0000","last_peered":"2024-08-09T00:40:55.203061+0000","last_clean":"2024-08-09T00:40:55.203061+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:40:55.203061+0000","last_undegraded":"2024-08-09T00:40:55.203061+0000","last_fullsized":"2024-08-09T00:40:55.203061+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.202784+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:48.362184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'191","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.952109+0000","last_change":"2024-08-09T00:41:08.952180+0000","last_active":"2024-08-09T00:41:08.952109+0000","last_peered":"2024-08-09T00:41:08.952109+0000","last_clean":"2024-08-09T00:41:08.952109+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:41:08.952109+0000","last_undegraded":"2024-08-09T00:41:08.952109+0000","last_fullsized":"2024-08-09T00:41:08.952109+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.951911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:39.305150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":3384,"num_write":904,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'235","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.617024+0000","last_change":"2024-08-09T00:41:05.617090+0000","last_active":"2024-08-09T00:41:05.617024+0000","last_peered":"2024-08-09T00:41:05.617024+0000","last_clean":"2024-08-09T00:41:05.617024+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:41:05.617024+0000","last_undegraded":"2024-08-09T00:41:05.617024+0000","last_fullsized":"2024-08-09T00:41:05.617024+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.616835+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:52:10.896240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":527,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'216","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.646071+0000","last_change":"2024-08-08T23:28:24.767376+0000","last_active":"2024-08-09T00:40:30.646071+0000","last_peered":"2024-08-09T00:40:30.646071+0000","last_clean":"2024-08-09T00:40:30.646071+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:40:30.646071+0000","last_undegraded":"2024-08-09T00:40:30.646071+0000","last_fullsized":"2024-08-09T00:40:30.646071+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":22668,"num_write":1178,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.114112+0000","last_change":"2024-08-09T00:41:05.114174+0000","last_active":"2024-08-09T00:41:05.114112+0000","last_peered":"2024-08-09T00:41:05.114112+0000","last_clean":"2024-08-09T00:41:05.114112+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:41:05.114112+0000","last_undegraded":"2024-08-09T00:41:05.114112+0000","last_fullsized":"2024-08-09T00:41:05.114112+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.113918+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:33:20.516143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'200","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.116081+0000","last_change":"2024-08-09T00:41:01.116200+0000","last_active":"2024-08-09T00:41:01.116081+0000","last_peered":"2024-08-09T00:41:01.116081+0000","last_clean":"2024-08-09T00:41:01.116081+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:41:01.116081+0000","last_undegraded":"2024-08-09T00:41:01.116081+0000","last_fullsized":"2024-08-09T00:41:01.116081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.115878+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:35.058861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568643,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":448,"num_read_kb":38040,"num_write":1155,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821632+0000","last_change":"2024-08-08T23:28:26.760047+0000","last_active":"2024-08-09T00:40:33.821632+0000","last_peered":"2024-08-09T00:40:33.821632+0000","last_clean":"2024-08-09T00:40:33.821632+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:40:33.821632+0000","last_undegraded":"2024-08-09T00:40:33.821632+0000","last_fullsized":"2024-08-09T00:40:33.821632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'215","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.766491+0000","last_change":"2024-08-09T00:40:39.766664+0000","last_active":"2024-08-09T00:40:39.766491+0000","last_peered":"2024-08-09T00:40:39.766491+0000","last_clean":"2024-08-09T00:40:39.766491+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:40:39.766491+0000","last_undegraded":"2024-08-09T00:40:39.766491+0000","last_fullsized":"2024-08-09T00:40:39.766491+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.766288+0000","objects_scrubbed":10,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:26:32.617815+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8746313,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":21778,"num_write":1217,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.141948+0000","last_change":"2024-08-09T00:41:05.142012+0000","last_active":"2024-08-09T00:41:05.141948+0000","last_peered":"2024-08-09T00:41:05.141948+0000","last_clean":"2024-08-09T00:41:05.141948+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:41:05.141948+0000","last_undegraded":"2024-08-09T00:41:05.141948+0000","last_fullsized":"2024-08-09T00:41:05.141948+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.141756+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:03.113824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'189","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.095124+0000","last_change":"2024-08-09T00:41:07.095339+0000","last_active":"2024-08-09T00:41:07.095124+0000","last_peered":"2024-08-09T00:41:07.095124+0000","last_clean":"2024-08-09T00:41:07.095124+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:41:07.095124+0000","last_undegraded":"2024-08-09T00:41:07.095124+0000","last_fullsized":"2024-08-09T00:41:07.095124+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.094845+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:36:35.837560+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49415,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":54098,"num_write":1119,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.866304+0000","last_change":"2024-08-08T23:28:26.761766+0000","last_active":"2024-08-09T00:39:17.866304+0000","last_peered":"2024-08-09T00:39:17.866304+0000","last_clean":"2024-08-09T00:39:17.866304+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:39:17.866304+0000","last_undegraded":"2024-08-09T00:39:17.866304+0000","last_fullsized":"2024-08-09T00:39:17.866304+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'197","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066848+0000","last_change":"2024-08-08T23:28:24.795258+0000","last_active":"2024-08-09T00:40:37.066848+0000","last_peered":"2024-08-09T00:40:37.066848+0000","last_clean":"2024-08-09T00:40:37.066848+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:40:37.066848+0000","last_undegraded":"2024-08-09T00:40:37.066848+0000","last_fullsized":"2024-08-09T00:40:37.066848+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743987,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":11259,"num_write":1113,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'107","reported_seq":731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.180279+0000","last_change":"2024-08-09T00:40:57.180343+0000","last_active":"2024-08-09T00:40:57.180279+0000","last_peered":"2024-08-09T00:40:57.180279+0000","last_clean":"2024-08-09T00:40:57.180279+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:40:57.180279+0000","last_undegraded":"2024-08-09T00:40:57.180279+0000","last_fullsized":"2024-08-09T00:40:57.180279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'107","last_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_deep_scrub":"268'107","last_deep_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.180097+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:33:50.782470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'155","reported_seq":790,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209750+0000","last_change":"2024-08-08T23:28:24.788172+0000","last_active":"2024-08-09T00:40:35.209750+0000","last_peered":"2024-08-09T00:40:35.209750+0000","last_clean":"2024-08-09T00:40:35.209750+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:40:35.209750+0000","last_undegraded":"2024-08-09T00:40:35.209750+0000","last_fullsized":"2024-08-09T00:40:35.209750+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":32780,"num_write":887,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'209","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.112478+0000","last_change":"2024-08-09T00:40:59.112559+0000","last_active":"2024-08-09T00:40:59.112478+0000","last_peered":"2024-08-09T00:40:59.112478+0000","last_clean":"2024-08-09T00:40:59.112478+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:40:59.112478+0000","last_undegraded":"2024-08-09T00:40:59.112478+0000","last_fullsized":"2024-08-09T00:40:59.112478+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.112286+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.598671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":263,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'34","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.101640+0000","last_change":"2024-08-09T00:41:03.101708+0000","last_active":"2024-08-09T00:41:03.101640+0000","last_peered":"2024-08-09T00:41:03.101640+0000","last_clean":"2024-08-09T00:41:03.101640+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:41:03.101640+0000","last_undegraded":"2024-08-09T00:41:03.101640+0000","last_fullsized":"2024-08-09T00:41:03.101640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.101426+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:13.790151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'172","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066869+0000","last_change":"2024-08-08T23:28:24.816136+0000","last_active":"2024-08-09T00:40:37.066869+0000","last_peered":"2024-08-09T00:40:37.066869+0000","last_clean":"2024-08-09T00:40:37.066869+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:40:37.066869+0000","last_undegraded":"2024-08-09T00:40:37.066869+0000","last_fullsized":"2024-08-09T00:40:37.066869+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":8171,"num_write":1047,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.633161+0000","last_change":"2024-08-09T00:41:03.633221+0000","last_active":"2024-08-09T00:41:03.633161+0000","last_peered":"2024-08-09T00:41:03.633161+0000","last_clean":"2024-08-09T00:41:03.633161+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:41:03.633161+0000","last_undegraded":"2024-08-09T00:41:03.633161+0000","last_fullsized":"2024-08-09T00:41:03.633161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.632964+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:20:37.391665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'198","reported_seq":802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.231804+0000","last_change":"2024-08-09T00:40:46.231893+0000","last_active":"2024-08-09T00:40:46.231804+0000","last_peered":"2024-08-09T00:40:46.231804+0000","last_clean":"2024-08-09T00:40:46.231804+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:40:46.231804+0000","last_undegraded":"2024-08-09T00:40:46.231804+0000","last_fullsized":"2024-08-09T00:40:46.231804+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.231597+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:55.781502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":6729,"num_write":999,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.201532+0000","last_change":"2024-08-09T00:40:54.201532+0000","last_active":"2024-08-09T00:40:54.201532+0000","last_peered":"2024-08-09T00:40:54.201532+0000","last_clean":"2024-08-09T00:40:54.201532+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:40:54.201532+0000","last_undegraded":"2024-08-09T00:40:54.201532+0000","last_fullsized":"2024-08-09T00:40:54.201532+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.201267+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:12.747587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'246","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.180957+0000","last_change":"2024-08-09T00:41:04.181040+0000","last_active":"2024-08-09T00:41:04.180957+0000","last_peered":"2024-08-09T00:41:04.180957+0000","last_clean":"2024-08-09T00:41:04.180957+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:41:04.180957+0000","last_undegraded":"2024-08-09T00:41:04.180957+0000","last_fullsized":"2024-08-09T00:41:04.180957+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.180754+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:04:49.717911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":13197,"num_write":1122,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'22","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.113760+0000","last_change":"2024-08-09T00:40:58.113824+0000","last_active":"2024-08-09T00:40:58.113760+0000","last_peered":"2024-08-09T00:40:58.113760+0000","last_clean":"2024-08-09T00:40:58.113760+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:40:58.113760+0000","last_undegraded":"2024-08-09T00:40:58.113760+0000","last_fullsized":"2024-08-09T00:40:58.113760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.113559+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:11:08.699949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'176","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.219293+0000","last_change":"2024-08-09T00:40:40.219376+0000","last_active":"2024-08-09T00:40:40.219293+0000","last_peered":"2024-08-09T00:40:40.219293+0000","last_clean":"2024-08-09T00:40:40.219293+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:40:40.219293+0000","last_undegraded":"2024-08-09T00:40:40.219293+0000","last_fullsized":"2024-08-09T00:40:40.219293+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.219095+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:19.550329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":29619,"num_write":952,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.112836+0000","last_change":"2024-08-09T00:41:01.112901+0000","last_active":"2024-08-09T00:41:01.112836+0000","last_peered":"2024-08-09T00:41:01.112836+0000","last_clean":"2024-08-09T00:41:01.112836+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:41:01.112836+0000","last_undegraded":"2024-08-09T00:41:01.112836+0000","last_fullsized":"2024-08-09T00:41:01.112836+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.112641+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:24.506004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'166","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209677+0000","last_change":"2024-08-08T23:28:24.754546+0000","last_active":"2024-08-09T00:40:35.209677+0000","last_peered":"2024-08-09T00:40:35.209677+0000","last_clean":"2024-08-09T00:40:35.209677+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:40:35.209677+0000","last_undegraded":"2024-08-09T00:40:35.209677+0000","last_fullsized":"2024-08-09T00:40:35.209677+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146116,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":37287,"num_write":965,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.001404+0000","last_change":"2024-08-09T00:41:01.001568+0000","last_active":"2024-08-09T00:41:01.001404+0000","last_peered":"2024-08-09T00:41:01.001404+0000","last_clean":"2024-08-09T00:41:01.001404+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:41:01.001404+0000","last_undegraded":"2024-08-09T00:41:01.001404+0000","last_fullsized":"2024-08-09T00:41:01.001404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.001176+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:30:05.967079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'222","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821373+0000","last_change":"2024-08-08T23:28:24.772092+0000","last_active":"2024-08-09T00:40:33.821373+0000","last_peered":"2024-08-09T00:40:33.821373+0000","last_clean":"2024-08-09T00:40:33.821373+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:40:33.821373+0000","last_undegraded":"2024-08-09T00:40:33.821373+0000","last_fullsized":"2024-08-09T00:40:33.821373+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":428,"num_read_kb":738,"num_write":1172,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'110","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.001523+0000","last_change":"2024-08-09T00:40:41.001523+0000","last_active":"2024-08-09T00:40:41.001523+0000","last_peered":"2024-08-09T00:40:41.001523+0000","last_clean":"2024-08-09T00:40:41.001523+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:40:41.001523+0000","last_undegraded":"2024-08-09T00:40:41.001523+0000","last_fullsized":"2024-08-09T00:40:41.001523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.001229+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:58:15.431511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.262057+0000","last_change":"2024-08-09T00:40:42.262175+0000","last_active":"2024-08-09T00:40:42.262057+0000","last_peered":"2024-08-09T00:40:42.262057+0000","last_clean":"2024-08-09T00:40:42.262057+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:40:42.262057+0000","last_undegraded":"2024-08-09T00:40:42.262057+0000","last_fullsized":"2024-08-09T00:40:42.262057+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.261780+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:47.848829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'178","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.553323+0000","last_change":"2024-08-09T00:40:50.553409+0000","last_active":"2024-08-09T00:40:50.553323+0000","last_peered":"2024-08-09T00:40:50.553323+0000","last_clean":"2024-08-09T00:40:50.553323+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:40:50.553323+0000","last_undegraded":"2024-08-09T00:40:50.553323+0000","last_fullsized":"2024-08-09T00:40:50.553323+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.553124+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:04.843417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":22191,"num_write":1038,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.031946+0000","last_change":"2024-08-09T00:41:04.031999+0000","last_active":"2024-08-09T00:41:04.031946+0000","last_peered":"2024-08-09T00:41:04.031946+0000","last_clean":"2024-08-09T00:41:04.031946+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:41:04.031946+0000","last_undegraded":"2024-08-09T00:41:04.031946+0000","last_fullsized":"2024-08-09T00:41:04.031946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.031745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:48.346071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'220","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821363+0000","last_change":"2024-08-08T23:28:30.789123+0000","last_active":"2024-08-09T00:40:33.821363+0000","last_peered":"2024-08-09T00:40:33.821363+0000","last_clean":"2024-08-09T00:40:33.821363+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:40:33.821363+0000","last_undegraded":"2024-08-09T00:40:33.821363+0000","last_fullsized":"2024-08-09T00:40:33.821363+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":290,"num_write":170,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.721552+0000","last_change":"2024-08-09T00:40:55.721552+0000","last_active":"2024-08-09T00:40:55.721552+0000","last_peered":"2024-08-09T00:40:55.721552+0000","last_clean":"2024-08-09T00:40:55.721552+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:40:55.721552+0000","last_undegraded":"2024-08-09T00:40:55.721552+0000","last_fullsized":"2024-08-09T00:40:55.721552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.721289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:38:12.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2401","reported_seq":4293,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.236072+0000","last_change":"2024-08-09T00:40:43.236142+0000","last_active":"2024-08-09T00:40:43.236072+0000","last_peered":"2024-08-09T00:40:43.236072+0000","last_clean":"2024-08-09T00:40:43.236072+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:40:43.236072+0000","last_undegraded":"2024-08-09T00:40:43.236072+0000","last_fullsized":"2024-08-09T00:40:43.236072+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2401","last_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_deep_scrub":"268'2401","last_deep_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.235885+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":2300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:26:55.409086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.137766+0000","last_change":"2024-08-09T00:41:00.137831+0000","last_active":"2024-08-09T00:41:00.137766+0000","last_peered":"2024-08-09T00:41:00.137766+0000","last_clean":"2024-08-09T00:41:00.137766+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:41:00.137766+0000","last_undegraded":"2024-08-09T00:41:00.137766+0000","last_fullsized":"2024-08-09T00:41:00.137766+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.137580+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:44.917221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'184","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821137+0000","last_change":"2024-08-08T23:28:24.801192+0000","last_active":"2024-08-09T00:40:33.821137+0000","last_peered":"2024-08-09T00:40:33.821137+0000","last_clean":"2024-08-09T00:40:33.821137+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:40:33.821137+0000","last_undegraded":"2024-08-09T00:40:33.821137+0000","last_fullsized":"2024-08-09T00:40:33.821137+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311673,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":392,"num_read_kb":16280,"num_write":970,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210011+0000","last_change":"2024-08-08T23:28:28.783265+0000","last_active":"2024-08-09T00:40:35.210011+0000","last_peered":"2024-08-09T00:40:35.210011+0000","last_clean":"2024-08-09T00:40:35.210011+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:40:35.210011+0000","last_undegraded":"2024-08-09T00:40:35.210011+0000","last_fullsized":"2024-08-09T00:40:35.210011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'109","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.684151+0000","last_change":"2024-08-08T23:28:30.786099+0000","last_active":"2024-08-09T00:40:35.684151+0000","last_peered":"2024-08-09T00:40:35.684151+0000","last_clean":"2024-08-09T00:40:35.684151+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:40:35.684151+0000","last_undegraded":"2024-08-09T00:40:35.684151+0000","last_fullsized":"2024-08-09T00:40:35.684151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.057708+0000","last_change":"2024-08-09T00:40:44.057708+0000","last_active":"2024-08-09T00:40:44.057708+0000","last_peered":"2024-08-09T00:40:44.057708+0000","last_clean":"2024-08-09T00:40:44.057708+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:40:44.057708+0000","last_undegraded":"2024-08-09T00:40:44.057708+0000","last_fullsized":"2024-08-09T00:40:44.057708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.057369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:45.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'140","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.618287+0000","last_change":"2024-08-09T00:40:50.618287+0000","last_active":"2024-08-09T00:40:50.618287+0000","last_peered":"2024-08-09T00:40:50.618287+0000","last_clean":"2024-08-09T00:40:50.618287+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:40:50.618287+0000","last_undegraded":"2024-08-09T00:40:50.618287+0000","last_fullsized":"2024-08-09T00:40:50.618287+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.618030+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:01.456614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821274+0000","last_change":"2024-08-08T23:28:26.765583+0000","last_active":"2024-08-09T00:40:33.821274+0000","last_peered":"2024-08-09T00:40:33.821274+0000","last_clean":"2024-08-09T00:40:33.821274+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:40:33.821274+0000","last_undegraded":"2024-08-09T00:40:33.821274+0000","last_fullsized":"2024-08-09T00:40:33.821274+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'232","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066802+0000","last_change":"2024-08-08T23:28:24.800844+0000","last_active":"2024-08-09T00:40:37.066802+0000","last_peered":"2024-08-09T00:40:37.066802+0000","last_clean":"2024-08-09T00:40:37.066802+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:40:37.066802+0000","last_undegraded":"2024-08-09T00:40:37.066802+0000","last_fullsized":"2024-08-09T00:40:37.066802+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":26858,"num_write":1144,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.437862+0000","last_change":"2024-08-09T00:41:11.437915+0000","last_active":"2024-08-09T00:41:11.437862+0000","last_peered":"2024-08-09T00:41:11.437862+0000","last_clean":"2024-08-09T00:41:11.437862+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:41:11.437862+0000","last_undegraded":"2024-08-09T00:41:11.437862+0000","last_fullsized":"2024-08-09T00:41:11.437862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.437657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:41.178098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'154","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.250412+0000","last_change":"2024-08-09T00:40:43.250412+0000","last_active":"2024-08-09T00:40:43.250412+0000","last_peered":"2024-08-09T00:40:43.250412+0000","last_clean":"2024-08-09T00:40:43.250412+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:40:43.250412+0000","last_undegraded":"2024-08-09T00:40:43.250412+0000","last_fullsized":"2024-08-09T00:40:43.250412+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.250137+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:26.394703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'514","reported_seq":2629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.623510+0000","last_change":"2024-08-09T00:40:59.623510+0000","last_active":"2024-08-09T00:40:59.623510+0000","last_peered":"2024-08-09T00:40:59.623510+0000","last_clean":"2024-08-09T00:40:59.623510+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:40:59.623510+0000","last_undegraded":"2024-08-09T00:40:59.623510+0000","last_fullsized":"2024-08-09T00:40:59.623510+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.623248+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:49.685761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'205","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.032946+0000","last_change":"2024-08-09T00:40:43.032946+0000","last_active":"2024-08-09T00:40:43.032946+0000","last_peered":"2024-08-09T00:40:43.032946+0000","last_clean":"2024-08-09T00:40:43.032946+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:40:43.032946+0000","last_undegraded":"2024-08-09T00:40:43.032946+0000","last_fullsized":"2024-08-09T00:40:43.032946+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.032703+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.934858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'198","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.400322+0000","last_change":"2024-08-09T00:41:05.400388+0000","last_active":"2024-08-09T00:41:05.400322+0000","last_peered":"2024-08-09T00:41:05.400322+0000","last_clean":"2024-08-09T00:41:05.400322+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:41:05.400322+0000","last_undegraded":"2024-08-09T00:41:05.400322+0000","last_fullsized":"2024-08-09T00:41:05.400322+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.400130+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:27:16.014784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'184","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.246023+0000","last_change":"2024-08-09T00:41:01.246106+0000","last_active":"2024-08-09T00:41:01.246023+0000","last_peered":"2024-08-09T00:41:01.246023+0000","last_clean":"2024-08-09T00:41:01.246023+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:41:01.246023+0000","last_undegraded":"2024-08-09T00:41:01.246023+0000","last_fullsized":"2024-08-09T00:41:01.246023+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.245827+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:25.571962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":349,"num_read_kb":11144,"num_write":998,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.046179+0000","last_change":"2024-08-09T00:41:08.046237+0000","last_active":"2024-08-09T00:41:08.046179+0000","last_peered":"2024-08-09T00:41:08.046179+0000","last_clean":"2024-08-09T00:41:08.046179+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:41:08.046179+0000","last_undegraded":"2024-08-09T00:41:08.046179+0000","last_fullsized":"2024-08-09T00:41:08.046179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.045971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:20.972107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'147","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067544+0000","last_change":"2024-08-08T23:28:31.044506+0000","last_active":"2024-08-09T00:40:37.067544+0000","last_peered":"2024-08-09T00:40:37.067544+0000","last_clean":"2024-08-09T00:40:37.067544+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:40:37.067544+0000","last_undegraded":"2024-08-09T00:40:37.067544+0000","last_fullsized":"2024-08-09T00:40:37.067544+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":269,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'525","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.330769+0000","last_change":"2024-08-09T00:40:53.330769+0000","last_active":"2024-08-09T00:40:53.330769+0000","last_peered":"2024-08-09T00:40:53.330769+0000","last_clean":"2024-08-09T00:40:53.330769+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:40:53.330769+0000","last_undegraded":"2024-08-09T00:40:53.330769+0000","last_fullsized":"2024-08-09T00:40:53.330769+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.330522+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:02.062195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.080669+0000","last_change":"2024-08-09T00:41:02.080730+0000","last_active":"2024-08-09T00:41:02.080669+0000","last_peered":"2024-08-09T00:41:02.080669+0000","last_clean":"2024-08-09T00:41:02.080669+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:41:02.080669+0000","last_undegraded":"2024-08-09T00:41:02.080669+0000","last_fullsized":"2024-08-09T00:41:02.080669+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.080481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:38:44.354454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'202","reported_seq":866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.066734+0000","last_change":"2024-08-08T23:28:24.813067+0000","last_active":"2024-08-09T00:40:37.066734+0000","last_peered":"2024-08-09T00:40:37.066734+0000","last_clean":"2024-08-09T00:40:37.066734+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:40:37.066734+0000","last_undegraded":"2024-08-09T00:40:37.066734+0000","last_fullsized":"2024-08-09T00:40:37.066734+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":38000,"num_write":1175,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.612386+0000","last_change":"2024-08-09T00:41:04.612442+0000","last_active":"2024-08-09T00:41:04.612386+0000","last_peered":"2024-08-09T00:41:04.612386+0000","last_clean":"2024-08-09T00:41:04.612386+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:41:04.612386+0000","last_undegraded":"2024-08-09T00:41:04.612386+0000","last_fullsized":"2024-08-09T00:41:04.612386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.612184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:19.806143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'276","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.227188+0000","last_change":"2024-08-09T00:40:47.227392+0000","last_active":"2024-08-09T00:40:47.227188+0000","last_peered":"2024-08-09T00:40:47.227188+0000","last_clean":"2024-08-09T00:40:47.227188+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:40:47.227188+0000","last_undegraded":"2024-08-09T00:40:47.227188+0000","last_fullsized":"2024-08-09T00:40:47.227188+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'276","last_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_deep_scrub":"268'276","last_deep_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.226937+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:10.282050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":369,"num_read_kb":429,"num_write":224,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.784054+0000","last_change":"2024-08-09T00:40:59.784105+0000","last_active":"2024-08-09T00:40:59.784054+0000","last_peered":"2024-08-09T00:40:59.784054+0000","last_clean":"2024-08-09T00:40:59.784054+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:40:59.784054+0000","last_undegraded":"2024-08-09T00:40:59.784054+0000","last_fullsized":"2024-08-09T00:40:59.784054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:32.556424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'554","reported_seq":1380,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.235374+0000","last_change":"2024-08-09T00:40:37.235454+0000","last_active":"2024-08-09T00:40:37.235374+0000","last_peered":"2024-08-09T00:40:37.235374+0000","last_clean":"2024-08-09T00:40:37.235374+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:40:37.235374+0000","last_undegraded":"2024-08-09T00:40:37.235374+0000","last_fullsized":"2024-08-09T00:40:37.235374+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'554","last_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_deep_scrub":"268'554","last_deep_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.235172+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:51.183078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4316","reported_seq":4952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.272456+0000","last_change":"2024-08-09T00:41:12.272517+0000","last_active":"2024-08-09T00:41:12.272456+0000","last_peered":"2024-08-09T00:41:12.272456+0000","last_clean":"2024-08-09T00:41:12.272456+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:41:12.272456+0000","last_undegraded":"2024-08-09T00:41:12.272456+0000","last_fullsized":"2024-08-09T00:41:12.272456+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4316","last_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_deep_scrub":"268'4316","last_deep_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.272273+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.931506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'233","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.637091+0000","last_change":"2024-08-08T23:28:24.807393+0000","last_active":"2024-08-09T00:40:30.637091+0000","last_peered":"2024-08-09T00:40:30.637091+0000","last_clean":"2024-08-09T00:40:30.637091+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:40:30.637091+0000","last_undegraded":"2024-08-09T00:40:30.637091+0000","last_fullsized":"2024-08-09T00:40:30.637091+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1254,"num_read_kb":40415,"num_write":1272,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.181967+0000","last_change":"2024-08-09T00:40:53.182021+0000","last_active":"2024-08-09T00:40:53.181967+0000","last_peered":"2024-08-09T00:40:53.181967+0000","last_clean":"2024-08-09T00:40:53.181967+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:40:53.181967+0000","last_undegraded":"2024-08-09T00:40:53.181967+0000","last_fullsized":"2024-08-09T00:40:53.181967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.181758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:41:27.166441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'146","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705353+0000","last_change":"2024-08-08T23:28:30.791505+0000","last_active":"2024-08-09T00:40:32.705353+0000","last_peered":"2024-08-09T00:40:32.705353+0000","last_clean":"2024-08-09T00:40:32.705353+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:40:32.705353+0000","last_undegraded":"2024-08-09T00:40:32.705353+0000","last_fullsized":"2024-08-09T00:40:32.705353+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5295,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":256,"num_write":102,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.323741+0000","last_change":"2024-08-09T00:40:58.323795+0000","last_active":"2024-08-09T00:40:58.323741+0000","last_peered":"2024-08-09T00:40:58.323741+0000","last_clean":"2024-08-09T00:40:58.323741+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:40:58.323741+0000","last_undegraded":"2024-08-09T00:40:58.323741+0000","last_fullsized":"2024-08-09T00:40:58.323741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.323537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:08.678263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'96","reported_seq":611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.048327+0000","last_change":"2024-08-09T00:40:54.048389+0000","last_active":"2024-08-09T00:40:54.048327+0000","last_peered":"2024-08-09T00:40:54.048327+0000","last_clean":"2024-08-09T00:40:54.048327+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:40:54.048327+0000","last_undegraded":"2024-08-09T00:40:54.048327+0000","last_fullsized":"2024-08-09T00:40:54.048327+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.048139+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:06.586071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'227","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.085887+0000","last_change":"2024-08-09T00:40:55.085952+0000","last_active":"2024-08-09T00:40:55.085887+0000","last_peered":"2024-08-09T00:40:55.085887+0000","last_clean":"2024-08-09T00:40:55.085887+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:40:55.085887+0000","last_undegraded":"2024-08-09T00:40:55.085887+0000","last_fullsized":"2024-08-09T00:40:55.085887+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.085694+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:46:56.426782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'160","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.612481+0000","last_change":"2024-08-09T00:41:11.612660+0000","last_active":"2024-08-09T00:41:11.612481+0000","last_peered":"2024-08-09T00:41:11.612481+0000","last_clean":"2024-08-09T00:41:11.612481+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:41:11.612481+0000","last_undegraded":"2024-08-09T00:41:11.612481+0000","last_fullsized":"2024-08-09T00:41:11.612481+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.612149+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:01.762322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317190,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":142181,"num_write":944,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.214568+0000","last_change":"2024-08-09T00:40:51.214679+0000","last_active":"2024-08-09T00:40:51.214568+0000","last_peered":"2024-08-09T00:40:51.214568+0000","last_clean":"2024-08-09T00:40:51.214568+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:40:51.214568+0000","last_undegraded":"2024-08-09T00:40:51.214568+0000","last_fullsized":"2024-08-09T00:40:51.214568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.214333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:45:12.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'211","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.624004+0000","last_change":"2024-08-08T23:28:30.781902+0000","last_active":"2024-08-09T00:40:30.624004+0000","last_peered":"2024-08-09T00:40:30.624004+0000","last_clean":"2024-08-09T00:40:30.624004+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:40:30.624004+0000","last_undegraded":"2024-08-09T00:40:30.624004+0000","last_fullsized":"2024-08-09T00:40:30.624004+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":290,"num_read_kb":376,"num_write":174,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'509","reported_seq":4406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.601435+0000","last_change":"2024-08-09T00:40:57.601465+0000","last_active":"2024-08-09T00:40:57.601435+0000","last_peered":"2024-08-09T00:40:57.601435+0000","last_clean":"2024-08-09T00:40:57.601435+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:57.601435+0000","last_undegraded":"2024-08-09T00:40:57.601435+0000","last_fullsized":"2024-08-09T00:40:57.601435+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'509","last_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_deep_scrub":"268'509","last_deep_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.601327+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:05:46.941619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'112","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.643203+0000","last_change":"2024-08-09T00:40:47.643278+0000","last_active":"2024-08-09T00:40:47.643203+0000","last_peered":"2024-08-09T00:40:47.643203+0000","last_clean":"2024-08-09T00:40:47.643203+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:40:47.643203+0000","last_undegraded":"2024-08-09T00:40:47.643203+0000","last_fullsized":"2024-08-09T00:40:47.643203+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.643006+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:42.442342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.877980+0000","last_change":"2024-08-08T23:28:26.756430+0000","last_active":"2024-08-09T00:40:27.877980+0000","last_peered":"2024-08-09T00:40:27.877980+0000","last_clean":"2024-08-09T00:40:27.877980+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:40:27.877980+0000","last_undegraded":"2024-08-09T00:40:27.877980+0000","last_fullsized":"2024-08-09T00:40:27.877980+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'251","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.076928+0000","last_change":"2024-08-09T00:41:03.077035+0000","last_active":"2024-08-09T00:41:03.076928+0000","last_peered":"2024-08-09T00:41:03.076928+0000","last_clean":"2024-08-09T00:41:03.076928+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:41:03.076928+0000","last_undegraded":"2024-08-09T00:41:03.076928+0000","last_fullsized":"2024-08-09T00:41:03.076928+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.076723+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:34:28.543793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":20334,"num_write":1169,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.236924+0000","last_change":"2024-08-09T00:40:47.236992+0000","last_active":"2024-08-09T00:40:47.236924+0000","last_peered":"2024-08-09T00:40:47.236924+0000","last_clean":"2024-08-09T00:40:47.236924+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:40:47.236924+0000","last_undegraded":"2024-08-09T00:40:47.236924+0000","last_fullsized":"2024-08-09T00:40:47.236924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.236732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:54.921678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":486,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'252","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.640989+0000","last_change":"2024-08-08T23:28:30.788934+0000","last_active":"2024-08-09T00:40:30.640989+0000","last_peered":"2024-08-09T00:40:30.640989+0000","last_clean":"2024-08-09T00:40:30.640989+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:40:30.640989+0000","last_undegraded":"2024-08-09T00:40:30.640989+0000","last_fullsized":"2024-08-09T00:40:30.640989+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41629,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":626,"num_write":204,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.251368+0000","last_change":"2024-08-09T00:40:38.251420+0000","last_active":"2024-08-09T00:40:38.251368+0000","last_peered":"2024-08-09T00:40:38.251368+0000","last_clean":"2024-08-09T00:40:38.251368+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:40:38.251368+0000","last_undegraded":"2024-08-09T00:40:38.251368+0000","last_fullsized":"2024-08-09T00:40:38.251368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.251160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:52:01.992409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'103","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.716990+0000","last_change":"2024-08-09T00:40:44.717155+0000","last_active":"2024-08-09T00:40:44.716990+0000","last_peered":"2024-08-09T00:40:44.716990+0000","last_clean":"2024-08-09T00:40:44.716990+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:40:44.716990+0000","last_undegraded":"2024-08-09T00:40:44.716990+0000","last_fullsized":"2024-08-09T00:40:44.716990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.716722+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.554310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.882365+0000","last_change":"2024-08-08T23:28:26.760627+0000","last_active":"2024-08-09T00:40:27.882365+0000","last_peered":"2024-08-09T00:40:27.882365+0000","last_clean":"2024-08-09T00:40:27.882365+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:40:27.882365+0000","last_undegraded":"2024-08-09T00:40:27.882365+0000","last_fullsized":"2024-08-09T00:40:27.882365+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'169","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.205826+0000","last_change":"2024-08-09T00:40:52.205935+0000","last_active":"2024-08-09T00:40:52.205826+0000","last_peered":"2024-08-09T00:40:52.205826+0000","last_clean":"2024-08-09T00:40:52.205826+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:40:52.205826+0000","last_undegraded":"2024-08-09T00:40:52.205826+0000","last_fullsized":"2024-08-09T00:40:52.205826+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'169","last_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_deep_scrub":"268'169","last_deep_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.205600+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:53.896377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055036,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":365,"num_read_kb":5320,"num_write":980,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.203522+0000","last_change":"2024-08-09T00:40:45.203576+0000","last_active":"2024-08-09T00:40:45.203522+0000","last_peered":"2024-08-09T00:40:45.203522+0000","last_clean":"2024-08-09T00:40:45.203522+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:40:45.203522+0000","last_undegraded":"2024-08-09T00:40:45.203522+0000","last_fullsized":"2024-08-09T00:40:45.203522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.203322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:04:32.071267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'181","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.169556+0000","last_change":"2024-08-09T00:41:06.169635+0000","last_active":"2024-08-09T00:41:06.169556+0000","last_peered":"2024-08-09T00:41:06.169556+0000","last_clean":"2024-08-09T00:41:06.169556+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:41:06.169556+0000","last_undegraded":"2024-08-09T00:41:06.169556+0000","last_fullsized":"2024-08-09T00:41:06.169556+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.169361+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:46.582796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8780,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":256,"num_read_kb":313,"num_write":192,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15128,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.587144+0000","last_change":"2024-08-09T00:40:54.587207+0000","last_active":"2024-08-09T00:40:54.587144+0000","last_peered":"2024-08-09T00:40:54.587144+0000","last_clean":"2024-08-09T00:40:54.587144+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:40:54.587144+0000","last_undegraded":"2024-08-09T00:40:54.587144+0000","last_fullsized":"2024-08-09T00:40:54.587144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:32.403866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'138","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.387779+0000","last_change":"2024-08-09T00:40:45.387779+0000","last_active":"2024-08-09T00:40:45.387779+0000","last_peered":"2024-08-09T00:40:45.387779+0000","last_clean":"2024-08-09T00:40:45.387779+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:40:45.387779+0000","last_undegraded":"2024-08-09T00:40:45.387779+0000","last_fullsized":"2024-08-09T00:40:45.387779+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.387511+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:18.812396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'186","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.998987+0000","last_change":"2024-08-09T00:40:58.999056+0000","last_active":"2024-08-09T00:40:58.998987+0000","last_peered":"2024-08-09T00:40:58.998987+0000","last_clean":"2024-08-09T00:40:58.998987+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:40:58.998987+0000","last_undegraded":"2024-08-09T00:40:58.998987+0000","last_fullsized":"2024-08-09T00:40:58.998987+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'186","last_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_deep_scrub":"268'186","last_deep_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.998783+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:06:38.911931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'205","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.221223+0000","last_change":"2024-08-09T00:41:00.221455+0000","last_active":"2024-08-09T00:41:00.221223+0000","last_peered":"2024-08-09T00:41:00.221223+0000","last_clean":"2024-08-09T00:41:00.221223+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:41:00.221223+0000","last_undegraded":"2024-08-09T00:41:00.221223+0000","last_fullsized":"2024-08-09T00:41:00.221223+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.220981+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:00.213193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":34331,"num_write":1087,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.794304+0000","last_change":"2024-08-09T00:40:49.794358+0000","last_active":"2024-08-09T00:40:49.794304+0000","last_peered":"2024-08-09T00:40:49.794304+0000","last_clean":"2024-08-09T00:40:49.794304+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:40:49.794304+0000","last_undegraded":"2024-08-09T00:40:49.794304+0000","last_fullsized":"2024-08-09T00:40:49.794304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.794107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:44.283341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'204","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.244661+0000","last_change":"2024-08-09T00:40:41.244661+0000","last_active":"2024-08-09T00:40:41.244661+0000","last_peered":"2024-08-09T00:40:41.244661+0000","last_clean":"2024-08-09T00:40:41.244661+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:40:41.244661+0000","last_undegraded":"2024-08-09T00:40:41.244661+0000","last_fullsized":"2024-08-09T00:40:41.244661+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'204","last_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_deep_scrub":"268'204","last_deep_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.244364+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:23.051092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14461,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":384,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'493","reported_seq":2267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.206039+0000","last_change":"2024-08-09T00:40:39.206104+0000","last_active":"2024-08-09T00:40:39.206039+0000","last_peered":"2024-08-09T00:40:39.206039+0000","last_clean":"2024-08-09T00:40:39.206039+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:40:39.206039+0000","last_undegraded":"2024-08-09T00:40:39.206039+0000","last_fullsized":"2024-08-09T00:40:39.206039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'493","last_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_deep_scrub":"268'493","last_deep_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.205835+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:20:27.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'124","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.732586+0000","last_change":"2024-08-09T00:40:43.732680+0000","last_active":"2024-08-09T00:40:43.732586+0000","last_peered":"2024-08-09T00:40:43.732586+0000","last_clean":"2024-08-09T00:40:43.732586+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:40:43.732586+0000","last_undegraded":"2024-08-09T00:40:43.732586+0000","last_fullsized":"2024-08-09T00:40:43.732586+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.732377+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:57.582089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.989260+0000","last_change":"2024-08-09T00:40:53.989319+0000","last_active":"2024-08-09T00:40:53.989260+0000","last_peered":"2024-08-09T00:40:53.989260+0000","last_clean":"2024-08-09T00:40:53.989260+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:40:53.989260+0000","last_undegraded":"2024-08-09T00:40:53.989260+0000","last_fullsized":"2024-08-09T00:40:53.989260+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'197","last_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_deep_scrub":"268'197","last_deep_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.989031+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:30.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'205","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.230060+0000","last_change":"2024-08-09T00:41:09.230142+0000","last_active":"2024-08-09T00:41:09.230060+0000","last_peered":"2024-08-09T00:41:09.230060+0000","last_clean":"2024-08-09T00:41:09.230060+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:41:09.230060+0000","last_undegraded":"2024-08-09T00:41:09.230060+0000","last_fullsized":"2024-08-09T00:41:09.230060+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.229867+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:53:34.348554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":23703,"num_write":1091,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.137127+0000","last_change":"2024-08-08T23:28:28.776671+0000","last_active":"2024-08-09T00:40:36.137127+0000","last_peered":"2024-08-09T00:40:36.137127+0000","last_clean":"2024-08-09T00:40:36.137127+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:40:36.137127+0000","last_undegraded":"2024-08-09T00:40:36.137127+0000","last_fullsized":"2024-08-09T00:40:36.137127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":638,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'110","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.302700+0000","last_change":"2024-08-09T00:41:00.302779+0000","last_active":"2024-08-09T00:41:00.302700+0000","last_peered":"2024-08-09T00:41:00.302700+0000","last_clean":"2024-08-09T00:41:00.302700+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:41:00.302700+0000","last_undegraded":"2024-08-09T00:41:00.302700+0000","last_fullsized":"2024-08-09T00:41:00.302700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.302528+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:36.655301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'500","reported_seq":2270,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.915039+0000","last_change":"2024-08-09T00:40:41.915107+0000","last_active":"2024-08-09T00:40:41.915039+0000","last_peered":"2024-08-09T00:40:41.915039+0000","last_clean":"2024-08-09T00:40:41.915039+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:40:41.915039+0000","last_undegraded":"2024-08-09T00:40:41.915039+0000","last_fullsized":"2024-08-09T00:40:41.915039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.914818+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:19.244826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.954086+0000","last_change":"2024-08-09T00:40:39.954144+0000","last_active":"2024-08-09T00:40:39.954086+0000","last_peered":"2024-08-09T00:40:39.954086+0000","last_clean":"2024-08-09T00:40:39.954086+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:40:39.954086+0000","last_undegraded":"2024-08-09T00:40:39.954086+0000","last_fullsized":"2024-08-09T00:40:39.954086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.953890+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:35:41.399127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'462","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.925537+0000","last_change":"2024-08-09T00:41:10.925665+0000","last_active":"2024-08-09T00:41:10.925537+0000","last_peered":"2024-08-09T00:41:10.925537+0000","last_clean":"2024-08-09T00:41:10.925537+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:41:10.925537+0000","last_undegraded":"2024-08-09T00:41:10.925537+0000","last_fullsized":"2024-08-09T00:41:10.925537+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.925280+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:54:19.284724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'181","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.528840+0000","last_change":"2024-08-08T23:28:24.793691+0000","last_active":"2024-08-09T00:40:30.528840+0000","last_peered":"2024-08-09T00:40:30.528840+0000","last_clean":"2024-08-09T00:40:30.528840+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:40:30.528840+0000","last_undegraded":"2024-08-09T00:40:30.528840+0000","last_fullsized":"2024-08-09T00:40:30.528840+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":4543,"num_write":1045,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.129849+0000","last_change":"2024-08-09T00:41:04.129954+0000","last_active":"2024-08-09T00:41:04.129849+0000","last_peered":"2024-08-09T00:41:04.129849+0000","last_clean":"2024-08-09T00:41:04.129849+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:41:04.129849+0000","last_undegraded":"2024-08-09T00:41:04.129849+0000","last_fullsized":"2024-08-09T00:41:04.129849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.129554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:45.978812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'311","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.290776+0000","last_change":"2024-08-09T00:40:50.290869+0000","last_active":"2024-08-09T00:40:50.290776+0000","last_peered":"2024-08-09T00:40:50.290776+0000","last_clean":"2024-08-09T00:40:50.290776+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:40:50.290776+0000","last_undegraded":"2024-08-09T00:40:50.290776+0000","last_fullsized":"2024-08-09T00:40:50.290776+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.290582+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:57.971956+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":996,"num_read_kb":1052,"num_write":1534,"num_write_kb":1360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455368,"num_omap_keys":1106,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.917979+0000","last_change":"2024-08-09T00:40:45.918031+0000","last_active":"2024-08-09T00:40:45.917979+0000","last_peered":"2024-08-09T00:40:45.917979+0000","last_clean":"2024-08-09T00:40:45.917979+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:40:45.917979+0000","last_undegraded":"2024-08-09T00:40:45.917979+0000","last_fullsized":"2024-08-09T00:40:45.917979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.917777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:46:24.483454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'106","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.933118+0000","last_change":"2024-08-09T00:41:11.933187+0000","last_active":"2024-08-09T00:41:11.933118+0000","last_peered":"2024-08-09T00:41:11.933118+0000","last_clean":"2024-08-09T00:41:11.933118+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:41:11.933118+0000","last_undegraded":"2024-08-09T00:41:11.933118+0000","last_fullsized":"2024-08-09T00:41:11.933118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.932938+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:03:35.742761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.933962+0000","last_change":"2024-08-09T00:40:50.934023+0000","last_active":"2024-08-09T00:40:50.933962+0000","last_peered":"2024-08-09T00:40:50.933962+0000","last_clean":"2024-08-09T00:40:50.933962+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:40:50.933962+0000","last_undegraded":"2024-08-09T00:40:50.933962+0000","last_fullsized":"2024-08-09T00:40:50.933962+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.933771+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:53:51.224009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'161","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:27.692047+0000","last_change":"2024-08-08T23:28:10.065738+0000","last_active":"2024-08-09T00:40:27.692047+0000","last_peered":"2024-08-09T00:40:27.692047+0000","last_clean":"2024-08-09T00:40:27.692047+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:40:27.692047+0000","last_undegraded":"2024-08-09T00:40:27.692047+0000","last_fullsized":"2024-08-09T00:40:27.692047+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:08.717706+0000","last_clean_scrub_stamp":"2024-08-08T23:28:08.717706+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.107390+0000","last_change":"2024-08-09T00:41:10.107390+0000","last_active":"2024-08-09T00:41:10.107390+0000","last_peered":"2024-08-09T00:41:10.107390+0000","last_clean":"2024-08-09T00:41:10.107390+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:41:10.107390+0000","last_undegraded":"2024-08-09T00:41:10.107390+0000","last_fullsized":"2024-08-09T00:41:10.107390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.107011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:17.872841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'173","reported_seq":815,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.617880+0000","last_change":"2024-08-08T23:28:24.807782+0000","last_active":"2024-08-09T00:40:30.617880+0000","last_peered":"2024-08-09T00:40:30.617880+0000","last_clean":"2024-08-09T00:40:30.617880+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:40:30.617880+0000","last_undegraded":"2024-08-09T00:40:30.617880+0000","last_fullsized":"2024-08-09T00:40:30.617880+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":19880,"num_write":949,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.569433+0000","last_change":"2024-08-09T00:41:06.569554+0000","last_active":"2024-08-09T00:41:06.569433+0000","last_peered":"2024-08-09T00:41:06.569433+0000","last_clean":"2024-08-09T00:41:06.569433+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:41:06.569433+0000","last_undegraded":"2024-08-09T00:41:06.569433+0000","last_fullsized":"2024-08-09T00:41:06.569433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.569203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:04.865756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'338","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276959+0000","last_change":"2024-08-09T00:40:49.277114+0000","last_active":"2024-08-09T00:40:49.276959+0000","last_peered":"2024-08-09T00:40:49.276959+0000","last_clean":"2024-08-09T00:40:49.276959+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:40:49.276959+0000","last_undegraded":"2024-08-09T00:40:49.276959+0000","last_fullsized":"2024-08-09T00:40:49.276959+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.276690+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:18:38.872577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":648,"num_read_kb":915,"num_write":594,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94900,"num_omap_keys":244,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.558455+0000","last_change":"2024-08-09T00:40:58.558566+0000","last_active":"2024-08-09T00:40:58.558455+0000","last_peered":"2024-08-09T00:40:58.558455+0000","last_clean":"2024-08-09T00:40:58.558455+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:40:58.558455+0000","last_undegraded":"2024-08-09T00:40:58.558455+0000","last_fullsized":"2024-08-09T00:40:58.558455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.558180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:29.719057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'208","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.967571+0000","last_change":"2024-08-09T00:40:51.967654+0000","last_active":"2024-08-09T00:40:51.967571+0000","last_peered":"2024-08-09T00:40:51.967571+0000","last_clean":"2024-08-09T00:40:51.967571+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:40:51.967571+0000","last_undegraded":"2024-08-09T00:40:51.967571+0000","last_fullsized":"2024-08-09T00:40:51.967571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.967362+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:19:16.020869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'189","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.502099+0000","last_change":"2024-08-09T00:41:07.502233+0000","last_active":"2024-08-09T00:41:07.502099+0000","last_peered":"2024-08-09T00:41:07.502099+0000","last_clean":"2024-08-09T00:41:07.502099+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:41:07.502099+0000","last_undegraded":"2024-08-09T00:41:07.502099+0000","last_fullsized":"2024-08-09T00:41:07.502099+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.501849+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:58.986880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.693251+0000","last_change":"2024-08-08T23:28:17.334495+0000","last_active":"2024-08-09T00:40:32.693251+0000","last_peered":"2024-08-09T00:40:32.693251+0000","last_clean":"2024-08-09T00:40:32.693251+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:40:32.693251+0000","last_undegraded":"2024-08-09T00:40:32.693251+0000","last_fullsized":"2024-08-09T00:40:32.693251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'203","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587945+0000","last_change":"2024-08-08T23:28:24.766365+0000","last_active":"2024-08-09T00:40:30.587945+0000","last_peered":"2024-08-09T00:40:30.587945+0000","last_clean":"2024-08-09T00:40:30.587945+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:40:30.587945+0000","last_undegraded":"2024-08-09T00:40:30.587945+0000","last_fullsized":"2024-08-09T00:40:30.587945+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":17063,"num_write":1110,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.082039+0000","last_change":"2024-08-09T00:41:06.082096+0000","last_active":"2024-08-09T00:41:06.082039+0000","last_peered":"2024-08-09T00:41:06.082039+0000","last_clean":"2024-08-09T00:41:06.082039+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:41:06.082039+0000","last_undegraded":"2024-08-09T00:41:06.082039+0000","last_fullsized":"2024-08-09T00:41:06.082039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.081818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:57:09.834674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'701","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.822170+0000","last_change":"2024-08-09T00:40:51.822263+0000","last_active":"2024-08-09T00:40:51.822170+0000","last_peered":"2024-08-09T00:40:51.822170+0000","last_clean":"2024-08-09T00:40:51.822170+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:40:51.822170+0000","last_undegraded":"2024-08-09T00:40:51.822170+0000","last_fullsized":"2024-08-09T00:40:51.822170+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'701","last_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_deep_scrub":"268'701","last_deep_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.821968+0000","objects_scrubbed":12,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:09.857257+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33400,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1006,"num_read_kb":1225,"num_write":322,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5370,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.634974+0000","last_change":"2024-08-09T00:40:58.635028+0000","last_active":"2024-08-09T00:40:58.634974+0000","last_peered":"2024-08-09T00:40:58.634974+0000","last_clean":"2024-08-09T00:40:58.634974+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:40:58.634974+0000","last_undegraded":"2024-08-09T00:40:58.634974+0000","last_fullsized":"2024-08-09T00:40:58.634974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.634757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:48:18.077124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'131","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.756535+0000","last_change":"2024-08-09T00:40:46.756610+0000","last_active":"2024-08-09T00:40:46.756535+0000","last_peered":"2024-08-09T00:40:46.756535+0000","last_clean":"2024-08-09T00:40:46.756535+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:40:46.756535+0000","last_undegraded":"2024-08-09T00:40:46.756535+0000","last_fullsized":"2024-08-09T00:40:46.756535+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.756345+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:00:48.329420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.844729+0000","last_change":"2024-08-09T00:40:54.844797+0000","last_active":"2024-08-09T00:40:54.844729+0000","last_peered":"2024-08-09T00:40:54.844729+0000","last_clean":"2024-08-09T00:40:54.844729+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:40:54.844729+0000","last_undegraded":"2024-08-09T00:40:54.844729+0000","last_fullsized":"2024-08-09T00:40:54.844729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.844530+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:53.737686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.162874+0000","last_change":"2024-08-09T00:40:54.162874+0000","last_active":"2024-08-09T00:40:54.162874+0000","last_peered":"2024-08-09T00:40:54.162874+0000","last_clean":"2024-08-09T00:40:54.162874+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:40:54.162874+0000","last_undegraded":"2024-08-09T00:40:54.162874+0000","last_fullsized":"2024-08-09T00:40:54.162874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.162620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:55:31.612873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'159","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.859274+0000","last_change":"2024-08-09T00:41:05.859381+0000","last_active":"2024-08-09T00:41:05.859274+0000","last_peered":"2024-08-09T00:41:05.859274+0000","last_clean":"2024-08-09T00:41:05.859274+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:41:05.859274+0000","last_undegraded":"2024-08-09T00:41:05.859274+0000","last_fullsized":"2024-08-09T00:41:05.859274+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.859043+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:19:18.467769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5883424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":29266,"num_write":862,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.201294+0000","last_change":"2024-08-09T00:40:49.201356+0000","last_active":"2024-08-09T00:40:49.201294+0000","last_peered":"2024-08-09T00:40:49.201294+0000","last_clean":"2024-08-09T00:40:49.201294+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:40:49.201294+0000","last_undegraded":"2024-08-09T00:40:49.201294+0000","last_fullsized":"2024-08-09T00:40:49.201294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.201098+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:48.803444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.636970+0000","last_change":"2024-08-09T00:41:01.637052+0000","last_active":"2024-08-09T00:41:01.636970+0000","last_peered":"2024-08-09T00:41:01.636970+0000","last_clean":"2024-08-09T00:41:01.636970+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:41:01.636970+0000","last_undegraded":"2024-08-09T00:41:01.636970+0000","last_fullsized":"2024-08-09T00:41:01.636970+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.636779+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:15.604735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5136,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.615342+0000","last_change":"2024-08-09T00:40:53.615396+0000","last_active":"2024-08-09T00:40:53.615342+0000","last_peered":"2024-08-09T00:40:53.615342+0000","last_clean":"2024-08-09T00:40:53.615342+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:40:53.615342+0000","last_undegraded":"2024-08-09T00:40:53.615342+0000","last_fullsized":"2024-08-09T00:40:53.615342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.615125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:52.741451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'279","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.246939+0000","last_change":"2024-08-09T00:40:48.247034+0000","last_active":"2024-08-09T00:40:48.246939+0000","last_peered":"2024-08-09T00:40:48.246939+0000","last_clean":"2024-08-09T00:40:48.246939+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:40:48.246939+0000","last_undegraded":"2024-08-09T00:40:48.246939+0000","last_fullsized":"2024-08-09T00:40:48.246939+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.246734+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:27.053825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.784152+0000","last_change":"2024-08-09T00:41:02.784216+0000","last_active":"2024-08-09T00:41:02.784152+0000","last_peered":"2024-08-09T00:41:02.784152+0000","last_clean":"2024-08-09T00:41:02.784152+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:41:02.784152+0000","last_undegraded":"2024-08-09T00:41:02.784152+0000","last_fullsized":"2024-08-09T00:41:02.784152+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.783953+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:19.727649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.152649+0000","last_change":"2024-08-09T00:41:11.152649+0000","last_active":"2024-08-09T00:41:11.152649+0000","last_peered":"2024-08-09T00:41:11.152649+0000","last_clean":"2024-08-09T00:41:11.152649+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:41:11.152649+0000","last_undegraded":"2024-08-09T00:41:11.152649+0000","last_fullsized":"2024-08-09T00:41:11.152649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.152393+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:25:27.137706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'200","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.205662+0000","last_change":"2024-08-09T00:41:08.205756+0000","last_active":"2024-08-09T00:41:08.205662+0000","last_peered":"2024-08-09T00:41:08.205662+0000","last_clean":"2024-08-09T00:41:08.205662+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:41:08.205662+0000","last_undegraded":"2024-08-09T00:41:08.205662+0000","last_fullsized":"2024-08-09T00:41:08.205662+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.205439+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:55.271838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":7644,"num_write":1044,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.521739+0000","last_change":"2024-08-09T00:41:04.521794+0000","last_active":"2024-08-09T00:41:04.521739+0000","last_peered":"2024-08-09T00:41:04.521739+0000","last_clean":"2024-08-09T00:41:04.521739+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:41:04.521739+0000","last_undegraded":"2024-08-09T00:41:04.521739+0000","last_fullsized":"2024-08-09T00:41:04.521739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.521542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:51:09.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'155","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:02.698485+0000","last_change":"2024-08-08T23:28:30.792974+0000","last_active":"2024-08-09T00:40:02.698485+0000","last_peered":"2024-08-09T00:40:02.698485+0000","last_clean":"2024-08-09T00:40:02.698485+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:40:02.698485+0000","last_undegraded":"2024-08-09T00:40:02.698485+0000","last_fullsized":"2024-08-09T00:40:02.698485+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.890179+0000","last_change":"2024-08-09T00:40:49.890232+0000","last_active":"2024-08-09T00:40:49.890179+0000","last_peered":"2024-08-09T00:40:49.890179+0000","last_clean":"2024-08-09T00:40:49.890179+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:40:49.890179+0000","last_undegraded":"2024-08-09T00:40:49.890179+0000","last_fullsized":"2024-08-09T00:40:49.890179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.889984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:45.090932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'114","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.232361+0000","last_change":"2024-08-09T00:40:38.232557+0000","last_active":"2024-08-09T00:40:38.232361+0000","last_peered":"2024-08-09T00:40:38.232361+0000","last_clean":"2024-08-09T00:40:38.232361+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:40:38.232361+0000","last_undegraded":"2024-08-09T00:40:38.232361+0000","last_fullsized":"2024-08-09T00:40:38.232361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.232120+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:00.159201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'156","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.776641+0000","last_change":"2024-08-09T00:40:52.776705+0000","last_active":"2024-08-09T00:40:52.776641+0000","last_peered":"2024-08-09T00:40:52.776641+0000","last_clean":"2024-08-09T00:40:52.776641+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:40:52.776641+0000","last_undegraded":"2024-08-09T00:40:52.776641+0000","last_fullsized":"2024-08-09T00:40:52.776641+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.776448+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.985569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'228","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.339653+0000","last_change":"2024-08-08T23:28:24.789743+0000","last_active":"2024-08-09T00:40:30.339653+0000","last_peered":"2024-08-09T00:40:30.339653+0000","last_clean":"2024-08-09T00:40:30.339653+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:40:30.339653+0000","last_undegraded":"2024-08-09T00:40:30.339653+0000","last_fullsized":"2024-08-09T00:40:30.339653+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":62351,"num_write":1160,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":548,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.839872+0000","last_change":"2024-08-09T00:41:04.839872+0000","last_active":"2024-08-09T00:41:04.839872+0000","last_peered":"2024-08-09T00:41:04.839872+0000","last_clean":"2024-08-09T00:41:04.839872+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:41:04.839872+0000","last_undegraded":"2024-08-09T00:41:04.839872+0000","last_fullsized":"2024-08-09T00:41:04.839872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.839580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:08.753071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.493143+0000","last_change":"2024-08-09T00:41:06.493196+0000","last_active":"2024-08-09T00:41:06.493143+0000","last_peered":"2024-08-09T00:41:06.493143+0000","last_clean":"2024-08-09T00:41:06.493143+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:41:06.493143+0000","last_undegraded":"2024-08-09T00:41:06.493143+0000","last_fullsized":"2024-08-09T00:41:06.493143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.492951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:59:56.992035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'321","reported_seq":1036,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.453248+0000","last_change":"2024-08-09T00:41:12.453343+0000","last_active":"2024-08-09T00:41:12.453248+0000","last_peered":"2024-08-09T00:41:12.453248+0000","last_clean":"2024-08-09T00:41:12.453248+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:41:12.453248+0000","last_undegraded":"2024-08-09T00:41:12.453248+0000","last_fullsized":"2024-08-09T00:41:12.453248+0000","mapping_epoch":31,"log_start":"268'301","ondisk_log_start":"268'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.453049+0000","objects_scrubbed":11,"log_size":20,"log_dups_size":301,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:21.298253+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29428,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":629,"num_write":258,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3642,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.097242+0000","last_change":"2024-08-09T00:40:45.097347+0000","last_active":"2024-08-09T00:40:45.097242+0000","last_peered":"2024-08-09T00:40:45.097242+0000","last_clean":"2024-08-09T00:40:45.097242+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:40:45.097242+0000","last_undegraded":"2024-08-09T00:40:45.097242+0000","last_fullsized":"2024-08-09T00:40:45.097242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.097011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:27:33.586520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'120","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.618159+0000","last_change":"2024-08-09T00:40:46.618231+0000","last_active":"2024-08-09T00:40:46.618159+0000","last_peered":"2024-08-09T00:40:46.618159+0000","last_clean":"2024-08-09T00:40:46.618159+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:40:46.618159+0000","last_undegraded":"2024-08-09T00:40:46.618159+0000","last_fullsized":"2024-08-09T00:40:46.618159+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.617950+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.403990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'157","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.589748+0000","last_change":"2024-08-09T00:41:02.589812+0000","last_active":"2024-08-09T00:41:02.589748+0000","last_peered":"2024-08-09T00:41:02.589748+0000","last_clean":"2024-08-09T00:41:02.589748+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:41:02.589748+0000","last_undegraded":"2024-08-09T00:41:02.589748+0000","last_fullsized":"2024-08-09T00:41:02.589748+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.589518+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:51:33.421207+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7572,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'317","reported_seq":1119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.931000+0000","last_change":"2024-08-09T00:41:07.931087+0000","last_active":"2024-08-09T00:41:07.931000+0000","last_peered":"2024-08-09T00:41:07.931000+0000","last_clean":"2024-08-09T00:41:07.931000+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:41:07.931000+0000","last_undegraded":"2024-08-09T00:41:07.931000+0000","last_fullsized":"2024-08-09T00:41:07.931000+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.930771+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:13:51.581165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1025,"num_read_kb":185751,"num_write":1335,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.889721+0000","last_change":"2024-08-08T23:28:17.334366+0000","last_active":"2024-08-09T00:39:17.889721+0000","last_peered":"2024-08-09T00:39:17.889721+0000","last_clean":"2024-08-09T00:39:17.889721+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:39:17.889721+0000","last_undegraded":"2024-08-09T00:39:17.889721+0000","last_fullsized":"2024-08-09T00:39:17.889721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:13.753654+0000","last_clean_scrub_stamp":"2024-08-08T23:28:13.753654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.926833+0000","last_change":"2024-08-09T00:40:48.926892+0000","last_active":"2024-08-09T00:40:48.926833+0000","last_peered":"2024-08-09T00:40:48.926833+0000","last_clean":"2024-08-09T00:40:48.926833+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:40:48.926833+0000","last_undegraded":"2024-08-09T00:40:48.926833+0000","last_fullsized":"2024-08-09T00:40:48.926833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.926628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:36:47.294692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'230","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.892028+0000","last_change":"2024-08-09T00:40:55.892073+0000","last_active":"2024-08-09T00:40:55.892028+0000","last_peered":"2024-08-09T00:40:55.892028+0000","last_clean":"2024-08-09T00:40:55.892028+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:40:55.892028+0000","last_undegraded":"2024-08-09T00:40:55.892028+0000","last_fullsized":"2024-08-09T00:40:55.892028+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'230","last_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_deep_scrub":"268'230","last_deep_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.891948+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:05.302427+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3366,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'528","reported_seq":4411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.223881+0000","last_change":"2024-08-09T00:40:46.223881+0000","last_active":"2024-08-09T00:40:46.223881+0000","last_peered":"2024-08-09T00:40:46.223881+0000","last_clean":"2024-08-09T00:40:46.223881+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:40:46.223881+0000","last_undegraded":"2024-08-09T00:40:46.223881+0000","last_fullsized":"2024-08-09T00:40:46.223881+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'528","last_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_deep_scrub":"268'528","last_deep_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.223619+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:52.863127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'168","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276198+0000","last_change":"2024-08-09T00:40:49.276198+0000","last_active":"2024-08-09T00:40:49.276198+0000","last_peered":"2024-08-09T00:40:49.276198+0000","last_clean":"2024-08-09T00:40:49.276198+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:40:49.276198+0000","last_undegraded":"2024-08-09T00:40:49.276198+0000","last_fullsized":"2024-08-09T00:40:49.276198+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.275905+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:14.189142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.409983+0000","last_change":"2024-08-09T00:41:07.410041+0000","last_active":"2024-08-09T00:41:07.409983+0000","last_peered":"2024-08-09T00:41:07.409983+0000","last_clean":"2024-08-09T00:41:07.409983+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:41:07.409983+0000","last_undegraded":"2024-08-09T00:41:07.409983+0000","last_fullsized":"2024-08-09T00:41:07.409983+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.409796+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:27.775222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'273","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.648337+0000","last_change":"2024-08-08T23:28:24.806986+0000","last_active":"2024-08-09T00:40:30.648337+0000","last_peered":"2024-08-09T00:40:30.648337+0000","last_clean":"2024-08-09T00:40:30.648337+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:40:30.648337+0000","last_undegraded":"2024-08-09T00:40:30.648337+0000","last_fullsized":"2024-08-09T00:40:30.648337+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311694,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1095,"num_read_kb":6569,"num_write":1298,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.812643+0000","last_change":"2024-08-09T00:41:03.812701+0000","last_active":"2024-08-09T00:41:03.812643+0000","last_peered":"2024-08-09T00:41:03.812643+0000","last_clean":"2024-08-09T00:41:03.812643+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:41:03.812643+0000","last_undegraded":"2024-08-09T00:41:03.812643+0000","last_fullsized":"2024-08-09T00:41:03.812643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.812444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:52:09.482944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.037197+0000","last_change":"2024-08-09T00:40:58.037254+0000","last_active":"2024-08-09T00:40:58.037197+0000","last_peered":"2024-08-09T00:40:58.037197+0000","last_clean":"2024-08-09T00:40:58.037197+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:40:58.037197+0000","last_undegraded":"2024-08-09T00:40:58.037197+0000","last_fullsized":"2024-08-09T00:40:58.037197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.036981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:31.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'154","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.047156+0000","last_change":"2024-08-09T00:40:49.047234+0000","last_active":"2024-08-09T00:40:49.047156+0000","last_peered":"2024-08-09T00:40:49.047156+0000","last_clean":"2024-08-09T00:40:49.047156+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:40:49.047156+0000","last_undegraded":"2024-08-09T00:40:49.047156+0000","last_fullsized":"2024-08-09T00:40:49.047156+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.046957+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:48:46.019855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'525","reported_seq":2308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.360768+0000","last_change":"2024-08-09T00:40:56.360829+0000","last_active":"2024-08-09T00:40:56.360768+0000","last_peered":"2024-08-09T00:40:56.360768+0000","last_clean":"2024-08-09T00:40:56.360768+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:40:56.360768+0000","last_undegraded":"2024-08-09T00:40:56.360768+0000","last_fullsized":"2024-08-09T00:40:56.360768+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.360575+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:37:54.817387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'240","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.635026+0000","last_change":"2024-08-09T00:40:51.635097+0000","last_active":"2024-08-09T00:40:51.635026+0000","last_peered":"2024-08-09T00:40:51.635026+0000","last_clean":"2024-08-09T00:40:51.635026+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:40:51.635026+0000","last_undegraded":"2024-08-09T00:40:51.635026+0000","last_fullsized":"2024-08-09T00:40:51.635026+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.634826+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:56.897177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.024639+0000","last_change":"2024-08-09T00:40:57.024702+0000","last_active":"2024-08-09T00:40:57.024639+0000","last_peered":"2024-08-09T00:40:57.024639+0000","last_clean":"2024-08-09T00:40:57.024639+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:40:57.024639+0000","last_undegraded":"2024-08-09T00:40:57.024639+0000","last_fullsized":"2024-08-09T00:40:57.024639+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.024418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:23:31.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'219","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.222329+0000","last_change":"2024-08-09T00:40:48.222507+0000","last_active":"2024-08-09T00:40:48.222329+0000","last_peered":"2024-08-09T00:40:48.222329+0000","last_clean":"2024-08-09T00:40:48.222329+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:40:48.222329+0000","last_undegraded":"2024-08-09T00:40:48.222329+0000","last_fullsized":"2024-08-09T00:40:48.222329+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.222109+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:43.098443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37546,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":443,"num_read_kb":66311,"num_write":1073,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.171339+0000","last_change":"2024-08-09T00:40:58.171400+0000","last_active":"2024-08-09T00:40:58.171339+0000","last_peered":"2024-08-09T00:40:58.171339+0000","last_clean":"2024-08-09T00:40:58.171339+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:40:58.171339+0000","last_undegraded":"2024-08-09T00:40:58.171339+0000","last_fullsized":"2024-08-09T00:40:58.171339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.171154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:38.726495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"268'5","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.469324+0000","last_change":"2024-08-09T00:41:09.469388+0000","last_active":"2024-08-09T00:41:09.469324+0000","last_peered":"2024-08-09T00:41:09.469324+0000","last_clean":"2024-08-09T00:41:09.469324+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:41:09.469324+0000","last_undegraded":"2024-08-09T00:41:09.469324+0000","last_fullsized":"2024-08-09T00:41:09.469324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.469138+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:46.425806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":797,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'350","reported_seq":1100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.540583+0000","last_change":"2024-08-08T23:28:31.044348+0000","last_active":"2024-08-09T00:40:30.540583+0000","last_peered":"2024-08-09T00:40:30.540583+0000","last_clean":"2024-08-09T00:40:30.540583+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:40:30.540583+0000","last_undegraded":"2024-08-09T00:40:30.540583+0000","last_fullsized":"2024-08-09T00:40:30.540583+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24443,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":707,"num_write":276,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.353382+0000","last_change":"2024-08-09T00:40:57.353437+0000","last_active":"2024-08-09T00:40:57.353382+0000","last_peered":"2024-08-09T00:40:57.353382+0000","last_clean":"2024-08-09T00:40:57.353382+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:40:57.353382+0000","last_undegraded":"2024-08-09T00:40:57.353382+0000","last_fullsized":"2024-08-09T00:40:57.353382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.353192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:43.153069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'127","reported_seq":629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.236617+0000","last_change":"2024-08-09T00:40:42.236705+0000","last_active":"2024-08-09T00:40:42.236617+0000","last_peered":"2024-08-09T00:40:42.236617+0000","last_clean":"2024-08-09T00:40:42.236617+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:40:42.236617+0000","last_undegraded":"2024-08-09T00:40:42.236617+0000","last_fullsized":"2024-08-09T00:40:42.236617+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.236387+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:25:28.423291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.636251+0000","last_change":"2024-08-09T00:40:49.636334+0000","last_active":"2024-08-09T00:40:49.636251+0000","last_peered":"2024-08-09T00:40:49.636251+0000","last_clean":"2024-08-09T00:40:49.636251+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:40:49.636251+0000","last_undegraded":"2024-08-09T00:40:49.636251+0000","last_fullsized":"2024-08-09T00:40:49.636251+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.636047+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:31:23.809790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.009785+0000","last_change":"2024-08-09T00:40:55.009848+0000","last_active":"2024-08-09T00:40:55.009785+0000","last_peered":"2024-08-09T00:40:55.009785+0000","last_clean":"2024-08-09T00:40:55.009785+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:40:55.009785+0000","last_undegraded":"2024-08-09T00:40:55.009785+0000","last_fullsized":"2024-08-09T00:40:55.009785+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.009572+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:01.862198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'229","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.272699+0000","last_change":"2024-08-09T00:41:10.272825+0000","last_active":"2024-08-09T00:41:10.272699+0000","last_peered":"2024-08-09T00:41:10.272699+0000","last_clean":"2024-08-09T00:41:10.272699+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:41:10.272699+0000","last_undegraded":"2024-08-09T00:41:10.272699+0000","last_fullsized":"2024-08-09T00:41:10.272699+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'229","last_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_deep_scrub":"268'229","last_deep_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.272502+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:34:49.338640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":23490,"num_write":1170,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.838789+0000","last_change":"2024-08-09T00:40:50.838789+0000","last_active":"2024-08-09T00:40:50.838789+0000","last_peered":"2024-08-09T00:40:50.838789+0000","last_clean":"2024-08-09T00:40:50.838789+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:40:50.838789+0000","last_undegraded":"2024-08-09T00:40:50.838789+0000","last_fullsized":"2024-08-09T00:40:50.838789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.838517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:22:43.037726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'165","reported_seq":778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210114+0000","last_change":"2024-08-08T23:28:30.793314+0000","last_active":"2024-08-09T00:40:35.210114+0000","last_peered":"2024-08-09T00:40:35.210114+0000","last_clean":"2024-08-09T00:40:35.210114+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:40:35.210114+0000","last_undegraded":"2024-08-09T00:40:35.210114+0000","last_fullsized":"2024-08-09T00:40:35.210114+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":265,"num_write":116,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.311465+0000","last_change":"2024-08-09T00:40:54.311516+0000","last_active":"2024-08-09T00:40:54.311465+0000","last_peered":"2024-08-09T00:40:54.311465+0000","last_clean":"2024-08-09T00:40:54.311465+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:40:54.311465+0000","last_undegraded":"2024-08-09T00:40:54.311465+0000","last_fullsized":"2024-08-09T00:40:54.311465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.311271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:13:18.035747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'118","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.310577+0000","last_change":"2024-08-09T00:40:52.310577+0000","last_active":"2024-08-09T00:40:52.310577+0000","last_peered":"2024-08-09T00:40:52.310577+0000","last_clean":"2024-08-09T00:40:52.310577+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:40:52.310577+0000","last_undegraded":"2024-08-09T00:40:52.310577+0000","last_fullsized":"2024-08-09T00:40:52.310577+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.310328+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:58:03.731104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.900163+0000","last_change":"2024-08-09T00:40:56.900283+0000","last_active":"2024-08-09T00:40:56.900163+0000","last_peered":"2024-08-09T00:40:56.900163+0000","last_clean":"2024-08-09T00:40:56.900163+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:40:56.900163+0000","last_undegraded":"2024-08-09T00:40:56.900163+0000","last_fullsized":"2024-08-09T00:40:56.900163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.899845+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:06.513441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'183","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067036+0000","last_change":"2024-08-08T23:28:24.807407+0000","last_active":"2024-08-09T00:40:37.067036+0000","last_peered":"2024-08-09T00:40:37.067036+0000","last_clean":"2024-08-09T00:40:37.067036+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:40:37.067036+0000","last_undegraded":"2024-08-09T00:40:37.067036+0000","last_fullsized":"2024-08-09T00:40:37.067036+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661190,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":16787,"num_write":983,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210018+0000","last_change":"2024-08-08T23:28:28.775072+0000","last_active":"2024-08-09T00:40:35.210018+0000","last_peered":"2024-08-09T00:40:35.210018+0000","last_clean":"2024-08-09T00:40:35.210018+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:40:35.210018+0000","last_undegraded":"2024-08-09T00:40:35.210018+0000","last_fullsized":"2024-08-09T00:40:35.210018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:27.735445+0000","last_clean_scrub_stamp":"2024-08-08T23:28:27.735445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'57","reported_seq":585,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.502540+0000","last_change":"2024-08-09T00:41:10.502610+0000","last_active":"2024-08-09T00:41:10.502540+0000","last_peered":"2024-08-09T00:41:10.502540+0000","last_clean":"2024-08-09T00:41:10.502540+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:41:10.502540+0000","last_undegraded":"2024-08-09T00:41:10.502540+0000","last_fullsized":"2024-08-09T00:41:10.502540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'57","last_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_deep_scrub":"268'57","last_deep_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.502327+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:08:11.822426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.648110+0000","last_change":"2024-08-09T00:40:57.648162+0000","last_active":"2024-08-09T00:40:57.648110+0000","last_peered":"2024-08-09T00:40:57.648110+0000","last_clean":"2024-08-09T00:40:57.648110+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:40:57.648110+0000","last_undegraded":"2024-08-09T00:40:57.648110+0000","last_fullsized":"2024-08-09T00:40:57.648110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.647902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:11.434378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'189","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.596320+0000","last_change":"2024-08-09T00:40:45.596320+0000","last_active":"2024-08-09T00:40:45.596320+0000","last_peered":"2024-08-09T00:40:45.596320+0000","last_clean":"2024-08-09T00:40:45.596320+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:40:45.596320+0000","last_undegraded":"2024-08-09T00:40:45.596320+0000","last_fullsized":"2024-08-09T00:40:45.596320+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.595931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:42:19.396170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.418868+0000","last_change":"2024-08-09T00:41:06.418930+0000","last_active":"2024-08-09T00:41:06.418868+0000","last_peered":"2024-08-09T00:41:06.418868+0000","last_clean":"2024-08-09T00:41:06.418868+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:41:06.418868+0000","last_undegraded":"2024-08-09T00:41:06.418868+0000","last_fullsized":"2024-08-09T00:41:06.418868+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.418680+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:29.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'202","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.136190+0000","last_change":"2024-08-08T23:28:24.813548+0000","last_active":"2024-08-09T00:40:36.136190+0000","last_peered":"2024-08-09T00:40:36.136190+0000","last_clean":"2024-08-09T00:40:36.136190+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:40:36.136190+0000","last_undegraded":"2024-08-09T00:40:36.136190+0000","last_fullsized":"2024-08-09T00:40:36.136190+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110897,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":499,"num_read_kb":9686,"num_write":1123,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.661101+0000","last_change":"2024-08-09T00:41:02.661162+0000","last_active":"2024-08-09T00:41:02.661101+0000","last_peered":"2024-08-09T00:41:02.661101+0000","last_clean":"2024-08-09T00:41:02.661101+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:41:02.661101+0000","last_undegraded":"2024-08-09T00:41:02.661101+0000","last_fullsized":"2024-08-09T00:41:02.661101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.660881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:10.460272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.352259+0000","last_change":"2024-08-09T00:41:02.352342+0000","last_active":"2024-08-09T00:41:02.352259+0000","last_peered":"2024-08-09T00:41:02.352259+0000","last_clean":"2024-08-09T00:41:02.352259+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:41:02.352259+0000","last_undegraded":"2024-08-09T00:41:02.352259+0000","last_fullsized":"2024-08-09T00:41:02.352259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.352069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:47.940433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":367,"num_write":158,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.887230+0000","last_change":"2024-08-09T00:40:47.887323+0000","last_active":"2024-08-09T00:40:47.887230+0000","last_peered":"2024-08-09T00:40:47.887230+0000","last_clean":"2024-08-09T00:40:47.887230+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:40:47.887230+0000","last_undegraded":"2024-08-09T00:40:47.887230+0000","last_fullsized":"2024-08-09T00:40:47.887230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.886949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:37.660989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'115","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.262602+0000","last_change":"2024-08-09T00:40:41.262602+0000","last_active":"2024-08-09T00:40:41.262602+0000","last_peered":"2024-08-09T00:40:41.262602+0000","last_clean":"2024-08-09T00:40:41.262602+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:40:41.262602+0000","last_undegraded":"2024-08-09T00:40:41.262602+0000","last_fullsized":"2024-08-09T00:40:41.262602+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.262339+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:46:01.693522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'371","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209931+0000","last_change":"2024-08-08T23:28:26.753207+0000","last_active":"2024-08-09T00:40:35.209931+0000","last_peered":"2024-08-09T00:40:35.209931+0000","last_clean":"2024-08-09T00:40:35.209931+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:40:35.209931+0000","last_undegraded":"2024-08-09T00:40:35.209931+0000","last_fullsized":"2024-08-09T00:40:35.209931+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'167","reported_seq":767,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821037+0000","last_change":"2024-08-08T23:28:24.808426+0000","last_active":"2024-08-09T00:40:33.821037+0000","last_peered":"2024-08-09T00:40:33.821037+0000","last_clean":"2024-08-09T00:40:33.821037+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:40:33.821037+0000","last_undegraded":"2024-08-09T00:40:33.821037+0000","last_fullsized":"2024-08-09T00:40:33.821037+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":317,"num_read_kb":1399,"num_write":881,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.890394+0000","last_change":"2024-08-09T00:40:44.890394+0000","last_active":"2024-08-09T00:40:44.890394+0000","last_peered":"2024-08-09T00:40:44.890394+0000","last_clean":"2024-08-09T00:40:44.890394+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:40:44.890394+0000","last_undegraded":"2024-08-09T00:40:44.890394+0000","last_fullsized":"2024-08-09T00:40:44.890394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.890149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:41.092600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'141","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.646816+0000","last_change":"2024-08-09T00:41:12.646898+0000","last_active":"2024-08-09T00:41:12.646816+0000","last_peered":"2024-08-09T00:41:12.646816+0000","last_clean":"2024-08-09T00:41:12.646816+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:41:12.646816+0000","last_undegraded":"2024-08-09T00:41:12.646816+0000","last_fullsized":"2024-08-09T00:41:12.646816+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.646589+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:37:54.847960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":239,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.614977+0000","last_change":"2024-08-09T00:40:55.615035+0000","last_active":"2024-08-09T00:40:55.614977+0000","last_peered":"2024-08-09T00:40:55.614977+0000","last_clean":"2024-08-09T00:40:55.614977+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:40:55.614977+0000","last_undegraded":"2024-08-09T00:40:55.614977+0000","last_fullsized":"2024-08-09T00:40:55.614977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.614759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:17.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.009702+0000","last_change":"2024-08-09T00:40:53.009760+0000","last_active":"2024-08-09T00:40:53.009702+0000","last_peered":"2024-08-09T00:40:53.009702+0000","last_clean":"2024-08-09T00:40:53.009702+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:40:53.009702+0000","last_undegraded":"2024-08-09T00:40:53.009702+0000","last_fullsized":"2024-08-09T00:40:53.009702+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.009497+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:39.267801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'160","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209738+0000","last_change":"2024-08-08T23:28:24.774093+0000","last_active":"2024-08-09T00:40:35.209738+0000","last_peered":"2024-08-09T00:40:35.209738+0000","last_clean":"2024-08-09T00:40:35.209738+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:40:35.209738+0000","last_undegraded":"2024-08-09T00:40:35.209738+0000","last_fullsized":"2024-08-09T00:40:35.209738+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540766,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":18716,"num_write":872,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.503559+0000","last_change":"2024-08-09T00:41:08.503665+0000","last_active":"2024-08-09T00:41:08.503559+0000","last_peered":"2024-08-09T00:41:08.503559+0000","last_clean":"2024-08-09T00:41:08.503559+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:41:08.503559+0000","last_undegraded":"2024-08-09T00:41:08.503559+0000","last_fullsized":"2024-08-09T00:41:08.503559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.503276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.754186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'227","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.827005+0000","last_change":"2024-08-09T00:40:53.827005+0000","last_active":"2024-08-09T00:40:53.827005+0000","last_peered":"2024-08-09T00:40:53.827005+0000","last_clean":"2024-08-09T00:40:53.827005+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:40:53.827005+0000","last_undegraded":"2024-08-09T00:40:53.827005+0000","last_fullsized":"2024-08-09T00:40:53.827005+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.826785+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:20:32.238202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17674,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":513,"num_write":222,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22936,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.257255+0000","last_change":"2024-08-09T00:40:45.257255+0000","last_active":"2024-08-09T00:40:45.257255+0000","last_peered":"2024-08-09T00:40:45.257255+0000","last_clean":"2024-08-09T00:40:45.257255+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:40:45.257255+0000","last_undegraded":"2024-08-09T00:40:45.257255+0000","last_fullsized":"2024-08-09T00:40:45.257255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.256887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.726347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'166","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.339701+0000","last_change":"2024-08-09T00:40:46.339701+0000","last_active":"2024-08-09T00:40:46.339701+0000","last_peered":"2024-08-09T00:40:46.339701+0000","last_clean":"2024-08-09T00:40:46.339701+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:40:46.339701+0000","last_undegraded":"2024-08-09T00:40:46.339701+0000","last_fullsized":"2024-08-09T00:40:46.339701+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.339303+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:17.653047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.565127+0000","last_change":"2024-08-09T00:41:03.565307+0000","last_active":"2024-08-09T00:41:03.565127+0000","last_peered":"2024-08-09T00:41:03.565127+0000","last_clean":"2024-08-09T00:41:03.565127+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:41:03.565127+0000","last_undegraded":"2024-08-09T00:41:03.565127+0000","last_fullsized":"2024-08-09T00:41:03.565127+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.564859+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:40:42.536359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'284","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.725010+0000","last_change":"2024-08-09T00:40:40.725010+0000","last_active":"2024-08-09T00:40:40.725010+0000","last_peered":"2024-08-09T00:40:40.725010+0000","last_clean":"2024-08-09T00:40:40.725010+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:40:40.725010+0000","last_undegraded":"2024-08-09T00:40:40.725010+0000","last_fullsized":"2024-08-09T00:40:40.725010+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.724693+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:21.253956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":69125,"num_write":1347,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.890568+0000","last_change":"2024-08-09T00:40:46.890625+0000","last_active":"2024-08-09T00:40:46.890568+0000","last_peered":"2024-08-09T00:40:46.890568+0000","last_clean":"2024-08-09T00:40:46.890568+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:40:46.890568+0000","last_undegraded":"2024-08-09T00:40:46.890568+0000","last_fullsized":"2024-08-09T00:40:46.890568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.890298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:04:42.778225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'206","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.581112+0000","last_change":"2024-08-09T00:41:10.581199+0000","last_active":"2024-08-09T00:41:10.581112+0000","last_peered":"2024-08-09T00:41:10.581112+0000","last_clean":"2024-08-09T00:41:10.581112+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:41:10.581112+0000","last_undegraded":"2024-08-09T00:41:10.581112+0000","last_fullsized":"2024-08-09T00:41:10.581112+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.580894+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:00.947265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":267,"num_read_kb":315,"num_write":170,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10932,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.793837+0000","last_change":"2024-08-09T00:41:01.793837+0000","last_active":"2024-08-09T00:41:01.793837+0000","last_peered":"2024-08-09T00:41:01.793837+0000","last_clean":"2024-08-09T00:41:01.793837+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:41:01.793837+0000","last_undegraded":"2024-08-09T00:41:01.793837+0000","last_fullsized":"2024-08-09T00:41:01.793837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.793483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:08.479888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'188","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.120576+0000","last_change":"2024-08-09T00:40:56.120576+0000","last_active":"2024-08-09T00:40:56.120576+0000","last_peered":"2024-08-09T00:40:56.120576+0000","last_clean":"2024-08-09T00:40:56.120576+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:40:56.120576+0000","last_undegraded":"2024-08-09T00:40:56.120576+0000","last_fullsized":"2024-08-09T00:40:56.120576+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.120294+0000","objects_scrubbed":10,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:47.202816+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4117","reported_seq":4733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209915+0000","last_change":"2024-08-08T23:28:26.748196+0000","last_active":"2024-08-09T00:40:35.209915+0000","last_peered":"2024-08-09T00:40:35.209915+0000","last_clean":"2024-08-09T00:40:35.209915+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:40:35.209915+0000","last_undegraded":"2024-08-09T00:40:35.209915+0000","last_fullsized":"2024-08-09T00:40:35.209915+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":3000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'213","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.230094+0000","last_change":"2024-08-09T00:40:50.230251+0000","last_active":"2024-08-09T00:40:50.230094+0000","last_peered":"2024-08-09T00:40:50.230094+0000","last_clean":"2024-08-09T00:40:50.230094+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:40:50.230094+0000","last_undegraded":"2024-08-09T00:40:50.230094+0000","last_fullsized":"2024-08-09T00:40:50.230094+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.229893+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.519276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":59906,"num_write":1092,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.049221+0000","last_change":"2024-08-09T00:41:02.049221+0000","last_active":"2024-08-09T00:41:02.049221+0000","last_peered":"2024-08-09T00:41:02.049221+0000","last_clean":"2024-08-09T00:41:02.049221+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:41:02.049221+0000","last_undegraded":"2024-08-09T00:41:02.049221+0000","last_fullsized":"2024-08-09T00:41:02.049221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.048973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:40:26.776047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'175","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.309685+0000","last_change":"2024-08-09T00:41:01.309831+0000","last_active":"2024-08-09T00:41:01.309685+0000","last_peered":"2024-08-09T00:41:01.309685+0000","last_clean":"2024-08-09T00:41:01.309685+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:41:01.309685+0000","last_undegraded":"2024-08-09T00:41:01.309685+0000","last_fullsized":"2024-08-09T00:41:01.309685+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.309443+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:19.119093+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":299,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.854076+0000","last_change":"2024-08-09T00:40:57.854204+0000","last_active":"2024-08-09T00:40:57.854076+0000","last_peered":"2024-08-09T00:40:57.854076+0000","last_clean":"2024-08-09T00:40:57.854076+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:40:57.854076+0000","last_undegraded":"2024-08-09T00:40:57.854076+0000","last_fullsized":"2024-08-09T00:40:57.854076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.853840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:19:44.705587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'171","reported_seq":704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.231644+0000","last_change":"2024-08-09T00:40:39.231644+0000","last_active":"2024-08-09T00:40:39.231644+0000","last_peered":"2024-08-09T00:40:39.231644+0000","last_clean":"2024-08-09T00:40:39.231644+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:40:39.231644+0000","last_undegraded":"2024-08-09T00:40:39.231644+0000","last_fullsized":"2024-08-09T00:40:39.231644+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.231346+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:32:12.225013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.081101+0000","last_change":"2024-08-09T00:41:00.081164+0000","last_active":"2024-08-09T00:41:00.081101+0000","last_peered":"2024-08-09T00:41:00.081101+0000","last_clean":"2024-08-09T00:41:00.081101+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:41:00.081101+0000","last_undegraded":"2024-08-09T00:41:00.081101+0000","last_fullsized":"2024-08-09T00:41:00.081101+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.080907+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:25:56.975527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'174","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821291+0000","last_change":"2024-08-08T23:28:24.793246+0000","last_active":"2024-08-09T00:40:33.821291+0000","last_peered":"2024-08-09T00:40:33.821291+0000","last_clean":"2024-08-09T00:40:33.821291+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:40:33.821291+0000","last_undegraded":"2024-08-09T00:40:33.821291+0000","last_fullsized":"2024-08-09T00:40:33.821291+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":4608,"num_write":1010,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.781111+0000","last_change":"2024-08-09T00:40:47.781111+0000","last_active":"2024-08-09T00:40:47.781111+0000","last_peered":"2024-08-09T00:40:47.781111+0000","last_clean":"2024-08-09T00:40:47.781111+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:40:47.781111+0000","last_undegraded":"2024-08-09T00:40:47.781111+0000","last_fullsized":"2024-08-09T00:40:47.781111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.780862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:19.491613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'125","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.081649+0000","last_change":"2024-08-09T00:40:48.081744+0000","last_active":"2024-08-09T00:40:48.081649+0000","last_peered":"2024-08-09T00:40:48.081649+0000","last_clean":"2024-08-09T00:40:48.081649+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:40:48.081649+0000","last_undegraded":"2024-08-09T00:40:48.081649+0000","last_fullsized":"2024-08-09T00:40:48.081649+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.081431+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.399083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1648,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'500","reported_seq":2384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.928622+0000","last_change":"2024-08-09T00:40:43.928684+0000","last_active":"2024-08-09T00:40:43.928622+0000","last_peered":"2024-08-09T00:40:43.928622+0000","last_clean":"2024-08-09T00:40:43.928622+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:40:43.928622+0000","last_undegraded":"2024-08-09T00:40:43.928622+0000","last_fullsized":"2024-08-09T00:40:43.928622+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.928424+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:09:10.523694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.672780+0000","last_change":"2024-08-09T00:40:54.672780+0000","last_active":"2024-08-09T00:40:54.672780+0000","last_peered":"2024-08-09T00:40:54.672780+0000","last_clean":"2024-08-09T00:40:54.672780+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:40:54.672780+0000","last_undegraded":"2024-08-09T00:40:54.672780+0000","last_fullsized":"2024-08-09T00:40:54.672780+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.672506+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:21:26.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.683214+0000","last_change":"2024-08-08T23:28:26.759596+0000","last_active":"2024-08-09T00:40:35.683214+0000","last_peered":"2024-08-09T00:40:35.683214+0000","last_clean":"2024-08-09T00:40:35.683214+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:40:35.683214+0000","last_undegraded":"2024-08-09T00:40:35.683214+0000","last_fullsized":"2024-08-09T00:40:35.683214+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'193","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.140413+0000","last_change":"2024-08-09T00:40:59.140519+0000","last_active":"2024-08-09T00:40:59.140413+0000","last_peered":"2024-08-09T00:40:59.140413+0000","last_clean":"2024-08-09T00:40:59.140413+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:40:59.140413+0000","last_undegraded":"2024-08-09T00:40:59.140413+0000","last_fullsized":"2024-08-09T00:40:59.140413+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.140216+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:09:17.562745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755945,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":50563,"num_write":1098,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.518613+0000","last_change":"2024-08-09T00:41:08.518669+0000","last_active":"2024-08-09T00:41:08.518613+0000","last_peered":"2024-08-09T00:41:08.518613+0000","last_clean":"2024-08-09T00:41:08.518613+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:41:08.518613+0000","last_undegraded":"2024-08-09T00:41:08.518613+0000","last_fullsized":"2024-08-09T00:41:08.518613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.518412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:26.350798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'253","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.298426+0000","last_change":"2024-08-09T00:40:51.298522+0000","last_active":"2024-08-09T00:40:51.298426+0000","last_peered":"2024-08-09T00:40:51.298426+0000","last_clean":"2024-08-09T00:40:51.298426+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:40:51.298426+0000","last_undegraded":"2024-08-09T00:40:51.298426+0000","last_fullsized":"2024-08-09T00:40:51.298426+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.298232+0000","objects_scrubbed":11,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:39.882351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10001,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":440,"num_write":200,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.608126+0000","last_change":"2024-08-09T00:41:01.608126+0000","last_active":"2024-08-09T00:41:01.608126+0000","last_peered":"2024-08-09T00:41:01.608126+0000","last_clean":"2024-08-09T00:41:01.608126+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:41:01.608126+0000","last_undegraded":"2024-08-09T00:41:01.608126+0000","last_fullsized":"2024-08-09T00:41:01.608126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.607865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:12:52.168443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'122","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.594729+0000","last_change":"2024-08-09T00:40:51.594729+0000","last_active":"2024-08-09T00:40:51.594729+0000","last_peered":"2024-08-09T00:40:51.594729+0000","last_clean":"2024-08-09T00:40:51.594729+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:40:51.594729+0000","last_undegraded":"2024-08-09T00:40:51.594729+0000","last_fullsized":"2024-08-09T00:40:51.594729+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.594473+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:11.845593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.242586+0000","last_change":"2024-08-09T00:41:11.242704+0000","last_active":"2024-08-09T00:41:11.242586+0000","last_peered":"2024-08-09T00:41:11.242586+0000","last_clean":"2024-08-09T00:41:11.242586+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:41:11.242586+0000","last_undegraded":"2024-08-09T00:41:11.242586+0000","last_fullsized":"2024-08-09T00:41:11.242586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.242344+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:24.429124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'198","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.069128+0000","last_change":"2024-08-09T00:41:05.069265+0000","last_active":"2024-08-09T00:41:05.069128+0000","last_peered":"2024-08-09T00:41:05.069128+0000","last_clean":"2024-08-09T00:41:05.069128+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:41:05.069128+0000","last_undegraded":"2024-08-09T00:41:05.069128+0000","last_fullsized":"2024-08-09T00:41:05.069128+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.068927+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:34:56.248742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":62745,"num_write":1020,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.230548+0000","last_change":"2024-08-09T00:40:53.230548+0000","last_active":"2024-08-09T00:40:53.230548+0000","last_peered":"2024-08-09T00:40:53.230548+0000","last_clean":"2024-08-09T00:40:53.230548+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:40:53.230548+0000","last_undegraded":"2024-08-09T00:40:53.230548+0000","last_fullsized":"2024-08-09T00:40:53.230548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.230299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:57.894338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'146","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.821673+0000","last_change":"2024-08-08T23:28:30.790450+0000","last_active":"2024-08-09T00:40:33.821673+0000","last_peered":"2024-08-09T00:40:33.821673+0000","last_clean":"2024-08-09T00:40:33.821673+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:40:33.821673+0000","last_undegraded":"2024-08-09T00:40:33.821673+0000","last_fullsized":"2024-08-09T00:40:33.821673+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:29.747075+0000","last_clean_scrub_stamp":"2024-08-08T23:28:29.747075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":272,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.898098+0000","last_change":"2024-08-09T00:40:42.898098+0000","last_active":"2024-08-09T00:40:42.898098+0000","last_peered":"2024-08-09T00:40:42.898098+0000","last_clean":"2024-08-09T00:40:42.898098+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:40:42.898098+0000","last_undegraded":"2024-08-09T00:40:42.898098+0000","last_fullsized":"2024-08-09T00:40:42.898098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.897858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:14.996595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'139","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.308062+0000","last_change":"2024-08-09T00:40:50.308062+0000","last_active":"2024-08-09T00:40:50.308062+0000","last_peered":"2024-08-09T00:40:50.308062+0000","last_clean":"2024-08-09T00:40:50.308062+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:40:50.308062+0000","last_undegraded":"2024-08-09T00:40:50.308062+0000","last_fullsized":"2024-08-09T00:40:50.308062+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.307777+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:13:23.329056+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.467022+0000","last_change":"2024-08-09T00:41:10.467022+0000","last_active":"2024-08-09T00:41:10.467022+0000","last_peered":"2024-08-09T00:41:10.467022+0000","last_clean":"2024-08-09T00:41:10.467022+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:41:10.467022+0000","last_undegraded":"2024-08-09T00:41:10.467022+0000","last_fullsized":"2024-08-09T00:41:10.467022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.466733+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:15.220734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'266","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.209738+0000","last_change":"2024-08-08T23:28:24.793205+0000","last_active":"2024-08-09T00:40:35.209738+0000","last_peered":"2024-08-09T00:40:35.209738+0000","last_clean":"2024-08-09T00:40:35.209738+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:40:35.209738+0000","last_undegraded":"2024-08-09T00:40:35.209738+0000","last_fullsized":"2024-08-09T00:40:35.209738+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":32625,"num_write":1559,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.988585+0000","last_change":"2024-08-09T00:40:59.988585+0000","last_active":"2024-08-09T00:40:59.988585+0000","last_peered":"2024-08-09T00:40:59.988585+0000","last_clean":"2024-08-09T00:40:59.988585+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:40:59.988585+0000","last_undegraded":"2024-08-09T00:40:59.988585+0000","last_fullsized":"2024-08-09T00:40:59.988585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.988336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:23:42.997335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'127","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.386302+0000","last_change":"2024-08-09T00:41:04.386371+0000","last_active":"2024-08-09T00:41:04.386302+0000","last_peered":"2024-08-09T00:41:04.386302+0000","last_clean":"2024-08-09T00:41:04.386302+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:41:04.386302+0000","last_undegraded":"2024-08-09T00:41:04.386302+0000","last_fullsized":"2024-08-09T00:41:04.386302+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.386118+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:45:47.085465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":219,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.105495+0000","last_change":"2024-08-09T00:40:47.105495+0000","last_active":"2024-08-09T00:40:47.105495+0000","last_peered":"2024-08-09T00:40:47.105495+0000","last_clean":"2024-08-09T00:40:47.105495+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:40:47.105495+0000","last_undegraded":"2024-08-09T00:40:47.105495+0000","last_fullsized":"2024-08-09T00:40:47.105495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.105221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:39.031153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'148","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.651222+0000","last_change":"2024-08-09T00:40:53.651222+0000","last_active":"2024-08-09T00:40:53.651222+0000","last_peered":"2024-08-09T00:40:53.651222+0000","last_clean":"2024-08-09T00:40:53.651222+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:40:53.651222+0000","last_undegraded":"2024-08-09T00:40:53.651222+0000","last_fullsized":"2024-08-09T00:40:53.651222+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.650953+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:30.584762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":200,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.022603+0000","last_change":"2024-08-09T00:40:56.022603+0000","last_active":"2024-08-09T00:40:56.022603+0000","last_peered":"2024-08-09T00:40:56.022603+0000","last_clean":"2024-08-09T00:40:56.022603+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:40:56.022603+0000","last_undegraded":"2024-08-09T00:40:56.022603+0000","last_fullsized":"2024-08-09T00:40:56.022603+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4116","last_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_deep_scrub":"268'4116","last_deep_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.022341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:22:33.702715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'159","reported_seq":784,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.478153+0000","last_change":"2024-08-08T23:28:24.808379+0000","last_active":"2024-08-09T00:40:30.478153+0000","last_peered":"2024-08-09T00:40:30.478153+0000","last_clean":"2024-08-09T00:40:30.478153+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:40:30.478153+0000","last_undegraded":"2024-08-09T00:40:30.478153+0000","last_fullsized":"2024-08-09T00:40:30.478153+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4272291,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":403,"num_read_kb":16350,"num_write":847,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.815630+0000","last_change":"2024-08-09T00:40:48.815755+0000","last_active":"2024-08-09T00:40:48.815630+0000","last_peered":"2024-08-09T00:40:48.815630+0000","last_clean":"2024-08-09T00:40:48.815630+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:40:48.815630+0000","last_undegraded":"2024-08-09T00:40:48.815630+0000","last_fullsized":"2024-08-09T00:40:48.815630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.815323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:20.269004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'200","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.035765+0000","last_change":"2024-08-09T00:40:51.035765+0000","last_active":"2024-08-09T00:40:51.035765+0000","last_peered":"2024-08-09T00:40:51.035765+0000","last_clean":"2024-08-09T00:40:51.035765+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:40:51.035765+0000","last_undegraded":"2024-08-09T00:40:51.035765+0000","last_fullsized":"2024-08-09T00:40:51.035765+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.035329+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:12:44.986718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":353,"num_write":152,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.582286+0000","last_change":"2024-08-09T00:40:59.582286+0000","last_active":"2024-08-09T00:40:59.582286+0000","last_peered":"2024-08-09T00:40:59.582286+0000","last_clean":"2024-08-09T00:40:59.582286+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:40:59.582286+0000","last_undegraded":"2024-08-09T00:40:59.582286+0000","last_fullsized":"2024-08-09T00:40:59.582286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.581921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.548390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'143","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.960067+0000","last_change":"2024-08-09T00:40:38.960067+0000","last_active":"2024-08-09T00:40:38.960067+0000","last_peered":"2024-08-09T00:40:38.960067+0000","last_clean":"2024-08-09T00:40:38.960067+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:40:38.960067+0000","last_undegraded":"2024-08-09T00:40:38.960067+0000","last_fullsized":"2024-08-09T00:40:38.960067+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.959801+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:09.065450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'226","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.823607+0000","last_change":"2024-08-09T00:41:00.823673+0000","last_active":"2024-08-09T00:41:00.823607+0000","last_peered":"2024-08-09T00:41:00.823607+0000","last_clean":"2024-08-09T00:41:00.823607+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:41:00.823607+0000","last_undegraded":"2024-08-09T00:41:00.823607+0000","last_fullsized":"2024-08-09T00:41:00.823607+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.823423+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:01.815453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'212","reported_seq":846,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.210550+0000","last_change":"2024-08-09T00:41:03.210660+0000","last_active":"2024-08-09T00:41:03.210550+0000","last_peered":"2024-08-09T00:41:03.210550+0000","last_clean":"2024-08-09T00:41:03.210550+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:41:03.210550+0000","last_undegraded":"2024-08-09T00:41:03.210550+0000","last_fullsized":"2024-08-09T00:41:03.210550+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'212","last_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_deep_scrub":"268'212","last_deep_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.210345+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:21.028021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170402,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":16985,"num_write":1184,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'148","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.251126+0000","last_change":"2024-08-09T00:40:36.251196+0000","last_active":"2024-08-09T00:40:36.251126+0000","last_peered":"2024-08-09T00:40:36.251126+0000","last_clean":"2024-08-09T00:40:36.251126+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:40:36.251126+0000","last_undegraded":"2024-08-09T00:40:36.251126+0000","last_fullsized":"2024-08-09T00:40:36.251126+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.250936+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:42.591313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'209","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.138731+0000","last_change":"2024-08-09T00:40:56.138828+0000","last_active":"2024-08-09T00:40:56.138731+0000","last_peered":"2024-08-09T00:40:56.138731+0000","last_clean":"2024-08-09T00:40:56.138731+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:40:56.138731+0000","last_undegraded":"2024-08-09T00:40:56.138731+0000","last_fullsized":"2024-08-09T00:40:56.138731+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.138509+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:17.475723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906586,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":27391,"num_write":1081,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.212561+0000","last_change":"2024-08-09T00:40:56.212627+0000","last_active":"2024-08-09T00:40:56.212561+0000","last_peered":"2024-08-09T00:40:56.212561+0000","last_clean":"2024-08-09T00:40:56.212561+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:40:56.212561+0000","last_undegraded":"2024-08-09T00:40:56.212561+0000","last_fullsized":"2024-08-09T00:40:56.212561+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.212357+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:04.512212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'208","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.628261+0000","last_change":"2024-08-08T23:28:24.796787+0000","last_active":"2024-08-09T00:40:30.628261+0000","last_peered":"2024-08-09T00:40:30.628261+0000","last_clean":"2024-08-09T00:40:30.628261+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:40:30.628261+0000","last_undegraded":"2024-08-09T00:40:30.628261+0000","last_fullsized":"2024-08-09T00:40:30.628261+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":17234,"num_write":1189,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'70","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.835828+0000","last_change":"2024-08-09T00:40:58.835895+0000","last_active":"2024-08-09T00:40:58.835828+0000","last_peered":"2024-08-09T00:40:58.835828+0000","last_clean":"2024-08-09T00:40:58.835828+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:40:58.835828+0000","last_undegraded":"2024-08-09T00:40:58.835828+0000","last_fullsized":"2024-08-09T00:40:58.835828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'70","last_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_deep_scrub":"268'70","last_deep_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.835621+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:34.064444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'258","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.234546+0000","last_change":"2024-08-09T00:40:44.234632+0000","last_active":"2024-08-09T00:40:44.234546+0000","last_peered":"2024-08-09T00:40:44.234546+0000","last_clean":"2024-08-09T00:40:44.234546+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:40:44.234546+0000","last_undegraded":"2024-08-09T00:40:44.234546+0000","last_fullsized":"2024-08-09T00:40:44.234546+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.234346+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:03.157959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":548,"num_read_kb":58241,"num_write":1241,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'130","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.443166+0000","last_change":"2024-08-09T00:41:08.443305+0000","last_active":"2024-08-09T00:41:08.443166+0000","last_peered":"2024-08-09T00:41:08.443166+0000","last_clean":"2024-08-09T00:41:08.443166+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:41:08.443166+0000","last_undegraded":"2024-08-09T00:41:08.443166+0000","last_fullsized":"2024-08-09T00:41:08.443166+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.442893+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:52.226288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'208","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.627881+0000","last_change":"2024-08-08T23:28:24.774296+0000","last_active":"2024-08-09T00:40:30.627881+0000","last_peered":"2024-08-09T00:40:30.627881+0000","last_clean":"2024-08-09T00:40:30.627881+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:40:30.627881+0000","last_undegraded":"2024-08-09T00:40:30.627881+0000","last_fullsized":"2024-08-09T00:40:30.627881+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":406,"num_read_kb":7859,"num_write":1109,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.066312+0000","last_change":"2024-08-09T00:40:52.066374+0000","last_active":"2024-08-09T00:40:52.066312+0000","last_peered":"2024-08-09T00:40:52.066312+0000","last_clean":"2024-08-09T00:40:52.066312+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:40:52.066312+0000","last_undegraded":"2024-08-09T00:40:52.066312+0000","last_fullsized":"2024-08-09T00:40:52.066312+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.066127+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:09:51.014077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'239","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.916506+0000","last_change":"2024-08-09T00:41:06.916652+0000","last_active":"2024-08-09T00:41:06.916506+0000","last_peered":"2024-08-09T00:41:06.916506+0000","last_clean":"2024-08-09T00:41:06.916506+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:41:06.916506+0000","last_undegraded":"2024-08-09T00:41:06.916506+0000","last_fullsized":"2024-08-09T00:41:06.916506+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.916270+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:05:47.293252+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4141181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":20658,"num_write":1118,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:17.688044+0000","last_change":"2024-08-08T23:28:26.753891+0000","last_active":"2024-08-09T00:39:17.688044+0000","last_peered":"2024-08-09T00:39:17.688044+0000","last_clean":"2024-08-09T00:39:17.688044+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:39:17.688044+0000","last_undegraded":"2024-08-09T00:39:17.688044+0000","last_fullsized":"2024-08-09T00:39:17.688044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:25.728617+0000","last_clean_scrub_stamp":"2024-08-08T23:28:25.728617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.259004+0000","last_change":"2024-08-09T00:41:02.259178+0000","last_active":"2024-08-09T00:41:02.259004+0000","last_peered":"2024-08-09T00:41:02.259004+0000","last_clean":"2024-08-09T00:41:02.259004+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:41:02.259004+0000","last_undegraded":"2024-08-09T00:41:02.259004+0000","last_fullsized":"2024-08-09T00:41:02.259004+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.258807+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:14:06.788691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":364,"num_read_kb":32922,"num_write":1098,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'233","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.141198+0000","last_change":"2024-08-09T00:40:57.141350+0000","last_active":"2024-08-09T00:40:57.141198+0000","last_peered":"2024-08-09T00:40:57.141198+0000","last_clean":"2024-08-09T00:40:57.141198+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:40:57.141198+0000","last_undegraded":"2024-08-09T00:40:57.141198+0000","last_fullsized":"2024-08-09T00:40:57.141198+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.140970+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:09.384475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'255","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.689648+0000","last_change":"2024-08-09T00:40:42.689791+0000","last_active":"2024-08-09T00:40:42.689648+0000","last_peered":"2024-08-09T00:40:42.689648+0000","last_clean":"2024-08-09T00:40:42.689648+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:40:42.689648+0000","last_undegraded":"2024-08-09T00:40:42.689648+0000","last_fullsized":"2024-08-09T00:40:42.689648+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'255","last_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_deep_scrub":"268'255","last_deep_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.689455+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:26:59.280632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":18739,"num_write":1245,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.482175+0000","last_change":"2024-08-09T00:41:05.482316+0000","last_active":"2024-08-09T00:41:05.482175+0000","last_peered":"2024-08-09T00:41:05.482175+0000","last_clean":"2024-08-09T00:41:05.482175+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:41:05.482175+0000","last_undegraded":"2024-08-09T00:41:05.482175+0000","last_fullsized":"2024-08-09T00:41:05.482175+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.481959+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:37:25.905559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'189","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.107206+0000","last_change":"2024-08-09T00:41:12.107374+0000","last_active":"2024-08-09T00:41:12.107206+0000","last_peered":"2024-08-09T00:41:12.107206+0000","last_clean":"2024-08-09T00:41:12.107206+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:41:12.107206+0000","last_undegraded":"2024-08-09T00:41:12.107206+0000","last_fullsized":"2024-08-09T00:41:12.107206+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.106973+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:34.387579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917966,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":400,"num_read_kb":34111,"num_write":1045,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'82","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.194385+0000","last_change":"2024-08-09T00:41:07.194448+0000","last_active":"2024-08-09T00:41:07.194385+0000","last_peered":"2024-08-09T00:41:07.194385+0000","last_clean":"2024-08-09T00:41:07.194385+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:41:07.194385+0000","last_undegraded":"2024-08-09T00:41:07.194385+0000","last_fullsized":"2024-08-09T00:41:07.194385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'82","last_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_deep_scrub":"268'82","last_deep_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.194191+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:54:41.141377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'206","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.637685+0000","last_change":"2024-08-08T23:28:24.754432+0000","last_active":"2024-08-09T00:40:30.637685+0000","last_peered":"2024-08-09T00:40:30.637685+0000","last_clean":"2024-08-09T00:40:30.637685+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:40:30.637685+0000","last_undegraded":"2024-08-09T00:40:30.637685+0000","last_fullsized":"2024-08-09T00:40:30.637685+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":96889,"num_write":1101,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.089279+0000","last_change":"2024-08-09T00:40:57.089342+0000","last_active":"2024-08-09T00:40:57.089279+0000","last_peered":"2024-08-09T00:40:57.089279+0000","last_clean":"2024-08-09T00:40:57.089279+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:40:57.089279+0000","last_undegraded":"2024-08-09T00:40:57.089279+0000","last_fullsized":"2024-08-09T00:40:57.089279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'66","last_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_deep_scrub":"268'66","last_deep_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.089084+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:47.534069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'184","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.587897+0000","last_change":"2024-08-08T23:28:24.814748+0000","last_active":"2024-08-09T00:40:30.587897+0000","last_peered":"2024-08-09T00:40:30.587897+0000","last_clean":"2024-08-09T00:40:30.587897+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:40:30.587897+0000","last_undegraded":"2024-08-09T00:40:30.587897+0000","last_fullsized":"2024-08-09T00:40:30.587897+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":443,"num_read_kb":71209,"num_write":978,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.029644+0000","last_change":"2024-08-09T00:40:53.029715+0000","last_active":"2024-08-09T00:40:53.029644+0000","last_peered":"2024-08-09T00:40:53.029644+0000","last_clean":"2024-08-09T00:40:53.029644+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:40:53.029644+0000","last_undegraded":"2024-08-09T00:40:53.029644+0000","last_fullsized":"2024-08-09T00:40:53.029644+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.029406+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:02.108228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'175","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:30.530493+0000","last_change":"2024-08-08T23:28:24.794487+0000","last_active":"2024-08-09T00:40:30.530493+0000","last_peered":"2024-08-09T00:40:30.530493+0000","last_clean":"2024-08-09T00:40:30.530493+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:40:30.530493+0000","last_undegraded":"2024-08-09T00:40:30.530493+0000","last_fullsized":"2024-08-09T00:40:30.530493+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":31431,"num_write":995,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.566407+0000","last_change":"2024-08-09T00:41:09.566466+0000","last_active":"2024-08-09T00:41:09.566407+0000","last_peered":"2024-08-09T00:41:09.566407+0000","last_clean":"2024-08-09T00:41:09.566407+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:41:09.566407+0000","last_undegraded":"2024-08-09T00:41:09.566407+0000","last_fullsized":"2024-08-09T00:41:09.566407+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.566215+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:38:01.849623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'231","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.186379+0000","last_change":"2024-08-09T00:40:59.186465+0000","last_active":"2024-08-09T00:40:59.186379+0000","last_peered":"2024-08-09T00:40:59.186379+0000","last_clean":"2024-08-09T00:40:59.186379+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:40:59.186379+0000","last_undegraded":"2024-08-09T00:40:59.186379+0000","last_fullsized":"2024-08-09T00:40:59.186379+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.186180+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:22.480994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":70204,"num_write":1298,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.467575+0000","last_change":"2024-08-09T00:41:09.467702+0000","last_active":"2024-08-09T00:41:09.467575+0000","last_peered":"2024-08-09T00:41:09.467575+0000","last_clean":"2024-08-09T00:41:09.467575+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:41:09.467575+0000","last_undegraded":"2024-08-09T00:41:09.467575+0000","last_fullsized":"2024-08-09T00:41:09.467575+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.467287+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:21.257904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'214","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.067238+0000","last_change":"2024-08-08T23:28:24.801641+0000","last_active":"2024-08-09T00:40:37.067238+0000","last_peered":"2024-08-09T00:40:37.067238+0000","last_clean":"2024-08-09T00:40:37.067238+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:40:37.067238+0000","last_undegraded":"2024-08-09T00:40:37.067238+0000","last_fullsized":"2024-08-09T00:40:37.067238+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":54938,"num_write":1149,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.449184+0000","last_change":"2024-08-09T00:41:12.449298+0000","last_active":"2024-08-09T00:41:12.449184+0000","last_peered":"2024-08-09T00:41:12.449184+0000","last_clean":"2024-08-09T00:41:12.449184+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:41:12.449184+0000","last_undegraded":"2024-08-09T00:41:12.449184+0000","last_fullsized":"2024-08-09T00:41:12.449184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.448907+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:29.102323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'161","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.163620+0000","last_change":"2024-08-09T00:40:55.163789+0000","last_active":"2024-08-09T00:40:55.163620+0000","last_peered":"2024-08-09T00:40:55.163620+0000","last_clean":"2024-08-09T00:40:55.163620+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:40:55.163620+0000","last_undegraded":"2024-08-09T00:40:55.163620+0000","last_fullsized":"2024-08-09T00:40:55.163620+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'161","last_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_deep_scrub":"268'161","last_deep_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.163304+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:36.656935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029153,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":19124,"num_write":939,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.542965+0000","last_change":"2024-08-09T00:41:07.543024+0000","last_active":"2024-08-09T00:41:07.542965+0000","last_peered":"2024-08-09T00:41:07.542965+0000","last_clean":"2024-08-09T00:41:07.542965+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:41:07.542965+0000","last_undegraded":"2024-08-09T00:41:07.542965+0000","last_fullsized":"2024-08-09T00:41:07.542965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.542773+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:53:09.581153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'233","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.070027+0000","last_change":"2024-08-09T00:41:09.070186+0000","last_active":"2024-08-09T00:41:09.070027+0000","last_peered":"2024-08-09T00:41:09.070027+0000","last_clean":"2024-08-09T00:41:09.070027+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:41:09.070027+0000","last_undegraded":"2024-08-09T00:41:09.070027+0000","last_fullsized":"2024-08-09T00:41:09.070027+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.069721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:01:13.191209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":89533,"num_write":1169,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'222","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.136531+0000","last_change":"2024-08-08T23:28:24.793918+0000","last_active":"2024-08-09T00:40:36.136531+0000","last_peered":"2024-08-09T00:40:36.136531+0000","last_clean":"2024-08-09T00:40:36.136531+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:40:36.136531+0000","last_undegraded":"2024-08-09T00:40:36.136531+0000","last_fullsized":"2024-08-09T00:40:36.136531+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-08T23:28:23.721546+0000","last_clean_scrub_stamp":"2024-08-08T23:28:23.721546+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055020,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":157320,"num_write":1033,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.484453+0000","last_change":"2024-08-09T00:41:11.484453+0000","last_active":"2024-08-09T00:41:11.484453+0000","last_peered":"2024-08-09T00:41:11.484453+0000","last_clean":"2024-08-09T00:41:11.484453+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:41:11.484453+0000","last_undegraded":"2024-08-09T00:41:11.484453+0000","last_fullsized":"2024-08-09T00:41:11.484453+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.484163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:06:01.629340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'185","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.975381+0000","last_change":"2024-08-09T00:41:09.975629+0000","last_active":"2024-08-09T00:41:09.975381+0000","last_peered":"2024-08-09T00:41:09.975381+0000","last_clean":"2024-08-09T00:41:09.975381+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:41:09.975381+0000","last_undegraded":"2024-08-09T00:41:09.975381+0000","last_fullsized":"2024-08-09T00:41:09.975381+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.975107+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:02.479753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":17056,"num_write":1042,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.144029+0000","last_change":"2024-08-09T00:40:58.144087+0000","last_active":"2024-08-09T00:40:58.144029+0000","last_peered":"2024-08-09T00:40:58.144029+0000","last_clean":"2024-08-09T00:40:58.144029+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:40:58.144029+0000","last_undegraded":"2024-08-09T00:40:58.144029+0000","last_fullsized":"2024-08-09T00:40:58.144029+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.143843+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:59.634585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6218,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4197,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1760,"ondisk_log_size":1760,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":494,"ondisk_log_size":494,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314750,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9845,"num_read_kb":12223,"num_write":6853,"num_write_kb":2887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":618926,"num_omap_keys":1514,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1613,"num_read_kb":1921,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18186,"num_omap_keys":77,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3466,"ondisk_log_size":3466,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":88031934,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":32363,"num_read_kb":2279985,"num_write":69541,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134025216,"data_stored":134025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4276,"ondisk_log_size":4276,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":194734,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":183422,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575731,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246792,"kb_used_data":21248,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125048,"statfs":{"total":96636764160,"available":96384049152,"internally_reserved":0,"allocated":21757952,"data_stored":19593835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575729,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284076,"kb_used_data":22436,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94087764,"statfs":{"total":96636764160,"available":96345870336,"internally_reserved":0,"allocated":22974464,"data_stored":20860820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575731,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107176,"kb_used_data":17760,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264664,"statfs":{"total":96636764160,"available":96527015936,"internally_reserved":0,"allocated":18186240,"data_stored":16015430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575729,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110208,"kb_used_data":20728,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94261632,"statfs":{"total":96636764160,"available":96523911168,"internally_reserved":0,"allocated":21225472,"data_stored":19169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575728,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235232,"kb_used_data":23576,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94136608,"statfs":{"total":96636764160,"available":96395886592,"internally_reserved":0,"allocated":24141824,"data_stored":22000945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575729,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105888,"kb_used_data":20632,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265952,"statfs":{"total":96636764160,"available":96528334848,"internally_reserved":0,"allocated":21127168,"data_stored":19032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575732,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":19616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":20086784,"data_stored":17965451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575729,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236592,"kb_used_data":20776,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94135248,"statfs":{"total":96636764160,"available":96394493952,"internally_reserved":0,"allocated":21274624,"data_stored":19114679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16203776,"data_stored":16203776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16715776,"data_stored":16715776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19681280,"data_stored":19681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18542592,"data_stored":18542592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":16683008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:41:18.451 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.451 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.451 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.452 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.452 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.452 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.452 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.452 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.453 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.453 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.453 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.453 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.454 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.454 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.454 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.454 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.454 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.455 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.455 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.455 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.455 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.455 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.456 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.456 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.456 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.456 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-08T23:48:37.017110+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=37, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.457 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.457 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.457 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.457 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.458 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.458 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.458 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.458 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.459 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.459 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.459 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.459 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.459 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.460 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.460 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.460 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.460 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-08T23:48:41.056576+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.460 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.461 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.461 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.461 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.461 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.461 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.462 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.462 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.462 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.462 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.463 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.463 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.463 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.463 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.464 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.464 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.464 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.465 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.465 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.465 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.465 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.466 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.466 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.466 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.466 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.467 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-08T23:28:08.717706+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=8, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.467 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.467 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.467 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.468 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.468 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.468 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-08T23:28:13.753654+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=13, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.469 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.469 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.469 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.470 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.470 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-08-08T23:28:27.735445+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=27, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.470 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.470 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.470 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.471 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.471 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.471 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.471 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.472 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-08-08T23:28:29.747075+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=29, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.472 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.472 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.472 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.473 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.473 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-08-08T23:28:25.728617+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=25, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.473 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.473 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.474 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.474 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.474 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-08T23:28:23.721546+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=8, tm_hour=23, tm_min=28, tm_sec=23, tm_wday=3, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:18.474 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-09T00:41:38.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:41:38.854 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:41:38.866 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:41:38.880 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2465,"stamp":"2024-08-09T00:41:37.350737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88958767,"num_objects":608,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":150062,"num_read_kb":2759937,"num_write":130193,"num_write_kb":2369717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676633,"num_omap_keys":1748,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13232,"ondisk_log_size":13232,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1471092,"kb_used_data":166772,"kb_used_omap":12,"kb_used_meta":1304243,"kb_avail":753503628,"statfs":{"total":773094113280,"available":771587715072,"internally_reserved":0,"allocated":170774528,"data_stored":153754026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1335545392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007699"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.137615+0000","last_change":"2024-08-09T00:41:23.137670+0000","last_active":"2024-08-09T00:41:23.137615+0000","last_peered":"2024-08-09T00:41:23.137615+0000","last_clean":"2024-08-09T00:41:23.137615+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:41:23.137615+0000","last_undegraded":"2024-08-09T00:41:23.137615+0000","last_fullsized":"2024-08-09T00:41:23.137615+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:23.137392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:23.137392+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.137392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:58.737448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.120847+0000","last_change":"2024-08-09T00:41:22.120905+0000","last_active":"2024-08-09T00:41:22.120847+0000","last_peered":"2024-08-09T00:41:22.120847+0000","last_clean":"2024-08-09T00:41:22.120847+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:41:22.120847+0000","last_undegraded":"2024-08-09T00:41:22.120847+0000","last_fullsized":"2024-08-09T00:41:22.120847+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:22.120654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:22.120654+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.120654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:48.905970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.271122+0000","last_change":"2024-08-09T00:40:39.271122+0000","last_active":"2024-08-09T00:40:39.271122+0000","last_peered":"2024-08-09T00:40:39.271122+0000","last_clean":"2024-08-09T00:40:39.271122+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:40:39.271122+0000","last_undegraded":"2024-08-09T00:40:39.271122+0000","last_fullsized":"2024-08-09T00:40:39.271122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.270864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:38.071300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.658714+0000","last_change":"2024-08-09T00:40:35.658714+0000","last_active":"2024-08-09T00:40:35.658714+0000","last_peered":"2024-08-09T00:40:35.658714+0000","last_clean":"2024-08-09T00:40:35.658714+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:40:35.658714+0000","last_undegraded":"2024-08-09T00:40:35.658714+0000","last_fullsized":"2024-08-09T00:40:35.658714+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.658455+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:16.669438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.030403+0000","last_change":"2024-08-09T00:41:08.030505+0000","last_active":"2024-08-09T00:41:08.030403+0000","last_peered":"2024-08-09T00:41:08.030403+0000","last_clean":"2024-08-09T00:41:08.030403+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:41:08.030403+0000","last_undegraded":"2024-08-09T00:41:08.030403+0000","last_fullsized":"2024-08-09T00:41:08.030403+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.030171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:07:43.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.374296+0000","last_change":"2024-08-09T00:41:22.374359+0000","last_active":"2024-08-09T00:41:22.374296+0000","last_peered":"2024-08-09T00:41:22.374296+0000","last_clean":"2024-08-09T00:41:22.374296+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:41:22.374296+0000","last_undegraded":"2024-08-09T00:41:22.374296+0000","last_fullsized":"2024-08-09T00:41:22.374296+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:22.374084+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:22.374084+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.374084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:46:23.857682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'12","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.802356+0000","last_change":"2024-08-09T00:40:34.802356+0000","last_active":"2024-08-09T00:40:34.802356+0000","last_peered":"2024-08-09T00:40:34.802356+0000","last_clean":"2024-08-09T00:40:34.802356+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:40:34.802356+0000","last_undegraded":"2024-08-09T00:40:34.802356+0000","last_fullsized":"2024-08-09T00:40:34.802356+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.802208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:12.870620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4144,"num_write":22,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":226,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.185356+0000","last_change":"2024-08-09T00:40:35.185356+0000","last_active":"2024-08-09T00:40:35.185356+0000","last_peered":"2024-08-09T00:40:35.185356+0000","last_clean":"2024-08-09T00:40:35.185356+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:40:35.185356+0000","last_undegraded":"2024-08-09T00:40:35.185356+0000","last_fullsized":"2024-08-09T00:40:35.185356+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.185085+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:13:40.941525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.999674+0000","last_change":"2024-08-09T00:41:12.999728+0000","last_active":"2024-08-09T00:41:12.999674+0000","last_peered":"2024-08-09T00:41:12.999674+0000","last_clean":"2024-08-09T00:41:12.999674+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:41:12.999674+0000","last_undegraded":"2024-08-09T00:41:12.999674+0000","last_fullsized":"2024-08-09T00:41:12.999674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:12.999475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:12.999475+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.999475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:01:35.675189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.537961+0000","last_change":"2024-08-09T00:41:27.538031+0000","last_active":"2024-08-09T00:41:27.537961+0000","last_peered":"2024-08-09T00:41:27.537961+0000","last_clean":"2024-08-09T00:41:27.537961+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:41:27.537961+0000","last_undegraded":"2024-08-09T00:41:27.537961+0000","last_fullsized":"2024-08-09T00:41:27.537961+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:27.537764+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:27.537764+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.537764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:03.934063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.052384+0000","last_change":"2024-08-09T00:41:05.052451+0000","last_active":"2024-08-09T00:41:05.052384+0000","last_peered":"2024-08-09T00:41:05.052384+0000","last_clean":"2024-08-09T00:41:05.052384+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:41:05.052384+0000","last_undegraded":"2024-08-09T00:41:05.052384+0000","last_fullsized":"2024-08-09T00:41:05.052384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.052191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:29:43.122709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.643998+0000","last_change":"2024-08-09T00:40:41.644063+0000","last_active":"2024-08-09T00:40:41.643998+0000","last_peered":"2024-08-09T00:40:41.643998+0000","last_clean":"2024-08-09T00:40:41.643998+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:40:41.643998+0000","last_undegraded":"2024-08-09T00:40:41.643998+0000","last_fullsized":"2024-08-09T00:40:41.643998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.643807+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:22.863068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210814+0000","last_change":"2024-08-09T00:04:29.875131+0000","last_active":"2024-08-09T00:40:35.210814+0000","last_peered":"2024-08-09T00:40:35.210814+0000","last_clean":"2024-08-09T00:40:35.210814+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:40:35.210814+0000","last_undegraded":"2024-08-09T00:40:35.210814+0000","last_fullsized":"2024-08-09T00:40:35.210814+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.606132+0000","last_change":"2024-08-09T00:41:30.606190+0000","last_active":"2024-08-09T00:41:30.606132+0000","last_peered":"2024-08-09T00:41:30.606132+0000","last_clean":"2024-08-09T00:41:30.606132+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:41:30.606132+0000","last_undegraded":"2024-08-09T00:41:30.606132+0000","last_fullsized":"2024-08-09T00:41:30.606132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.605884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.605884+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.605884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:34.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.137960+0000","last_change":"2024-08-09T00:40:46.138108+0000","last_active":"2024-08-09T00:40:46.137960+0000","last_peered":"2024-08-09T00:40:46.137960+0000","last_clean":"2024-08-09T00:40:46.137960+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:40:46.137960+0000","last_undegraded":"2024-08-09T00:40:46.137960+0000","last_fullsized":"2024-08-09T00:40:46.137960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.137726+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:04.630323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.280270+0000","last_change":"2024-08-09T00:40:41.280331+0000","last_active":"2024-08-09T00:40:41.280270+0000","last_peered":"2024-08-09T00:40:41.280270+0000","last_clean":"2024-08-09T00:40:41.280270+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:40:41.280270+0000","last_undegraded":"2024-08-09T00:40:41.280270+0000","last_fullsized":"2024-08-09T00:40:41.280270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.280078+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:02:07.630638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210912+0000","last_change":"2024-08-09T00:04:29.876265+0000","last_active":"2024-08-09T00:40:35.210912+0000","last_peered":"2024-08-09T00:40:35.210912+0000","last_clean":"2024-08-09T00:40:35.210912+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:40:35.210912+0000","last_undegraded":"2024-08-09T00:40:35.210912+0000","last_fullsized":"2024-08-09T00:40:35.210912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'11","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.076829+0000","last_change":"2024-08-09T00:41:21.076890+0000","last_active":"2024-08-09T00:41:21.076829+0000","last_peered":"2024-08-09T00:41:21.076829+0000","last_clean":"2024-08-09T00:41:21.076829+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:41:21.076829+0000","last_undegraded":"2024-08-09T00:41:21.076829+0000","last_fullsized":"2024-08-09T00:41:21.076829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-08-09T00:41:21.076644+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-08-09T00:41:21.076644+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.076644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:31:02.616259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17458,"num_write":16,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.633589+0000","last_change":"2024-08-09T00:40:34.633632+0000","last_active":"2024-08-09T00:40:34.633589+0000","last_peered":"2024-08-09T00:40:34.633589+0000","last_clean":"2024-08-09T00:40:34.633589+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:40:34.633589+0000","last_undegraded":"2024-08-09T00:40:34.633589+0000","last_fullsized":"2024-08-09T00:40:34.633589+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.633469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:40.040241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.238228+0000","last_change":"2024-08-09T00:40:38.238357+0000","last_active":"2024-08-09T00:40:38.238228+0000","last_peered":"2024-08-09T00:40:38.238228+0000","last_clean":"2024-08-09T00:40:38.238228+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:40:38.238228+0000","last_undegraded":"2024-08-09T00:40:38.238228+0000","last_fullsized":"2024-08-09T00:40:38.238228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.237982+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:45.723779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.874696+0000","last_change":"2024-08-09T00:41:18.874758+0000","last_active":"2024-08-09T00:41:18.874696+0000","last_peered":"2024-08-09T00:41:18.874696+0000","last_clean":"2024-08-09T00:41:18.874696+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:41:18.874696+0000","last_undegraded":"2024-08-09T00:41:18.874696+0000","last_fullsized":"2024-08-09T00:41:18.874696+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:18.874484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:18.874484+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.874484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:54:43.251082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.028175+0000","last_change":"2024-08-09T00:41:08.028228+0000","last_active":"2024-08-09T00:41:08.028175+0000","last_peered":"2024-08-09T00:41:08.028175+0000","last_clean":"2024-08-09T00:41:08.028175+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:41:08.028175+0000","last_undegraded":"2024-08-09T00:41:08.028175+0000","last_fullsized":"2024-08-09T00:41:08.028175+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.027970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:24:22.702951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.913495+0000","last_change":"2024-08-09T00:40:37.913550+0000","last_active":"2024-08-09T00:40:37.913495+0000","last_peered":"2024-08-09T00:40:37.913495+0000","last_clean":"2024-08-09T00:40:37.913495+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:40:37.913495+0000","last_undegraded":"2024-08-09T00:40:37.913495+0000","last_fullsized":"2024-08-09T00:40:37.913495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.913298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:15.804242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.915549+0000","last_change":"2024-08-09T00:40:36.915685+0000","last_active":"2024-08-09T00:40:36.915549+0000","last_peered":"2024-08-09T00:40:36.915549+0000","last_clean":"2024-08-09T00:40:36.915549+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:40:36.915549+0000","last_undegraded":"2024-08-09T00:40:36.915549+0000","last_fullsized":"2024-08-09T00:40:36.915549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.915302+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:49:03.528537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.815184+0000","last_change":"2024-08-09T00:41:27.815253+0000","last_active":"2024-08-09T00:41:27.815184+0000","last_peered":"2024-08-09T00:41:27.815184+0000","last_clean":"2024-08-09T00:41:27.815184+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:41:27.815184+0000","last_undegraded":"2024-08-09T00:41:27.815184+0000","last_fullsized":"2024-08-09T00:41:27.815184+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:27.814961+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:27.814961+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.814961+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:03:33.447165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.070337+0000","last_change":"2024-08-09T00:41:10.070337+0000","last_active":"2024-08-09T00:41:10.070337+0000","last_peered":"2024-08-09T00:41:10.070337+0000","last_clean":"2024-08-09T00:41:10.070337+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:41:10.070337+0000","last_undegraded":"2024-08-09T00:41:10.070337+0000","last_fullsized":"2024-08-09T00:41:10.070337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.070055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:52.633196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.310133+0000","last_change":"2024-08-09T00:41:17.310195+0000","last_active":"2024-08-09T00:41:17.310133+0000","last_peered":"2024-08-09T00:41:17.310133+0000","last_clean":"2024-08-09T00:41:17.310133+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:41:17.310133+0000","last_undegraded":"2024-08-09T00:41:17.310133+0000","last_fullsized":"2024-08-09T00:41:17.310133+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:17.309930+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:17.309930+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.309930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:45.342607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.707450+0000","last_change":"2024-08-09T00:40:39.707514+0000","last_active":"2024-08-09T00:40:39.707450+0000","last_peered":"2024-08-09T00:40:39.707450+0000","last_clean":"2024-08-09T00:40:39.707450+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:40:39.707450+0000","last_undegraded":"2024-08-09T00:40:39.707450+0000","last_fullsized":"2024-08-09T00:40:39.707450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.707247+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:07.954822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:39:32.893277+0000","last_change":"2024-08-09T00:04:29.885001+0000","last_active":"2024-08-09T00:39:32.893277+0000","last_peered":"2024-08-09T00:39:32.893277+0000","last_clean":"2024-08-09T00:39:32.893277+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:39:32.893277+0000","last_undegraded":"2024-08-09T00:39:32.893277+0000","last_fullsized":"2024-08-09T00:39:32.893277+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.308345+0000","last_change":"2024-08-09T00:40:43.308345+0000","last_active":"2024-08-09T00:40:43.308345+0000","last_peered":"2024-08-09T00:40:43.308345+0000","last_clean":"2024-08-09T00:40:43.308345+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:40:43.308345+0000","last_undegraded":"2024-08-09T00:40:43.308345+0000","last_fullsized":"2024-08-09T00:40:43.308345+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.308076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:30.144196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.660858+0000","last_change":"2024-08-09T00:40:36.660858+0000","last_active":"2024-08-09T00:40:36.660858+0000","last_peered":"2024-08-09T00:40:36.660858+0000","last_clean":"2024-08-09T00:40:36.660858+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:40:36.660858+0000","last_undegraded":"2024-08-09T00:40:36.660858+0000","last_fullsized":"2024-08-09T00:40:36.660858+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.660732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:31:02.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.833334+0000","last_change":"2024-08-09T00:40:36.833359+0000","last_active":"2024-08-09T00:40:36.833334+0000","last_peered":"2024-08-09T00:40:36.833334+0000","last_clean":"2024-08-09T00:40:36.833334+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:40:36.833334+0000","last_undegraded":"2024-08-09T00:40:36.833334+0000","last_fullsized":"2024-08-09T00:40:36.833334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.833241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:35:54.834498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.904711+0000","last_change":"2024-08-09T00:41:16.904840+0000","last_active":"2024-08-09T00:41:16.904711+0000","last_peered":"2024-08-09T00:41:16.904711+0000","last_clean":"2024-08-09T00:41:16.904711+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:41:16.904711+0000","last_undegraded":"2024-08-09T00:41:16.904711+0000","last_fullsized":"2024-08-09T00:41:16.904711+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:16.904463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:16.904463+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.904463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:45.221248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.283034+0000","last_change":"2024-08-09T00:40:59.283093+0000","last_active":"2024-08-09T00:40:59.283034+0000","last_peered":"2024-08-09T00:40:59.283034+0000","last_clean":"2024-08-09T00:40:59.283034+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:40:59.283034+0000","last_undegraded":"2024-08-09T00:40:59.283034+0000","last_fullsized":"2024-08-09T00:40:59.283034+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.282823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:49:49.304715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.264682+0000","last_change":"2024-08-09T00:40:52.264744+0000","last_active":"2024-08-09T00:40:52.264682+0000","last_peered":"2024-08-09T00:40:52.264682+0000","last_clean":"2024-08-09T00:40:52.264682+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:40:52.264682+0000","last_undegraded":"2024-08-09T00:40:52.264682+0000","last_fullsized":"2024-08-09T00:40:52.264682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.264488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:36:28.875953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.729225+0000","last_change":"2024-08-09T00:40:38.729357+0000","last_active":"2024-08-09T00:40:38.729225+0000","last_peered":"2024-08-09T00:40:38.729225+0000","last_clean":"2024-08-09T00:40:38.729225+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:40:38.729225+0000","last_undegraded":"2024-08-09T00:40:38.729225+0000","last_fullsized":"2024-08-09T00:40:38.729225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.728971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:46:20.124323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.039472+0000","last_change":"2024-08-09T00:41:07.039540+0000","last_active":"2024-08-09T00:41:07.039472+0000","last_peered":"2024-08-09T00:41:07.039472+0000","last_clean":"2024-08-09T00:41:07.039472+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:41:07.039472+0000","last_undegraded":"2024-08-09T00:41:07.039472+0000","last_fullsized":"2024-08-09T00:41:07.039472+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.039280+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:03.469816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.370327+0000","last_change":"2024-08-09T00:41:03.370381+0000","last_active":"2024-08-09T00:41:03.370327+0000","last_peered":"2024-08-09T00:41:03.370327+0000","last_clean":"2024-08-09T00:41:03.370327+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:41:03.370327+0000","last_undegraded":"2024-08-09T00:41:03.370327+0000","last_fullsized":"2024-08-09T00:41:03.370327+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.370116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:33:18.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.602304+0000","last_change":"2024-08-09T00:40:37.602366+0000","last_active":"2024-08-09T00:40:37.602304+0000","last_peered":"2024-08-09T00:40:37.602304+0000","last_clean":"2024-08-09T00:40:37.602304+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:40:37.602304+0000","last_undegraded":"2024-08-09T00:40:37.602304+0000","last_fullsized":"2024-08-09T00:40:37.602304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.602099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:43:52.947621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.237531+0000","last_change":"2024-08-09T00:40:40.237588+0000","last_active":"2024-08-09T00:40:40.237531+0000","last_peered":"2024-08-09T00:40:40.237531+0000","last_clean":"2024-08-09T00:40:40.237531+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:40:40.237531+0000","last_undegraded":"2024-08-09T00:40:40.237531+0000","last_fullsized":"2024-08-09T00:40:40.237531+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.237342+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:46:29.023191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.765619+0000","last_change":"2024-08-09T00:41:28.765675+0000","last_active":"2024-08-09T00:41:28.765619+0000","last_peered":"2024-08-09T00:41:28.765619+0000","last_clean":"2024-08-09T00:41:28.765619+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:41:28.765619+0000","last_undegraded":"2024-08-09T00:41:28.765619+0000","last_fullsized":"2024-08-09T00:41:28.765619+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:28.765402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:28.765402+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.765402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:29.466631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.573395+0000","last_change":"2024-08-09T00:41:31.573532+0000","last_active":"2024-08-09T00:41:31.573395+0000","last_peered":"2024-08-09T00:41:31.573395+0000","last_clean":"2024-08-09T00:41:31.573395+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:41:31.573395+0000","last_undegraded":"2024-08-09T00:41:31.573395+0000","last_fullsized":"2024-08-09T00:41:31.573395+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.573174+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:47:24.936886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.100393+0000","last_change":"2024-08-09T00:41:04.100452+0000","last_active":"2024-08-09T00:41:04.100393+0000","last_peered":"2024-08-09T00:41:04.100393+0000","last_clean":"2024-08-09T00:41:04.100393+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:41:04.100393+0000","last_undegraded":"2024-08-09T00:41:04.100393+0000","last_fullsized":"2024-08-09T00:41:04.100393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.100190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:42:44.280085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.232009+0000","last_change":"2024-08-09T00:40:37.232034+0000","last_active":"2024-08-09T00:40:37.232009+0000","last_peered":"2024-08-09T00:40:37.232009+0000","last_clean":"2024-08-09T00:40:37.232009+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:40:37.232009+0000","last_undegraded":"2024-08-09T00:40:37.232009+0000","last_fullsized":"2024-08-09T00:40:37.232009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.231936+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:46.987261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.089469+0000","last_change":"2024-08-09T00:41:24.089582+0000","last_active":"2024-08-09T00:41:24.089469+0000","last_peered":"2024-08-09T00:41:24.089469+0000","last_clean":"2024-08-09T00:41:24.089469+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:41:24.089469+0000","last_undegraded":"2024-08-09T00:41:24.089469+0000","last_fullsized":"2024-08-09T00:41:24.089469+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:24.089223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:24.089223+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.089223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:20:12.891214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'4","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.327034+0000","last_change":"2024-08-09T00:41:21.327096+0000","last_active":"2024-08-09T00:41:21.327034+0000","last_peered":"2024-08-09T00:41:21.327034+0000","last_clean":"2024-08-09T00:41:21.327034+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:41:21.327034+0000","last_undegraded":"2024-08-09T00:41:21.327034+0000","last_fullsized":"2024-08-09T00:41:21.327034+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:21.326838+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:21.326838+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.326838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:06:46.805339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.636164+0000","last_change":"2024-08-09T00:40:44.636229+0000","last_active":"2024-08-09T00:40:44.636164+0000","last_peered":"2024-08-09T00:40:44.636164+0000","last_clean":"2024-08-09T00:40:44.636164+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:40:44.636164+0000","last_undegraded":"2024-08-09T00:40:44.636164+0000","last_fullsized":"2024-08-09T00:40:44.636164+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.635966+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:22.290779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.541393+0000","last_change":"2024-08-09T00:40:45.541393+0000","last_active":"2024-08-09T00:40:45.541393+0000","last_peered":"2024-08-09T00:40:45.541393+0000","last_clean":"2024-08-09T00:40:45.541393+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:40:45.541393+0000","last_undegraded":"2024-08-09T00:40:45.541393+0000","last_fullsized":"2024-08-09T00:40:45.541393+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.540982+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:27:18.363747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.210877+0000","last_change":"2024-08-09T00:04:29.873908+0000","last_active":"2024-08-09T00:40:35.210877+0000","last_peered":"2024-08-09T00:40:35.210877+0000","last_clean":"2024-08-09T00:40:35.210877+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:40:35.210877+0000","last_undegraded":"2024-08-09T00:40:35.210877+0000","last_fullsized":"2024-08-09T00:40:35.210877+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.927722+0000","last_change":"2024-08-09T00:41:14.927794+0000","last_active":"2024-08-09T00:41:14.927722+0000","last_peered":"2024-08-09T00:41:14.927722+0000","last_clean":"2024-08-09T00:41:14.927722+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:41:14.927722+0000","last_undegraded":"2024-08-09T00:41:14.927722+0000","last_fullsized":"2024-08-09T00:41:14.927722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:14.927504+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:14.927504+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.927504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:28.979969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.024780+0000","last_change":"2024-08-09T00:40:50.024835+0000","last_active":"2024-08-09T00:40:50.024780+0000","last_peered":"2024-08-09T00:40:50.024780+0000","last_clean":"2024-08-09T00:40:50.024780+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:40:50.024780+0000","last_undegraded":"2024-08-09T00:40:50.024780+0000","last_fullsized":"2024-08-09T00:40:50.024780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.024567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:42:36.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":195,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.540116+0000","last_change":"2024-08-09T00:40:43.540116+0000","last_active":"2024-08-09T00:40:43.540116+0000","last_peered":"2024-08-09T00:40:43.540116+0000","last_clean":"2024-08-09T00:40:43.540116+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:40:43.540116+0000","last_undegraded":"2024-08-09T00:40:43.540116+0000","last_fullsized":"2024-08-09T00:40:43.540116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'47","last_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_deep_scrub":"268'47","last_deep_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.539854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:53:56.070084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:33.822645+0000","last_change":"2024-08-09T00:04:29.878386+0000","last_active":"2024-08-09T00:40:33.822645+0000","last_peered":"2024-08-09T00:40:33.822645+0000","last_clean":"2024-08-09T00:40:33.822645+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:40:33.822645+0000","last_undegraded":"2024-08-09T00:40:33.822645+0000","last_fullsized":"2024-08-09T00:40:33.822645+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.928746+0000","last_change":"2024-08-09T00:41:13.928807+0000","last_active":"2024-08-09T00:41:13.928746+0000","last_peered":"2024-08-09T00:41:13.928746+0000","last_clean":"2024-08-09T00:41:13.928746+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:41:13.928746+0000","last_undegraded":"2024-08-09T00:41:13.928746+0000","last_fullsized":"2024-08-09T00:41:13.928746+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:41:13.928543+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:41:13.928543+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.928543+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:32:00.943555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.189314+0000","last_change":"2024-08-09T00:40:36.189393+0000","last_active":"2024-08-09T00:40:36.189314+0000","last_peered":"2024-08-09T00:40:36.189314+0000","last_clean":"2024-08-09T00:40:36.189314+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:40:36.189314+0000","last_undegraded":"2024-08-09T00:40:36.189314+0000","last_fullsized":"2024-08-09T00:40:36.189314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.189163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:32.228273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.680167+0000","last_change":"2024-08-09T00:40:42.680167+0000","last_active":"2024-08-09T00:40:42.680167+0000","last_peered":"2024-08-09T00:40:42.680167+0000","last_clean":"2024-08-09T00:40:42.680167+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:40:42.680167+0000","last_undegraded":"2024-08-09T00:40:42.680167+0000","last_fullsized":"2024-08-09T00:40:42.680167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.679754+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:38.367106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.563393+0000","last_change":"2024-08-09T00:41:29.563514+0000","last_active":"2024-08-09T00:41:29.563393+0000","last_peered":"2024-08-09T00:41:29.563393+0000","last_clean":"2024-08-09T00:41:29.563393+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:41:29.563393+0000","last_undegraded":"2024-08-09T00:41:29.563393+0000","last_fullsized":"2024-08-09T00:41:29.563393+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:29.563140+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:29.563140+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.563140+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:37.245189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.559441+0000","last_change":"2024-08-09T00:41:28.559513+0000","last_active":"2024-08-09T00:41:28.559441+0000","last_peered":"2024-08-09T00:41:28.559441+0000","last_clean":"2024-08-09T00:41:28.559441+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:41:28.559441+0000","last_undegraded":"2024-08-09T00:41:28.559441+0000","last_fullsized":"2024-08-09T00:41:28.559441+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:28.559253+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:28.559253+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.559253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:00.084906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'8","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.050854+0000","last_change":"2024-08-09T00:41:07.051008+0000","last_active":"2024-08-09T00:41:07.050854+0000","last_peered":"2024-08-09T00:41:07.050854+0000","last_clean":"2024-08-09T00:41:07.050854+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:41:07.050854+0000","last_undegraded":"2024-08-09T00:41:07.050854+0000","last_fullsized":"2024-08-09T00:41:07.050854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.050631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:47.276263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10240,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.953904+0000","last_change":"2024-08-09T00:40:36.953904+0000","last_active":"2024-08-09T00:40:36.953904+0000","last_peered":"2024-08-09T00:40:36.953904+0000","last_clean":"2024-08-09T00:40:36.953904+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:40:36.953904+0000","last_undegraded":"2024-08-09T00:40:36.953904+0000","last_fullsized":"2024-08-09T00:40:36.953904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.953505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:31:08.054694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:32.528146+0000","last_change":"2024-08-09T00:41:32.528218+0000","last_active":"2024-08-09T00:41:32.528146+0000","last_peered":"2024-08-09T00:41:32.528146+0000","last_clean":"2024-08-09T00:41:32.528146+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:41:32.528146+0000","last_undegraded":"2024-08-09T00:41:32.528146+0000","last_fullsized":"2024-08-09T00:41:32.528146+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:32.527940+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:32.527940+0000","last_clean_scrub_stamp":"2024-08-09T00:41:32.527940+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:15.744148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.049098+0000","last_change":"2024-08-09T00:41:11.049245+0000","last_active":"2024-08-09T00:41:11.049098+0000","last_peered":"2024-08-09T00:41:11.049098+0000","last_clean":"2024-08-09T00:41:11.049098+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:41:11.049098+0000","last_undegraded":"2024-08-09T00:41:11.049098+0000","last_fullsized":"2024-08-09T00:41:11.049098+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.048878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:07:10.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.148259+0000","last_change":"2024-08-09T00:41:19.148410+0000","last_active":"2024-08-09T00:41:19.148259+0000","last_peered":"2024-08-09T00:41:19.148259+0000","last_clean":"2024-08-09T00:41:19.148259+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:41:19.148259+0000","last_undegraded":"2024-08-09T00:41:19.148259+0000","last_fullsized":"2024-08-09T00:41:19.148259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:41:19.147995+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:41:19.147995+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.147995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:11:17.461019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.290222+0000","last_change":"2024-08-09T00:40:42.290222+0000","last_active":"2024-08-09T00:40:42.290222+0000","last_peered":"2024-08-09T00:40:42.290222+0000","last_clean":"2024-08-09T00:40:42.290222+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:40:42.290222+0000","last_undegraded":"2024-08-09T00:40:42.290222+0000","last_fullsized":"2024-08-09T00:40:42.290222+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.289963+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:20.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.004742+0000","last_change":"2024-08-09T00:41:06.004742+0000","last_active":"2024-08-09T00:41:06.004742+0000","last_peered":"2024-08-09T00:41:06.004742+0000","last_clean":"2024-08-09T00:41:06.004742+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:41:06.004742+0000","last_undegraded":"2024-08-09T00:41:06.004742+0000","last_fullsized":"2024-08-09T00:41:06.004742+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.004500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:50:16.004969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.356428+0000","last_change":"2024-08-09T00:40:55.356491+0000","last_active":"2024-08-09T00:40:55.356428+0000","last_peered":"2024-08-09T00:40:55.356428+0000","last_clean":"2024-08-09T00:40:55.356428+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:40:55.356428+0000","last_undegraded":"2024-08-09T00:40:55.356428+0000","last_fullsized":"2024-08-09T00:40:55.356428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.356225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:19:18.875712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.617885+0000","last_change":"2024-08-09T00:40:40.617947+0000","last_active":"2024-08-09T00:40:40.617885+0000","last_peered":"2024-08-09T00:40:40.617885+0000","last_clean":"2024-08-09T00:40:40.617885+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:40:40.617885+0000","last_undegraded":"2024-08-09T00:40:40.617885+0000","last_fullsized":"2024-08-09T00:40:40.617885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.617682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:12:17.390972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.221534+0000","last_change":"2024-08-09T00:40:37.221534+0000","last_active":"2024-08-09T00:40:37.221534+0000","last_peered":"2024-08-09T00:40:37.221534+0000","last_clean":"2024-08-09T00:40:37.221534+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:40:37.221534+0000","last_undegraded":"2024-08-09T00:40:37.221534+0000","last_fullsized":"2024-08-09T00:40:37.221534+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.221435+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:15.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.850392+0000","last_change":"2024-08-09T00:41:30.850525+0000","last_active":"2024-08-09T00:41:30.850392+0000","last_peered":"2024-08-09T00:41:30.850392+0000","last_clean":"2024-08-09T00:41:30.850392+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:41:30.850392+0000","last_undegraded":"2024-08-09T00:41:30.850392+0000","last_fullsized":"2024-08-09T00:41:30.850392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.850157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.850157+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.850157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:52:29.311754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.291641+0000","last_change":"2024-08-09T00:40:47.291758+0000","last_active":"2024-08-09T00:40:47.291641+0000","last_peered":"2024-08-09T00:40:47.291641+0000","last_clean":"2024-08-09T00:40:47.291641+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:40:47.291641+0000","last_undegraded":"2024-08-09T00:40:47.291641+0000","last_fullsized":"2024-08-09T00:40:47.291641+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.291419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:22.686399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21602,"num_write":20,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.187960+0000","last_change":"2024-08-09T00:40:36.187987+0000","last_active":"2024-08-09T00:40:36.187960+0000","last_peered":"2024-08-09T00:40:36.187960+0000","last_clean":"2024-08-09T00:40:36.187960+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:40:36.187960+0000","last_undegraded":"2024-08-09T00:40:36.187960+0000","last_fullsized":"2024-08-09T00:40:36.187960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.187856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:49.116286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.267812+0000","last_change":"2024-08-09T00:40:40.267812+0000","last_active":"2024-08-09T00:40:40.267812+0000","last_peered":"2024-08-09T00:40:40.267812+0000","last_clean":"2024-08-09T00:40:40.267812+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:40:40.267812+0000","last_undegraded":"2024-08-09T00:40:40.267812+0000","last_fullsized":"2024-08-09T00:40:40.267812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.267563+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:43:32.319577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.011164+0000","last_change":"2024-08-09T00:41:12.011164+0000","last_active":"2024-08-09T00:41:12.011164+0000","last_peered":"2024-08-09T00:41:12.011164+0000","last_clean":"2024-08-09T00:41:12.011164+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:41:12.011164+0000","last_undegraded":"2024-08-09T00:41:12.011164+0000","last_fullsized":"2024-08-09T00:41:12.011164+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.010911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:29.212890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'6","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.886252+0000","last_change":"2024-08-09T00:41:15.886387+0000","last_active":"2024-08-09T00:41:15.886252+0000","last_peered":"2024-08-09T00:41:15.886252+0000","last_clean":"2024-08-09T00:41:15.886252+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:41:15.886252+0000","last_undegraded":"2024-08-09T00:41:15.886252+0000","last_fullsized":"2024-08-09T00:41:15.886252+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:15.886022+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:15.886022+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.886022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:47.010517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.617301+0000","last_change":"2024-08-09T00:40:52.617361+0000","last_active":"2024-08-09T00:40:52.617301+0000","last_peered":"2024-08-09T00:40:52.617301+0000","last_clean":"2024-08-09T00:40:52.617301+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:40:52.617301+0000","last_undegraded":"2024-08-09T00:40:52.617301+0000","last_fullsized":"2024-08-09T00:40:52.617301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.617100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:13:44.945362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.872232+0000","last_change":"2024-08-09T00:40:40.872232+0000","last_active":"2024-08-09T00:40:40.872232+0000","last_peered":"2024-08-09T00:40:40.872232+0000","last_clean":"2024-08-09T00:40:40.872232+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:40:40.872232+0000","last_undegraded":"2024-08-09T00:40:40.872232+0000","last_fullsized":"2024-08-09T00:40:40.872232+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.871937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:00:56.402314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.890540+0000","last_change":"2024-08-09T00:41:31.890598+0000","last_active":"2024-08-09T00:41:31.890540+0000","last_peered":"2024-08-09T00:41:31.890540+0000","last_clean":"2024-08-09T00:41:31.890540+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:41:31.890540+0000","last_undegraded":"2024-08-09T00:41:31.890540+0000","last_fullsized":"2024-08-09T00:41:31.890540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.890312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.890312+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.890312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:23:39.034164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.321654+0000","last_change":"2024-08-09T00:40:51.321769+0000","last_active":"2024-08-09T00:40:51.321654+0000","last_peered":"2024-08-09T00:40:51.321654+0000","last_clean":"2024-08-09T00:40:51.321654+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:40:51.321654+0000","last_undegraded":"2024-08-09T00:40:51.321654+0000","last_fullsized":"2024-08-09T00:40:51.321654+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.321317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:07.828364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.818946+0000","last_change":"2024-08-09T00:40:37.819109+0000","last_active":"2024-08-09T00:40:37.818946+0000","last_peered":"2024-08-09T00:40:37.818946+0000","last_clean":"2024-08-09T00:40:37.818946+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:40:37.818946+0000","last_undegraded":"2024-08-09T00:40:37.818946+0000","last_fullsized":"2024-08-09T00:40:37.818946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.818705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:34.295358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.074220+0000","last_change":"2024-08-09T00:41:02.074220+0000","last_active":"2024-08-09T00:41:02.074220+0000","last_peered":"2024-08-09T00:41:02.074220+0000","last_clean":"2024-08-09T00:41:02.074220+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:41:02.074220+0000","last_undegraded":"2024-08-09T00:41:02.074220+0000","last_fullsized":"2024-08-09T00:41:02.074220+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.073969+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:30:35.961027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:32.705514+0000","last_change":"2024-08-09T00:04:29.875038+0000","last_active":"2024-08-09T00:40:32.705514+0000","last_peered":"2024-08-09T00:40:32.705514+0000","last_clean":"2024-08-09T00:40:32.705514+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:40:32.705514+0000","last_undegraded":"2024-08-09T00:40:32.705514+0000","last_fullsized":"2024-08-09T00:40:32.705514+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.331877+0000","last_change":"2024-08-09T00:41:19.331939+0000","last_active":"2024-08-09T00:41:19.331877+0000","last_peered":"2024-08-09T00:41:19.331877+0000","last_clean":"2024-08-09T00:41:19.331877+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:41:19.331877+0000","last_undegraded":"2024-08-09T00:41:19.331877+0000","last_fullsized":"2024-08-09T00:41:19.331877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:19.331682+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:19.331682+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.331682+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:08:52.245568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.641196+0000","last_change":"2024-08-09T00:40:48.641266+0000","last_active":"2024-08-09T00:40:48.641196+0000","last_peered":"2024-08-09T00:40:48.641196+0000","last_clean":"2024-08-09T00:40:48.641196+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:40:48.641196+0000","last_undegraded":"2024-08-09T00:40:48.641196+0000","last_fullsized":"2024-08-09T00:40:48.641196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.640998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:55:08.396765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.681164+0000","last_change":"2024-08-09T00:40:43.681164+0000","last_active":"2024-08-09T00:40:43.681164+0000","last_peered":"2024-08-09T00:40:43.681164+0000","last_clean":"2024-08-09T00:40:43.681164+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:40:43.681164+0000","last_undegraded":"2024-08-09T00:40:43.681164+0000","last_fullsized":"2024-08-09T00:40:43.681164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.680900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:05.167122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.068530+0000","last_change":"2024-08-09T00:04:29.884810+0000","last_active":"2024-08-09T00:40:37.068530+0000","last_peered":"2024-08-09T00:40:37.068530+0000","last_clean":"2024-08-09T00:40:37.068530+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:40:37.068530+0000","last_undegraded":"2024-08-09T00:40:37.068530+0000","last_fullsized":"2024-08-09T00:40:37.068530+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:04:28.810711+0000","last_clean_scrub_stamp":"2024-08-09T00:04:28.810711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.492000+0000","last_change":"2024-08-09T00:40:48.492064+0000","last_active":"2024-08-09T00:40:48.492000+0000","last_peered":"2024-08-09T00:40:48.492000+0000","last_clean":"2024-08-09T00:40:48.492000+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:40:48.492000+0000","last_undegraded":"2024-08-09T00:40:48.492000+0000","last_fullsized":"2024-08-09T00:40:48.492000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.491783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:04:46.088876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.785042+0000","last_change":"2024-08-09T00:40:35.785042+0000","last_active":"2024-08-09T00:40:35.785042+0000","last_peered":"2024-08-09T00:40:35.785042+0000","last_clean":"2024-08-09T00:40:35.785042+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:40:35.785042+0000","last_undegraded":"2024-08-09T00:40:35.785042+0000","last_fullsized":"2024-08-09T00:40:35.785042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.784595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:17:51.280650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.531782+0000","last_change":"2024-08-09T00:40:47.531782+0000","last_active":"2024-08-09T00:40:47.531782+0000","last_peered":"2024-08-09T00:40:47.531782+0000","last_clean":"2024-08-09T00:40:47.531782+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:40:47.531782+0000","last_undegraded":"2024-08-09T00:40:47.531782+0000","last_fullsized":"2024-08-09T00:40:47.531782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.531527+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:25.997420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.590552+0000","last_change":"2024-08-09T00:41:00.590620+0000","last_active":"2024-08-09T00:41:00.590552+0000","last_peered":"2024-08-09T00:41:00.590552+0000","last_clean":"2024-08-09T00:41:00.590552+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:41:00.590552+0000","last_undegraded":"2024-08-09T00:41:00.590552+0000","last_fullsized":"2024-08-09T00:41:00.590552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.590347+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:18:27.821143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.750685+0000","last_change":"2024-08-09T00:40:45.750799+0000","last_active":"2024-08-09T00:40:45.750685+0000","last_peered":"2024-08-09T00:40:45.750685+0000","last_clean":"2024-08-09T00:40:45.750685+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:40:45.750685+0000","last_undegraded":"2024-08-09T00:40:45.750685+0000","last_fullsized":"2024-08-09T00:40:45.750685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.750417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:11.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.685218+0000","last_change":"2024-08-09T00:40:40.685218+0000","last_active":"2024-08-09T00:40:40.685218+0000","last_peered":"2024-08-09T00:40:40.685218+0000","last_clean":"2024-08-09T00:40:40.685218+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:40:40.685218+0000","last_undegraded":"2024-08-09T00:40:40.685218+0000","last_fullsized":"2024-08-09T00:40:40.685218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.684961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:53.340721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.348843+0000","last_change":"2024-08-09T00:40:44.348843+0000","last_active":"2024-08-09T00:40:44.348843+0000","last_peered":"2024-08-09T00:40:44.348843+0000","last_clean":"2024-08-09T00:40:44.348843+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:40:44.348843+0000","last_undegraded":"2024-08-09T00:40:44.348843+0000","last_fullsized":"2024-08-09T00:40:44.348843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.348587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:09:49.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:32.532311+0000","last_change":"2024-08-09T00:41:32.532419+0000","last_active":"2024-08-09T00:41:32.532311+0000","last_peered":"2024-08-09T00:41:32.532311+0000","last_clean":"2024-08-09T00:41:32.532311+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:41:32.532311+0000","last_undegraded":"2024-08-09T00:41:32.532311+0000","last_fullsized":"2024-08-09T00:41:32.532311+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:32.532066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:32.532066+0000","last_clean_scrub_stamp":"2024-08-09T00:41:32.532066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:22:17.571585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.504759+0000","last_change":"2024-08-09T00:40:44.504759+0000","last_active":"2024-08-09T00:40:44.504759+0000","last_peered":"2024-08-09T00:40:44.504759+0000","last_clean":"2024-08-09T00:40:44.504759+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:40:44.504759+0000","last_undegraded":"2024-08-09T00:40:44.504759+0000","last_fullsized":"2024-08-09T00:40:44.504759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.504500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:10.357467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.012427+0000","last_change":"2024-08-09T00:40:42.012589+0000","last_active":"2024-08-09T00:40:42.012427+0000","last_peered":"2024-08-09T00:40:42.012427+0000","last_clean":"2024-08-09T00:40:42.012427+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:40:42.012427+0000","last_undegraded":"2024-08-09T00:40:42.012427+0000","last_fullsized":"2024-08-09T00:40:42.012427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.012179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:37.853605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.097064+0000","last_change":"2024-08-09T00:41:06.097064+0000","last_active":"2024-08-09T00:41:06.097064+0000","last_peered":"2024-08-09T00:41:06.097064+0000","last_clean":"2024-08-09T00:41:06.097064+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:41:06.097064+0000","last_undegraded":"2024-08-09T00:41:06.097064+0000","last_fullsized":"2024-08-09T00:41:06.097064+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.096779+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:14:32.896863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.808182+0000","last_change":"2024-08-09T00:41:29.808238+0000","last_active":"2024-08-09T00:41:29.808182+0000","last_peered":"2024-08-09T00:41:29.808182+0000","last_clean":"2024-08-09T00:41:29.808182+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:41:29.808182+0000","last_undegraded":"2024-08-09T00:41:29.808182+0000","last_fullsized":"2024-08-09T00:41:29.808182+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:29.807929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:29.807929+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.807929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:51.780052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'7","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.588080+0000","last_change":"2024-08-09T00:40:56.588080+0000","last_active":"2024-08-09T00:40:56.588080+0000","last_peered":"2024-08-09T00:40:56.588080+0000","last_clean":"2024-08-09T00:40:56.588080+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:40:56.588080+0000","last_undegraded":"2024-08-09T00:40:56.588080+0000","last_fullsized":"2024-08-09T00:40:56.588080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.587815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:06.658894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.639579+0000","last_change":"2024-08-09T00:40:38.639579+0000","last_active":"2024-08-09T00:40:38.639579+0000","last_peered":"2024-08-09T00:40:38.639579+0000","last_clean":"2024-08-09T00:40:38.639579+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:40:38.639579+0000","last_undegraded":"2024-08-09T00:40:38.639579+0000","last_fullsized":"2024-08-09T00:40:38.639579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.639308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:48.995525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.691644+0000","last_change":"2024-08-09T00:40:37.691644+0000","last_active":"2024-08-09T00:40:37.691644+0000","last_peered":"2024-08-09T00:40:37.691644+0000","last_clean":"2024-08-09T00:40:37.691644+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:40:37.691644+0000","last_undegraded":"2024-08-09T00:40:37.691644+0000","last_fullsized":"2024-08-09T00:40:37.691644+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.691368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:15:07.123436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.047426+0000","last_change":"2024-08-09T00:41:25.047481+0000","last_active":"2024-08-09T00:41:25.047426+0000","last_peered":"2024-08-09T00:41:25.047426+0000","last_clean":"2024-08-09T00:41:25.047426+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:41:25.047426+0000","last_undegraded":"2024-08-09T00:41:25.047426+0000","last_fullsized":"2024-08-09T00:41:25.047426+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:25.047228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:25.047228+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.047228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:30:38.942347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.604672+0000","last_change":"2024-08-09T00:41:00.604736+0000","last_active":"2024-08-09T00:41:00.604672+0000","last_peered":"2024-08-09T00:41:00.604672+0000","last_clean":"2024-08-09T00:41:00.604672+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:41:00.604672+0000","last_undegraded":"2024-08-09T00:41:00.604672+0000","last_fullsized":"2024-08-09T00:41:00.604672+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.604461+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:51.169699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.060533+0000","last_change":"2024-08-09T00:41:03.060593+0000","last_active":"2024-08-09T00:41:03.060533+0000","last_peered":"2024-08-09T00:41:03.060533+0000","last_clean":"2024-08-09T00:41:03.060533+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:41:03.060533+0000","last_undegraded":"2024-08-09T00:41:03.060533+0000","last_fullsized":"2024-08-09T00:41:03.060533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.060324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:13:49.765010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'86","reported_seq":339,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.895905+0000","last_change":"2024-08-09T00:40:37.895905+0000","last_active":"2024-08-09T00:40:37.895905+0000","last_peered":"2024-08-09T00:40:37.895905+0000","last_clean":"2024-08-09T00:40:37.895905+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:40:37.895905+0000","last_undegraded":"2024-08-09T00:40:37.895905+0000","last_fullsized":"2024-08-09T00:40:37.895905+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.895611+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:36:13.014150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3248,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.903278+0000","last_change":"2024-08-09T00:41:17.903387+0000","last_active":"2024-08-09T00:41:17.903278+0000","last_peered":"2024-08-09T00:41:17.903278+0000","last_clean":"2024-08-09T00:41:17.903278+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:41:17.903278+0000","last_undegraded":"2024-08-09T00:41:17.903278+0000","last_fullsized":"2024-08-09T00:41:17.903278+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:17.902987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:17.902987+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.902987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:41.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.614833+0000","last_change":"2024-08-09T00:40:52.614893+0000","last_active":"2024-08-09T00:40:52.614833+0000","last_peered":"2024-08-09T00:40:52.614833+0000","last_clean":"2024-08-09T00:40:52.614833+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:40:52.614833+0000","last_undegraded":"2024-08-09T00:40:52.614833+0000","last_fullsized":"2024-08-09T00:40:52.614833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.614638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:19.525948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'7","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.214947+0000","last_change":"2024-08-09T00:40:48.215013+0000","last_active":"2024-08-09T00:40:48.214947+0000","last_peered":"2024-08-09T00:40:48.214947+0000","last_clean":"2024-08-09T00:40:48.214947+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:40:48.214947+0000","last_undegraded":"2024-08-09T00:40:48.214947+0000","last_fullsized":"2024-08-09T00:40:48.214947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.214757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:00.067724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.530066+0000","last_change":"2024-08-09T00:40:46.530066+0000","last_active":"2024-08-09T00:40:46.530066+0000","last_peered":"2024-08-09T00:40:46.530066+0000","last_clean":"2024-08-09T00:40:46.530066+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:40:46.530066+0000","last_undegraded":"2024-08-09T00:40:46.530066+0000","last_fullsized":"2024-08-09T00:40:46.530066+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.529798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:28.838684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.332848+0000","last_change":"2024-08-09T00:41:23.333036+0000","last_active":"2024-08-09T00:41:23.332848+0000","last_peered":"2024-08-09T00:41:23.332848+0000","last_clean":"2024-08-09T00:41:23.332848+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:41:23.332848+0000","last_undegraded":"2024-08-09T00:41:23.332848+0000","last_fullsized":"2024-08-09T00:41:23.332848+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:23.332612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:23.332612+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.332612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:45.141929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.299734+0000","last_change":"2024-08-09T00:41:18.299795+0000","last_active":"2024-08-09T00:41:18.299734+0000","last_peered":"2024-08-09T00:41:18.299734+0000","last_clean":"2024-08-09T00:41:18.299734+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:41:18.299734+0000","last_undegraded":"2024-08-09T00:41:18.299734+0000","last_fullsized":"2024-08-09T00:41:18.299734+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:18.299529+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:18.299529+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.299529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:44.560774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7184,"num_write":6,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.642345+0000","last_change":"2024-08-09T00:40:39.642407+0000","last_active":"2024-08-09T00:40:39.642345+0000","last_peered":"2024-08-09T00:40:39.642345+0000","last_clean":"2024-08-09T00:40:39.642345+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:40:39.642345+0000","last_undegraded":"2024-08-09T00:40:39.642345+0000","last_fullsized":"2024-08-09T00:40:39.642345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.642111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:06:21.202789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.771514+0000","last_change":"2024-08-09T00:40:38.771514+0000","last_active":"2024-08-09T00:40:38.771514+0000","last_peered":"2024-08-09T00:40:38.771514+0000","last_clean":"2024-08-09T00:40:38.771514+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:40:38.771514+0000","last_undegraded":"2024-08-09T00:40:38.771514+0000","last_fullsized":"2024-08-09T00:40:38.771514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.771257+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:13.221977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.998721+0000","last_change":"2024-08-09T00:41:08.998721+0000","last_active":"2024-08-09T00:41:08.998721+0000","last_peered":"2024-08-09T00:41:08.998721+0000","last_clean":"2024-08-09T00:41:08.998721+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:41:08.998721+0000","last_undegraded":"2024-08-09T00:41:08.998721+0000","last_fullsized":"2024-08-09T00:41:08.998721+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.998456+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:46.509152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'8","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.910817+0000","last_change":"2024-08-09T00:41:12.910993+0000","last_active":"2024-08-09T00:41:12.910817+0000","last_peered":"2024-08-09T00:41:12.910817+0000","last_clean":"2024-08-09T00:41:12.910817+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:41:12.910817+0000","last_undegraded":"2024-08-09T00:41:12.910817+0000","last_fullsized":"2024-08-09T00:41:12.910817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:12.910568+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:12.910568+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.910568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:48.806511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.563040+0000","last_change":"2024-08-09T00:40:42.563040+0000","last_active":"2024-08-09T00:40:42.563040+0000","last_peered":"2024-08-09T00:40:42.563040+0000","last_clean":"2024-08-09T00:40:42.563040+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:40:42.563040+0000","last_undegraded":"2024-08-09T00:40:42.563040+0000","last_fullsized":"2024-08-09T00:40:42.563040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.562784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:16.829344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.262213+0000","last_change":"2024-08-09T00:40:44.262213+0000","last_active":"2024-08-09T00:40:44.262213+0000","last_peered":"2024-08-09T00:40:44.262213+0000","last_clean":"2024-08-09T00:40:44.262213+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:40:44.262213+0000","last_undegraded":"2024-08-09T00:40:44.262213+0000","last_fullsized":"2024-08-09T00:40:44.262213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.261956+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:37.462204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.568698+0000","last_change":"2024-08-09T00:41:31.568812+0000","last_active":"2024-08-09T00:41:31.568698+0000","last_peered":"2024-08-09T00:41:31.568698+0000","last_clean":"2024-08-09T00:41:31.568698+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:41:31.568698+0000","last_undegraded":"2024-08-09T00:41:31.568698+0000","last_fullsized":"2024-08-09T00:41:31.568698+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.568467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.568467+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.568467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:21:55.784188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.105810+0000","last_change":"2024-08-09T00:41:20.105868+0000","last_active":"2024-08-09T00:41:20.105810+0000","last_peered":"2024-08-09T00:41:20.105810+0000","last_clean":"2024-08-09T00:41:20.105810+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:41:20.105810+0000","last_undegraded":"2024-08-09T00:41:20.105810+0000","last_fullsized":"2024-08-09T00:41:20.105810+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:41:20.105618+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:41:20.105618+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.105618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:00.785561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.595802+0000","last_change":"2024-08-09T00:40:41.595802+0000","last_active":"2024-08-09T00:40:41.595802+0000","last_peered":"2024-08-09T00:40:41.595802+0000","last_clean":"2024-08-09T00:40:41.595802+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:40:41.595802+0000","last_undegraded":"2024-08-09T00:40:41.595802+0000","last_fullsized":"2024-08-09T00:40:41.595802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.595540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:00.572160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.906989+0000","last_change":"2024-08-09T00:40:35.906989+0000","last_active":"2024-08-09T00:40:35.906989+0000","last_peered":"2024-08-09T00:40:35.906989+0000","last_clean":"2024-08-09T00:40:35.906989+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:40:35.906989+0000","last_undegraded":"2024-08-09T00:40:35.906989+0000","last_fullsized":"2024-08-09T00:40:35.906989+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.906730+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:03:23.261597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.540507+0000","last_change":"2024-08-09T00:41:30.540574+0000","last_active":"2024-08-09T00:41:30.540507+0000","last_peered":"2024-08-09T00:41:30.540507+0000","last_clean":"2024-08-09T00:41:30.540507+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:41:30.540507+0000","last_undegraded":"2024-08-09T00:41:30.540507+0000","last_fullsized":"2024-08-09T00:41:30.540507+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.540289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.540289+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.540289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:53:15.479053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.063238+0000","last_change":"2024-08-09T00:41:09.063328+0000","last_active":"2024-08-09T00:41:09.063238+0000","last_peered":"2024-08-09T00:41:09.063238+0000","last_clean":"2024-08-09T00:41:09.063238+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:41:09.063238+0000","last_undegraded":"2024-08-09T00:41:09.063238+0000","last_fullsized":"2024-08-09T00:41:09.063238+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.062923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:16:05.039859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.691491+0000","last_change":"2024-08-09T00:40:41.691491+0000","last_active":"2024-08-09T00:40:41.691491+0000","last_peered":"2024-08-09T00:40:41.691491+0000","last_clean":"2024-08-09T00:40:41.691491+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:40:41.691491+0000","last_undegraded":"2024-08-09T00:40:41.691491+0000","last_fullsized":"2024-08-09T00:40:41.691491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.691090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:04:50.076445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.899972+0000","last_change":"2024-08-09T00:40:38.899972+0000","last_active":"2024-08-09T00:40:38.899972+0000","last_peered":"2024-08-09T00:40:38.899972+0000","last_clean":"2024-08-09T00:40:38.899972+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:40:38.899972+0000","last_undegraded":"2024-08-09T00:40:38.899972+0000","last_fullsized":"2024-08-09T00:40:38.899972+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.899571+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:03.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.697082+0000","last_change":"2024-08-09T00:40:56.697187+0000","last_active":"2024-08-09T00:40:56.697082+0000","last_peered":"2024-08-09T00:40:56.697082+0000","last_clean":"2024-08-09T00:40:56.697082+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:40:56.697082+0000","last_undegraded":"2024-08-09T00:40:56.697082+0000","last_fullsized":"2024-08-09T00:40:56.697082+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.696850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:28:39.200712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.309045+0000","last_change":"2024-08-09T00:41:20.309112+0000","last_active":"2024-08-09T00:41:20.309045+0000","last_peered":"2024-08-09T00:41:20.309045+0000","last_clean":"2024-08-09T00:41:20.309045+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:41:20.309045+0000","last_undegraded":"2024-08-09T00:41:20.309045+0000","last_fullsized":"2024-08-09T00:41:20.309045+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:20.308852+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:20.308852+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.308852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:33:26.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.889285+0000","last_change":"2024-08-09T00:40:39.889285+0000","last_active":"2024-08-09T00:40:39.889285+0000","last_peered":"2024-08-09T00:40:39.889285+0000","last_clean":"2024-08-09T00:40:39.889285+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:40:39.889285+0000","last_undegraded":"2024-08-09T00:40:39.889285+0000","last_fullsized":"2024-08-09T00:40:39.889285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.889006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:10.545546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'76","reported_seq":308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.502863+0000","last_change":"2024-08-09T00:40:49.502863+0000","last_active":"2024-08-09T00:40:49.502863+0000","last_peered":"2024-08-09T00:40:49.502863+0000","last_clean":"2024-08-09T00:40:49.502863+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:40:49.502863+0000","last_undegraded":"2024-08-09T00:40:49.502863+0000","last_fullsized":"2024-08-09T00:40:49.502863+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.502595+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:44:42.439163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2970,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'160","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.746254+0000","last_change":"2024-08-09T00:41:23.746355+0000","last_active":"2024-08-09T00:41:23.746254+0000","last_peered":"2024-08-09T00:41:23.746254+0000","last_clean":"2024-08-09T00:41:23.746254+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:41:23.746254+0000","last_undegraded":"2024-08-09T00:41:23.746254+0000","last_fullsized":"2024-08-09T00:41:23.746254+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:23.746032+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:23.746032+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.746032+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:24.195653+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850193,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":340,"num_read_kb":12258,"num_write":951,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.203061+0000","last_change":"2024-08-09T00:40:55.203061+0000","last_active":"2024-08-09T00:40:55.203061+0000","last_peered":"2024-08-09T00:40:55.203061+0000","last_clean":"2024-08-09T00:40:55.203061+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:40:55.203061+0000","last_undegraded":"2024-08-09T00:40:55.203061+0000","last_fullsized":"2024-08-09T00:40:55.203061+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.202784+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:48.362184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'191","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.952180+0000","last_change":"2024-08-09T00:41:08.952180+0000","last_active":"2024-08-09T00:41:08.952180+0000","last_peered":"2024-08-09T00:41:08.952180+0000","last_clean":"2024-08-09T00:41:08.952180+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:41:08.952180+0000","last_undegraded":"2024-08-09T00:41:08.952180+0000","last_fullsized":"2024-08-09T00:41:08.952180+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.951911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:39.305150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":3384,"num_write":904,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'235","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.617024+0000","last_change":"2024-08-09T00:41:05.617090+0000","last_active":"2024-08-09T00:41:05.617024+0000","last_peered":"2024-08-09T00:41:05.617024+0000","last_clean":"2024-08-09T00:41:05.617024+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:41:05.617024+0000","last_undegraded":"2024-08-09T00:41:05.617024+0000","last_fullsized":"2024-08-09T00:41:05.617024+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.616835+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:52:10.896240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":527,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'216","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.565748+0000","last_change":"2024-08-09T00:41:19.565748+0000","last_active":"2024-08-09T00:41:19.565748+0000","last_peered":"2024-08-09T00:41:19.565748+0000","last_clean":"2024-08-09T00:41:19.565748+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:41:19.565748+0000","last_undegraded":"2024-08-09T00:41:19.565748+0000","last_fullsized":"2024-08-09T00:41:19.565748+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-08-09T00:41:19.565327+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-08-09T00:41:19.565327+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.565327+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:24:05.617684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":22668,"num_write":1178,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.114112+0000","last_change":"2024-08-09T00:41:05.114174+0000","last_active":"2024-08-09T00:41:05.114112+0000","last_peered":"2024-08-09T00:41:05.114112+0000","last_clean":"2024-08-09T00:41:05.114112+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:41:05.114112+0000","last_undegraded":"2024-08-09T00:41:05.114112+0000","last_fullsized":"2024-08-09T00:41:05.114112+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.113918+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:33:20.516143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'200","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.116081+0000","last_change":"2024-08-09T00:41:01.116200+0000","last_active":"2024-08-09T00:41:01.116081+0000","last_peered":"2024-08-09T00:41:01.116081+0000","last_clean":"2024-08-09T00:41:01.116081+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:41:01.116081+0000","last_undegraded":"2024-08-09T00:41:01.116081+0000","last_fullsized":"2024-08-09T00:41:01.116081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.115878+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:35.058861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568643,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":448,"num_read_kb":38040,"num_write":1155,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.488980+0000","last_change":"2024-08-09T00:41:15.489041+0000","last_active":"2024-08-09T00:41:15.488980+0000","last_peered":"2024-08-09T00:41:15.488980+0000","last_clean":"2024-08-09T00:41:15.488980+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:41:15.488980+0000","last_undegraded":"2024-08-09T00:41:15.488980+0000","last_fullsized":"2024-08-09T00:41:15.488980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'82","last_scrub_stamp":"2024-08-09T00:41:15.488754+0000","last_deep_scrub":"268'82","last_deep_scrub_stamp":"2024-08-09T00:41:15.488754+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.488754+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:48.690230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'215","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.766664+0000","last_change":"2024-08-09T00:40:39.766664+0000","last_active":"2024-08-09T00:40:39.766664+0000","last_peered":"2024-08-09T00:40:39.766664+0000","last_clean":"2024-08-09T00:40:39.766664+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:40:39.766664+0000","last_undegraded":"2024-08-09T00:40:39.766664+0000","last_fullsized":"2024-08-09T00:40:39.766664+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.766288+0000","objects_scrubbed":10,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:26:32.617815+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8746313,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":21778,"num_write":1217,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.141948+0000","last_change":"2024-08-09T00:41:05.142012+0000","last_active":"2024-08-09T00:41:05.141948+0000","last_peered":"2024-08-09T00:41:05.141948+0000","last_clean":"2024-08-09T00:41:05.141948+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:41:05.141948+0000","last_undegraded":"2024-08-09T00:41:05.141948+0000","last_fullsized":"2024-08-09T00:41:05.141948+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.141756+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:03.113824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'189","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.095124+0000","last_change":"2024-08-09T00:41:07.095339+0000","last_active":"2024-08-09T00:41:07.095124+0000","last_peered":"2024-08-09T00:41:07.095124+0000","last_clean":"2024-08-09T00:41:07.095124+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:41:07.095124+0000","last_undegraded":"2024-08-09T00:41:07.095124+0000","last_fullsized":"2024-08-09T00:41:07.095124+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.094845+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:36:35.837560+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49415,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":54098,"num_write":1119,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.309373+0000","last_change":"2024-08-09T00:41:15.309373+0000","last_active":"2024-08-09T00:41:15.309373+0000","last_peered":"2024-08-09T00:41:15.309373+0000","last_clean":"2024-08-09T00:41:15.309373+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:41:15.309373+0000","last_undegraded":"2024-08-09T00:41:15.309373+0000","last_fullsized":"2024-08-09T00:41:15.309373+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:41:15.309122+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:41:15.309122+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.309122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:31:25.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'197","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.743514+0000","last_change":"2024-08-09T00:41:21.743606+0000","last_active":"2024-08-09T00:41:21.743514+0000","last_peered":"2024-08-09T00:41:21.743514+0000","last_clean":"2024-08-09T00:41:21.743514+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:41:21.743514+0000","last_undegraded":"2024-08-09T00:41:21.743514+0000","last_fullsized":"2024-08-09T00:41:21.743514+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'197","last_scrub_stamp":"2024-08-09T00:41:21.743305+0000","last_deep_scrub":"268'197","last_deep_scrub_stamp":"2024-08-09T00:41:21.743305+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.743305+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:45:02.031739+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743987,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":11259,"num_write":1113,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'107","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.180343+0000","last_change":"2024-08-09T00:40:57.180343+0000","last_active":"2024-08-09T00:40:57.180343+0000","last_peered":"2024-08-09T00:40:57.180343+0000","last_clean":"2024-08-09T00:40:57.180343+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:40:57.180343+0000","last_undegraded":"2024-08-09T00:40:57.180343+0000","last_fullsized":"2024-08-09T00:40:57.180343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'107","last_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_deep_scrub":"268'107","last_deep_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.180097+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:33:50.782470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'155","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.503781+0000","last_change":"2024-08-09T00:41:25.503877+0000","last_active":"2024-08-09T00:41:25.503781+0000","last_peered":"2024-08-09T00:41:25.503781+0000","last_clean":"2024-08-09T00:41:25.503781+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:41:25.503781+0000","last_undegraded":"2024-08-09T00:41:25.503781+0000","last_fullsized":"2024-08-09T00:41:25.503781+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-08-09T00:41:25.503580+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-08-09T00:41:25.503580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.503580+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:11.318212+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":32780,"num_write":887,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'209","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.112559+0000","last_change":"2024-08-09T00:40:59.112559+0000","last_active":"2024-08-09T00:40:59.112559+0000","last_peered":"2024-08-09T00:40:59.112559+0000","last_clean":"2024-08-09T00:40:59.112559+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:40:59.112559+0000","last_undegraded":"2024-08-09T00:40:59.112559+0000","last_fullsized":"2024-08-09T00:40:59.112559+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.112286+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.598671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":263,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'34","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.101640+0000","last_change":"2024-08-09T00:41:03.101708+0000","last_active":"2024-08-09T00:41:03.101640+0000","last_peered":"2024-08-09T00:41:03.101640+0000","last_clean":"2024-08-09T00:41:03.101640+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:41:03.101640+0000","last_undegraded":"2024-08-09T00:41:03.101640+0000","last_fullsized":"2024-08-09T00:41:03.101640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.101426+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:13.790151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'172","reported_seq":791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.608773+0000","last_change":"2024-08-09T00:41:13.608870+0000","last_active":"2024-08-09T00:41:13.608773+0000","last_peered":"2024-08-09T00:41:13.608773+0000","last_clean":"2024-08-09T00:41:13.608773+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:41:13.608773+0000","last_undegraded":"2024-08-09T00:41:13.608773+0000","last_fullsized":"2024-08-09T00:41:13.608773+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-08-09T00:41:13.608571+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-08-09T00:41:13.608571+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.608571+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:10.191297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":8171,"num_write":1047,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.633161+0000","last_change":"2024-08-09T00:41:03.633221+0000","last_active":"2024-08-09T00:41:03.633161+0000","last_peered":"2024-08-09T00:41:03.633161+0000","last_clean":"2024-08-09T00:41:03.633161+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:41:03.633161+0000","last_undegraded":"2024-08-09T00:41:03.633161+0000","last_fullsized":"2024-08-09T00:41:03.633161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.632964+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:20:37.391665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'198","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.231893+0000","last_change":"2024-08-09T00:40:46.231893+0000","last_active":"2024-08-09T00:40:46.231893+0000","last_peered":"2024-08-09T00:40:46.231893+0000","last_clean":"2024-08-09T00:40:46.231893+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:40:46.231893+0000","last_undegraded":"2024-08-09T00:40:46.231893+0000","last_fullsized":"2024-08-09T00:40:46.231893+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.231597+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:55.781502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":6729,"num_write":999,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.201532+0000","last_change":"2024-08-09T00:40:54.201532+0000","last_active":"2024-08-09T00:40:54.201532+0000","last_peered":"2024-08-09T00:40:54.201532+0000","last_clean":"2024-08-09T00:40:54.201532+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:40:54.201532+0000","last_undegraded":"2024-08-09T00:40:54.201532+0000","last_fullsized":"2024-08-09T00:40:54.201532+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.201267+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:12.747587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'246","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.180957+0000","last_change":"2024-08-09T00:41:04.181040+0000","last_active":"2024-08-09T00:41:04.180957+0000","last_peered":"2024-08-09T00:41:04.180957+0000","last_clean":"2024-08-09T00:41:04.180957+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:41:04.180957+0000","last_undegraded":"2024-08-09T00:41:04.180957+0000","last_fullsized":"2024-08-09T00:41:04.180957+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.180754+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:04:49.717911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":13197,"num_write":1122,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'22","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.113760+0000","last_change":"2024-08-09T00:40:58.113824+0000","last_active":"2024-08-09T00:40:58.113760+0000","last_peered":"2024-08-09T00:40:58.113760+0000","last_clean":"2024-08-09T00:40:58.113760+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:40:58.113760+0000","last_undegraded":"2024-08-09T00:40:58.113760+0000","last_fullsized":"2024-08-09T00:40:58.113760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.113559+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:11:08.699949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'176","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.219376+0000","last_change":"2024-08-09T00:40:40.219376+0000","last_active":"2024-08-09T00:40:40.219376+0000","last_peered":"2024-08-09T00:40:40.219376+0000","last_clean":"2024-08-09T00:40:40.219376+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:40:40.219376+0000","last_undegraded":"2024-08-09T00:40:40.219376+0000","last_fullsized":"2024-08-09T00:40:40.219376+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.219095+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:19.550329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":29619,"num_write":952,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.112836+0000","last_change":"2024-08-09T00:41:01.112901+0000","last_active":"2024-08-09T00:41:01.112836+0000","last_peered":"2024-08-09T00:41:01.112836+0000","last_clean":"2024-08-09T00:41:01.112836+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:41:01.112836+0000","last_undegraded":"2024-08-09T00:41:01.112836+0000","last_fullsized":"2024-08-09T00:41:01.112836+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.112641+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:24.506004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'166","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.429876+0000","last_change":"2024-08-09T00:41:22.429993+0000","last_active":"2024-08-09T00:41:22.429876+0000","last_peered":"2024-08-09T00:41:22.429876+0000","last_clean":"2024-08-09T00:41:22.429876+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:41:22.429876+0000","last_undegraded":"2024-08-09T00:41:22.429876+0000","last_fullsized":"2024-08-09T00:41:22.429876+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:41:22.429666+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:41:22.429666+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.429666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:51.824803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146116,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":37287,"num_write":965,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.001404+0000","last_change":"2024-08-09T00:41:01.001568+0000","last_active":"2024-08-09T00:41:01.001404+0000","last_peered":"2024-08-09T00:41:01.001404+0000","last_clean":"2024-08-09T00:41:01.001404+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:41:01.001404+0000","last_undegraded":"2024-08-09T00:41:01.001404+0000","last_fullsized":"2024-08-09T00:41:01.001404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.001176+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:30:05.967079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'222","reported_seq":856,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.526088+0000","last_change":"2024-08-09T00:41:20.526160+0000","last_active":"2024-08-09T00:41:20.526088+0000","last_peered":"2024-08-09T00:41:20.526088+0000","last_clean":"2024-08-09T00:41:20.526088+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:41:20.526088+0000","last_undegraded":"2024-08-09T00:41:20.526088+0000","last_fullsized":"2024-08-09T00:41:20.526088+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'222","last_scrub_stamp":"2024-08-09T00:41:20.525883+0000","last_deep_scrub":"268'222","last_deep_scrub_stamp":"2024-08-09T00:41:20.525883+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.525883+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:11.546286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":428,"num_read_kb":738,"num_write":1172,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'110","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.001523+0000","last_change":"2024-08-09T00:40:41.001523+0000","last_active":"2024-08-09T00:40:41.001523+0000","last_peered":"2024-08-09T00:40:41.001523+0000","last_clean":"2024-08-09T00:40:41.001523+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:40:41.001523+0000","last_undegraded":"2024-08-09T00:40:41.001523+0000","last_fullsized":"2024-08-09T00:40:41.001523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.001229+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:58:15.431511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.262057+0000","last_change":"2024-08-09T00:40:42.262175+0000","last_active":"2024-08-09T00:40:42.262057+0000","last_peered":"2024-08-09T00:40:42.262057+0000","last_clean":"2024-08-09T00:40:42.262057+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:40:42.262057+0000","last_undegraded":"2024-08-09T00:40:42.262057+0000","last_fullsized":"2024-08-09T00:40:42.262057+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.261780+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:47.848829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'178","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.553323+0000","last_change":"2024-08-09T00:40:50.553409+0000","last_active":"2024-08-09T00:40:50.553323+0000","last_peered":"2024-08-09T00:40:50.553323+0000","last_clean":"2024-08-09T00:40:50.553323+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:40:50.553323+0000","last_undegraded":"2024-08-09T00:40:50.553323+0000","last_fullsized":"2024-08-09T00:40:50.553323+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.553124+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:04.843417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":22191,"num_write":1038,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.031946+0000","last_change":"2024-08-09T00:41:04.031999+0000","last_active":"2024-08-09T00:41:04.031946+0000","last_peered":"2024-08-09T00:41:04.031946+0000","last_clean":"2024-08-09T00:41:04.031946+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:41:04.031946+0000","last_undegraded":"2024-08-09T00:41:04.031946+0000","last_fullsized":"2024-08-09T00:41:04.031946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.031745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:48.346071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'226","reported_seq":868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.529553+0000","last_change":"2024-08-09T00:41:16.529635+0000","last_active":"2024-08-09T00:41:16.529553+0000","last_peered":"2024-08-09T00:41:16.529553+0000","last_clean":"2024-08-09T00:41:16.529553+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:41:16.529553+0000","last_undegraded":"2024-08-09T00:41:16.529553+0000","last_fullsized":"2024-08-09T00:41:16.529553+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-08-09T00:41:16.529355+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-08-09T00:41:16.529355+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.529355+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:40:00.253593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":290,"num_write":170,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.721552+0000","last_change":"2024-08-09T00:40:55.721552+0000","last_active":"2024-08-09T00:40:55.721552+0000","last_peered":"2024-08-09T00:40:55.721552+0000","last_clean":"2024-08-09T00:40:55.721552+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:40:55.721552+0000","last_undegraded":"2024-08-09T00:40:55.721552+0000","last_fullsized":"2024-08-09T00:40:55.721552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.721289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:38:12.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2401","reported_seq":4294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.236142+0000","last_change":"2024-08-09T00:40:43.236142+0000","last_active":"2024-08-09T00:40:43.236142+0000","last_peered":"2024-08-09T00:40:43.236142+0000","last_clean":"2024-08-09T00:40:43.236142+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:40:43.236142+0000","last_undegraded":"2024-08-09T00:40:43.236142+0000","last_fullsized":"2024-08-09T00:40:43.236142+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2401","last_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_deep_scrub":"268'2401","last_deep_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.235885+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":2300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:26:55.409086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.137766+0000","last_change":"2024-08-09T00:41:00.137831+0000","last_active":"2024-08-09T00:41:00.137766+0000","last_peered":"2024-08-09T00:41:00.137766+0000","last_clean":"2024-08-09T00:41:00.137766+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:41:00.137766+0000","last_undegraded":"2024-08-09T00:41:00.137766+0000","last_fullsized":"2024-08-09T00:41:00.137766+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.137580+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:44.917221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'184","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.518319+0000","last_change":"2024-08-09T00:41:23.518437+0000","last_active":"2024-08-09T00:41:23.518319+0000","last_peered":"2024-08-09T00:41:23.518319+0000","last_clean":"2024-08-09T00:41:23.518319+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:41:23.518319+0000","last_undegraded":"2024-08-09T00:41:23.518319+0000","last_fullsized":"2024-08-09T00:41:23.518319+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:23.518119+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:23.518119+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.518119+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:02.433878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311673,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":392,"num_read_kb":16280,"num_write":970,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.464070+0000","last_change":"2024-08-09T00:41:15.464126+0000","last_active":"2024-08-09T00:41:15.464070+0000","last_peered":"2024-08-09T00:41:15.464070+0000","last_clean":"2024-08-09T00:41:15.464070+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:41:15.464070+0000","last_undegraded":"2024-08-09T00:41:15.464070+0000","last_fullsized":"2024-08-09T00:41:15.464070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:15.463866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:15.463866+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.463866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:14.987905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'113","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.352126+0000","last_change":"2024-08-09T00:41:16.352214+0000","last_active":"2024-08-09T00:41:16.352126+0000","last_peered":"2024-08-09T00:41:16.352126+0000","last_clean":"2024-08-09T00:41:16.352126+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:41:16.352126+0000","last_undegraded":"2024-08-09T00:41:16.352126+0000","last_fullsized":"2024-08-09T00:41:16.352126+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'113","last_scrub_stamp":"2024-08-09T00:41:16.351910+0000","last_deep_scrub":"268'113","last_deep_scrub_stamp":"2024-08-09T00:41:16.351910+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.351910+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:38.221455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.057708+0000","last_change":"2024-08-09T00:40:44.057708+0000","last_active":"2024-08-09T00:40:44.057708+0000","last_peered":"2024-08-09T00:40:44.057708+0000","last_clean":"2024-08-09T00:40:44.057708+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:40:44.057708+0000","last_undegraded":"2024-08-09T00:40:44.057708+0000","last_fullsized":"2024-08-09T00:40:44.057708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.057369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:45.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'140","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.618287+0000","last_change":"2024-08-09T00:40:50.618287+0000","last_active":"2024-08-09T00:40:50.618287+0000","last_peered":"2024-08-09T00:40:50.618287+0000","last_clean":"2024-08-09T00:40:50.618287+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:40:50.618287+0000","last_undegraded":"2024-08-09T00:40:50.618287+0000","last_fullsized":"2024-08-09T00:40:50.618287+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.618030+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:01.456614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.444558+0000","last_change":"2024-08-09T00:41:13.444620+0000","last_active":"2024-08-09T00:41:13.444558+0000","last_peered":"2024-08-09T00:41:13.444558+0000","last_clean":"2024-08-09T00:41:13.444558+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:41:13.444558+0000","last_undegraded":"2024-08-09T00:41:13.444558+0000","last_fullsized":"2024-08-09T00:41:13.444558+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:41:13.444362+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:41:13.444362+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.444362+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:54:55.143156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'232","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.696623+0000","last_change":"2024-08-09T00:41:22.696834+0000","last_active":"2024-08-09T00:41:22.696623+0000","last_peered":"2024-08-09T00:41:22.696623+0000","last_clean":"2024-08-09T00:41:22.696623+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:41:22.696623+0000","last_undegraded":"2024-08-09T00:41:22.696623+0000","last_fullsized":"2024-08-09T00:41:22.696623+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'232","last_scrub_stamp":"2024-08-09T00:41:22.696391+0000","last_deep_scrub":"268'232","last_deep_scrub_stamp":"2024-08-09T00:41:22.696391+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.696391+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:09.465742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":26858,"num_write":1144,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.437862+0000","last_change":"2024-08-09T00:41:11.437915+0000","last_active":"2024-08-09T00:41:11.437862+0000","last_peered":"2024-08-09T00:41:11.437862+0000","last_clean":"2024-08-09T00:41:11.437862+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:41:11.437862+0000","last_undegraded":"2024-08-09T00:41:11.437862+0000","last_fullsized":"2024-08-09T00:41:11.437862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.437657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:41.178098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'154","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.250412+0000","last_change":"2024-08-09T00:40:43.250412+0000","last_active":"2024-08-09T00:40:43.250412+0000","last_peered":"2024-08-09T00:40:43.250412+0000","last_clean":"2024-08-09T00:40:43.250412+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:40:43.250412+0000","last_undegraded":"2024-08-09T00:40:43.250412+0000","last_fullsized":"2024-08-09T00:40:43.250412+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.250137+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:26.394703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'514","reported_seq":2629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.623510+0000","last_change":"2024-08-09T00:40:59.623510+0000","last_active":"2024-08-09T00:40:59.623510+0000","last_peered":"2024-08-09T00:40:59.623510+0000","last_clean":"2024-08-09T00:40:59.623510+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:40:59.623510+0000","last_undegraded":"2024-08-09T00:40:59.623510+0000","last_fullsized":"2024-08-09T00:40:59.623510+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.623248+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:49.685761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'205","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.032946+0000","last_change":"2024-08-09T00:40:43.032946+0000","last_active":"2024-08-09T00:40:43.032946+0000","last_peered":"2024-08-09T00:40:43.032946+0000","last_clean":"2024-08-09T00:40:43.032946+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:40:43.032946+0000","last_undegraded":"2024-08-09T00:40:43.032946+0000","last_fullsized":"2024-08-09T00:40:43.032946+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.032703+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.934858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'198","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.400322+0000","last_change":"2024-08-09T00:41:05.400388+0000","last_active":"2024-08-09T00:41:05.400322+0000","last_peered":"2024-08-09T00:41:05.400322+0000","last_clean":"2024-08-09T00:41:05.400322+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:41:05.400322+0000","last_undegraded":"2024-08-09T00:41:05.400322+0000","last_fullsized":"2024-08-09T00:41:05.400322+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.400130+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:27:16.014784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'184","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.246023+0000","last_change":"2024-08-09T00:41:01.246106+0000","last_active":"2024-08-09T00:41:01.246023+0000","last_peered":"2024-08-09T00:41:01.246023+0000","last_clean":"2024-08-09T00:41:01.246023+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:41:01.246023+0000","last_undegraded":"2024-08-09T00:41:01.246023+0000","last_fullsized":"2024-08-09T00:41:01.246023+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.245827+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:25.571962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":349,"num_read_kb":11144,"num_write":998,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.046179+0000","last_change":"2024-08-09T00:41:08.046237+0000","last_active":"2024-08-09T00:41:08.046179+0000","last_peered":"2024-08-09T00:41:08.046179+0000","last_clean":"2024-08-09T00:41:08.046179+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:41:08.046179+0000","last_undegraded":"2024-08-09T00:41:08.046179+0000","last_fullsized":"2024-08-09T00:41:08.046179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.045971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:20.972107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'152","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.805504+0000","last_change":"2024-08-09T00:41:26.805584+0000","last_active":"2024-08-09T00:41:26.805504+0000","last_peered":"2024-08-09T00:41:26.805504+0000","last_clean":"2024-08-09T00:41:26.805504+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:41:26.805504+0000","last_undegraded":"2024-08-09T00:41:26.805504+0000","last_fullsized":"2024-08-09T00:41:26.805504+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-08-09T00:41:26.805285+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-08-09T00:41:26.805285+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.805285+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:29:35.369476+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":269,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'525","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.330769+0000","last_change":"2024-08-09T00:40:53.330769+0000","last_active":"2024-08-09T00:40:53.330769+0000","last_peered":"2024-08-09T00:40:53.330769+0000","last_clean":"2024-08-09T00:40:53.330769+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:40:53.330769+0000","last_undegraded":"2024-08-09T00:40:53.330769+0000","last_fullsized":"2024-08-09T00:40:53.330769+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.330522+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:02.062195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.080669+0000","last_change":"2024-08-09T00:41:02.080730+0000","last_active":"2024-08-09T00:41:02.080669+0000","last_peered":"2024-08-09T00:41:02.080669+0000","last_clean":"2024-08-09T00:41:02.080669+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:41:02.080669+0000","last_undegraded":"2024-08-09T00:41:02.080669+0000","last_fullsized":"2024-08-09T00:41:02.080669+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.080481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:38:44.354454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'202","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.667022+0000","last_change":"2024-08-09T00:41:15.667089+0000","last_active":"2024-08-09T00:41:15.667022+0000","last_peered":"2024-08-09T00:41:15.667022+0000","last_clean":"2024-08-09T00:41:15.667022+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:41:15.667022+0000","last_undegraded":"2024-08-09T00:41:15.667022+0000","last_fullsized":"2024-08-09T00:41:15.667022+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-08-09T00:41:15.666822+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-08-09T00:41:15.666822+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.666822+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:12.674600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":38000,"num_write":1175,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.612386+0000","last_change":"2024-08-09T00:41:04.612442+0000","last_active":"2024-08-09T00:41:04.612386+0000","last_peered":"2024-08-09T00:41:04.612386+0000","last_clean":"2024-08-09T00:41:04.612386+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:41:04.612386+0000","last_undegraded":"2024-08-09T00:41:04.612386+0000","last_fullsized":"2024-08-09T00:41:04.612386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.612184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:19.806143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'276","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.227188+0000","last_change":"2024-08-09T00:40:47.227392+0000","last_active":"2024-08-09T00:40:47.227188+0000","last_peered":"2024-08-09T00:40:47.227188+0000","last_clean":"2024-08-09T00:40:47.227188+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:40:47.227188+0000","last_undegraded":"2024-08-09T00:40:47.227188+0000","last_fullsized":"2024-08-09T00:40:47.227188+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'276","last_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_deep_scrub":"268'276","last_deep_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.226937+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:10.282050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":369,"num_read_kb":429,"num_write":224,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.784054+0000","last_change":"2024-08-09T00:40:59.784105+0000","last_active":"2024-08-09T00:40:59.784054+0000","last_peered":"2024-08-09T00:40:59.784054+0000","last_clean":"2024-08-09T00:40:59.784054+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:40:59.784054+0000","last_undegraded":"2024-08-09T00:40:59.784054+0000","last_fullsized":"2024-08-09T00:40:59.784054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:32.556424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'554","reported_seq":1381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.235454+0000","last_change":"2024-08-09T00:40:37.235454+0000","last_active":"2024-08-09T00:40:37.235454+0000","last_peered":"2024-08-09T00:40:37.235454+0000","last_clean":"2024-08-09T00:40:37.235454+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:40:37.235454+0000","last_undegraded":"2024-08-09T00:40:37.235454+0000","last_fullsized":"2024-08-09T00:40:37.235454+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'554","last_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_deep_scrub":"268'554","last_deep_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.235172+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:51.183078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4316","reported_seq":4952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.272456+0000","last_change":"2024-08-09T00:41:12.272517+0000","last_active":"2024-08-09T00:41:12.272456+0000","last_peered":"2024-08-09T00:41:12.272456+0000","last_clean":"2024-08-09T00:41:12.272456+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:41:12.272456+0000","last_undegraded":"2024-08-09T00:41:12.272456+0000","last_fullsized":"2024-08-09T00:41:12.272456+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4316","last_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_deep_scrub":"268'4316","last_deep_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.272273+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.931506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'233","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.668573+0000","last_change":"2024-08-09T00:41:17.668678+0000","last_active":"2024-08-09T00:41:17.668573+0000","last_peered":"2024-08-09T00:41:17.668573+0000","last_clean":"2024-08-09T00:41:17.668573+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:41:17.668573+0000","last_undegraded":"2024-08-09T00:41:17.668573+0000","last_fullsized":"2024-08-09T00:41:17.668573+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:41:17.668369+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:41:17.668369+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.668369+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:04.570917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1254,"num_read_kb":40415,"num_write":1272,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.181967+0000","last_change":"2024-08-09T00:40:53.182021+0000","last_active":"2024-08-09T00:40:53.181967+0000","last_peered":"2024-08-09T00:40:53.181967+0000","last_clean":"2024-08-09T00:40:53.181967+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:40:53.181967+0000","last_undegraded":"2024-08-09T00:40:53.181967+0000","last_fullsized":"2024-08-09T00:40:53.181967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.181758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:41:27.166441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'151","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.423729+0000","last_change":"2024-08-09T00:41:17.423805+0000","last_active":"2024-08-09T00:41:17.423729+0000","last_peered":"2024-08-09T00:41:17.423729+0000","last_clean":"2024-08-09T00:41:17.423729+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:41:17.423729+0000","last_undegraded":"2024-08-09T00:41:17.423729+0000","last_fullsized":"2024-08-09T00:41:17.423729+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-08-09T00:41:17.423542+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-08-09T00:41:17.423542+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.423542+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:16:21.114570+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5295,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":256,"num_write":102,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.323741+0000","last_change":"2024-08-09T00:40:58.323795+0000","last_active":"2024-08-09T00:40:58.323741+0000","last_peered":"2024-08-09T00:40:58.323741+0000","last_clean":"2024-08-09T00:40:58.323741+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:40:58.323741+0000","last_undegraded":"2024-08-09T00:40:58.323741+0000","last_fullsized":"2024-08-09T00:40:58.323741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.323537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:08.678263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'96","reported_seq":611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.048327+0000","last_change":"2024-08-09T00:40:54.048389+0000","last_active":"2024-08-09T00:40:54.048327+0000","last_peered":"2024-08-09T00:40:54.048327+0000","last_clean":"2024-08-09T00:40:54.048327+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:40:54.048327+0000","last_undegraded":"2024-08-09T00:40:54.048327+0000","last_fullsized":"2024-08-09T00:40:54.048327+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.048139+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:06.586071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'227","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.085887+0000","last_change":"2024-08-09T00:40:55.085952+0000","last_active":"2024-08-09T00:40:55.085887+0000","last_peered":"2024-08-09T00:40:55.085887+0000","last_clean":"2024-08-09T00:40:55.085887+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:40:55.085887+0000","last_undegraded":"2024-08-09T00:40:55.085887+0000","last_fullsized":"2024-08-09T00:40:55.085887+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.085694+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:46:56.426782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'160","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.612481+0000","last_change":"2024-08-09T00:41:11.612660+0000","last_active":"2024-08-09T00:41:11.612481+0000","last_peered":"2024-08-09T00:41:11.612481+0000","last_clean":"2024-08-09T00:41:11.612481+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:41:11.612481+0000","last_undegraded":"2024-08-09T00:41:11.612481+0000","last_fullsized":"2024-08-09T00:41:11.612481+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.612149+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:01.762322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317190,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":142181,"num_write":944,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.214568+0000","last_change":"2024-08-09T00:40:51.214679+0000","last_active":"2024-08-09T00:40:51.214568+0000","last_peered":"2024-08-09T00:40:51.214568+0000","last_clean":"2024-08-09T00:40:51.214568+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:40:51.214568+0000","last_undegraded":"2024-08-09T00:40:51.214568+0000","last_fullsized":"2024-08-09T00:40:51.214568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.214333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:45:12.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'220","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.628479+0000","last_change":"2024-08-09T00:41:14.628557+0000","last_active":"2024-08-09T00:41:14.628479+0000","last_peered":"2024-08-09T00:41:14.628479+0000","last_clean":"2024-08-09T00:41:14.628479+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:41:14.628479+0000","last_undegraded":"2024-08-09T00:41:14.628479+0000","last_fullsized":"2024-08-09T00:41:14.628479+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'220","last_scrub_stamp":"2024-08-09T00:41:14.628292+0000","last_deep_scrub":"268'220","last_deep_scrub_stamp":"2024-08-09T00:41:14.628292+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.628292+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:03:57.553638+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":290,"num_read_kb":376,"num_write":174,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'509","reported_seq":4406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.601435+0000","last_change":"2024-08-09T00:40:57.601465+0000","last_active":"2024-08-09T00:40:57.601435+0000","last_peered":"2024-08-09T00:40:57.601435+0000","last_clean":"2024-08-09T00:40:57.601435+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:57.601435+0000","last_undegraded":"2024-08-09T00:40:57.601435+0000","last_fullsized":"2024-08-09T00:40:57.601435+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'509","last_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_deep_scrub":"268'509","last_deep_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.601327+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:05:46.941619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'112","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.643203+0000","last_change":"2024-08-09T00:40:47.643278+0000","last_active":"2024-08-09T00:40:47.643203+0000","last_peered":"2024-08-09T00:40:47.643203+0000","last_clean":"2024-08-09T00:40:47.643203+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:40:47.643203+0000","last_undegraded":"2024-08-09T00:40:47.643203+0000","last_fullsized":"2024-08-09T00:40:47.643203+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.643006+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:42.442342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.557711+0000","last_change":"2024-08-09T00:41:17.557829+0000","last_active":"2024-08-09T00:41:17.557711+0000","last_peered":"2024-08-09T00:41:17.557711+0000","last_clean":"2024-08-09T00:41:17.557711+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:41:17.557711+0000","last_undegraded":"2024-08-09T00:41:17.557711+0000","last_fullsized":"2024-08-09T00:41:17.557711+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-08-09T00:41:17.557428+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-08-09T00:41:17.557428+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.557428+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:51.254540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'251","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.076928+0000","last_change":"2024-08-09T00:41:03.077035+0000","last_active":"2024-08-09T00:41:03.076928+0000","last_peered":"2024-08-09T00:41:03.076928+0000","last_clean":"2024-08-09T00:41:03.076928+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:41:03.076928+0000","last_undegraded":"2024-08-09T00:41:03.076928+0000","last_fullsized":"2024-08-09T00:41:03.076928+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.076723+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:34:28.543793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":20334,"num_write":1169,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.236924+0000","last_change":"2024-08-09T00:40:47.236992+0000","last_active":"2024-08-09T00:40:47.236924+0000","last_peered":"2024-08-09T00:40:47.236924+0000","last_clean":"2024-08-09T00:40:47.236924+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:40:47.236924+0000","last_undegraded":"2024-08-09T00:40:47.236924+0000","last_fullsized":"2024-08-09T00:40:47.236924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.236732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:54.921678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":486,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'259","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.485689+0000","last_change":"2024-08-09T00:41:14.485837+0000","last_active":"2024-08-09T00:41:14.485689+0000","last_peered":"2024-08-09T00:41:14.485689+0000","last_clean":"2024-08-09T00:41:14.485689+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:41:14.485689+0000","last_undegraded":"2024-08-09T00:41:14.485689+0000","last_fullsized":"2024-08-09T00:41:14.485689+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'259","last_scrub_stamp":"2024-08-09T00:41:14.485409+0000","last_deep_scrub":"268'259","last_deep_scrub_stamp":"2024-08-09T00:41:14.485409+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.485409+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:09.094447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41629,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":626,"num_write":204,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.251368+0000","last_change":"2024-08-09T00:40:38.251420+0000","last_active":"2024-08-09T00:40:38.251368+0000","last_peered":"2024-08-09T00:40:38.251368+0000","last_clean":"2024-08-09T00:40:38.251368+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:40:38.251368+0000","last_undegraded":"2024-08-09T00:40:38.251368+0000","last_fullsized":"2024-08-09T00:40:38.251368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.251160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:52:01.992409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'103","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.716990+0000","last_change":"2024-08-09T00:40:44.717155+0000","last_active":"2024-08-09T00:40:44.716990+0000","last_peered":"2024-08-09T00:40:44.716990+0000","last_clean":"2024-08-09T00:40:44.716990+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:40:44.716990+0000","last_undegraded":"2024-08-09T00:40:44.716990+0000","last_fullsized":"2024-08-09T00:40:44.716990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.716722+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.554310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.298441+0000","last_change":"2024-08-09T00:41:14.298501+0000","last_active":"2024-08-09T00:41:14.298441+0000","last_peered":"2024-08-09T00:41:14.298441+0000","last_clean":"2024-08-09T00:41:14.298441+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:41:14.298441+0000","last_undegraded":"2024-08-09T00:41:14.298441+0000","last_fullsized":"2024-08-09T00:41:14.298441+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'326","last_scrub_stamp":"2024-08-09T00:41:14.298245+0000","last_deep_scrub":"268'326","last_deep_scrub_stamp":"2024-08-09T00:41:14.298245+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.298245+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:53.762309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'169","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.205826+0000","last_change":"2024-08-09T00:40:52.205935+0000","last_active":"2024-08-09T00:40:52.205826+0000","last_peered":"2024-08-09T00:40:52.205826+0000","last_clean":"2024-08-09T00:40:52.205826+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:40:52.205826+0000","last_undegraded":"2024-08-09T00:40:52.205826+0000","last_fullsized":"2024-08-09T00:40:52.205826+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'169","last_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_deep_scrub":"268'169","last_deep_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.205600+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:53.896377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055036,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":365,"num_read_kb":5320,"num_write":980,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.203522+0000","last_change":"2024-08-09T00:40:45.203576+0000","last_active":"2024-08-09T00:40:45.203522+0000","last_peered":"2024-08-09T00:40:45.203522+0000","last_clean":"2024-08-09T00:40:45.203522+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:40:45.203522+0000","last_undegraded":"2024-08-09T00:40:45.203522+0000","last_fullsized":"2024-08-09T00:40:45.203522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.203322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:04:32.071267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'181","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.169556+0000","last_change":"2024-08-09T00:41:06.169635+0000","last_active":"2024-08-09T00:41:06.169556+0000","last_peered":"2024-08-09T00:41:06.169556+0000","last_clean":"2024-08-09T00:41:06.169556+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:41:06.169556+0000","last_undegraded":"2024-08-09T00:41:06.169556+0000","last_fullsized":"2024-08-09T00:41:06.169556+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.169361+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:46.582796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8780,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":256,"num_read_kb":313,"num_write":192,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15128,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.587144+0000","last_change":"2024-08-09T00:40:54.587207+0000","last_active":"2024-08-09T00:40:54.587144+0000","last_peered":"2024-08-09T00:40:54.587144+0000","last_clean":"2024-08-09T00:40:54.587144+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:40:54.587144+0000","last_undegraded":"2024-08-09T00:40:54.587144+0000","last_fullsized":"2024-08-09T00:40:54.587144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:32.403866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'138","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.387779+0000","last_change":"2024-08-09T00:40:45.387779+0000","last_active":"2024-08-09T00:40:45.387779+0000","last_peered":"2024-08-09T00:40:45.387779+0000","last_clean":"2024-08-09T00:40:45.387779+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:40:45.387779+0000","last_undegraded":"2024-08-09T00:40:45.387779+0000","last_fullsized":"2024-08-09T00:40:45.387779+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.387511+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:18.812396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'186","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.998987+0000","last_change":"2024-08-09T00:40:58.999056+0000","last_active":"2024-08-09T00:40:58.998987+0000","last_peered":"2024-08-09T00:40:58.998987+0000","last_clean":"2024-08-09T00:40:58.998987+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:40:58.998987+0000","last_undegraded":"2024-08-09T00:40:58.998987+0000","last_fullsized":"2024-08-09T00:40:58.998987+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'186","last_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_deep_scrub":"268'186","last_deep_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.998783+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:06:38.911931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'205","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.221223+0000","last_change":"2024-08-09T00:41:00.221455+0000","last_active":"2024-08-09T00:41:00.221223+0000","last_peered":"2024-08-09T00:41:00.221223+0000","last_clean":"2024-08-09T00:41:00.221223+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:41:00.221223+0000","last_undegraded":"2024-08-09T00:41:00.221223+0000","last_fullsized":"2024-08-09T00:41:00.221223+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.220981+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:00.213193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":34331,"num_write":1087,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.794304+0000","last_change":"2024-08-09T00:40:49.794358+0000","last_active":"2024-08-09T00:40:49.794304+0000","last_peered":"2024-08-09T00:40:49.794304+0000","last_clean":"2024-08-09T00:40:49.794304+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:40:49.794304+0000","last_undegraded":"2024-08-09T00:40:49.794304+0000","last_fullsized":"2024-08-09T00:40:49.794304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.794107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:44.283341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'204","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.244661+0000","last_change":"2024-08-09T00:40:41.244661+0000","last_active":"2024-08-09T00:40:41.244661+0000","last_peered":"2024-08-09T00:40:41.244661+0000","last_clean":"2024-08-09T00:40:41.244661+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:40:41.244661+0000","last_undegraded":"2024-08-09T00:40:41.244661+0000","last_fullsized":"2024-08-09T00:40:41.244661+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'204","last_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_deep_scrub":"268'204","last_deep_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.244364+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:23.051092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14461,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":384,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'493","reported_seq":2267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.206039+0000","last_change":"2024-08-09T00:40:39.206104+0000","last_active":"2024-08-09T00:40:39.206039+0000","last_peered":"2024-08-09T00:40:39.206039+0000","last_clean":"2024-08-09T00:40:39.206039+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:40:39.206039+0000","last_undegraded":"2024-08-09T00:40:39.206039+0000","last_fullsized":"2024-08-09T00:40:39.206039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'493","last_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_deep_scrub":"268'493","last_deep_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.205835+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:20:27.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'124","reported_seq":643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.732680+0000","last_change":"2024-08-09T00:40:43.732680+0000","last_active":"2024-08-09T00:40:43.732680+0000","last_peered":"2024-08-09T00:40:43.732680+0000","last_clean":"2024-08-09T00:40:43.732680+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:40:43.732680+0000","last_undegraded":"2024-08-09T00:40:43.732680+0000","last_fullsized":"2024-08-09T00:40:43.732680+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.732377+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:57.582089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.989260+0000","last_change":"2024-08-09T00:40:53.989319+0000","last_active":"2024-08-09T00:40:53.989260+0000","last_peered":"2024-08-09T00:40:53.989260+0000","last_clean":"2024-08-09T00:40:53.989260+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:40:53.989260+0000","last_undegraded":"2024-08-09T00:40:53.989260+0000","last_fullsized":"2024-08-09T00:40:53.989260+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'197","last_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_deep_scrub":"268'197","last_deep_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.989031+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:30.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'205","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.230060+0000","last_change":"2024-08-09T00:41:09.230142+0000","last_active":"2024-08-09T00:41:09.230060+0000","last_peered":"2024-08-09T00:41:09.230060+0000","last_clean":"2024-08-09T00:41:09.230060+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:41:09.230060+0000","last_undegraded":"2024-08-09T00:41:09.230060+0000","last_fullsized":"2024-08-09T00:41:09.230060+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.229867+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:53:34.348554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":23703,"num_write":1091,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.199719+0000","last_change":"2024-08-09T00:41:18.199796+0000","last_active":"2024-08-09T00:41:18.199719+0000","last_peered":"2024-08-09T00:41:18.199719+0000","last_clean":"2024-08-09T00:41:18.199719+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:41:18.199719+0000","last_undegraded":"2024-08-09T00:41:18.199719+0000","last_fullsized":"2024-08-09T00:41:18.199719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:18.199530+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:18.199530+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.199530+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:48:03.616448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":638,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'110","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.302700+0000","last_change":"2024-08-09T00:41:00.302779+0000","last_active":"2024-08-09T00:41:00.302700+0000","last_peered":"2024-08-09T00:41:00.302700+0000","last_clean":"2024-08-09T00:41:00.302700+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:41:00.302700+0000","last_undegraded":"2024-08-09T00:41:00.302700+0000","last_fullsized":"2024-08-09T00:41:00.302700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.302528+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:36.655301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'500","reported_seq":2270,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.915039+0000","last_change":"2024-08-09T00:40:41.915107+0000","last_active":"2024-08-09T00:40:41.915039+0000","last_peered":"2024-08-09T00:40:41.915039+0000","last_clean":"2024-08-09T00:40:41.915039+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:40:41.915039+0000","last_undegraded":"2024-08-09T00:40:41.915039+0000","last_fullsized":"2024-08-09T00:40:41.915039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.914818+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:19.244826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.954144+0000","last_change":"2024-08-09T00:40:39.954144+0000","last_active":"2024-08-09T00:40:39.954144+0000","last_peered":"2024-08-09T00:40:39.954144+0000","last_clean":"2024-08-09T00:40:39.954144+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:40:39.954144+0000","last_undegraded":"2024-08-09T00:40:39.954144+0000","last_fullsized":"2024-08-09T00:40:39.954144+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.953890+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:35:41.399127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'462","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.925537+0000","last_change":"2024-08-09T00:41:10.925665+0000","last_active":"2024-08-09T00:41:10.925537+0000","last_peered":"2024-08-09T00:41:10.925537+0000","last_clean":"2024-08-09T00:41:10.925537+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:41:10.925537+0000","last_undegraded":"2024-08-09T00:41:10.925537+0000","last_fullsized":"2024-08-09T00:41:10.925537+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.925280+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:54:19.284724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'181","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.479868+0000","last_change":"2024-08-09T00:41:27.479963+0000","last_active":"2024-08-09T00:41:27.479868+0000","last_peered":"2024-08-09T00:41:27.479868+0000","last_clean":"2024-08-09T00:41:27.479868+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:41:27.479868+0000","last_undegraded":"2024-08-09T00:41:27.479868+0000","last_fullsized":"2024-08-09T00:41:27.479868+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-08-09T00:41:27.479664+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-08-09T00:41:27.479664+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.479664+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:16:21.169759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":4543,"num_write":1045,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.129849+0000","last_change":"2024-08-09T00:41:04.129954+0000","last_active":"2024-08-09T00:41:04.129849+0000","last_peered":"2024-08-09T00:41:04.129849+0000","last_clean":"2024-08-09T00:41:04.129849+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:41:04.129849+0000","last_undegraded":"2024-08-09T00:41:04.129849+0000","last_fullsized":"2024-08-09T00:41:04.129849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.129554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:45.978812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'311","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.290776+0000","last_change":"2024-08-09T00:40:50.290869+0000","last_active":"2024-08-09T00:40:50.290776+0000","last_peered":"2024-08-09T00:40:50.290776+0000","last_clean":"2024-08-09T00:40:50.290776+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:40:50.290776+0000","last_undegraded":"2024-08-09T00:40:50.290776+0000","last_fullsized":"2024-08-09T00:40:50.290776+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.290582+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:57.971956+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":996,"num_read_kb":1052,"num_write":1534,"num_write_kb":1360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455368,"num_omap_keys":1106,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.917979+0000","last_change":"2024-08-09T00:40:45.918031+0000","last_active":"2024-08-09T00:40:45.917979+0000","last_peered":"2024-08-09T00:40:45.917979+0000","last_clean":"2024-08-09T00:40:45.917979+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:40:45.917979+0000","last_undegraded":"2024-08-09T00:40:45.917979+0000","last_fullsized":"2024-08-09T00:40:45.917979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.917777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:46:24.483454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'106","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.933187+0000","last_change":"2024-08-09T00:41:11.933187+0000","last_active":"2024-08-09T00:41:11.933187+0000","last_peered":"2024-08-09T00:41:11.933187+0000","last_clean":"2024-08-09T00:41:11.933187+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:41:11.933187+0000","last_undegraded":"2024-08-09T00:41:11.933187+0000","last_fullsized":"2024-08-09T00:41:11.933187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.932938+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:03:35.742761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.934023+0000","last_change":"2024-08-09T00:40:50.934023+0000","last_active":"2024-08-09T00:40:50.934023+0000","last_peered":"2024-08-09T00:40:50.934023+0000","last_clean":"2024-08-09T00:40:50.934023+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:40:50.934023+0000","last_undegraded":"2024-08-09T00:40:50.934023+0000","last_fullsized":"2024-08-09T00:40:50.934023+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.933771+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:53:51.224009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'163","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.679838+0000","last_change":"2024-08-09T00:41:18.679915+0000","last_active":"2024-08-09T00:41:18.679838+0000","last_peered":"2024-08-09T00:41:18.679838+0000","last_clean":"2024-08-09T00:41:18.679838+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:41:18.679838+0000","last_undegraded":"2024-08-09T00:41:18.679838+0000","last_fullsized":"2024-08-09T00:41:18.679838+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-08-09T00:41:18.679647+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-08-09T00:41:18.679647+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.679647+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:36.387779+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.107390+0000","last_change":"2024-08-09T00:41:10.107390+0000","last_active":"2024-08-09T00:41:10.107390+0000","last_peered":"2024-08-09T00:41:10.107390+0000","last_clean":"2024-08-09T00:41:10.107390+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:41:10.107390+0000","last_undegraded":"2024-08-09T00:41:10.107390+0000","last_fullsized":"2024-08-09T00:41:10.107390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.107011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:17.872841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'173","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.439898+0000","last_change":"2024-08-09T00:41:20.439898+0000","last_active":"2024-08-09T00:41:20.439898+0000","last_peered":"2024-08-09T00:41:20.439898+0000","last_clean":"2024-08-09T00:41:20.439898+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:41:20.439898+0000","last_undegraded":"2024-08-09T00:41:20.439898+0000","last_fullsized":"2024-08-09T00:41:20.439898+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-08-09T00:41:20.439472+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-08-09T00:41:20.439472+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.439472+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:17.526348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":19880,"num_write":949,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.569554+0000","last_change":"2024-08-09T00:41:06.569554+0000","last_active":"2024-08-09T00:41:06.569554+0000","last_peered":"2024-08-09T00:41:06.569554+0000","last_clean":"2024-08-09T00:41:06.569554+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:41:06.569554+0000","last_undegraded":"2024-08-09T00:41:06.569554+0000","last_fullsized":"2024-08-09T00:41:06.569554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.569203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:04.865756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'338","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276959+0000","last_change":"2024-08-09T00:40:49.277114+0000","last_active":"2024-08-09T00:40:49.276959+0000","last_peered":"2024-08-09T00:40:49.276959+0000","last_clean":"2024-08-09T00:40:49.276959+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:40:49.276959+0000","last_undegraded":"2024-08-09T00:40:49.276959+0000","last_fullsized":"2024-08-09T00:40:49.276959+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.276690+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:18:38.872577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":648,"num_read_kb":915,"num_write":594,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94900,"num_omap_keys":244,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.558455+0000","last_change":"2024-08-09T00:40:58.558566+0000","last_active":"2024-08-09T00:40:58.558455+0000","last_peered":"2024-08-09T00:40:58.558455+0000","last_clean":"2024-08-09T00:40:58.558455+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:40:58.558455+0000","last_undegraded":"2024-08-09T00:40:58.558455+0000","last_fullsized":"2024-08-09T00:40:58.558455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.558180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:29.719057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'208","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.967571+0000","last_change":"2024-08-09T00:40:51.967654+0000","last_active":"2024-08-09T00:40:51.967571+0000","last_peered":"2024-08-09T00:40:51.967571+0000","last_clean":"2024-08-09T00:40:51.967571+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:40:51.967571+0000","last_undegraded":"2024-08-09T00:40:51.967571+0000","last_fullsized":"2024-08-09T00:40:51.967571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.967362+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:19:16.020869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'189","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.502099+0000","last_change":"2024-08-09T00:41:07.502233+0000","last_active":"2024-08-09T00:41:07.502099+0000","last_peered":"2024-08-09T00:41:07.502099+0000","last_clean":"2024-08-09T00:41:07.502099+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:41:07.502099+0000","last_undegraded":"2024-08-09T00:41:07.502099+0000","last_fullsized":"2024-08-09T00:41:07.502099+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.501849+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:58.986880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.713717+0000","last_change":"2024-08-09T00:41:19.713772+0000","last_active":"2024-08-09T00:41:19.713717+0000","last_peered":"2024-08-09T00:41:19.713717+0000","last_clean":"2024-08-09T00:41:19.713717+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:41:19.713717+0000","last_undegraded":"2024-08-09T00:41:19.713717+0000","last_fullsized":"2024-08-09T00:41:19.713717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:19.713516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:19.713516+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.713516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:54.949292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'203","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.597277+0000","last_change":"2024-08-09T00:41:18.597277+0000","last_active":"2024-08-09T00:41:18.597277+0000","last_peered":"2024-08-09T00:41:18.597277+0000","last_clean":"2024-08-09T00:41:18.597277+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:41:18.597277+0000","last_undegraded":"2024-08-09T00:41:18.597277+0000","last_fullsized":"2024-08-09T00:41:18.597277+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-08-09T00:41:18.596993+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-08-09T00:41:18.596993+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.596993+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:04:41.844385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":17063,"num_write":1110,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.082039+0000","last_change":"2024-08-09T00:41:06.082096+0000","last_active":"2024-08-09T00:41:06.082039+0000","last_peered":"2024-08-09T00:41:06.082039+0000","last_clean":"2024-08-09T00:41:06.082039+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:41:06.082039+0000","last_undegraded":"2024-08-09T00:41:06.082039+0000","last_fullsized":"2024-08-09T00:41:06.082039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.081818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:57:09.834674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'701","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.822263+0000","last_change":"2024-08-09T00:40:51.822263+0000","last_active":"2024-08-09T00:40:51.822263+0000","last_peered":"2024-08-09T00:40:51.822263+0000","last_clean":"2024-08-09T00:40:51.822263+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:40:51.822263+0000","last_undegraded":"2024-08-09T00:40:51.822263+0000","last_fullsized":"2024-08-09T00:40:51.822263+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'701","last_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_deep_scrub":"268'701","last_deep_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.821968+0000","objects_scrubbed":12,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:09.857257+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33400,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1006,"num_read_kb":1225,"num_write":322,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5370,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.634974+0000","last_change":"2024-08-09T00:40:58.635028+0000","last_active":"2024-08-09T00:40:58.634974+0000","last_peered":"2024-08-09T00:40:58.634974+0000","last_clean":"2024-08-09T00:40:58.634974+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:40:58.634974+0000","last_undegraded":"2024-08-09T00:40:58.634974+0000","last_fullsized":"2024-08-09T00:40:58.634974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.634757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:48:18.077124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'131","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.756535+0000","last_change":"2024-08-09T00:40:46.756610+0000","last_active":"2024-08-09T00:40:46.756535+0000","last_peered":"2024-08-09T00:40:46.756535+0000","last_clean":"2024-08-09T00:40:46.756535+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:40:46.756535+0000","last_undegraded":"2024-08-09T00:40:46.756535+0000","last_fullsized":"2024-08-09T00:40:46.756535+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.756345+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:00:48.329420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.844729+0000","last_change":"2024-08-09T00:40:54.844797+0000","last_active":"2024-08-09T00:40:54.844729+0000","last_peered":"2024-08-09T00:40:54.844729+0000","last_clean":"2024-08-09T00:40:54.844729+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:40:54.844729+0000","last_undegraded":"2024-08-09T00:40:54.844729+0000","last_fullsized":"2024-08-09T00:40:54.844729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.844530+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:53.737686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.162874+0000","last_change":"2024-08-09T00:40:54.162874+0000","last_active":"2024-08-09T00:40:54.162874+0000","last_peered":"2024-08-09T00:40:54.162874+0000","last_clean":"2024-08-09T00:40:54.162874+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:40:54.162874+0000","last_undegraded":"2024-08-09T00:40:54.162874+0000","last_fullsized":"2024-08-09T00:40:54.162874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.162620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:55:31.612873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'159","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.859274+0000","last_change":"2024-08-09T00:41:05.859381+0000","last_active":"2024-08-09T00:41:05.859274+0000","last_peered":"2024-08-09T00:41:05.859274+0000","last_clean":"2024-08-09T00:41:05.859274+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:41:05.859274+0000","last_undegraded":"2024-08-09T00:41:05.859274+0000","last_fullsized":"2024-08-09T00:41:05.859274+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.859043+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:19:18.467769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5883424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":29266,"num_write":862,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.201294+0000","last_change":"2024-08-09T00:40:49.201356+0000","last_active":"2024-08-09T00:40:49.201294+0000","last_peered":"2024-08-09T00:40:49.201294+0000","last_clean":"2024-08-09T00:40:49.201294+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:40:49.201294+0000","last_undegraded":"2024-08-09T00:40:49.201294+0000","last_fullsized":"2024-08-09T00:40:49.201294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.201098+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:48.803444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.636970+0000","last_change":"2024-08-09T00:41:01.637052+0000","last_active":"2024-08-09T00:41:01.636970+0000","last_peered":"2024-08-09T00:41:01.636970+0000","last_clean":"2024-08-09T00:41:01.636970+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:41:01.636970+0000","last_undegraded":"2024-08-09T00:41:01.636970+0000","last_fullsized":"2024-08-09T00:41:01.636970+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.636779+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:15.604735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5136,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.615396+0000","last_change":"2024-08-09T00:40:53.615396+0000","last_active":"2024-08-09T00:40:53.615396+0000","last_peered":"2024-08-09T00:40:53.615396+0000","last_clean":"2024-08-09T00:40:53.615396+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:40:53.615396+0000","last_undegraded":"2024-08-09T00:40:53.615396+0000","last_fullsized":"2024-08-09T00:40:53.615396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.615125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:52.741451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'279","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.246939+0000","last_change":"2024-08-09T00:40:48.247034+0000","last_active":"2024-08-09T00:40:48.246939+0000","last_peered":"2024-08-09T00:40:48.246939+0000","last_clean":"2024-08-09T00:40:48.246939+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:40:48.246939+0000","last_undegraded":"2024-08-09T00:40:48.246939+0000","last_fullsized":"2024-08-09T00:40:48.246939+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.246734+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:27.053825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.784216+0000","last_change":"2024-08-09T00:41:02.784216+0000","last_active":"2024-08-09T00:41:02.784216+0000","last_peered":"2024-08-09T00:41:02.784216+0000","last_clean":"2024-08-09T00:41:02.784216+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:41:02.784216+0000","last_undegraded":"2024-08-09T00:41:02.784216+0000","last_fullsized":"2024-08-09T00:41:02.784216+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.783953+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:19.727649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.152649+0000","last_change":"2024-08-09T00:41:11.152649+0000","last_active":"2024-08-09T00:41:11.152649+0000","last_peered":"2024-08-09T00:41:11.152649+0000","last_clean":"2024-08-09T00:41:11.152649+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:41:11.152649+0000","last_undegraded":"2024-08-09T00:41:11.152649+0000","last_fullsized":"2024-08-09T00:41:11.152649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.152393+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:25:27.137706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'200","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.205756+0000","last_change":"2024-08-09T00:41:08.205756+0000","last_active":"2024-08-09T00:41:08.205756+0000","last_peered":"2024-08-09T00:41:08.205756+0000","last_clean":"2024-08-09T00:41:08.205756+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:41:08.205756+0000","last_undegraded":"2024-08-09T00:41:08.205756+0000","last_fullsized":"2024-08-09T00:41:08.205756+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.205439+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:55.271838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":7644,"num_write":1044,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.521739+0000","last_change":"2024-08-09T00:41:04.521794+0000","last_active":"2024-08-09T00:41:04.521739+0000","last_peered":"2024-08-09T00:41:04.521739+0000","last_clean":"2024-08-09T00:41:04.521739+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:41:04.521739+0000","last_undegraded":"2024-08-09T00:41:04.521739+0000","last_fullsized":"2024-08-09T00:41:04.521739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.521542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:51:09.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'162","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.423903+0000","last_change":"2024-08-09T00:41:19.423976+0000","last_active":"2024-08-09T00:41:19.423903+0000","last_peered":"2024-08-09T00:41:19.423903+0000","last_clean":"2024-08-09T00:41:19.423903+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:41:19.423903+0000","last_undegraded":"2024-08-09T00:41:19.423903+0000","last_fullsized":"2024-08-09T00:41:19.423903+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'162","last_scrub_stamp":"2024-08-09T00:41:19.423715+0000","last_deep_scrub":"268'162","last_deep_scrub_stamp":"2024-08-09T00:41:19.423715+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.423715+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:31:51.585794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1542,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.890179+0000","last_change":"2024-08-09T00:40:49.890232+0000","last_active":"2024-08-09T00:40:49.890179+0000","last_peered":"2024-08-09T00:40:49.890179+0000","last_clean":"2024-08-09T00:40:49.890179+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:40:49.890179+0000","last_undegraded":"2024-08-09T00:40:49.890179+0000","last_fullsized":"2024-08-09T00:40:49.890179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.889984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:45.090932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'114","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.232361+0000","last_change":"2024-08-09T00:40:38.232557+0000","last_active":"2024-08-09T00:40:38.232361+0000","last_peered":"2024-08-09T00:40:38.232361+0000","last_clean":"2024-08-09T00:40:38.232361+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:40:38.232361+0000","last_undegraded":"2024-08-09T00:40:38.232361+0000","last_fullsized":"2024-08-09T00:40:38.232361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.232120+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:00.159201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'156","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.776705+0000","last_change":"2024-08-09T00:40:52.776705+0000","last_active":"2024-08-09T00:40:52.776705+0000","last_peered":"2024-08-09T00:40:52.776705+0000","last_clean":"2024-08-09T00:40:52.776705+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:40:52.776705+0000","last_undegraded":"2024-08-09T00:40:52.776705+0000","last_fullsized":"2024-08-09T00:40:52.776705+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.776448+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.985569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'228","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.140336+0000","last_change":"2024-08-09T00:41:13.140445+0000","last_active":"2024-08-09T00:41:13.140336+0000","last_peered":"2024-08-09T00:41:13.140336+0000","last_clean":"2024-08-09T00:41:13.140336+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:41:13.140336+0000","last_undegraded":"2024-08-09T00:41:13.140336+0000","last_fullsized":"2024-08-09T00:41:13.140336+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'228","last_scrub_stamp":"2024-08-09T00:41:13.140140+0000","last_deep_scrub":"268'228","last_deep_scrub_stamp":"2024-08-09T00:41:13.140140+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.140140+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:10.870347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":62351,"num_write":1160,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":548,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.839872+0000","last_change":"2024-08-09T00:41:04.839872+0000","last_active":"2024-08-09T00:41:04.839872+0000","last_peered":"2024-08-09T00:41:04.839872+0000","last_clean":"2024-08-09T00:41:04.839872+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:41:04.839872+0000","last_undegraded":"2024-08-09T00:41:04.839872+0000","last_fullsized":"2024-08-09T00:41:04.839872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.839580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:08.753071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.493196+0000","last_change":"2024-08-09T00:41:06.493196+0000","last_active":"2024-08-09T00:41:06.493196+0000","last_peered":"2024-08-09T00:41:06.493196+0000","last_clean":"2024-08-09T00:41:06.493196+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:41:06.493196+0000","last_undegraded":"2024-08-09T00:41:06.493196+0000","last_fullsized":"2024-08-09T00:41:06.493196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.492951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:59:56.992035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'321","reported_seq":1036,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.453248+0000","last_change":"2024-08-09T00:41:12.453343+0000","last_active":"2024-08-09T00:41:12.453248+0000","last_peered":"2024-08-09T00:41:12.453248+0000","last_clean":"2024-08-09T00:41:12.453248+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:41:12.453248+0000","last_undegraded":"2024-08-09T00:41:12.453248+0000","last_fullsized":"2024-08-09T00:41:12.453248+0000","mapping_epoch":31,"log_start":"268'301","ondisk_log_start":"268'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.453049+0000","objects_scrubbed":11,"log_size":20,"log_dups_size":301,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:21.298253+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29428,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":629,"num_write":258,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3642,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.097347+0000","last_change":"2024-08-09T00:40:45.097347+0000","last_active":"2024-08-09T00:40:45.097347+0000","last_peered":"2024-08-09T00:40:45.097347+0000","last_clean":"2024-08-09T00:40:45.097347+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:40:45.097347+0000","last_undegraded":"2024-08-09T00:40:45.097347+0000","last_fullsized":"2024-08-09T00:40:45.097347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.097011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:27:33.586520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'120","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.618159+0000","last_change":"2024-08-09T00:40:46.618231+0000","last_active":"2024-08-09T00:40:46.618159+0000","last_peered":"2024-08-09T00:40:46.618159+0000","last_clean":"2024-08-09T00:40:46.618159+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:40:46.618159+0000","last_undegraded":"2024-08-09T00:40:46.618159+0000","last_fullsized":"2024-08-09T00:40:46.618159+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.617950+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.403990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'157","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.589812+0000","last_change":"2024-08-09T00:41:02.589812+0000","last_active":"2024-08-09T00:41:02.589812+0000","last_peered":"2024-08-09T00:41:02.589812+0000","last_clean":"2024-08-09T00:41:02.589812+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:41:02.589812+0000","last_undegraded":"2024-08-09T00:41:02.589812+0000","last_fullsized":"2024-08-09T00:41:02.589812+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.589518+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:51:33.421207+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7572,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'317","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.931087+0000","last_change":"2024-08-09T00:41:07.931087+0000","last_active":"2024-08-09T00:41:07.931087+0000","last_peered":"2024-08-09T00:41:07.931087+0000","last_clean":"2024-08-09T00:41:07.931087+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:41:07.931087+0000","last_undegraded":"2024-08-09T00:41:07.931087+0000","last_fullsized":"2024-08-09T00:41:07.931087+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.930771+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:13:51.581165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1025,"num_read_kb":185751,"num_write":1335,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.719419+0000","last_change":"2024-08-09T00:41:20.719419+0000","last_active":"2024-08-09T00:41:20.719419+0000","last_peered":"2024-08-09T00:41:20.719419+0000","last_clean":"2024-08-09T00:41:20.719419+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:41:20.719419+0000","last_undegraded":"2024-08-09T00:41:20.719419+0000","last_fullsized":"2024-08-09T00:41:20.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:20.719173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:20.719173+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.719173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:30.544614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.926892+0000","last_change":"2024-08-09T00:40:48.926892+0000","last_active":"2024-08-09T00:40:48.926892+0000","last_peered":"2024-08-09T00:40:48.926892+0000","last_clean":"2024-08-09T00:40:48.926892+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:40:48.926892+0000","last_undegraded":"2024-08-09T00:40:48.926892+0000","last_fullsized":"2024-08-09T00:40:48.926892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.926628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:36:47.294692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'230","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.892073+0000","last_change":"2024-08-09T00:40:55.892073+0000","last_active":"2024-08-09T00:40:55.892073+0000","last_peered":"2024-08-09T00:40:55.892073+0000","last_clean":"2024-08-09T00:40:55.892073+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:40:55.892073+0000","last_undegraded":"2024-08-09T00:40:55.892073+0000","last_fullsized":"2024-08-09T00:40:55.892073+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'230","last_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_deep_scrub":"268'230","last_deep_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.891948+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:05.302427+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3366,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'528","reported_seq":4411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.223881+0000","last_change":"2024-08-09T00:40:46.223881+0000","last_active":"2024-08-09T00:40:46.223881+0000","last_peered":"2024-08-09T00:40:46.223881+0000","last_clean":"2024-08-09T00:40:46.223881+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:40:46.223881+0000","last_undegraded":"2024-08-09T00:40:46.223881+0000","last_fullsized":"2024-08-09T00:40:46.223881+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'528","last_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_deep_scrub":"268'528","last_deep_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.223619+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:52.863127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'168","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276198+0000","last_change":"2024-08-09T00:40:49.276198+0000","last_active":"2024-08-09T00:40:49.276198+0000","last_peered":"2024-08-09T00:40:49.276198+0000","last_clean":"2024-08-09T00:40:49.276198+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:40:49.276198+0000","last_undegraded":"2024-08-09T00:40:49.276198+0000","last_fullsized":"2024-08-09T00:40:49.276198+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.275905+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:14.189142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.409983+0000","last_change":"2024-08-09T00:41:07.410041+0000","last_active":"2024-08-09T00:41:07.409983+0000","last_peered":"2024-08-09T00:41:07.409983+0000","last_clean":"2024-08-09T00:41:07.409983+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:41:07.409983+0000","last_undegraded":"2024-08-09T00:41:07.409983+0000","last_fullsized":"2024-08-09T00:41:07.409983+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.409796+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:27.775222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'273","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.525977+0000","last_change":"2024-08-09T00:41:28.526093+0000","last_active":"2024-08-09T00:41:28.525977+0000","last_peered":"2024-08-09T00:41:28.525977+0000","last_clean":"2024-08-09T00:41:28.525977+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:41:28.525977+0000","last_undegraded":"2024-08-09T00:41:28.525977+0000","last_fullsized":"2024-08-09T00:41:28.525977+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-08-09T00:41:28.525755+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-08-09T00:41:28.525755+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.525755+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:50:59.294149+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311694,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1095,"num_read_kb":6569,"num_write":1298,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.812643+0000","last_change":"2024-08-09T00:41:03.812701+0000","last_active":"2024-08-09T00:41:03.812643+0000","last_peered":"2024-08-09T00:41:03.812643+0000","last_clean":"2024-08-09T00:41:03.812643+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:41:03.812643+0000","last_undegraded":"2024-08-09T00:41:03.812643+0000","last_fullsized":"2024-08-09T00:41:03.812643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.812444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:52:09.482944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.037254+0000","last_change":"2024-08-09T00:40:58.037254+0000","last_active":"2024-08-09T00:40:58.037254+0000","last_peered":"2024-08-09T00:40:58.037254+0000","last_clean":"2024-08-09T00:40:58.037254+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:40:58.037254+0000","last_undegraded":"2024-08-09T00:40:58.037254+0000","last_fullsized":"2024-08-09T00:40:58.037254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.036981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:31.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'154","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.047234+0000","last_change":"2024-08-09T00:40:49.047234+0000","last_active":"2024-08-09T00:40:49.047234+0000","last_peered":"2024-08-09T00:40:49.047234+0000","last_clean":"2024-08-09T00:40:49.047234+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:40:49.047234+0000","last_undegraded":"2024-08-09T00:40:49.047234+0000","last_fullsized":"2024-08-09T00:40:49.047234+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.046957+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:48:46.019855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'525","reported_seq":2309,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.360829+0000","last_change":"2024-08-09T00:40:56.360829+0000","last_active":"2024-08-09T00:40:56.360829+0000","last_peered":"2024-08-09T00:40:56.360829+0000","last_clean":"2024-08-09T00:40:56.360829+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:40:56.360829+0000","last_undegraded":"2024-08-09T00:40:56.360829+0000","last_fullsized":"2024-08-09T00:40:56.360829+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.360575+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:37:54.817387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'240","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.635026+0000","last_change":"2024-08-09T00:40:51.635097+0000","last_active":"2024-08-09T00:40:51.635026+0000","last_peered":"2024-08-09T00:40:51.635026+0000","last_clean":"2024-08-09T00:40:51.635026+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:40:51.635026+0000","last_undegraded":"2024-08-09T00:40:51.635026+0000","last_fullsized":"2024-08-09T00:40:51.635026+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.634826+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:56.897177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.024702+0000","last_change":"2024-08-09T00:40:57.024702+0000","last_active":"2024-08-09T00:40:57.024702+0000","last_peered":"2024-08-09T00:40:57.024702+0000","last_clean":"2024-08-09T00:40:57.024702+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:40:57.024702+0000","last_undegraded":"2024-08-09T00:40:57.024702+0000","last_fullsized":"2024-08-09T00:40:57.024702+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.024418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:23:31.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'219","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.222329+0000","last_change":"2024-08-09T00:40:48.222507+0000","last_active":"2024-08-09T00:40:48.222329+0000","last_peered":"2024-08-09T00:40:48.222329+0000","last_clean":"2024-08-09T00:40:48.222329+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:40:48.222329+0000","last_undegraded":"2024-08-09T00:40:48.222329+0000","last_fullsized":"2024-08-09T00:40:48.222329+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.222109+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:43.098443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37546,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":443,"num_read_kb":66311,"num_write":1073,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.171339+0000","last_change":"2024-08-09T00:40:58.171400+0000","last_active":"2024-08-09T00:40:58.171339+0000","last_peered":"2024-08-09T00:40:58.171339+0000","last_clean":"2024-08-09T00:40:58.171339+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:40:58.171339+0000","last_undegraded":"2024-08-09T00:40:58.171339+0000","last_fullsized":"2024-08-09T00:40:58.171339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.171154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:38.726495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"268'5","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.469324+0000","last_change":"2024-08-09T00:41:09.469388+0000","last_active":"2024-08-09T00:41:09.469324+0000","last_peered":"2024-08-09T00:41:09.469324+0000","last_clean":"2024-08-09T00:41:09.469324+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:41:09.469324+0000","last_undegraded":"2024-08-09T00:41:09.469324+0000","last_fullsized":"2024-08-09T00:41:09.469324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.469138+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:46.425806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":797,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'359","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.645972+0000","last_change":"2024-08-09T00:41:16.645972+0000","last_active":"2024-08-09T00:41:16.645972+0000","last_peered":"2024-08-09T00:41:16.645972+0000","last_clean":"2024-08-09T00:41:16.645972+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:41:16.645972+0000","last_undegraded":"2024-08-09T00:41:16.645972+0000","last_fullsized":"2024-08-09T00:41:16.645972+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-08-09T00:41:16.645692+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-08-09T00:41:16.645692+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.645692+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:28:30.136571+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24443,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":707,"num_write":276,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.353437+0000","last_change":"2024-08-09T00:40:57.353437+0000","last_active":"2024-08-09T00:40:57.353437+0000","last_peered":"2024-08-09T00:40:57.353437+0000","last_clean":"2024-08-09T00:40:57.353437+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:40:57.353437+0000","last_undegraded":"2024-08-09T00:40:57.353437+0000","last_fullsized":"2024-08-09T00:40:57.353437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.353192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:43.153069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'127","reported_seq":629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.236617+0000","last_change":"2024-08-09T00:40:42.236705+0000","last_active":"2024-08-09T00:40:42.236617+0000","last_peered":"2024-08-09T00:40:42.236617+0000","last_clean":"2024-08-09T00:40:42.236617+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:40:42.236617+0000","last_undegraded":"2024-08-09T00:40:42.236617+0000","last_fullsized":"2024-08-09T00:40:42.236617+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.236387+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:25:28.423291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.636334+0000","last_change":"2024-08-09T00:40:49.636334+0000","last_active":"2024-08-09T00:40:49.636334+0000","last_peered":"2024-08-09T00:40:49.636334+0000","last_clean":"2024-08-09T00:40:49.636334+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:40:49.636334+0000","last_undegraded":"2024-08-09T00:40:49.636334+0000","last_fullsized":"2024-08-09T00:40:49.636334+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.636047+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:31:23.809790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.009785+0000","last_change":"2024-08-09T00:40:55.009848+0000","last_active":"2024-08-09T00:40:55.009785+0000","last_peered":"2024-08-09T00:40:55.009785+0000","last_clean":"2024-08-09T00:40:55.009785+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:40:55.009785+0000","last_undegraded":"2024-08-09T00:40:55.009785+0000","last_fullsized":"2024-08-09T00:40:55.009785+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.009572+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:01.862198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'229","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.272699+0000","last_change":"2024-08-09T00:41:10.272825+0000","last_active":"2024-08-09T00:41:10.272699+0000","last_peered":"2024-08-09T00:41:10.272699+0000","last_clean":"2024-08-09T00:41:10.272699+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:41:10.272699+0000","last_undegraded":"2024-08-09T00:41:10.272699+0000","last_fullsized":"2024-08-09T00:41:10.272699+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'229","last_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_deep_scrub":"268'229","last_deep_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.272502+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:34:49.338640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":23490,"num_write":1170,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.838789+0000","last_change":"2024-08-09T00:40:50.838789+0000","last_active":"2024-08-09T00:40:50.838789+0000","last_peered":"2024-08-09T00:40:50.838789+0000","last_clean":"2024-08-09T00:40:50.838789+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:40:50.838789+0000","last_undegraded":"2024-08-09T00:40:50.838789+0000","last_fullsized":"2024-08-09T00:40:50.838789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.838517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:22:43.037726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'171","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.570689+0000","last_change":"2024-08-09T00:41:29.570774+0000","last_active":"2024-08-09T00:41:29.570689+0000","last_peered":"2024-08-09T00:41:29.570689+0000","last_clean":"2024-08-09T00:41:29.570689+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:41:29.570689+0000","last_undegraded":"2024-08-09T00:41:29.570689+0000","last_fullsized":"2024-08-09T00:41:29.570689+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:41:29.570475+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:41:29.570475+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.570475+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:19:06.668610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":265,"num_write":116,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.311465+0000","last_change":"2024-08-09T00:40:54.311516+0000","last_active":"2024-08-09T00:40:54.311465+0000","last_peered":"2024-08-09T00:40:54.311465+0000","last_clean":"2024-08-09T00:40:54.311465+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:40:54.311465+0000","last_undegraded":"2024-08-09T00:40:54.311465+0000","last_fullsized":"2024-08-09T00:40:54.311465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.311271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:13:18.035747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'118","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.310577+0000","last_change":"2024-08-09T00:40:52.310577+0000","last_active":"2024-08-09T00:40:52.310577+0000","last_peered":"2024-08-09T00:40:52.310577+0000","last_clean":"2024-08-09T00:40:52.310577+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:40:52.310577+0000","last_undegraded":"2024-08-09T00:40:52.310577+0000","last_fullsized":"2024-08-09T00:40:52.310577+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.310328+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:58:03.731104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.900163+0000","last_change":"2024-08-09T00:40:56.900283+0000","last_active":"2024-08-09T00:40:56.900163+0000","last_peered":"2024-08-09T00:40:56.900163+0000","last_clean":"2024-08-09T00:40:56.900163+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:40:56.900163+0000","last_undegraded":"2024-08-09T00:40:56.900163+0000","last_fullsized":"2024-08-09T00:40:56.900163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.899845+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:06.513441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'183","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.774647+0000","last_change":"2024-08-09T00:41:25.774729+0000","last_active":"2024-08-09T00:41:25.774647+0000","last_peered":"2024-08-09T00:41:25.774647+0000","last_clean":"2024-08-09T00:41:25.774647+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:41:25.774647+0000","last_undegraded":"2024-08-09T00:41:25.774647+0000","last_fullsized":"2024-08-09T00:41:25.774647+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'183","last_scrub_stamp":"2024-08-09T00:41:25.774445+0000","last_deep_scrub":"268'183","last_deep_scrub_stamp":"2024-08-09T00:41:25.774445+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.774445+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:27:56.689587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661190,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":16787,"num_write":983,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.434981+0000","last_change":"2024-08-09T00:41:13.435039+0000","last_active":"2024-08-09T00:41:13.434981+0000","last_peered":"2024-08-09T00:41:13.434981+0000","last_clean":"2024-08-09T00:41:13.434981+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:41:13.434981+0000","last_undegraded":"2024-08-09T00:41:13.434981+0000","last_fullsized":"2024-08-09T00:41:13.434981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:13.434758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:13.434758+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.434758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:14.208717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'57","reported_seq":585,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.502540+0000","last_change":"2024-08-09T00:41:10.502610+0000","last_active":"2024-08-09T00:41:10.502540+0000","last_peered":"2024-08-09T00:41:10.502540+0000","last_clean":"2024-08-09T00:41:10.502540+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:41:10.502540+0000","last_undegraded":"2024-08-09T00:41:10.502540+0000","last_fullsized":"2024-08-09T00:41:10.502540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'57","last_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_deep_scrub":"268'57","last_deep_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.502327+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:08:11.822426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.648110+0000","last_change":"2024-08-09T00:40:57.648162+0000","last_active":"2024-08-09T00:40:57.648110+0000","last_peered":"2024-08-09T00:40:57.648110+0000","last_clean":"2024-08-09T00:40:57.648110+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:40:57.648110+0000","last_undegraded":"2024-08-09T00:40:57.648110+0000","last_fullsized":"2024-08-09T00:40:57.648110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.647902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:11.434378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'189","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.596320+0000","last_change":"2024-08-09T00:40:45.596320+0000","last_active":"2024-08-09T00:40:45.596320+0000","last_peered":"2024-08-09T00:40:45.596320+0000","last_clean":"2024-08-09T00:40:45.596320+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:40:45.596320+0000","last_undegraded":"2024-08-09T00:40:45.596320+0000","last_fullsized":"2024-08-09T00:40:45.596320+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.595931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:42:19.396170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.418868+0000","last_change":"2024-08-09T00:41:06.418930+0000","last_active":"2024-08-09T00:41:06.418868+0000","last_peered":"2024-08-09T00:41:06.418868+0000","last_clean":"2024-08-09T00:41:06.418868+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:41:06.418868+0000","last_undegraded":"2024-08-09T00:41:06.418868+0000","last_fullsized":"2024-08-09T00:41:06.418868+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.418680+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:29.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'202","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.175679+0000","last_change":"2024-08-09T00:41:16.175778+0000","last_active":"2024-08-09T00:41:16.175679+0000","last_peered":"2024-08-09T00:41:16.175679+0000","last_clean":"2024-08-09T00:41:16.175679+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:41:16.175679+0000","last_undegraded":"2024-08-09T00:41:16.175679+0000","last_fullsized":"2024-08-09T00:41:16.175679+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-08-09T00:41:16.175456+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-08-09T00:41:16.175456+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.175456+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:29.832621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110897,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":499,"num_read_kb":9686,"num_write":1123,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.661101+0000","last_change":"2024-08-09T00:41:02.661162+0000","last_active":"2024-08-09T00:41:02.661101+0000","last_peered":"2024-08-09T00:41:02.661101+0000","last_clean":"2024-08-09T00:41:02.661101+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:41:02.661101+0000","last_undegraded":"2024-08-09T00:41:02.661101+0000","last_fullsized":"2024-08-09T00:41:02.661101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.660881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:10.460272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.352259+0000","last_change":"2024-08-09T00:41:02.352342+0000","last_active":"2024-08-09T00:41:02.352259+0000","last_peered":"2024-08-09T00:41:02.352259+0000","last_clean":"2024-08-09T00:41:02.352259+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:41:02.352259+0000","last_undegraded":"2024-08-09T00:41:02.352259+0000","last_fullsized":"2024-08-09T00:41:02.352259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.352069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:47.940433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":367,"num_write":158,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.887230+0000","last_change":"2024-08-09T00:40:47.887323+0000","last_active":"2024-08-09T00:40:47.887230+0000","last_peered":"2024-08-09T00:40:47.887230+0000","last_clean":"2024-08-09T00:40:47.887230+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:40:47.887230+0000","last_undegraded":"2024-08-09T00:40:47.887230+0000","last_fullsized":"2024-08-09T00:40:47.887230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.886949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:37.660989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'115","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.262602+0000","last_change":"2024-08-09T00:40:41.262602+0000","last_active":"2024-08-09T00:40:41.262602+0000","last_peered":"2024-08-09T00:40:41.262602+0000","last_clean":"2024-08-09T00:40:41.262602+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:40:41.262602+0000","last_undegraded":"2024-08-09T00:40:41.262602+0000","last_fullsized":"2024-08-09T00:40:41.262602+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.262339+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:46:01.693522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'372","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.425681+0000","last_change":"2024-08-09T00:41:16.425805+0000","last_active":"2024-08-09T00:41:16.425681+0000","last_peered":"2024-08-09T00:41:16.425681+0000","last_clean":"2024-08-09T00:41:16.425681+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:41:16.425681+0000","last_undegraded":"2024-08-09T00:41:16.425681+0000","last_fullsized":"2024-08-09T00:41:16.425681+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-08-09T00:41:16.425422+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-08-09T00:41:16.425422+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.425422+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:45.886954+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'167","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.539724+0000","last_change":"2024-08-09T00:41:25.539918+0000","last_active":"2024-08-09T00:41:25.539724+0000","last_peered":"2024-08-09T00:41:25.539724+0000","last_clean":"2024-08-09T00:41:25.539724+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:41:25.539724+0000","last_undegraded":"2024-08-09T00:41:25.539724+0000","last_fullsized":"2024-08-09T00:41:25.539724+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'167","last_scrub_stamp":"2024-08-09T00:41:25.539472+0000","last_deep_scrub":"268'167","last_deep_scrub_stamp":"2024-08-09T00:41:25.539472+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.539472+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:15:00.311078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":317,"num_read_kb":1399,"num_write":881,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.890394+0000","last_change":"2024-08-09T00:40:44.890394+0000","last_active":"2024-08-09T00:40:44.890394+0000","last_peered":"2024-08-09T00:40:44.890394+0000","last_clean":"2024-08-09T00:40:44.890394+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:40:44.890394+0000","last_undegraded":"2024-08-09T00:40:44.890394+0000","last_fullsized":"2024-08-09T00:40:44.890394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.890149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:41.092600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'141","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.646816+0000","last_change":"2024-08-09T00:41:12.646898+0000","last_active":"2024-08-09T00:41:12.646816+0000","last_peered":"2024-08-09T00:41:12.646816+0000","last_clean":"2024-08-09T00:41:12.646816+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:41:12.646816+0000","last_undegraded":"2024-08-09T00:41:12.646816+0000","last_fullsized":"2024-08-09T00:41:12.646816+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.646589+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:37:54.847960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":239,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.614977+0000","last_change":"2024-08-09T00:40:55.615035+0000","last_active":"2024-08-09T00:40:55.614977+0000","last_peered":"2024-08-09T00:40:55.614977+0000","last_clean":"2024-08-09T00:40:55.614977+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:40:55.614977+0000","last_undegraded":"2024-08-09T00:40:55.614977+0000","last_fullsized":"2024-08-09T00:40:55.614977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.614759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:17.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":743,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.009760+0000","last_change":"2024-08-09T00:40:53.009760+0000","last_active":"2024-08-09T00:40:53.009760+0000","last_peered":"2024-08-09T00:40:53.009760+0000","last_clean":"2024-08-09T00:40:53.009760+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:40:53.009760+0000","last_undegraded":"2024-08-09T00:40:53.009760+0000","last_fullsized":"2024-08-09T00:40:53.009760+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.009497+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:39.267801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'160","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.451824+0000","last_change":"2024-08-09T00:41:23.451912+0000","last_active":"2024-08-09T00:41:23.451824+0000","last_peered":"2024-08-09T00:41:23.451824+0000","last_clean":"2024-08-09T00:41:23.451824+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:41:23.451824+0000","last_undegraded":"2024-08-09T00:41:23.451824+0000","last_fullsized":"2024-08-09T00:41:23.451824+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:23.451628+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:23.451628+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.451628+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:05:23.967285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540766,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":18716,"num_write":872,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.503559+0000","last_change":"2024-08-09T00:41:08.503665+0000","last_active":"2024-08-09T00:41:08.503559+0000","last_peered":"2024-08-09T00:41:08.503559+0000","last_clean":"2024-08-09T00:41:08.503559+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:41:08.503559+0000","last_undegraded":"2024-08-09T00:41:08.503559+0000","last_fullsized":"2024-08-09T00:41:08.503559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.503276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.754186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'227","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.827005+0000","last_change":"2024-08-09T00:40:53.827005+0000","last_active":"2024-08-09T00:40:53.827005+0000","last_peered":"2024-08-09T00:40:53.827005+0000","last_clean":"2024-08-09T00:40:53.827005+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:40:53.827005+0000","last_undegraded":"2024-08-09T00:40:53.827005+0000","last_fullsized":"2024-08-09T00:40:53.827005+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.826785+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:20:32.238202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17674,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":513,"num_write":222,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22936,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.257255+0000","last_change":"2024-08-09T00:40:45.257255+0000","last_active":"2024-08-09T00:40:45.257255+0000","last_peered":"2024-08-09T00:40:45.257255+0000","last_clean":"2024-08-09T00:40:45.257255+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:40:45.257255+0000","last_undegraded":"2024-08-09T00:40:45.257255+0000","last_fullsized":"2024-08-09T00:40:45.257255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.256887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.726347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'166","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.339701+0000","last_change":"2024-08-09T00:40:46.339701+0000","last_active":"2024-08-09T00:40:46.339701+0000","last_peered":"2024-08-09T00:40:46.339701+0000","last_clean":"2024-08-09T00:40:46.339701+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:40:46.339701+0000","last_undegraded":"2024-08-09T00:40:46.339701+0000","last_fullsized":"2024-08-09T00:40:46.339701+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.339303+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:17.653047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.565127+0000","last_change":"2024-08-09T00:41:03.565307+0000","last_active":"2024-08-09T00:41:03.565127+0000","last_peered":"2024-08-09T00:41:03.565127+0000","last_clean":"2024-08-09T00:41:03.565127+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:41:03.565127+0000","last_undegraded":"2024-08-09T00:41:03.565127+0000","last_fullsized":"2024-08-09T00:41:03.565127+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.564859+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:40:42.536359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'284","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.725010+0000","last_change":"2024-08-09T00:40:40.725010+0000","last_active":"2024-08-09T00:40:40.725010+0000","last_peered":"2024-08-09T00:40:40.725010+0000","last_clean":"2024-08-09T00:40:40.725010+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:40:40.725010+0000","last_undegraded":"2024-08-09T00:40:40.725010+0000","last_fullsized":"2024-08-09T00:40:40.725010+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.724693+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:21.253956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":69125,"num_write":1347,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.890625+0000","last_change":"2024-08-09T00:40:46.890625+0000","last_active":"2024-08-09T00:40:46.890625+0000","last_peered":"2024-08-09T00:40:46.890625+0000","last_clean":"2024-08-09T00:40:46.890625+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:40:46.890625+0000","last_undegraded":"2024-08-09T00:40:46.890625+0000","last_fullsized":"2024-08-09T00:40:46.890625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.890298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:04:42.778225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'206","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.581112+0000","last_change":"2024-08-09T00:41:10.581199+0000","last_active":"2024-08-09T00:41:10.581112+0000","last_peered":"2024-08-09T00:41:10.581112+0000","last_clean":"2024-08-09T00:41:10.581112+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:41:10.581112+0000","last_undegraded":"2024-08-09T00:41:10.581112+0000","last_fullsized":"2024-08-09T00:41:10.581112+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.580894+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:00.947265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":267,"num_read_kb":315,"num_write":170,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10932,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.793837+0000","last_change":"2024-08-09T00:41:01.793837+0000","last_active":"2024-08-09T00:41:01.793837+0000","last_peered":"2024-08-09T00:41:01.793837+0000","last_clean":"2024-08-09T00:41:01.793837+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:41:01.793837+0000","last_undegraded":"2024-08-09T00:41:01.793837+0000","last_fullsized":"2024-08-09T00:41:01.793837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.793483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:08.479888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'188","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.120576+0000","last_change":"2024-08-09T00:40:56.120576+0000","last_active":"2024-08-09T00:40:56.120576+0000","last_peered":"2024-08-09T00:40:56.120576+0000","last_clean":"2024-08-09T00:40:56.120576+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:40:56.120576+0000","last_undegraded":"2024-08-09T00:40:56.120576+0000","last_fullsized":"2024-08-09T00:40:56.120576+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.120294+0000","objects_scrubbed":10,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:47.202816+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4118","reported_seq":4742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.397040+0000","last_change":"2024-08-09T00:41:18.397065+0000","last_active":"2024-08-09T00:41:18.397040+0000","last_peered":"2024-08-09T00:41:18.397040+0000","last_clean":"2024-08-09T00:41:18.397040+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:41:18.397040+0000","last_undegraded":"2024-08-09T00:41:18.397040+0000","last_fullsized":"2024-08-09T00:41:18.397040+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4118","last_scrub_stamp":"2024-08-09T00:41:18.396971+0000","last_deep_scrub":"268'4118","last_deep_scrub_stamp":"2024-08-09T00:41:18.396971+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.396971+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:51:25.594140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'213","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.230094+0000","last_change":"2024-08-09T00:40:50.230251+0000","last_active":"2024-08-09T00:40:50.230094+0000","last_peered":"2024-08-09T00:40:50.230094+0000","last_clean":"2024-08-09T00:40:50.230094+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:40:50.230094+0000","last_undegraded":"2024-08-09T00:40:50.230094+0000","last_fullsized":"2024-08-09T00:40:50.230094+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.229893+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.519276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":59906,"num_write":1092,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.049221+0000","last_change":"2024-08-09T00:41:02.049221+0000","last_active":"2024-08-09T00:41:02.049221+0000","last_peered":"2024-08-09T00:41:02.049221+0000","last_clean":"2024-08-09T00:41:02.049221+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:41:02.049221+0000","last_undegraded":"2024-08-09T00:41:02.049221+0000","last_fullsized":"2024-08-09T00:41:02.049221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.048973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:40:26.776047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'175","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.309831+0000","last_change":"2024-08-09T00:41:01.309831+0000","last_active":"2024-08-09T00:41:01.309831+0000","last_peered":"2024-08-09T00:41:01.309831+0000","last_clean":"2024-08-09T00:41:01.309831+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:41:01.309831+0000","last_undegraded":"2024-08-09T00:41:01.309831+0000","last_fullsized":"2024-08-09T00:41:01.309831+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.309443+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:19.119093+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":299,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.854076+0000","last_change":"2024-08-09T00:40:57.854204+0000","last_active":"2024-08-09T00:40:57.854076+0000","last_peered":"2024-08-09T00:40:57.854076+0000","last_clean":"2024-08-09T00:40:57.854076+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:40:57.854076+0000","last_undegraded":"2024-08-09T00:40:57.854076+0000","last_fullsized":"2024-08-09T00:40:57.854076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.853840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:19:44.705587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'171","reported_seq":704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.231644+0000","last_change":"2024-08-09T00:40:39.231644+0000","last_active":"2024-08-09T00:40:39.231644+0000","last_peered":"2024-08-09T00:40:39.231644+0000","last_clean":"2024-08-09T00:40:39.231644+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:40:39.231644+0000","last_undegraded":"2024-08-09T00:40:39.231644+0000","last_fullsized":"2024-08-09T00:40:39.231644+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.231346+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:32:12.225013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.081101+0000","last_change":"2024-08-09T00:41:00.081164+0000","last_active":"2024-08-09T00:41:00.081101+0000","last_peered":"2024-08-09T00:41:00.081101+0000","last_clean":"2024-08-09T00:41:00.081101+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:41:00.081101+0000","last_undegraded":"2024-08-09T00:41:00.081101+0000","last_fullsized":"2024-08-09T00:41:00.081101+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.080907+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:25:56.975527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'174","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.511903+0000","last_change":"2024-08-09T00:41:21.512096+0000","last_active":"2024-08-09T00:41:21.511903+0000","last_peered":"2024-08-09T00:41:21.511903+0000","last_clean":"2024-08-09T00:41:21.511903+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:41:21.511903+0000","last_undegraded":"2024-08-09T00:41:21.511903+0000","last_fullsized":"2024-08-09T00:41:21.511903+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-08-09T00:41:21.511672+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-08-09T00:41:21.511672+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.511672+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:23:33.156663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":4608,"num_write":1010,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.781111+0000","last_change":"2024-08-09T00:40:47.781111+0000","last_active":"2024-08-09T00:40:47.781111+0000","last_peered":"2024-08-09T00:40:47.781111+0000","last_clean":"2024-08-09T00:40:47.781111+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:40:47.781111+0000","last_undegraded":"2024-08-09T00:40:47.781111+0000","last_fullsized":"2024-08-09T00:40:47.781111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.780862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:19.491613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'125","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.081649+0000","last_change":"2024-08-09T00:40:48.081744+0000","last_active":"2024-08-09T00:40:48.081649+0000","last_peered":"2024-08-09T00:40:48.081649+0000","last_clean":"2024-08-09T00:40:48.081649+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:40:48.081649+0000","last_undegraded":"2024-08-09T00:40:48.081649+0000","last_fullsized":"2024-08-09T00:40:48.081649+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.081431+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.399083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1648,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'500","reported_seq":2385,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.928684+0000","last_change":"2024-08-09T00:40:43.928684+0000","last_active":"2024-08-09T00:40:43.928684+0000","last_peered":"2024-08-09T00:40:43.928684+0000","last_clean":"2024-08-09T00:40:43.928684+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:40:43.928684+0000","last_undegraded":"2024-08-09T00:40:43.928684+0000","last_fullsized":"2024-08-09T00:40:43.928684+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.928424+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:09:10.523694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.672780+0000","last_change":"2024-08-09T00:40:54.672780+0000","last_active":"2024-08-09T00:40:54.672780+0000","last_peered":"2024-08-09T00:40:54.672780+0000","last_clean":"2024-08-09T00:40:54.672780+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:40:54.672780+0000","last_undegraded":"2024-08-09T00:40:54.672780+0000","last_fullsized":"2024-08-09T00:40:54.672780+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.672506+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:21:26.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.259011+0000","last_change":"2024-08-09T00:41:13.259073+0000","last_active":"2024-08-09T00:41:13.259011+0000","last_peered":"2024-08-09T00:41:13.259011+0000","last_clean":"2024-08-09T00:41:13.259011+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:41:13.259011+0000","last_undegraded":"2024-08-09T00:41:13.259011+0000","last_fullsized":"2024-08-09T00:41:13.259011+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-08-09T00:41:13.258816+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-08-09T00:41:13.258816+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.258816+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:31:02.126802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'193","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.140413+0000","last_change":"2024-08-09T00:40:59.140519+0000","last_active":"2024-08-09T00:40:59.140413+0000","last_peered":"2024-08-09T00:40:59.140413+0000","last_clean":"2024-08-09T00:40:59.140413+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:40:59.140413+0000","last_undegraded":"2024-08-09T00:40:59.140413+0000","last_fullsized":"2024-08-09T00:40:59.140413+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.140216+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:09:17.562745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755945,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":50563,"num_write":1098,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.518613+0000","last_change":"2024-08-09T00:41:08.518669+0000","last_active":"2024-08-09T00:41:08.518613+0000","last_peered":"2024-08-09T00:41:08.518613+0000","last_clean":"2024-08-09T00:41:08.518613+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:41:08.518613+0000","last_undegraded":"2024-08-09T00:41:08.518613+0000","last_fullsized":"2024-08-09T00:41:08.518613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.518412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:26.350798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'253","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.298522+0000","last_change":"2024-08-09T00:40:51.298522+0000","last_active":"2024-08-09T00:40:51.298522+0000","last_peered":"2024-08-09T00:40:51.298522+0000","last_clean":"2024-08-09T00:40:51.298522+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:40:51.298522+0000","last_undegraded":"2024-08-09T00:40:51.298522+0000","last_fullsized":"2024-08-09T00:40:51.298522+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.298232+0000","objects_scrubbed":11,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:39.882351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10001,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":440,"num_write":200,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.608126+0000","last_change":"2024-08-09T00:41:01.608126+0000","last_active":"2024-08-09T00:41:01.608126+0000","last_peered":"2024-08-09T00:41:01.608126+0000","last_clean":"2024-08-09T00:41:01.608126+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:41:01.608126+0000","last_undegraded":"2024-08-09T00:41:01.608126+0000","last_fullsized":"2024-08-09T00:41:01.608126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.607865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:12:52.168443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'122","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.594729+0000","last_change":"2024-08-09T00:40:51.594729+0000","last_active":"2024-08-09T00:40:51.594729+0000","last_peered":"2024-08-09T00:40:51.594729+0000","last_clean":"2024-08-09T00:40:51.594729+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:40:51.594729+0000","last_undegraded":"2024-08-09T00:40:51.594729+0000","last_fullsized":"2024-08-09T00:40:51.594729+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.594473+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:11.845593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.242586+0000","last_change":"2024-08-09T00:41:11.242704+0000","last_active":"2024-08-09T00:41:11.242586+0000","last_peered":"2024-08-09T00:41:11.242586+0000","last_clean":"2024-08-09T00:41:11.242586+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:41:11.242586+0000","last_undegraded":"2024-08-09T00:41:11.242586+0000","last_fullsized":"2024-08-09T00:41:11.242586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.242344+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:24.429124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'198","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.069128+0000","last_change":"2024-08-09T00:41:05.069265+0000","last_active":"2024-08-09T00:41:05.069128+0000","last_peered":"2024-08-09T00:41:05.069128+0000","last_clean":"2024-08-09T00:41:05.069128+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:41:05.069128+0000","last_undegraded":"2024-08-09T00:41:05.069128+0000","last_fullsized":"2024-08-09T00:41:05.069128+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.068927+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:34:56.248742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":62745,"num_write":1020,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.230548+0000","last_change":"2024-08-09T00:40:53.230548+0000","last_active":"2024-08-09T00:40:53.230548+0000","last_peered":"2024-08-09T00:40:53.230548+0000","last_clean":"2024-08-09T00:40:53.230548+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:40:53.230548+0000","last_undegraded":"2024-08-09T00:40:53.230548+0000","last_fullsized":"2024-08-09T00:40:53.230548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.230299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:57.894338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'151","reported_seq":754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.521612+0000","last_change":"2024-08-09T00:41:26.521763+0000","last_active":"2024-08-09T00:41:26.521612+0000","last_peered":"2024-08-09T00:41:26.521612+0000","last_clean":"2024-08-09T00:41:26.521612+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:41:26.521612+0000","last_undegraded":"2024-08-09T00:41:26.521612+0000","last_fullsized":"2024-08-09T00:41:26.521612+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-08-09T00:41:26.521391+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-08-09T00:41:26.521391+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.521391+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:12.442199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":272,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.898098+0000","last_change":"2024-08-09T00:40:42.898098+0000","last_active":"2024-08-09T00:40:42.898098+0000","last_peered":"2024-08-09T00:40:42.898098+0000","last_clean":"2024-08-09T00:40:42.898098+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:40:42.898098+0000","last_undegraded":"2024-08-09T00:40:42.898098+0000","last_fullsized":"2024-08-09T00:40:42.898098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.897858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:14.996595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'139","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.308062+0000","last_change":"2024-08-09T00:40:50.308062+0000","last_active":"2024-08-09T00:40:50.308062+0000","last_peered":"2024-08-09T00:40:50.308062+0000","last_clean":"2024-08-09T00:40:50.308062+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:40:50.308062+0000","last_undegraded":"2024-08-09T00:40:50.308062+0000","last_fullsized":"2024-08-09T00:40:50.308062+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.307777+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:13:23.329056+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.467022+0000","last_change":"2024-08-09T00:41:10.467022+0000","last_active":"2024-08-09T00:41:10.467022+0000","last_peered":"2024-08-09T00:41:10.467022+0000","last_clean":"2024-08-09T00:41:10.467022+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:41:10.467022+0000","last_undegraded":"2024-08-09T00:41:10.467022+0000","last_fullsized":"2024-08-09T00:41:10.467022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.466733+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:15.220734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'266","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.462725+0000","last_change":"2024-08-09T00:41:26.462878+0000","last_active":"2024-08-09T00:41:26.462725+0000","last_peered":"2024-08-09T00:41:26.462725+0000","last_clean":"2024-08-09T00:41:26.462725+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:41:26.462725+0000","last_undegraded":"2024-08-09T00:41:26.462725+0000","last_fullsized":"2024-08-09T00:41:26.462725+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'266","last_scrub_stamp":"2024-08-09T00:41:26.462496+0000","last_deep_scrub":"268'266","last_deep_scrub_stamp":"2024-08-09T00:41:26.462496+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.462496+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:41.483775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":32625,"num_write":1559,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.988585+0000","last_change":"2024-08-09T00:40:59.988585+0000","last_active":"2024-08-09T00:40:59.988585+0000","last_peered":"2024-08-09T00:40:59.988585+0000","last_clean":"2024-08-09T00:40:59.988585+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:40:59.988585+0000","last_undegraded":"2024-08-09T00:40:59.988585+0000","last_fullsized":"2024-08-09T00:40:59.988585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.988336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:23:42.997335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'127","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.386302+0000","last_change":"2024-08-09T00:41:04.386371+0000","last_active":"2024-08-09T00:41:04.386302+0000","last_peered":"2024-08-09T00:41:04.386302+0000","last_clean":"2024-08-09T00:41:04.386302+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:41:04.386302+0000","last_undegraded":"2024-08-09T00:41:04.386302+0000","last_fullsized":"2024-08-09T00:41:04.386302+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.386118+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:45:47.085465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":219,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.105495+0000","last_change":"2024-08-09T00:40:47.105495+0000","last_active":"2024-08-09T00:40:47.105495+0000","last_peered":"2024-08-09T00:40:47.105495+0000","last_clean":"2024-08-09T00:40:47.105495+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:40:47.105495+0000","last_undegraded":"2024-08-09T00:40:47.105495+0000","last_fullsized":"2024-08-09T00:40:47.105495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.105221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:39.031153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'148","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.651222+0000","last_change":"2024-08-09T00:40:53.651222+0000","last_active":"2024-08-09T00:40:53.651222+0000","last_peered":"2024-08-09T00:40:53.651222+0000","last_clean":"2024-08-09T00:40:53.651222+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:40:53.651222+0000","last_undegraded":"2024-08-09T00:40:53.651222+0000","last_fullsized":"2024-08-09T00:40:53.651222+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.650953+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:30.584762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":200,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.022603+0000","last_change":"2024-08-09T00:40:56.022603+0000","last_active":"2024-08-09T00:40:56.022603+0000","last_peered":"2024-08-09T00:40:56.022603+0000","last_clean":"2024-08-09T00:40:56.022603+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:40:56.022603+0000","last_undegraded":"2024-08-09T00:40:56.022603+0000","last_fullsized":"2024-08-09T00:40:56.022603+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4116","last_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_deep_scrub":"268'4116","last_deep_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.022341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:22:33.702715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'159","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.557770+0000","last_change":"2024-08-09T00:41:24.557865+0000","last_active":"2024-08-09T00:41:24.557770+0000","last_peered":"2024-08-09T00:41:24.557770+0000","last_clean":"2024-08-09T00:41:24.557770+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:41:24.557770+0000","last_undegraded":"2024-08-09T00:41:24.557770+0000","last_fullsized":"2024-08-09T00:41:24.557770+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-08-09T00:41:24.557573+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-08-09T00:41:24.557573+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.557573+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:40.743229+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4272291,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":403,"num_read_kb":16350,"num_write":847,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.815755+0000","last_change":"2024-08-09T00:40:48.815755+0000","last_active":"2024-08-09T00:40:48.815755+0000","last_peered":"2024-08-09T00:40:48.815755+0000","last_clean":"2024-08-09T00:40:48.815755+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:40:48.815755+0000","last_undegraded":"2024-08-09T00:40:48.815755+0000","last_fullsized":"2024-08-09T00:40:48.815755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.815323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:20.269004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'200","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.035765+0000","last_change":"2024-08-09T00:40:51.035765+0000","last_active":"2024-08-09T00:40:51.035765+0000","last_peered":"2024-08-09T00:40:51.035765+0000","last_clean":"2024-08-09T00:40:51.035765+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:40:51.035765+0000","last_undegraded":"2024-08-09T00:40:51.035765+0000","last_fullsized":"2024-08-09T00:40:51.035765+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.035329+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:12:44.986718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":353,"num_write":152,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.582286+0000","last_change":"2024-08-09T00:40:59.582286+0000","last_active":"2024-08-09T00:40:59.582286+0000","last_peered":"2024-08-09T00:40:59.582286+0000","last_clean":"2024-08-09T00:40:59.582286+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:40:59.582286+0000","last_undegraded":"2024-08-09T00:40:59.582286+0000","last_fullsized":"2024-08-09T00:40:59.582286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.581921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.548390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'143","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.960067+0000","last_change":"2024-08-09T00:40:38.960067+0000","last_active":"2024-08-09T00:40:38.960067+0000","last_peered":"2024-08-09T00:40:38.960067+0000","last_clean":"2024-08-09T00:40:38.960067+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:40:38.960067+0000","last_undegraded":"2024-08-09T00:40:38.960067+0000","last_fullsized":"2024-08-09T00:40:38.960067+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.959801+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:09.065450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'226","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.823607+0000","last_change":"2024-08-09T00:41:00.823673+0000","last_active":"2024-08-09T00:41:00.823607+0000","last_peered":"2024-08-09T00:41:00.823607+0000","last_clean":"2024-08-09T00:41:00.823607+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:41:00.823607+0000","last_undegraded":"2024-08-09T00:41:00.823607+0000","last_fullsized":"2024-08-09T00:41:00.823607+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.823423+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:01.815453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'212","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.210660+0000","last_change":"2024-08-09T00:41:03.210660+0000","last_active":"2024-08-09T00:41:03.210660+0000","last_peered":"2024-08-09T00:41:03.210660+0000","last_clean":"2024-08-09T00:41:03.210660+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:41:03.210660+0000","last_undegraded":"2024-08-09T00:41:03.210660+0000","last_fullsized":"2024-08-09T00:41:03.210660+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'212","last_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_deep_scrub":"268'212","last_deep_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.210345+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:21.028021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170402,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":16985,"num_write":1184,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'148","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.251126+0000","last_change":"2024-08-09T00:40:36.251196+0000","last_active":"2024-08-09T00:40:36.251126+0000","last_peered":"2024-08-09T00:40:36.251126+0000","last_clean":"2024-08-09T00:40:36.251126+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:40:36.251126+0000","last_undegraded":"2024-08-09T00:40:36.251126+0000","last_fullsized":"2024-08-09T00:40:36.251126+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.250936+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:42.591313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'209","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.138828+0000","last_change":"2024-08-09T00:40:56.138828+0000","last_active":"2024-08-09T00:40:56.138828+0000","last_peered":"2024-08-09T00:40:56.138828+0000","last_clean":"2024-08-09T00:40:56.138828+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:40:56.138828+0000","last_undegraded":"2024-08-09T00:40:56.138828+0000","last_fullsized":"2024-08-09T00:40:56.138828+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.138509+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:17.475723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906586,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":27391,"num_write":1081,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.212561+0000","last_change":"2024-08-09T00:40:56.212627+0000","last_active":"2024-08-09T00:40:56.212561+0000","last_peered":"2024-08-09T00:40:56.212561+0000","last_clean":"2024-08-09T00:40:56.212561+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:40:56.212561+0000","last_undegraded":"2024-08-09T00:40:56.212561+0000","last_fullsized":"2024-08-09T00:40:56.212561+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.212357+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:04.512212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.139595+0000","last_change":"2024-08-09T00:41:15.139595+0000","last_active":"2024-08-09T00:41:15.139595+0000","last_peered":"2024-08-09T00:41:15.139595+0000","last_clean":"2024-08-09T00:41:15.139595+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:41:15.139595+0000","last_undegraded":"2024-08-09T00:41:15.139595+0000","last_fullsized":"2024-08-09T00:41:15.139595+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:41:15.139316+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:41:15.139316+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.139316+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:36.800032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":17234,"num_write":1189,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'70","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.835828+0000","last_change":"2024-08-09T00:40:58.835895+0000","last_active":"2024-08-09T00:40:58.835828+0000","last_peered":"2024-08-09T00:40:58.835828+0000","last_clean":"2024-08-09T00:40:58.835828+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:40:58.835828+0000","last_undegraded":"2024-08-09T00:40:58.835828+0000","last_fullsized":"2024-08-09T00:40:58.835828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'70","last_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_deep_scrub":"268'70","last_deep_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.835621+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:34.064444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'258","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.234546+0000","last_change":"2024-08-09T00:40:44.234632+0000","last_active":"2024-08-09T00:40:44.234546+0000","last_peered":"2024-08-09T00:40:44.234546+0000","last_clean":"2024-08-09T00:40:44.234546+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:40:44.234546+0000","last_undegraded":"2024-08-09T00:40:44.234546+0000","last_fullsized":"2024-08-09T00:40:44.234546+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.234346+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:03.157959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":548,"num_read_kb":58241,"num_write":1241,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'130","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.443166+0000","last_change":"2024-08-09T00:41:08.443305+0000","last_active":"2024-08-09T00:41:08.443166+0000","last_peered":"2024-08-09T00:41:08.443166+0000","last_clean":"2024-08-09T00:41:08.443166+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:41:08.443166+0000","last_undegraded":"2024-08-09T00:41:08.443166+0000","last_fullsized":"2024-08-09T00:41:08.443166+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.442893+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:52.226288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'208","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.489043+0000","last_change":"2024-08-09T00:41:24.489124+0000","last_active":"2024-08-09T00:41:24.489043+0000","last_peered":"2024-08-09T00:41:24.489043+0000","last_clean":"2024-08-09T00:41:24.489043+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:41:24.489043+0000","last_undegraded":"2024-08-09T00:41:24.489043+0000","last_fullsized":"2024-08-09T00:41:24.489043+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:41:24.488851+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:41:24.488851+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.488851+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:27.461712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":406,"num_read_kb":7859,"num_write":1109,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.066374+0000","last_change":"2024-08-09T00:40:52.066374+0000","last_active":"2024-08-09T00:40:52.066374+0000","last_peered":"2024-08-09T00:40:52.066374+0000","last_clean":"2024-08-09T00:40:52.066374+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:40:52.066374+0000","last_undegraded":"2024-08-09T00:40:52.066374+0000","last_fullsized":"2024-08-09T00:40:52.066374+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.066127+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:09:51.014077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'239","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.916506+0000","last_change":"2024-08-09T00:41:06.916652+0000","last_active":"2024-08-09T00:41:06.916506+0000","last_peered":"2024-08-09T00:41:06.916506+0000","last_clean":"2024-08-09T00:41:06.916506+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:41:06.916506+0000","last_undegraded":"2024-08-09T00:41:06.916506+0000","last_fullsized":"2024-08-09T00:41:06.916506+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.916270+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:05:47.293252+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4141181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":20658,"num_write":1118,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.469253+0000","last_change":"2024-08-09T00:41:14.469253+0000","last_active":"2024-08-09T00:41:14.469253+0000","last_peered":"2024-08-09T00:41:14.469253+0000","last_clean":"2024-08-09T00:41:14.469253+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:41:14.469253+0000","last_undegraded":"2024-08-09T00:41:14.469253+0000","last_fullsized":"2024-08-09T00:41:14.469253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:41:14.469006+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:41:14.469006+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.469006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:27.702181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.259004+0000","last_change":"2024-08-09T00:41:02.259178+0000","last_active":"2024-08-09T00:41:02.259004+0000","last_peered":"2024-08-09T00:41:02.259004+0000","last_clean":"2024-08-09T00:41:02.259004+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:41:02.259004+0000","last_undegraded":"2024-08-09T00:41:02.259004+0000","last_fullsized":"2024-08-09T00:41:02.259004+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.258807+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:14:06.788691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":364,"num_read_kb":32922,"num_write":1098,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'233","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.141350+0000","last_change":"2024-08-09T00:40:57.141350+0000","last_active":"2024-08-09T00:40:57.141350+0000","last_peered":"2024-08-09T00:40:57.141350+0000","last_clean":"2024-08-09T00:40:57.141350+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:40:57.141350+0000","last_undegraded":"2024-08-09T00:40:57.141350+0000","last_fullsized":"2024-08-09T00:40:57.141350+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.140970+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:09.384475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'255","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.689648+0000","last_change":"2024-08-09T00:40:42.689791+0000","last_active":"2024-08-09T00:40:42.689648+0000","last_peered":"2024-08-09T00:40:42.689648+0000","last_clean":"2024-08-09T00:40:42.689648+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:40:42.689648+0000","last_undegraded":"2024-08-09T00:40:42.689648+0000","last_fullsized":"2024-08-09T00:40:42.689648+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'255","last_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_deep_scrub":"268'255","last_deep_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.689455+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:26:59.280632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":18739,"num_write":1245,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.482175+0000","last_change":"2024-08-09T00:41:05.482316+0000","last_active":"2024-08-09T00:41:05.482175+0000","last_peered":"2024-08-09T00:41:05.482175+0000","last_clean":"2024-08-09T00:41:05.482175+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:41:05.482175+0000","last_undegraded":"2024-08-09T00:41:05.482175+0000","last_fullsized":"2024-08-09T00:41:05.482175+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.481959+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:37:25.905559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'189","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.107206+0000","last_change":"2024-08-09T00:41:12.107374+0000","last_active":"2024-08-09T00:41:12.107206+0000","last_peered":"2024-08-09T00:41:12.107206+0000","last_clean":"2024-08-09T00:41:12.107206+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:41:12.107206+0000","last_undegraded":"2024-08-09T00:41:12.107206+0000","last_fullsized":"2024-08-09T00:41:12.107206+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.106973+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:34.387579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917966,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":400,"num_read_kb":34111,"num_write":1045,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'82","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.194385+0000","last_change":"2024-08-09T00:41:07.194448+0000","last_active":"2024-08-09T00:41:07.194385+0000","last_peered":"2024-08-09T00:41:07.194385+0000","last_clean":"2024-08-09T00:41:07.194385+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:41:07.194385+0000","last_undegraded":"2024-08-09T00:41:07.194385+0000","last_fullsized":"2024-08-09T00:41:07.194385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'82","last_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_deep_scrub":"268'82","last_deep_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.194191+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:54:41.141377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'206","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.414465+0000","last_change":"2024-08-09T00:41:21.414578+0000","last_active":"2024-08-09T00:41:21.414465+0000","last_peered":"2024-08-09T00:41:21.414465+0000","last_clean":"2024-08-09T00:41:21.414465+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:41:21.414465+0000","last_undegraded":"2024-08-09T00:41:21.414465+0000","last_fullsized":"2024-08-09T00:41:21.414465+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-08-09T00:41:21.414253+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-08-09T00:41:21.414253+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.414253+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:10:47.721636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":96889,"num_write":1101,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.089279+0000","last_change":"2024-08-09T00:40:57.089342+0000","last_active":"2024-08-09T00:40:57.089279+0000","last_peered":"2024-08-09T00:40:57.089279+0000","last_clean":"2024-08-09T00:40:57.089279+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:40:57.089279+0000","last_undegraded":"2024-08-09T00:40:57.089279+0000","last_fullsized":"2024-08-09T00:40:57.089279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'66","last_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_deep_scrub":"268'66","last_deep_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.089084+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:47.534069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'184","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.182399+0000","last_change":"2024-08-09T00:41:17.182489+0000","last_active":"2024-08-09T00:41:17.182399+0000","last_peered":"2024-08-09T00:41:17.182399+0000","last_clean":"2024-08-09T00:41:17.182399+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:41:17.182399+0000","last_undegraded":"2024-08-09T00:41:17.182399+0000","last_fullsized":"2024-08-09T00:41:17.182399+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:17.182206+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:17.182206+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.182206+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:11.839395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":443,"num_read_kb":71209,"num_write":978,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.029644+0000","last_change":"2024-08-09T00:40:53.029715+0000","last_active":"2024-08-09T00:40:53.029644+0000","last_peered":"2024-08-09T00:40:53.029644+0000","last_clean":"2024-08-09T00:40:53.029644+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:40:53.029644+0000","last_undegraded":"2024-08-09T00:40:53.029644+0000","last_fullsized":"2024-08-09T00:40:53.029644+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.029406+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:02.108228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'175","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.526651+0000","last_change":"2024-08-09T00:41:22.526728+0000","last_active":"2024-08-09T00:41:22.526651+0000","last_peered":"2024-08-09T00:41:22.526651+0000","last_clean":"2024-08-09T00:41:22.526651+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:41:22.526651+0000","last_undegraded":"2024-08-09T00:41:22.526651+0000","last_fullsized":"2024-08-09T00:41:22.526651+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-08-09T00:41:22.526459+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-08-09T00:41:22.526459+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.526459+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:00:29.954028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":31431,"num_write":995,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.566407+0000","last_change":"2024-08-09T00:41:09.566466+0000","last_active":"2024-08-09T00:41:09.566407+0000","last_peered":"2024-08-09T00:41:09.566407+0000","last_clean":"2024-08-09T00:41:09.566407+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:41:09.566407+0000","last_undegraded":"2024-08-09T00:41:09.566407+0000","last_fullsized":"2024-08-09T00:41:09.566407+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.566215+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:38:01.849623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'231","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.186379+0000","last_change":"2024-08-09T00:40:59.186465+0000","last_active":"2024-08-09T00:40:59.186379+0000","last_peered":"2024-08-09T00:40:59.186379+0000","last_clean":"2024-08-09T00:40:59.186379+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:40:59.186379+0000","last_undegraded":"2024-08-09T00:40:59.186379+0000","last_fullsized":"2024-08-09T00:40:59.186379+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.186180+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:22.480994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":70204,"num_write":1298,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.467575+0000","last_change":"2024-08-09T00:41:09.467702+0000","last_active":"2024-08-09T00:41:09.467575+0000","last_peered":"2024-08-09T00:41:09.467575+0000","last_clean":"2024-08-09T00:41:09.467575+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:41:09.467575+0000","last_undegraded":"2024-08-09T00:41:09.467575+0000","last_fullsized":"2024-08-09T00:41:09.467575+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.467287+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:21.257904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'214","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.748354+0000","last_change":"2024-08-09T00:41:24.748456+0000","last_active":"2024-08-09T00:41:24.748354+0000","last_peered":"2024-08-09T00:41:24.748354+0000","last_clean":"2024-08-09T00:41:24.748354+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:41:24.748354+0000","last_undegraded":"2024-08-09T00:41:24.748354+0000","last_fullsized":"2024-08-09T00:41:24.748354+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'214","last_scrub_stamp":"2024-08-09T00:41:24.748133+0000","last_deep_scrub":"268'214","last_deep_scrub_stamp":"2024-08-09T00:41:24.748133+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.748133+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:14.276247+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":54938,"num_write":1149,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.449184+0000","last_change":"2024-08-09T00:41:12.449298+0000","last_active":"2024-08-09T00:41:12.449184+0000","last_peered":"2024-08-09T00:41:12.449184+0000","last_clean":"2024-08-09T00:41:12.449184+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:41:12.449184+0000","last_undegraded":"2024-08-09T00:41:12.449184+0000","last_fullsized":"2024-08-09T00:41:12.449184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.448907+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:29.102323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'161","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.163620+0000","last_change":"2024-08-09T00:40:55.163789+0000","last_active":"2024-08-09T00:40:55.163620+0000","last_peered":"2024-08-09T00:40:55.163620+0000","last_clean":"2024-08-09T00:40:55.163620+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:40:55.163620+0000","last_undegraded":"2024-08-09T00:40:55.163620+0000","last_fullsized":"2024-08-09T00:40:55.163620+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'161","last_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_deep_scrub":"268'161","last_deep_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.163304+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:36.656935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029153,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":19124,"num_write":939,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.542965+0000","last_change":"2024-08-09T00:41:07.543024+0000","last_active":"2024-08-09T00:41:07.542965+0000","last_peered":"2024-08-09T00:41:07.542965+0000","last_clean":"2024-08-09T00:41:07.542965+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:41:07.542965+0000","last_undegraded":"2024-08-09T00:41:07.542965+0000","last_fullsized":"2024-08-09T00:41:07.542965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.542773+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:53:09.581153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'233","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.070027+0000","last_change":"2024-08-09T00:41:09.070186+0000","last_active":"2024-08-09T00:41:09.070027+0000","last_peered":"2024-08-09T00:41:09.070027+0000","last_clean":"2024-08-09T00:41:09.070027+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:41:09.070027+0000","last_undegraded":"2024-08-09T00:41:09.070027+0000","last_fullsized":"2024-08-09T00:41:09.070027+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.069721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:01:13.191209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":89533,"num_write":1169,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'222","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.170136+0000","last_change":"2024-08-09T00:41:14.170225+0000","last_active":"2024-08-09T00:41:14.170136+0000","last_peered":"2024-08-09T00:41:14.170136+0000","last_clean":"2024-08-09T00:41:14.170136+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:41:14.170136+0000","last_undegraded":"2024-08-09T00:41:14.170136+0000","last_fullsized":"2024-08-09T00:41:14.170136+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'222","last_scrub_stamp":"2024-08-09T00:41:14.169935+0000","last_deep_scrub":"268'222","last_deep_scrub_stamp":"2024-08-09T00:41:14.169935+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.169935+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.060883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055020,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":157320,"num_write":1033,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.484453+0000","last_change":"2024-08-09T00:41:11.484453+0000","last_active":"2024-08-09T00:41:11.484453+0000","last_peered":"2024-08-09T00:41:11.484453+0000","last_clean":"2024-08-09T00:41:11.484453+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:41:11.484453+0000","last_undegraded":"2024-08-09T00:41:11.484453+0000","last_fullsized":"2024-08-09T00:41:11.484453+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.484163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:06:01.629340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'185","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.975381+0000","last_change":"2024-08-09T00:41:09.975629+0000","last_active":"2024-08-09T00:41:09.975381+0000","last_peered":"2024-08-09T00:41:09.975381+0000","last_clean":"2024-08-09T00:41:09.975381+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:41:09.975381+0000","last_undegraded":"2024-08-09T00:41:09.975381+0000","last_fullsized":"2024-08-09T00:41:09.975381+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.975107+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:02.479753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":17056,"num_write":1042,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.144029+0000","last_change":"2024-08-09T00:40:58.144087+0000","last_active":"2024-08-09T00:40:58.144029+0000","last_peered":"2024-08-09T00:40:58.144029+0000","last_clean":"2024-08-09T00:40:58.144029+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:40:58.144029+0000","last_undegraded":"2024-08-09T00:40:58.144029+0000","last_fullsized":"2024-08-09T00:40:58.144029+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.143843+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:59.634585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6218,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4197,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1760,"ondisk_log_size":1760,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":494,"ondisk_log_size":494,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314750,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9845,"num_read_kb":12223,"num_write":6853,"num_write_kb":2887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":620468,"num_omap_keys":1518,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1819,"ondisk_log_size":1819,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1613,"num_read_kb":1921,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44622,"num_omap_keys":181,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3468,"ondisk_log_size":3468,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":88031934,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":32363,"num_read_kb":2279985,"num_write":69541,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134025216,"data_stored":134025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4276,"ondisk_log_size":4276,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":194734,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":183422,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575735,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246792,"kb_used_data":21248,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125048,"statfs":{"total":96636764160,"available":96384049152,"internally_reserved":0,"allocated":21757952,"data_stored":19593835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575733,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284076,"kb_used_data":22436,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94087764,"statfs":{"total":96636764160,"available":96345870336,"internally_reserved":0,"allocated":22974464,"data_stored":20860820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575735,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107176,"kb_used_data":17760,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264664,"statfs":{"total":96636764160,"available":96527015936,"internally_reserved":0,"allocated":18186240,"data_stored":16015430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575733,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110208,"kb_used_data":20728,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94261632,"statfs":{"total":96636764160,"available":96523911168,"internally_reserved":0,"allocated":21225472,"data_stored":19169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575732,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235232,"kb_used_data":23576,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94136608,"statfs":{"total":96636764160,"available":96395886592,"internally_reserved":0,"allocated":24141824,"data_stored":22000945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575733,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105888,"kb_used_data":20632,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265952,"statfs":{"total":96636764160,"available":96528334848,"internally_reserved":0,"allocated":21127168,"data_stored":19032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575736,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":19616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":20086784,"data_stored":17965451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575733,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236592,"kb_used_data":20776,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94135248,"statfs":{"total":96636764160,"available":96394493952,"internally_reserved":0,"allocated":21274624,"data_stored":19114679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16203776,"data_stored":16203776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16715776,"data_stored":16715776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19681280,"data_stored":19681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18542592,"data_stored":18542592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":16683008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:41:38.897 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.898 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.898 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.899 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.899 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.899 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.900 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-09T00:04:28.810711+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=4, tm_sec=28, tm_wday=4, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=9, tm_hour=0, tm_min=40, tm_sec=32, tm_wday=4, tm_yday=222, tm_isdst=0) 2024-08-09T00:41:38.903 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-09T00:41:58.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-09T00:41:59.281 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-08-09T00:41:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-08-09T00:41:59.314 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":2475,"stamp":"2024-08-09T00:41:57.364555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88958767,"num_objects":608,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":608,"num_whiteouts":0,"num_read":150062,"num_read_kb":2759937,"num_write":130193,"num_write_kb":2369717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":68,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676633,"num_omap_keys":1748,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13232,"ondisk_log_size":13232,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1471092,"kb_used_data":166772,"kb_used_omap":12,"kb_used_meta":1304243,"kb_avail":753503628,"statfs":{"total":773094113280,"available":771587715072,"internally_reserved":0,"allocated":170774528,"data_stored":153754026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1335545392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007639"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.137615+0000","last_change":"2024-08-09T00:41:23.137670+0000","last_active":"2024-08-09T00:41:23.137615+0000","last_peered":"2024-08-09T00:41:23.137615+0000","last_clean":"2024-08-09T00:41:23.137615+0000","last_became_active":"2024-08-09T00:04:29.869106+0000","last_became_peered":"2024-08-09T00:04:29.869106+0000","last_unstale":"2024-08-09T00:41:23.137615+0000","last_undegraded":"2024-08-09T00:41:23.137615+0000","last_fullsized":"2024-08-09T00:41:23.137615+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:23.137392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:23.137392+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.137392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:58.737448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.120847+0000","last_change":"2024-08-09T00:41:22.120905+0000","last_active":"2024-08-09T00:41:22.120847+0000","last_peered":"2024-08-09T00:41:22.120847+0000","last_clean":"2024-08-09T00:41:22.120847+0000","last_became_active":"2024-08-08T23:48:42.119604+0000","last_became_peered":"2024-08-08T23:48:42.119604+0000","last_unstale":"2024-08-09T00:41:22.120847+0000","last_undegraded":"2024-08-09T00:41:22.120847+0000","last_fullsized":"2024-08-09T00:41:22.120847+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:22.120654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:22.120654+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.120654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:48.905970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.271122+0000","last_change":"2024-08-09T00:40:39.271122+0000","last_active":"2024-08-09T00:40:39.271122+0000","last_peered":"2024-08-09T00:40:39.271122+0000","last_clean":"2024-08-09T00:40:39.271122+0000","last_became_active":"2024-08-08T23:48:38.081922+0000","last_became_peered":"2024-08-08T23:48:38.081922+0000","last_unstale":"2024-08-09T00:40:39.271122+0000","last_undegraded":"2024-08-09T00:40:39.271122+0000","last_fullsized":"2024-08-09T00:40:39.271122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:39.270864+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.270864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:38.071300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'24","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.658714+0000","last_change":"2024-08-09T00:40:35.658714+0000","last_active":"2024-08-09T00:40:35.658714+0000","last_peered":"2024-08-09T00:40:35.658714+0000","last_clean":"2024-08-09T00:40:35.658714+0000","last_became_active":"2024-08-08T23:44:47.427635+0000","last_became_peered":"2024-08-08T23:44:47.427635+0000","last_unstale":"2024-08-09T00:40:35.658714+0000","last_undegraded":"2024-08-09T00:40:35.658714+0000","last_fullsized":"2024-08-09T00:40:35.658714+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:35.658455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.658455+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:16.669438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":84,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.030403+0000","last_change":"2024-08-09T00:41:08.030505+0000","last_active":"2024-08-09T00:41:08.030403+0000","last_peered":"2024-08-09T00:41:08.030403+0000","last_clean":"2024-08-09T00:41:08.030403+0000","last_became_active":"2024-08-09T00:04:29.842654+0000","last_became_peered":"2024-08-09T00:04:29.842654+0000","last_unstale":"2024-08-09T00:41:08.030403+0000","last_undegraded":"2024-08-09T00:41:08.030403+0000","last_fullsized":"2024-08-09T00:41:08.030403+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.030171+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.030171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:07:43.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.374296+0000","last_change":"2024-08-09T00:41:22.374359+0000","last_active":"2024-08-09T00:41:22.374296+0000","last_peered":"2024-08-09T00:41:22.374296+0000","last_clean":"2024-08-09T00:41:22.374296+0000","last_became_active":"2024-08-08T23:48:42.108493+0000","last_became_peered":"2024-08-08T23:48:42.108493+0000","last_unstale":"2024-08-09T00:41:22.374296+0000","last_undegraded":"2024-08-09T00:41:22.374296+0000","last_fullsized":"2024-08-09T00:41:22.374296+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:22.374084+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:22.374084+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.374084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:46:23.857682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'12","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.802356+0000","last_change":"2024-08-09T00:40:34.802356+0000","last_active":"2024-08-09T00:40:34.802356+0000","last_peered":"2024-08-09T00:40:34.802356+0000","last_clean":"2024-08-09T00:40:34.802356+0000","last_became_active":"2024-08-08T23:48:38.091216+0000","last_became_peered":"2024-08-08T23:48:38.091216+0000","last_unstale":"2024-08-09T00:40:34.802356+0000","last_undegraded":"2024-08-09T00:40:34.802356+0000","last_fullsized":"2024-08-09T00:40:34.802356+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-08-09T00:40:34.802208+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.802208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:12.870620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4144,"num_write":22,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'56","reported_seq":226,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.185356+0000","last_change":"2024-08-09T00:40:35.185356+0000","last_active":"2024-08-09T00:40:35.185356+0000","last_peered":"2024-08-09T00:40:35.185356+0000","last_clean":"2024-08-09T00:40:35.185356+0000","last_became_active":"2024-08-08T23:44:47.412671+0000","last_became_peered":"2024-08-08T23:44:47.412671+0000","last_unstale":"2024-08-09T00:40:35.185356+0000","last_undegraded":"2024-08-09T00:40:35.185356+0000","last_fullsized":"2024-08-09T00:40:35.185356+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:35.185085+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.185085+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:13:40.941525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":209,"num_write":126,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.999674+0000","last_change":"2024-08-09T00:41:12.999728+0000","last_active":"2024-08-09T00:41:12.999674+0000","last_peered":"2024-08-09T00:41:12.999674+0000","last_clean":"2024-08-09T00:41:12.999674+0000","last_became_active":"2024-08-09T00:04:29.865077+0000","last_became_peered":"2024-08-09T00:04:29.865077+0000","last_unstale":"2024-08-09T00:41:12.999674+0000","last_undegraded":"2024-08-09T00:41:12.999674+0000","last_fullsized":"2024-08-09T00:41:12.999674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:12.999475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:12.999475+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.999475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:01:35.675189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.537961+0000","last_change":"2024-08-09T00:41:27.538031+0000","last_active":"2024-08-09T00:41:27.537961+0000","last_peered":"2024-08-09T00:41:27.537961+0000","last_clean":"2024-08-09T00:41:27.537961+0000","last_became_active":"2024-08-08T23:48:42.576398+0000","last_became_peered":"2024-08-08T23:48:42.576398+0000","last_unstale":"2024-08-09T00:41:27.537961+0000","last_undegraded":"2024-08-09T00:41:27.537961+0000","last_fullsized":"2024-08-09T00:41:27.537961+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:27.537764+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:27.537764+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.537764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:03.934063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.052384+0000","last_change":"2024-08-09T00:41:05.052451+0000","last_active":"2024-08-09T00:41:05.052384+0000","last_peered":"2024-08-09T00:41:05.052384+0000","last_clean":"2024-08-09T00:41:05.052384+0000","last_became_active":"2024-08-08T23:48:38.096236+0000","last_became_peered":"2024-08-08T23:48:38.096236+0000","last_unstale":"2024-08-09T00:41:05.052384+0000","last_undegraded":"2024-08-09T00:41:05.052384+0000","last_fullsized":"2024-08-09T00:41:05.052384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:05.052191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.052191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:29:43.122709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.643998+0000","last_change":"2024-08-09T00:40:41.644063+0000","last_active":"2024-08-09T00:40:41.643998+0000","last_peered":"2024-08-09T00:40:41.643998+0000","last_clean":"2024-08-09T00:40:41.643998+0000","last_became_active":"2024-08-08T23:44:47.409787+0000","last_became_peered":"2024-08-08T23:44:47.409787+0000","last_unstale":"2024-08-09T00:40:41.643998+0000","last_undegraded":"2024-08-09T00:40:41.643998+0000","last_fullsized":"2024-08-09T00:40:41.643998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-08-09T00:40:41.643807+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.643807+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:22.863068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":145,"num_write":57,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:35.540054+0000","last_change":"2024-08-09T00:41:35.540109+0000","last_active":"2024-08-09T00:41:35.540054+0000","last_peered":"2024-08-09T00:41:35.540054+0000","last_clean":"2024-08-09T00:41:35.540054+0000","last_became_active":"2024-08-09T00:04:29.874284+0000","last_became_peered":"2024-08-09T00:04:29.874284+0000","last_unstale":"2024-08-09T00:41:35.540054+0000","last_undegraded":"2024-08-09T00:41:35.540054+0000","last_fullsized":"2024-08-09T00:41:35.540054+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:35.539859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:35.539859+0000","last_clean_scrub_stamp":"2024-08-09T00:41:35.539859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:31:15.866875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.606132+0000","last_change":"2024-08-09T00:41:30.606190+0000","last_active":"2024-08-09T00:41:30.606132+0000","last_peered":"2024-08-09T00:41:30.606132+0000","last_clean":"2024-08-09T00:41:30.606132+0000","last_became_active":"2024-08-08T23:48:42.575519+0000","last_became_peered":"2024-08-08T23:48:42.575519+0000","last_unstale":"2024-08-09T00:41:30.606132+0000","last_undegraded":"2024-08-09T00:41:30.606132+0000","last_fullsized":"2024-08-09T00:41:30.606132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.605884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.605884+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.605884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:34.749478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.137960+0000","last_change":"2024-08-09T00:40:46.138108+0000","last_active":"2024-08-09T00:40:46.137960+0000","last_peered":"2024-08-09T00:40:46.137960+0000","last_clean":"2024-08-09T00:40:46.137960+0000","last_became_active":"2024-08-08T23:48:38.063436+0000","last_became_peered":"2024-08-08T23:48:38.063436+0000","last_unstale":"2024-08-09T00:40:46.137960+0000","last_undegraded":"2024-08-09T00:40:46.137960+0000","last_fullsized":"2024-08-09T00:40:46.137960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:46.137726+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.137726+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:04.630323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'43","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.280270+0000","last_change":"2024-08-09T00:40:41.280331+0000","last_active":"2024-08-09T00:40:41.280270+0000","last_peered":"2024-08-09T00:40:41.280270+0000","last_clean":"2024-08-09T00:40:41.280270+0000","last_became_active":"2024-08-08T23:44:47.399537+0000","last_became_peered":"2024-08-08T23:44:47.399537+0000","last_unstale":"2024-08-09T00:40:41.280270+0000","last_undegraded":"2024-08-09T00:40:41.280270+0000","last_fullsized":"2024-08-09T00:40:41.280270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'43","last_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_deep_scrub":"268'43","last_deep_scrub_stamp":"2024-08-09T00:40:41.280078+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.280078+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:02:07.630638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":157,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:36.557249+0000","last_change":"2024-08-09T00:41:36.557405+0000","last_active":"2024-08-09T00:41:36.557249+0000","last_peered":"2024-08-09T00:41:36.557249+0000","last_clean":"2024-08-09T00:41:36.557249+0000","last_became_active":"2024-08-09T00:04:29.874875+0000","last_became_peered":"2024-08-09T00:04:29.874875+0000","last_unstale":"2024-08-09T00:41:36.557249+0000","last_undegraded":"2024-08-09T00:41:36.557249+0000","last_fullsized":"2024-08-09T00:41:36.557249+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:36.557024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:36.557024+0000","last_clean_scrub_stamp":"2024-08-09T00:41:36.557024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:47:21.968804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'11","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.076829+0000","last_change":"2024-08-09T00:41:21.076890+0000","last_active":"2024-08-09T00:41:21.076829+0000","last_peered":"2024-08-09T00:41:21.076829+0000","last_clean":"2024-08-09T00:41:21.076829+0000","last_became_active":"2024-08-08T23:48:42.112915+0000","last_became_peered":"2024-08-08T23:48:42.112915+0000","last_unstale":"2024-08-09T00:41:21.076829+0000","last_undegraded":"2024-08-09T00:41:21.076829+0000","last_fullsized":"2024-08-09T00:41:21.076829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-08-09T00:41:21.076644+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-08-09T00:41:21.076644+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.076644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:31:02.616259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":17458,"num_write":16,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:34.633632+0000","last_change":"2024-08-09T00:40:34.633632+0000","last_active":"2024-08-09T00:40:34.633632+0000","last_peered":"2024-08-09T00:40:34.633632+0000","last_clean":"2024-08-09T00:40:34.633632+0000","last_became_active":"2024-08-08T23:48:38.057015+0000","last_became_peered":"2024-08-08T23:48:38.057015+0000","last_unstale":"2024-08-09T00:40:34.633632+0000","last_undegraded":"2024-08-09T00:40:34.633632+0000","last_fullsized":"2024-08-09T00:40:34.633632+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:34.633469+0000","last_clean_scrub_stamp":"2024-08-09T00:40:34.633469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:56:40.040241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'20","reported_seq":116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.238228+0000","last_change":"2024-08-09T00:40:38.238357+0000","last_active":"2024-08-09T00:40:38.238228+0000","last_peered":"2024-08-09T00:40:38.238228+0000","last_clean":"2024-08-09T00:40:38.238228+0000","last_became_active":"2024-08-08T23:44:47.423634+0000","last_became_peered":"2024-08-08T23:44:47.423634+0000","last_unstale":"2024-08-09T00:40:38.238228+0000","last_undegraded":"2024-08-09T00:40:38.238228+0000","last_fullsized":"2024-08-09T00:40:38.238228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-08-09T00:40:38.237982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.237982+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:45:45.723779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":71,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.874696+0000","last_change":"2024-08-09T00:41:18.874758+0000","last_active":"2024-08-09T00:41:18.874696+0000","last_peered":"2024-08-09T00:41:18.874696+0000","last_clean":"2024-08-09T00:41:18.874696+0000","last_became_active":"2024-08-09T00:04:29.871208+0000","last_became_peered":"2024-08-09T00:04:29.871208+0000","last_unstale":"2024-08-09T00:41:18.874696+0000","last_undegraded":"2024-08-09T00:41:18.874696+0000","last_fullsized":"2024-08-09T00:41:18.874696+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:18.874484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:18.874484+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.874484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:54:43.251082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.028228+0000","last_change":"2024-08-09T00:41:08.028228+0000","last_active":"2024-08-09T00:41:08.028228+0000","last_peered":"2024-08-09T00:41:08.028228+0000","last_clean":"2024-08-09T00:41:08.028228+0000","last_became_active":"2024-08-08T23:48:42.098775+0000","last_became_peered":"2024-08-08T23:48:42.098775+0000","last_unstale":"2024-08-09T00:41:08.028228+0000","last_undegraded":"2024-08-09T00:41:08.028228+0000","last_fullsized":"2024-08-09T00:41:08.028228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.027970+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.027970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:24:22.702951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.913495+0000","last_change":"2024-08-09T00:40:37.913550+0000","last_active":"2024-08-09T00:40:37.913495+0000","last_peered":"2024-08-09T00:40:37.913495+0000","last_clean":"2024-08-09T00:40:37.913495+0000","last_became_active":"2024-08-08T23:48:38.062188+0000","last_became_peered":"2024-08-08T23:48:38.062188+0000","last_unstale":"2024-08-09T00:40:37.913495+0000","last_undegraded":"2024-08-09T00:40:37.913495+0000","last_fullsized":"2024-08-09T00:40:37.913495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:37.913298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.913298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:15.804242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'61","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.915549+0000","last_change":"2024-08-09T00:40:36.915685+0000","last_active":"2024-08-09T00:40:36.915549+0000","last_peered":"2024-08-09T00:40:36.915549+0000","last_clean":"2024-08-09T00:40:36.915549+0000","last_became_active":"2024-08-08T23:44:47.415001+0000","last_became_peered":"2024-08-08T23:44:47.415001+0000","last_unstale":"2024-08-09T00:40:36.915549+0000","last_undegraded":"2024-08-09T00:40:36.915549+0000","last_fullsized":"2024-08-09T00:40:36.915549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-08-09T00:40:36.915302+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.915302+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:49:03.528537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":119,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.815184+0000","last_change":"2024-08-09T00:41:27.815253+0000","last_active":"2024-08-09T00:41:27.815184+0000","last_peered":"2024-08-09T00:41:27.815184+0000","last_clean":"2024-08-09T00:41:27.815184+0000","last_became_active":"2024-08-09T00:04:29.875222+0000","last_became_peered":"2024-08-09T00:04:29.875222+0000","last_unstale":"2024-08-09T00:41:27.815184+0000","last_undegraded":"2024-08-09T00:41:27.815184+0000","last_fullsized":"2024-08-09T00:41:27.815184+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:27.814961+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:27.814961+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.814961+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:03:33.447165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.070337+0000","last_change":"2024-08-09T00:41:10.070337+0000","last_active":"2024-08-09T00:41:10.070337+0000","last_peered":"2024-08-09T00:41:10.070337+0000","last_clean":"2024-08-09T00:41:10.070337+0000","last_became_active":"2024-08-08T23:48:42.104061+0000","last_became_peered":"2024-08-08T23:48:42.104061+0000","last_unstale":"2024-08-09T00:41:10.070337+0000","last_undegraded":"2024-08-09T00:41:10.070337+0000","last_fullsized":"2024-08-09T00:41:10.070337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.070055+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.070055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:44:52.633196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.310133+0000","last_change":"2024-08-09T00:41:17.310195+0000","last_active":"2024-08-09T00:41:17.310133+0000","last_peered":"2024-08-09T00:41:17.310133+0000","last_clean":"2024-08-09T00:41:17.310133+0000","last_became_active":"2024-08-08T23:48:38.091458+0000","last_became_peered":"2024-08-08T23:48:38.091458+0000","last_unstale":"2024-08-09T00:41:17.310133+0000","last_undegraded":"2024-08-09T00:41:17.310133+0000","last_fullsized":"2024-08-09T00:41:17.310133+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:17.309930+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:17.309930+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.309930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:45.342607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'44","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.707450+0000","last_change":"2024-08-09T00:40:39.707514+0000","last_active":"2024-08-09T00:40:39.707450+0000","last_peered":"2024-08-09T00:40:39.707450+0000","last_clean":"2024-08-09T00:40:39.707450+0000","last_became_active":"2024-08-08T23:44:47.418181+0000","last_became_peered":"2024-08-08T23:44:47.418181+0000","last_unstale":"2024-08-09T00:40:39.707450+0000","last_undegraded":"2024-08-09T00:40:39.707450+0000","last_fullsized":"2024-08-09T00:40:39.707450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:39.707247+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.707247+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:34:07.954822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":170,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:33.916270+0000","last_change":"2024-08-09T00:41:33.916325+0000","last_active":"2024-08-09T00:41:33.916270+0000","last_peered":"2024-08-09T00:41:33.916270+0000","last_clean":"2024-08-09T00:41:33.916270+0000","last_became_active":"2024-08-09T00:04:29.884222+0000","last_became_peered":"2024-08-09T00:04:29.884222+0000","last_unstale":"2024-08-09T00:41:33.916270+0000","last_undegraded":"2024-08-09T00:41:33.916270+0000","last_fullsized":"2024-08-09T00:41:33.916270+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:33.916072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:33.916072+0000","last_clean_scrub_stamp":"2024-08-09T00:41:33.916072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:42:04.445270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.308345+0000","last_change":"2024-08-09T00:40:43.308345+0000","last_active":"2024-08-09T00:40:43.308345+0000","last_peered":"2024-08-09T00:40:43.308345+0000","last_clean":"2024-08-09T00:40:43.308345+0000","last_became_active":"2024-08-08T23:48:42.092773+0000","last_became_peered":"2024-08-08T23:48:42.092773+0000","last_unstale":"2024-08-09T00:40:43.308345+0000","last_undegraded":"2024-08-09T00:40:43.308345+0000","last_fullsized":"2024-08-09T00:40:43.308345+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:43.308076+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.308076+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:09:30.144196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.660858+0000","last_change":"2024-08-09T00:40:36.660858+0000","last_active":"2024-08-09T00:40:36.660858+0000","last_peered":"2024-08-09T00:40:36.660858+0000","last_clean":"2024-08-09T00:40:36.660858+0000","last_became_active":"2024-08-08T23:48:38.069320+0000","last_became_peered":"2024-08-08T23:48:38.069320+0000","last_unstale":"2024-08-09T00:40:36.660858+0000","last_undegraded":"2024-08-09T00:40:36.660858+0000","last_fullsized":"2024-08-09T00:40:36.660858+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.660732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.660732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:31:02.434979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.833334+0000","last_change":"2024-08-09T00:40:36.833359+0000","last_active":"2024-08-09T00:40:36.833334+0000","last_peered":"2024-08-09T00:40:36.833334+0000","last_clean":"2024-08-09T00:40:36.833334+0000","last_became_active":"2024-08-08T23:44:47.400906+0000","last_became_peered":"2024-08-08T23:44:47.400906+0000","last_unstale":"2024-08-09T00:40:36.833334+0000","last_undegraded":"2024-08-09T00:40:36.833334+0000","last_fullsized":"2024-08-09T00:40:36.833334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-08-09T00:40:36.833241+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.833241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:35:54.834498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.904840+0000","last_change":"2024-08-09T00:41:16.904840+0000","last_active":"2024-08-09T00:41:16.904840+0000","last_peered":"2024-08-09T00:41:16.904840+0000","last_clean":"2024-08-09T00:41:16.904840+0000","last_became_active":"2024-08-09T00:04:29.863132+0000","last_became_peered":"2024-08-09T00:04:29.863132+0000","last_unstale":"2024-08-09T00:41:16.904840+0000","last_undegraded":"2024-08-09T00:41:16.904840+0000","last_fullsized":"2024-08-09T00:41:16.904840+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:16.904463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:16.904463+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.904463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:45.221248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'7","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.283093+0000","last_change":"2024-08-09T00:40:59.283093+0000","last_active":"2024-08-09T00:40:59.283093+0000","last_peered":"2024-08-09T00:40:59.283093+0000","last_clean":"2024-08-09T00:40:59.283093+0000","last_became_active":"2024-08-08T23:48:42.568722+0000","last_became_peered":"2024-08-08T23:48:42.568722+0000","last_unstale":"2024-08-09T00:40:59.283093+0000","last_undegraded":"2024-08-09T00:40:59.283093+0000","last_fullsized":"2024-08-09T00:40:59.283093+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:59.282823+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.282823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:49:49.304715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.264682+0000","last_change":"2024-08-09T00:40:52.264744+0000","last_active":"2024-08-09T00:40:52.264682+0000","last_peered":"2024-08-09T00:40:52.264682+0000","last_clean":"2024-08-09T00:40:52.264682+0000","last_became_active":"2024-08-08T23:48:38.077750+0000","last_became_peered":"2024-08-08T23:48:38.077750+0000","last_unstale":"2024-08-09T00:40:52.264682+0000","last_undegraded":"2024-08-09T00:40:52.264682+0000","last_fullsized":"2024-08-09T00:40:52.264682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:52.264488+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.264488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:36:28.875953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'27","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.729225+0000","last_change":"2024-08-09T00:40:38.729357+0000","last_active":"2024-08-09T00:40:38.729225+0000","last_peered":"2024-08-09T00:40:38.729225+0000","last_clean":"2024-08-09T00:40:38.729225+0000","last_became_active":"2024-08-08T23:44:47.419217+0000","last_became_peered":"2024-08-08T23:44:47.419217+0000","last_unstale":"2024-08-09T00:40:38.729225+0000","last_undegraded":"2024-08-09T00:40:38.729225+0000","last_fullsized":"2024-08-09T00:40:38.729225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-08-09T00:40:38.728971+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.728971+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:46:20.124323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.039540+0000","last_change":"2024-08-09T00:41:07.039540+0000","last_active":"2024-08-09T00:41:07.039540+0000","last_peered":"2024-08-09T00:41:07.039540+0000","last_clean":"2024-08-09T00:41:07.039540+0000","last_became_active":"2024-08-09T00:04:29.837325+0000","last_became_peered":"2024-08-09T00:04:29.837325+0000","last_unstale":"2024-08-09T00:41:07.039540+0000","last_undegraded":"2024-08-09T00:41:07.039540+0000","last_fullsized":"2024-08-09T00:41:07.039540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:07.039280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.039280+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:03.469816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.370327+0000","last_change":"2024-08-09T00:41:03.370381+0000","last_active":"2024-08-09T00:41:03.370327+0000","last_peered":"2024-08-09T00:41:03.370327+0000","last_clean":"2024-08-09T00:41:03.370327+0000","last_became_active":"2024-08-08T23:48:42.570094+0000","last_became_peered":"2024-08-08T23:48:42.570094+0000","last_unstale":"2024-08-09T00:41:03.370327+0000","last_undegraded":"2024-08-09T00:41:03.370327+0000","last_fullsized":"2024-08-09T00:41:03.370327+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.370116+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.370116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:33:18.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.602366+0000","last_change":"2024-08-09T00:40:37.602366+0000","last_active":"2024-08-09T00:40:37.602366+0000","last_peered":"2024-08-09T00:40:37.602366+0000","last_clean":"2024-08-09T00:40:37.602366+0000","last_became_active":"2024-08-08T23:48:38.080862+0000","last_became_peered":"2024-08-08T23:48:38.080862+0000","last_unstale":"2024-08-09T00:40:37.602366+0000","last_undegraded":"2024-08-09T00:40:37.602366+0000","last_fullsized":"2024-08-09T00:40:37.602366+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:40:37.602099+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.602099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:43:52.947621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'56","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.237531+0000","last_change":"2024-08-09T00:40:40.237588+0000","last_active":"2024-08-09T00:40:40.237531+0000","last_peered":"2024-08-09T00:40:40.237531+0000","last_clean":"2024-08-09T00:40:40.237531+0000","last_became_active":"2024-08-08T23:44:47.417705+0000","last_became_peered":"2024-08-08T23:44:47.417705+0000","last_unstale":"2024-08-09T00:40:40.237531+0000","last_undegraded":"2024-08-09T00:40:40.237531+0000","last_fullsized":"2024-08-09T00:40:40.237531+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-08-09T00:40:40.237342+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.237342+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:46:29.023191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":219,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.765675+0000","last_change":"2024-08-09T00:41:28.765675+0000","last_active":"2024-08-09T00:41:28.765675+0000","last_peered":"2024-08-09T00:41:28.765675+0000","last_clean":"2024-08-09T00:41:28.765675+0000","last_became_active":"2024-08-09T00:04:29.876492+0000","last_became_peered":"2024-08-09T00:04:29.876492+0000","last_unstale":"2024-08-09T00:41:28.765675+0000","last_undegraded":"2024-08-09T00:41:28.765675+0000","last_fullsized":"2024-08-09T00:41:28.765675+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:28.765402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:28.765402+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.765402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:06:29.466631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.573532+0000","last_change":"2024-08-09T00:41:31.573532+0000","last_active":"2024-08-09T00:41:31.573532+0000","last_peered":"2024-08-09T00:41:31.573532+0000","last_clean":"2024-08-09T00:41:31.573532+0000","last_became_active":"2024-08-08T23:48:42.579776+0000","last_became_peered":"2024-08-08T23:48:42.579776+0000","last_unstale":"2024-08-09T00:41:31.573532+0000","last_undegraded":"2024-08-09T00:41:31.573532+0000","last_fullsized":"2024-08-09T00:41:31.573532+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.573174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.573174+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.573174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:47:24.936886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.100452+0000","last_change":"2024-08-09T00:41:04.100452+0000","last_active":"2024-08-09T00:41:04.100452+0000","last_peered":"2024-08-09T00:41:04.100452+0000","last_clean":"2024-08-09T00:41:04.100452+0000","last_became_active":"2024-08-08T23:48:38.068903+0000","last_became_peered":"2024-08-08T23:48:38.068903+0000","last_unstale":"2024-08-09T00:41:04.100452+0000","last_undegraded":"2024-08-09T00:41:04.100452+0000","last_fullsized":"2024-08-09T00:41:04.100452+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:41:04.100190+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.100190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:42:44.280085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'41","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.232009+0000","last_change":"2024-08-09T00:40:37.232034+0000","last_active":"2024-08-09T00:40:37.232009+0000","last_peered":"2024-08-09T00:40:37.232009+0000","last_clean":"2024-08-09T00:40:37.232009+0000","last_became_active":"2024-08-08T23:44:47.403092+0000","last_became_peered":"2024-08-08T23:44:47.403092+0000","last_unstale":"2024-08-09T00:40:37.232009+0000","last_undegraded":"2024-08-09T00:40:37.232009+0000","last_fullsized":"2024-08-09T00:40:37.232009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-08-09T00:40:37.231936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.231936+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:46.987261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":137,"num_write":91,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.089582+0000","last_change":"2024-08-09T00:41:24.089582+0000","last_active":"2024-08-09T00:41:24.089582+0000","last_peered":"2024-08-09T00:41:24.089582+0000","last_clean":"2024-08-09T00:41:24.089582+0000","last_became_active":"2024-08-09T00:04:29.869122+0000","last_became_peered":"2024-08-09T00:04:29.869122+0000","last_unstale":"2024-08-09T00:41:24.089582+0000","last_undegraded":"2024-08-09T00:41:24.089582+0000","last_fullsized":"2024-08-09T00:41:24.089582+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:24.089223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:24.089223+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.089223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:20:12.891214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.327096+0000","last_change":"2024-08-09T00:41:21.327096+0000","last_active":"2024-08-09T00:41:21.327096+0000","last_peered":"2024-08-09T00:41:21.327096+0000","last_clean":"2024-08-09T00:41:21.327096+0000","last_became_active":"2024-08-08T23:48:42.104534+0000","last_became_peered":"2024-08-08T23:48:42.104534+0000","last_unstale":"2024-08-09T00:41:21.327096+0000","last_undegraded":"2024-08-09T00:41:21.327096+0000","last_fullsized":"2024-08-09T00:41:21.327096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:21.326838+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:21.326838+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.326838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:06:46.805339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'7","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.636229+0000","last_change":"2024-08-09T00:40:44.636229+0000","last_active":"2024-08-09T00:40:44.636229+0000","last_peered":"2024-08-09T00:40:44.636229+0000","last_clean":"2024-08-09T00:40:44.636229+0000","last_became_active":"2024-08-08T23:48:38.069475+0000","last_became_peered":"2024-08-08T23:48:38.069475+0000","last_unstale":"2024-08-09T00:40:44.636229+0000","last_undegraded":"2024-08-09T00:40:44.636229+0000","last_fullsized":"2024-08-09T00:40:44.636229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.635966+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.635966+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:22.290779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'44","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.541393+0000","last_change":"2024-08-09T00:40:45.541393+0000","last_active":"2024-08-09T00:40:45.541393+0000","last_peered":"2024-08-09T00:40:45.541393+0000","last_clean":"2024-08-09T00:40:45.541393+0000","last_became_active":"2024-08-08T23:44:47.415282+0000","last_became_peered":"2024-08-08T23:44:47.415282+0000","last_unstale":"2024-08-09T00:40:45.541393+0000","last_undegraded":"2024-08-09T00:40:45.541393+0000","last_fullsized":"2024-08-09T00:40:45.541393+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:40:45.540982+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.540982+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:27:18.363747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":153,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:33.567264+0000","last_change":"2024-08-09T00:41:33.567317+0000","last_active":"2024-08-09T00:41:33.567264+0000","last_peered":"2024-08-09T00:41:33.567264+0000","last_clean":"2024-08-09T00:41:33.567264+0000","last_became_active":"2024-08-09T00:04:29.865583+0000","last_became_peered":"2024-08-09T00:04:29.865583+0000","last_unstale":"2024-08-09T00:41:33.567264+0000","last_undegraded":"2024-08-09T00:41:33.567264+0000","last_fullsized":"2024-08-09T00:41:33.567264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:33.567076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:33.567076+0000","last_clean_scrub_stamp":"2024-08-09T00:41:33.567076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:08:50.761050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.927722+0000","last_change":"2024-08-09T00:41:14.927794+0000","last_active":"2024-08-09T00:41:14.927722+0000","last_peered":"2024-08-09T00:41:14.927722+0000","last_clean":"2024-08-09T00:41:14.927722+0000","last_became_active":"2024-08-08T23:48:42.117625+0000","last_became_peered":"2024-08-08T23:48:42.117625+0000","last_unstale":"2024-08-09T00:41:14.927722+0000","last_undegraded":"2024-08-09T00:41:14.927722+0000","last_fullsized":"2024-08-09T00:41:14.927722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:14.927504+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:14.927504+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.927504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:50:28.979969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.024780+0000","last_change":"2024-08-09T00:40:50.024835+0000","last_active":"2024-08-09T00:40:50.024780+0000","last_peered":"2024-08-09T00:40:50.024780+0000","last_clean":"2024-08-09T00:40:50.024780+0000","last_became_active":"2024-08-08T23:48:38.066908+0000","last_became_peered":"2024-08-08T23:48:38.066908+0000","last_unstale":"2024-08-09T00:40:50.024780+0000","last_undegraded":"2024-08-09T00:40:50.024780+0000","last_fullsized":"2024-08-09T00:40:50.024780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.024567+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.024567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:42:36.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'47","reported_seq":195,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.540116+0000","last_change":"2024-08-09T00:40:43.540116+0000","last_active":"2024-08-09T00:40:43.540116+0000","last_peered":"2024-08-09T00:40:43.540116+0000","last_clean":"2024-08-09T00:40:43.540116+0000","last_became_active":"2024-08-08T23:44:47.416926+0000","last_became_peered":"2024-08-08T23:44:47.416926+0000","last_unstale":"2024-08-09T00:40:43.540116+0000","last_undegraded":"2024-08-09T00:40:43.540116+0000","last_fullsized":"2024-08-09T00:40:43.540116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'47","last_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_deep_scrub":"268'47","last_deep_scrub_stamp":"2024-08-09T00:40:43.539854+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.539854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:53:56.070084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":169,"num_write":90,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:33.551456+0000","last_change":"2024-08-09T00:41:33.551565+0000","last_active":"2024-08-09T00:41:33.551456+0000","last_peered":"2024-08-09T00:41:33.551456+0000","last_clean":"2024-08-09T00:41:33.551456+0000","last_became_active":"2024-08-09T00:04:29.877535+0000","last_became_peered":"2024-08-09T00:04:29.877535+0000","last_unstale":"2024-08-09T00:41:33.551456+0000","last_undegraded":"2024-08-09T00:41:33.551456+0000","last_fullsized":"2024-08-09T00:41:33.551456+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:33.551231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:33.551231+0000","last_clean_scrub_stamp":"2024-08-09T00:41:33.551231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:12:44.131250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.928746+0000","last_change":"2024-08-09T00:41:13.928807+0000","last_active":"2024-08-09T00:41:13.928746+0000","last_peered":"2024-08-09T00:41:13.928746+0000","last_clean":"2024-08-09T00:41:13.928746+0000","last_became_active":"2024-08-08T23:48:42.117850+0000","last_became_peered":"2024-08-08T23:48:42.117850+0000","last_unstale":"2024-08-09T00:41:13.928746+0000","last_undegraded":"2024-08-09T00:41:13.928746+0000","last_fullsized":"2024-08-09T00:41:13.928746+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:41:13.928543+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:41:13.928543+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.928543+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:32:00.943555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.189314+0000","last_change":"2024-08-09T00:40:36.189393+0000","last_active":"2024-08-09T00:40:36.189314+0000","last_peered":"2024-08-09T00:40:36.189314+0000","last_clean":"2024-08-09T00:40:36.189314+0000","last_became_active":"2024-08-08T23:48:38.081431+0000","last_became_peered":"2024-08-08T23:48:38.081431+0000","last_unstale":"2024-08-09T00:40:36.189314+0000","last_undegraded":"2024-08-09T00:40:36.189314+0000","last_fullsized":"2024-08-09T00:40:36.189314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:36.189163+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.189163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:33:32.228273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'30","reported_seq":146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.680167+0000","last_change":"2024-08-09T00:40:42.680167+0000","last_active":"2024-08-09T00:40:42.680167+0000","last_peered":"2024-08-09T00:40:42.680167+0000","last_clean":"2024-08-09T00:40:42.680167+0000","last_became_active":"2024-08-08T23:44:47.410769+0000","last_became_peered":"2024-08-08T23:44:47.410769+0000","last_unstale":"2024-08-09T00:40:42.680167+0000","last_undegraded":"2024-08-09T00:40:42.680167+0000","last_fullsized":"2024-08-09T00:40:42.680167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-08-09T00:40:42.679754+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.679754+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:23:38.367106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":62,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.563393+0000","last_change":"2024-08-09T00:41:29.563514+0000","last_active":"2024-08-09T00:41:29.563393+0000","last_peered":"2024-08-09T00:41:29.563393+0000","last_clean":"2024-08-09T00:41:29.563393+0000","last_became_active":"2024-08-09T00:04:29.847204+0000","last_became_peered":"2024-08-09T00:04:29.847204+0000","last_unstale":"2024-08-09T00:41:29.563393+0000","last_undegraded":"2024-08-09T00:41:29.563393+0000","last_fullsized":"2024-08-09T00:41:29.563393+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:29.563140+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:29.563140+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.563140+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:16:37.245189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.559441+0000","last_change":"2024-08-09T00:41:28.559513+0000","last_active":"2024-08-09T00:41:28.559441+0000","last_peered":"2024-08-09T00:41:28.559441+0000","last_clean":"2024-08-09T00:41:28.559441+0000","last_became_active":"2024-08-08T23:49:03.185659+0000","last_became_peered":"2024-08-08T23:49:03.185659+0000","last_unstale":"2024-08-09T00:41:28.559441+0000","last_undegraded":"2024-08-09T00:41:28.559441+0000","last_fullsized":"2024-08-09T00:41:28.559441+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:28.559253+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:28.559253+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.559253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:11:00.084906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.12","version":"268'8","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.050854+0000","last_change":"2024-08-09T00:41:07.051008+0000","last_active":"2024-08-09T00:41:07.050854+0000","last_peered":"2024-08-09T00:41:07.050854+0000","last_clean":"2024-08-09T00:41:07.050854+0000","last_became_active":"2024-08-08T23:48:38.094117+0000","last_became_peered":"2024-08-08T23:48:38.094117+0000","last_unstale":"2024-08-09T00:41:07.050854+0000","last_undegraded":"2024-08-09T00:41:07.050854+0000","last_fullsized":"2024-08-09T00:41:07.050854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:07.050631+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.050631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:08:47.276263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10240,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'14","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.953904+0000","last_change":"2024-08-09T00:40:36.953904+0000","last_active":"2024-08-09T00:40:36.953904+0000","last_peered":"2024-08-09T00:40:36.953904+0000","last_clean":"2024-08-09T00:40:36.953904+0000","last_became_active":"2024-08-08T23:44:47.392864+0000","last_became_peered":"2024-08-08T23:44:47.392864+0000","last_unstale":"2024-08-09T00:40:36.953904+0000","last_undegraded":"2024-08-09T00:40:36.953904+0000","last_fullsized":"2024-08-09T00:40:36.953904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:36.953505+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.953505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:31:08.054694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:32.528146+0000","last_change":"2024-08-09T00:41:32.528218+0000","last_active":"2024-08-09T00:41:32.528146+0000","last_peered":"2024-08-09T00:41:32.528146+0000","last_clean":"2024-08-09T00:41:32.528146+0000","last_became_active":"2024-08-09T00:04:29.859255+0000","last_became_peered":"2024-08-09T00:04:29.859255+0000","last_unstale":"2024-08-09T00:41:32.528146+0000","last_undegraded":"2024-08-09T00:41:32.528146+0000","last_fullsized":"2024-08-09T00:41:32.528146+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:32.527940+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:32.527940+0000","last_clean_scrub_stamp":"2024-08-09T00:41:32.527940+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:48:15.744148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.049098+0000","last_change":"2024-08-09T00:41:11.049245+0000","last_active":"2024-08-09T00:41:11.049098+0000","last_peered":"2024-08-09T00:41:11.049098+0000","last_clean":"2024-08-09T00:41:11.049098+0000","last_became_active":"2024-08-08T23:48:42.118506+0000","last_became_peered":"2024-08-08T23:48:42.118506+0000","last_unstale":"2024-08-09T00:41:11.049098+0000","last_undegraded":"2024-08-09T00:41:11.049098+0000","last_fullsized":"2024-08-09T00:41:11.049098+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.048878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.048878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:07:10.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.148259+0000","last_change":"2024-08-09T00:41:19.148410+0000","last_active":"2024-08-09T00:41:19.148259+0000","last_peered":"2024-08-09T00:41:19.148259+0000","last_clean":"2024-08-09T00:41:19.148259+0000","last_became_active":"2024-08-08T23:48:38.094049+0000","last_became_peered":"2024-08-08T23:48:38.094049+0000","last_unstale":"2024-08-09T00:41:19.148259+0000","last_undegraded":"2024-08-09T00:41:19.148259+0000","last_fullsized":"2024-08-09T00:41:19.148259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:41:19.147995+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:41:19.147995+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.147995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:11:17.461019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'28","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.290222+0000","last_change":"2024-08-09T00:40:42.290222+0000","last_active":"2024-08-09T00:40:42.290222+0000","last_peered":"2024-08-09T00:40:42.290222+0000","last_clean":"2024-08-09T00:40:42.290222+0000","last_became_active":"2024-08-08T23:44:47.403984+0000","last_became_peered":"2024-08-08T23:44:47.403984+0000","last_unstale":"2024-08-09T00:40:42.290222+0000","last_undegraded":"2024-08-09T00:40:42.290222+0000","last_fullsized":"2024-08-09T00:40:42.290222+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-08-09T00:40:42.289963+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.289963+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:16:20.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.004742+0000","last_change":"2024-08-09T00:41:06.004742+0000","last_active":"2024-08-09T00:41:06.004742+0000","last_peered":"2024-08-09T00:41:06.004742+0000","last_clean":"2024-08-09T00:41:06.004742+0000","last_became_active":"2024-08-09T00:04:29.835030+0000","last_became_peered":"2024-08-09T00:04:29.835030+0000","last_unstale":"2024-08-09T00:41:06.004742+0000","last_undegraded":"2024-08-09T00:41:06.004742+0000","last_fullsized":"2024-08-09T00:41:06.004742+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.004500+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.004500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:50:16.004969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.356428+0000","last_change":"2024-08-09T00:40:55.356491+0000","last_active":"2024-08-09T00:40:55.356428+0000","last_peered":"2024-08-09T00:40:55.356428+0000","last_clean":"2024-08-09T00:40:55.356428+0000","last_became_active":"2024-08-08T23:48:42.110825+0000","last_became_peered":"2024-08-08T23:48:42.110825+0000","last_unstale":"2024-08-09T00:40:55.356428+0000","last_undegraded":"2024-08-09T00:40:55.356428+0000","last_fullsized":"2024-08-09T00:40:55.356428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:55.356225+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.356225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:19:18.875712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.617885+0000","last_change":"2024-08-09T00:40:40.617947+0000","last_active":"2024-08-09T00:40:40.617885+0000","last_peered":"2024-08-09T00:40:40.617885+0000","last_clean":"2024-08-09T00:40:40.617885+0000","last_became_active":"2024-08-08T23:48:38.086887+0000","last_became_peered":"2024-08-08T23:48:38.086887+0000","last_unstale":"2024-08-09T00:40:40.617885+0000","last_undegraded":"2024-08-09T00:40:40.617885+0000","last_fullsized":"2024-08-09T00:40:40.617885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.617682+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.617682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:12:17.390972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'24","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.221534+0000","last_change":"2024-08-09T00:40:37.221534+0000","last_active":"2024-08-09T00:40:37.221534+0000","last_peered":"2024-08-09T00:40:37.221534+0000","last_clean":"2024-08-09T00:40:37.221534+0000","last_became_active":"2024-08-08T23:44:47.427707+0000","last_became_peered":"2024-08-08T23:44:47.427707+0000","last_unstale":"2024-08-09T00:40:37.221534+0000","last_undegraded":"2024-08-09T00:40:37.221534+0000","last_fullsized":"2024-08-09T00:40:37.221534+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-08-09T00:40:37.221435+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.221435+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:15.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.850392+0000","last_change":"2024-08-09T00:41:30.850525+0000","last_active":"2024-08-09T00:41:30.850392+0000","last_peered":"2024-08-09T00:41:30.850392+0000","last_clean":"2024-08-09T00:41:30.850392+0000","last_became_active":"2024-08-09T00:04:29.879597+0000","last_became_peered":"2024-08-09T00:04:29.879597+0000","last_unstale":"2024-08-09T00:41:30.850392+0000","last_undegraded":"2024-08-09T00:41:30.850392+0000","last_fullsized":"2024-08-09T00:41:30.850392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.850157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.850157+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.850157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:52:29.311754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.291641+0000","last_change":"2024-08-09T00:40:47.291758+0000","last_active":"2024-08-09T00:40:47.291641+0000","last_peered":"2024-08-09T00:40:47.291641+0000","last_clean":"2024-08-09T00:40:47.291641+0000","last_became_active":"2024-08-08T23:48:42.098604+0000","last_became_peered":"2024-08-08T23:48:42.098604+0000","last_unstale":"2024-08-09T00:40:47.291641+0000","last_undegraded":"2024-08-09T00:40:47.291641+0000","last_fullsized":"2024-08-09T00:40:47.291641+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-08-09T00:40:47.291419+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.291419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:51:22.686399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21602,"num_write":20,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.187960+0000","last_change":"2024-08-09T00:40:36.187987+0000","last_active":"2024-08-09T00:40:36.187960+0000","last_peered":"2024-08-09T00:40:36.187960+0000","last_clean":"2024-08-09T00:40:36.187960+0000","last_became_active":"2024-08-08T23:48:38.059898+0000","last_became_peered":"2024-08-08T23:48:38.059898+0000","last_unstale":"2024-08-09T00:40:36.187960+0000","last_undegraded":"2024-08-09T00:40:36.187960+0000","last_fullsized":"2024-08-09T00:40:36.187960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:36.187856+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.187856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:49.116286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'7","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.267812+0000","last_change":"2024-08-09T00:40:40.267812+0000","last_active":"2024-08-09T00:40:40.267812+0000","last_peered":"2024-08-09T00:40:40.267812+0000","last_clean":"2024-08-09T00:40:40.267812+0000","last_became_active":"2024-08-08T23:44:47.402063+0000","last_became_peered":"2024-08-08T23:44:47.402063+0000","last_unstale":"2024-08-09T00:40:40.267812+0000","last_undegraded":"2024-08-09T00:40:40.267812+0000","last_fullsized":"2024-08-09T00:40:40.267812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:40.267563+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.267563+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:43:32.319577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.011164+0000","last_change":"2024-08-09T00:41:12.011164+0000","last_active":"2024-08-09T00:41:12.011164+0000","last_peered":"2024-08-09T00:41:12.011164+0000","last_clean":"2024-08-09T00:41:12.011164+0000","last_became_active":"2024-08-09T00:04:29.860634+0000","last_became_peered":"2024-08-09T00:04:29.860634+0000","last_unstale":"2024-08-09T00:41:12.011164+0000","last_undegraded":"2024-08-09T00:41:12.011164+0000","last_fullsized":"2024-08-09T00:41:12.011164+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:12.010911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.010911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:12:29.212890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'6","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.886252+0000","last_change":"2024-08-09T00:41:15.886387+0000","last_active":"2024-08-09T00:41:15.886252+0000","last_peered":"2024-08-09T00:41:15.886252+0000","last_clean":"2024-08-09T00:41:15.886252+0000","last_became_active":"2024-08-08T23:48:42.576312+0000","last_became_peered":"2024-08-08T23:48:42.576312+0000","last_unstale":"2024-08-09T00:41:15.886252+0000","last_undegraded":"2024-08-09T00:41:15.886252+0000","last_fullsized":"2024-08-09T00:41:15.886252+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:15.886022+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:15.886022+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.886022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:53:47.010517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.617301+0000","last_change":"2024-08-09T00:40:52.617361+0000","last_active":"2024-08-09T00:40:52.617301+0000","last_peered":"2024-08-09T00:40:52.617301+0000","last_clean":"2024-08-09T00:40:52.617301+0000","last_became_active":"2024-08-08T23:48:38.084407+0000","last_became_peered":"2024-08-08T23:48:38.084407+0000","last_unstale":"2024-08-09T00:40:52.617301+0000","last_undegraded":"2024-08-09T00:40:52.617301+0000","last_fullsized":"2024-08-09T00:40:52.617301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:52.617100+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.617100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:13:44.945362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'14","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.872232+0000","last_change":"2024-08-09T00:40:40.872232+0000","last_active":"2024-08-09T00:40:40.872232+0000","last_peered":"2024-08-09T00:40:40.872232+0000","last_clean":"2024-08-09T00:40:40.872232+0000","last_became_active":"2024-08-08T23:44:47.398358+0000","last_became_peered":"2024-08-08T23:44:47.398358+0000","last_unstale":"2024-08-09T00:40:40.872232+0000","last_undegraded":"2024-08-09T00:40:40.872232+0000","last_fullsized":"2024-08-09T00:40:40.872232+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'14","last_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_deep_scrub":"268'14","last_deep_scrub_stamp":"2024-08-09T00:40:40.871937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.871937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:00:56.402314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.890540+0000","last_change":"2024-08-09T00:41:31.890598+0000","last_active":"2024-08-09T00:41:31.890540+0000","last_peered":"2024-08-09T00:41:31.890540+0000","last_clean":"2024-08-09T00:41:31.890540+0000","last_became_active":"2024-08-09T00:04:29.879870+0000","last_became_peered":"2024-08-09T00:04:29.879870+0000","last_unstale":"2024-08-09T00:41:31.890540+0000","last_undegraded":"2024-08-09T00:41:31.890540+0000","last_fullsized":"2024-08-09T00:41:31.890540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.890312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.890312+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.890312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:23:39.034164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.321654+0000","last_change":"2024-08-09T00:40:51.321769+0000","last_active":"2024-08-09T00:40:51.321654+0000","last_peered":"2024-08-09T00:40:51.321654+0000","last_clean":"2024-08-09T00:40:51.321654+0000","last_became_active":"2024-08-08T23:48:42.108056+0000","last_became_peered":"2024-08-08T23:48:42.108056+0000","last_unstale":"2024-08-09T00:40:51.321654+0000","last_undegraded":"2024-08-09T00:40:51.321654+0000","last_fullsized":"2024-08-09T00:40:51.321654+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.321317+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.321317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:21:07.828364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.818946+0000","last_change":"2024-08-09T00:40:37.819109+0000","last_active":"2024-08-09T00:40:37.818946+0000","last_peered":"2024-08-09T00:40:37.818946+0000","last_clean":"2024-08-09T00:40:37.818946+0000","last_became_active":"2024-08-08T23:48:38.091356+0000","last_became_peered":"2024-08-08T23:48:38.091356+0000","last_unstale":"2024-08-09T00:40:37.818946+0000","last_undegraded":"2024-08-09T00:40:37.818946+0000","last_fullsized":"2024-08-09T00:40:37.818946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:40:37.818705+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.818705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:34.295358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'19","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.074220+0000","last_change":"2024-08-09T00:41:02.074220+0000","last_active":"2024-08-09T00:41:02.074220+0000","last_peered":"2024-08-09T00:41:02.074220+0000","last_clean":"2024-08-09T00:41:02.074220+0000","last_became_active":"2024-08-08T23:44:47.398555+0000","last_became_peered":"2024-08-08T23:44:47.398555+0000","last_unstale":"2024-08-09T00:41:02.074220+0000","last_undegraded":"2024-08-09T00:41:02.074220+0000","last_fullsized":"2024-08-09T00:41:02.074220+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-08-09T00:41:02.073969+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.073969+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:30:35.961027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:34.529400+0000","last_change":"2024-08-09T00:41:34.529462+0000","last_active":"2024-08-09T00:41:34.529400+0000","last_peered":"2024-08-09T00:41:34.529400+0000","last_clean":"2024-08-09T00:41:34.529400+0000","last_became_active":"2024-08-09T00:04:29.874051+0000","last_became_peered":"2024-08-09T00:04:29.874051+0000","last_unstale":"2024-08-09T00:41:34.529400+0000","last_undegraded":"2024-08-09T00:41:34.529400+0000","last_fullsized":"2024-08-09T00:41:34.529400+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:34.529203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:34.529203+0000","last_clean_scrub_stamp":"2024-08-09T00:41:34.529203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:18.160812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.331877+0000","last_change":"2024-08-09T00:41:19.331939+0000","last_active":"2024-08-09T00:41:19.331877+0000","last_peered":"2024-08-09T00:41:19.331877+0000","last_clean":"2024-08-09T00:41:19.331877+0000","last_became_active":"2024-08-08T23:48:42.091264+0000","last_became_peered":"2024-08-08T23:48:42.091264+0000","last_unstale":"2024-08-09T00:41:19.331877+0000","last_undegraded":"2024-08-09T00:41:19.331877+0000","last_fullsized":"2024-08-09T00:41:19.331877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:19.331682+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:19.331682+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.331682+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:08:52.245568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.641196+0000","last_change":"2024-08-09T00:40:48.641266+0000","last_active":"2024-08-09T00:40:48.641196+0000","last_peered":"2024-08-09T00:40:48.641196+0000","last_clean":"2024-08-09T00:40:48.641196+0000","last_became_active":"2024-08-08T23:48:38.076196+0000","last_became_peered":"2024-08-08T23:48:38.076196+0000","last_unstale":"2024-08-09T00:40:48.641196+0000","last_undegraded":"2024-08-09T00:40:48.641196+0000","last_fullsized":"2024-08-09T00:40:48.641196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:40:48.640998+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.640998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:55:08.396765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":10,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.681164+0000","last_change":"2024-08-09T00:40:43.681164+0000","last_active":"2024-08-09T00:40:43.681164+0000","last_peered":"2024-08-09T00:40:43.681164+0000","last_clean":"2024-08-09T00:40:43.681164+0000","last_became_active":"2024-08-08T23:44:47.407574+0000","last_became_peered":"2024-08-08T23:44:47.407574+0000","last_unstale":"2024-08-09T00:40:43.681164+0000","last_undegraded":"2024-08-09T00:40:43.681164+0000","last_fullsized":"2024-08-09T00:40:43.681164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:43.680900+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.680900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:00:05.167122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:32.881882+0000","last_change":"2024-08-09T00:41:32.881934+0000","last_active":"2024-08-09T00:41:32.881882+0000","last_peered":"2024-08-09T00:41:32.881882+0000","last_clean":"2024-08-09T00:41:32.881882+0000","last_became_active":"2024-08-09T00:04:29.883967+0000","last_became_peered":"2024-08-09T00:04:29.883967+0000","last_unstale":"2024-08-09T00:41:32.881882+0000","last_undegraded":"2024-08-09T00:41:32.881882+0000","last_fullsized":"2024-08-09T00:41:32.881882+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:32.881689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:32.881689+0000","last_clean_scrub_stamp":"2024-08-09T00:41:32.881689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:46:37.333472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.492000+0000","last_change":"2024-08-09T00:40:48.492064+0000","last_active":"2024-08-09T00:40:48.492000+0000","last_peered":"2024-08-09T00:40:48.492000+0000","last_clean":"2024-08-09T00:40:48.492000+0000","last_became_active":"2024-08-08T23:48:42.570027+0000","last_became_peered":"2024-08-08T23:48:42.570027+0000","last_unstale":"2024-08-09T00:40:48.492000+0000","last_undegraded":"2024-08-09T00:40:48.492000+0000","last_fullsized":"2024-08-09T00:40:48.492000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.491783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.491783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:04:46.088876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.785042+0000","last_change":"2024-08-09T00:40:35.785042+0000","last_active":"2024-08-09T00:40:35.785042+0000","last_peered":"2024-08-09T00:40:35.785042+0000","last_clean":"2024-08-09T00:40:35.785042+0000","last_became_active":"2024-08-08T23:48:38.091119+0000","last_became_peered":"2024-08-08T23:48:38.091119+0000","last_unstale":"2024-08-09T00:40:35.785042+0000","last_undegraded":"2024-08-09T00:40:35.785042+0000","last_fullsized":"2024-08-09T00:40:35.785042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:35.784595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.784595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:17:51.280650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'26","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.531782+0000","last_change":"2024-08-09T00:40:47.531782+0000","last_active":"2024-08-09T00:40:47.531782+0000","last_peered":"2024-08-09T00:40:47.531782+0000","last_clean":"2024-08-09T00:40:47.531782+0000","last_became_active":"2024-08-08T23:44:47.395297+0000","last_became_peered":"2024-08-08T23:44:47.395297+0000","last_unstale":"2024-08-09T00:40:47.531782+0000","last_undegraded":"2024-08-09T00:40:47.531782+0000","last_fullsized":"2024-08-09T00:40:47.531782+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:47.531527+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.531527+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:41:25.997420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":88,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.590552+0000","last_change":"2024-08-09T00:41:00.590620+0000","last_active":"2024-08-09T00:41:00.590552+0000","last_peered":"2024-08-09T00:41:00.590552+0000","last_clean":"2024-08-09T00:41:00.590552+0000","last_became_active":"2024-08-09T00:04:29.876055+0000","last_became_peered":"2024-08-09T00:04:29.876055+0000","last_unstale":"2024-08-09T00:41:00.590552+0000","last_undegraded":"2024-08-09T00:41:00.590552+0000","last_fullsized":"2024-08-09T00:41:00.590552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:00.590347+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.590347+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:18:27.821143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.750685+0000","last_change":"2024-08-09T00:40:45.750799+0000","last_active":"2024-08-09T00:40:45.750685+0000","last_peered":"2024-08-09T00:40:45.750685+0000","last_clean":"2024-08-09T00:40:45.750685+0000","last_became_active":"2024-08-08T23:48:42.117143+0000","last_became_peered":"2024-08-08T23:48:42.117143+0000","last_unstale":"2024-08-09T00:40:45.750685+0000","last_undegraded":"2024-08-09T00:40:45.750685+0000","last_fullsized":"2024-08-09T00:40:45.750685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.750417+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.750417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:32:11.026019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.685218+0000","last_change":"2024-08-09T00:40:40.685218+0000","last_active":"2024-08-09T00:40:40.685218+0000","last_peered":"2024-08-09T00:40:40.685218+0000","last_clean":"2024-08-09T00:40:40.685218+0000","last_became_active":"2024-08-08T23:48:38.069776+0000","last_became_peered":"2024-08-08T23:48:38.069776+0000","last_unstale":"2024-08-09T00:40:40.685218+0000","last_undegraded":"2024-08-09T00:40:40.685218+0000","last_fullsized":"2024-08-09T00:40:40.685218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:40.684961+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.684961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:53.340721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.348843+0000","last_change":"2024-08-09T00:40:44.348843+0000","last_active":"2024-08-09T00:40:44.348843+0000","last_peered":"2024-08-09T00:40:44.348843+0000","last_clean":"2024-08-09T00:40:44.348843+0000","last_became_active":"2024-08-08T23:44:47.396281+0000","last_became_peered":"2024-08-08T23:44:47.396281+0000","last_unstale":"2024-08-09T00:40:44.348843+0000","last_undegraded":"2024-08-09T00:40:44.348843+0000","last_fullsized":"2024-08-09T00:40:44.348843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:44.348587+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.348587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:09:49.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:32.532311+0000","last_change":"2024-08-09T00:41:32.532419+0000","last_active":"2024-08-09T00:41:32.532311+0000","last_peered":"2024-08-09T00:41:32.532311+0000","last_clean":"2024-08-09T00:41:32.532311+0000","last_became_active":"2024-08-09T00:04:29.865325+0000","last_became_peered":"2024-08-09T00:04:29.865325+0000","last_unstale":"2024-08-09T00:41:32.532311+0000","last_undegraded":"2024-08-09T00:41:32.532311+0000","last_fullsized":"2024-08-09T00:41:32.532311+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:32.532066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:32.532066+0000","last_clean_scrub_stamp":"2024-08-09T00:41:32.532066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:22:17.571585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.504759+0000","last_change":"2024-08-09T00:40:44.504759+0000","last_active":"2024-08-09T00:40:44.504759+0000","last_peered":"2024-08-09T00:40:44.504759+0000","last_clean":"2024-08-09T00:40:44.504759+0000","last_became_active":"2024-08-08T23:48:42.106496+0000","last_became_peered":"2024-08-08T23:48:42.106496+0000","last_unstale":"2024-08-09T00:40:44.504759+0000","last_undegraded":"2024-08-09T00:40:44.504759+0000","last_fullsized":"2024-08-09T00:40:44.504759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:44.504500+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.504500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:01:10.357467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.012427+0000","last_change":"2024-08-09T00:40:42.012589+0000","last_active":"2024-08-09T00:40:42.012427+0000","last_peered":"2024-08-09T00:40:42.012427+0000","last_clean":"2024-08-09T00:40:42.012427+0000","last_became_active":"2024-08-08T23:48:38.063189+0000","last_became_peered":"2024-08-08T23:48:38.063189+0000","last_unstale":"2024-08-09T00:40:42.012427+0000","last_undegraded":"2024-08-09T00:40:42.012427+0000","last_fullsized":"2024-08-09T00:40:42.012427+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:42.012179+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.012179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:57:37.853605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'37","reported_seq":171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.097064+0000","last_change":"2024-08-09T00:41:06.097064+0000","last_active":"2024-08-09T00:41:06.097064+0000","last_peered":"2024-08-09T00:41:06.097064+0000","last_clean":"2024-08-09T00:41:06.097064+0000","last_became_active":"2024-08-08T23:44:47.398151+0000","last_became_peered":"2024-08-08T23:44:47.398151+0000","last_unstale":"2024-08-09T00:41:06.097064+0000","last_undegraded":"2024-08-09T00:41:06.097064+0000","last_fullsized":"2024-08-09T00:41:06.097064+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-08-09T00:41:06.096779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.096779+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:14:32.896863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":135,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.808182+0000","last_change":"2024-08-09T00:41:29.808238+0000","last_active":"2024-08-09T00:41:29.808182+0000","last_peered":"2024-08-09T00:41:29.808182+0000","last_clean":"2024-08-09T00:41:29.808182+0000","last_became_active":"2024-08-09T00:04:29.878692+0000","last_became_peered":"2024-08-09T00:04:29.878692+0000","last_unstale":"2024-08-09T00:41:29.808182+0000","last_undegraded":"2024-08-09T00:41:29.808182+0000","last_fullsized":"2024-08-09T00:41:29.808182+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:29.807929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:29.807929+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.807929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:07:51.780052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"268'7","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.588080+0000","last_change":"2024-08-09T00:40:56.588080+0000","last_active":"2024-08-09T00:40:56.588080+0000","last_peered":"2024-08-09T00:40:56.588080+0000","last_clean":"2024-08-09T00:40:56.588080+0000","last_became_active":"2024-08-08T23:48:42.100316+0000","last_became_peered":"2024-08-08T23:48:42.100316+0000","last_unstale":"2024-08-09T00:40:56.588080+0000","last_undegraded":"2024-08-09T00:40:56.588080+0000","last_fullsized":"2024-08-09T00:40:56.588080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:56.587815+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.587815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:06.658894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4096,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.639579+0000","last_change":"2024-08-09T00:40:38.639579+0000","last_active":"2024-08-09T00:40:38.639579+0000","last_peered":"2024-08-09T00:40:38.639579+0000","last_clean":"2024-08-09T00:40:38.639579+0000","last_became_active":"2024-08-08T23:48:38.077975+0000","last_became_peered":"2024-08-08T23:48:38.077975+0000","last_unstale":"2024-08-09T00:40:38.639579+0000","last_undegraded":"2024-08-09T00:40:38.639579+0000","last_fullsized":"2024-08-09T00:40:38.639579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-08-09T00:40:38.639308+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.639308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:48.995525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.691644+0000","last_change":"2024-08-09T00:40:37.691644+0000","last_active":"2024-08-09T00:40:37.691644+0000","last_peered":"2024-08-09T00:40:37.691644+0000","last_clean":"2024-08-09T00:40:37.691644+0000","last_became_active":"2024-08-08T23:44:47.426773+0000","last_became_peered":"2024-08-08T23:44:47.426773+0000","last_unstale":"2024-08-09T00:40:37.691644+0000","last_undegraded":"2024-08-09T00:40:37.691644+0000","last_fullsized":"2024-08-09T00:40:37.691644+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-08-09T00:40:37.691368+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.691368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:15:07.123436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.047426+0000","last_change":"2024-08-09T00:41:25.047481+0000","last_active":"2024-08-09T00:41:25.047426+0000","last_peered":"2024-08-09T00:41:25.047426+0000","last_clean":"2024-08-09T00:41:25.047426+0000","last_became_active":"2024-08-09T00:04:29.880767+0000","last_became_peered":"2024-08-09T00:04:29.880767+0000","last_unstale":"2024-08-09T00:41:25.047426+0000","last_undegraded":"2024-08-09T00:41:25.047426+0000","last_fullsized":"2024-08-09T00:41:25.047426+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:25.047228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:25.047228+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.047228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:30:38.942347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.604672+0000","last_change":"2024-08-09T00:41:00.604736+0000","last_active":"2024-08-09T00:41:00.604672+0000","last_peered":"2024-08-09T00:41:00.604672+0000","last_clean":"2024-08-09T00:41:00.604672+0000","last_became_active":"2024-08-08T23:48:42.574136+0000","last_became_peered":"2024-08-08T23:48:42.574136+0000","last_unstale":"2024-08-09T00:41:00.604672+0000","last_undegraded":"2024-08-09T00:41:00.604672+0000","last_fullsized":"2024-08-09T00:41:00.604672+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:41:00.604461+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.604461+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:33:51.169699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.060533+0000","last_change":"2024-08-09T00:41:03.060593+0000","last_active":"2024-08-09T00:41:03.060533+0000","last_peered":"2024-08-09T00:41:03.060533+0000","last_clean":"2024-08-09T00:41:03.060533+0000","last_became_active":"2024-08-08T23:48:38.059991+0000","last_became_peered":"2024-08-08T23:48:38.059991+0000","last_unstale":"2024-08-09T00:41:03.060533+0000","last_undegraded":"2024-08-09T00:41:03.060533+0000","last_fullsized":"2024-08-09T00:41:03.060533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-08-09T00:41:03.060324+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.060324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:13:49.765010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'86","reported_seq":339,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.895905+0000","last_change":"2024-08-09T00:40:37.895905+0000","last_active":"2024-08-09T00:40:37.895905+0000","last_peered":"2024-08-09T00:40:37.895905+0000","last_clean":"2024-08-09T00:40:37.895905+0000","last_became_active":"2024-08-08T23:44:47.405133+0000","last_became_peered":"2024-08-08T23:44:47.405133+0000","last_unstale":"2024-08-09T00:40:37.895905+0000","last_undegraded":"2024-08-09T00:40:37.895905+0000","last_fullsized":"2024-08-09T00:40:37.895905+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-08-09T00:40:37.895611+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.895611+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:36:13.014150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":527,"num_read_kb":376,"num_write":119,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3248,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.903278+0000","last_change":"2024-08-09T00:41:17.903387+0000","last_active":"2024-08-09T00:41:17.903278+0000","last_peered":"2024-08-09T00:41:17.903278+0000","last_clean":"2024-08-09T00:41:17.903278+0000","last_became_active":"2024-08-09T00:04:29.871041+0000","last_became_peered":"2024-08-09T00:04:29.871041+0000","last_unstale":"2024-08-09T00:41:17.903278+0000","last_undegraded":"2024-08-09T00:41:17.903278+0000","last_fullsized":"2024-08-09T00:41:17.903278+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:17.902987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:17.902987+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.902987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:41.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.614833+0000","last_change":"2024-08-09T00:40:52.614893+0000","last_active":"2024-08-09T00:40:52.614833+0000","last_peered":"2024-08-09T00:40:52.614833+0000","last_clean":"2024-08-09T00:40:52.614833+0000","last_became_active":"2024-08-08T23:48:42.573900+0000","last_became_peered":"2024-08-08T23:48:42.573900+0000","last_unstale":"2024-08-09T00:40:52.614833+0000","last_undegraded":"2024-08-09T00:40:52.614833+0000","last_fullsized":"2024-08-09T00:40:52.614833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:40:52.614638+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.614638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:19.525948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"268'7","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.214947+0000","last_change":"2024-08-09T00:40:48.215013+0000","last_active":"2024-08-09T00:40:48.214947+0000","last_peered":"2024-08-09T00:40:48.214947+0000","last_clean":"2024-08-09T00:40:48.214947+0000","last_became_active":"2024-08-08T23:48:38.073410+0000","last_became_peered":"2024-08-08T23:48:38.073410+0000","last_unstale":"2024-08-09T00:40:48.214947+0000","last_undegraded":"2024-08-09T00:40:48.214947+0000","last_fullsized":"2024-08-09T00:40:48.214947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-08-09T00:40:48.214757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.214757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:00.067724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'16","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.530066+0000","last_change":"2024-08-09T00:40:46.530066+0000","last_active":"2024-08-09T00:40:46.530066+0000","last_peered":"2024-08-09T00:40:46.530066+0000","last_clean":"2024-08-09T00:40:46.530066+0000","last_became_active":"2024-08-08T23:44:47.408236+0000","last_became_peered":"2024-08-08T23:44:47.408236+0000","last_unstale":"2024-08-09T00:40:46.530066+0000","last_undegraded":"2024-08-09T00:40:46.530066+0000","last_fullsized":"2024-08-09T00:40:46.530066+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:46.529798+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.529798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:18:28.838684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.332848+0000","last_change":"2024-08-09T00:41:23.333036+0000","last_active":"2024-08-09T00:41:23.332848+0000","last_peered":"2024-08-09T00:41:23.332848+0000","last_clean":"2024-08-09T00:41:23.332848+0000","last_became_active":"2024-08-09T00:04:29.859317+0000","last_became_peered":"2024-08-09T00:04:29.859317+0000","last_unstale":"2024-08-09T00:41:23.332848+0000","last_undegraded":"2024-08-09T00:41:23.332848+0000","last_fullsized":"2024-08-09T00:41:23.332848+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:23.332612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:23.332612+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.332612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:10:45.141929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.299734+0000","last_change":"2024-08-09T00:41:18.299795+0000","last_active":"2024-08-09T00:41:18.299734+0000","last_peered":"2024-08-09T00:41:18.299734+0000","last_clean":"2024-08-09T00:41:18.299734+0000","last_became_active":"2024-08-08T23:48:42.089224+0000","last_became_peered":"2024-08-08T23:48:42.089224+0000","last_unstale":"2024-08-09T00:41:18.299734+0000","last_undegraded":"2024-08-09T00:41:18.299734+0000","last_fullsized":"2024-08-09T00:41:18.299734+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-08-09T00:41:18.299529+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-08-09T00:41:18.299529+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.299529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:44.560774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7184,"num_write":6,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.642345+0000","last_change":"2024-08-09T00:40:39.642407+0000","last_active":"2024-08-09T00:40:39.642345+0000","last_peered":"2024-08-09T00:40:39.642345+0000","last_clean":"2024-08-09T00:40:39.642345+0000","last_became_active":"2024-08-08T23:48:38.077708+0000","last_became_peered":"2024-08-08T23:48:38.077708+0000","last_unstale":"2024-08-09T00:40:39.642345+0000","last_undegraded":"2024-08-09T00:40:39.642345+0000","last_fullsized":"2024-08-09T00:40:39.642345+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-08-09T00:40:39.642111+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.642111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:06:21.202789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8208,"num_write":12,"num_write_kb":8208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'31","reported_seq":151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.771514+0000","last_change":"2024-08-09T00:40:38.771514+0000","last_active":"2024-08-09T00:40:38.771514+0000","last_peered":"2024-08-09T00:40:38.771514+0000","last_clean":"2024-08-09T00:40:38.771514+0000","last_became_active":"2024-08-08T23:44:47.400540+0000","last_became_peered":"2024-08-08T23:44:47.400540+0000","last_unstale":"2024-08-09T00:40:38.771514+0000","last_undegraded":"2024-08-09T00:40:38.771514+0000","last_fullsized":"2024-08-09T00:40:38.771514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-08-09T00:40:38.771257+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.771257+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:23:13.221977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.998721+0000","last_change":"2024-08-09T00:41:08.998721+0000","last_active":"2024-08-09T00:41:08.998721+0000","last_peered":"2024-08-09T00:41:08.998721+0000","last_clean":"2024-08-09T00:41:08.998721+0000","last_became_active":"2024-08-09T00:04:29.863089+0000","last_became_peered":"2024-08-09T00:04:29.863089+0000","last_unstale":"2024-08-09T00:41:08.998721+0000","last_undegraded":"2024-08-09T00:41:08.998721+0000","last_fullsized":"2024-08-09T00:41:08.998721+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:08.998456+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.998456+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:46.509152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'8","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.910817+0000","last_change":"2024-08-09T00:41:12.910993+0000","last_active":"2024-08-09T00:41:12.910817+0000","last_peered":"2024-08-09T00:41:12.910817+0000","last_clean":"2024-08-09T00:41:12.910817+0000","last_became_active":"2024-08-08T23:48:42.116743+0000","last_became_peered":"2024-08-08T23:48:42.116743+0000","last_unstale":"2024-08-09T00:41:12.910817+0000","last_undegraded":"2024-08-09T00:41:12.910817+0000","last_fullsized":"2024-08-09T00:41:12.910817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-08-09T00:41:12.910568+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-08-09T00:41:12.910568+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.910568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:48.806511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11266,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.563040+0000","last_change":"2024-08-09T00:40:42.563040+0000","last_active":"2024-08-09T00:40:42.563040+0000","last_peered":"2024-08-09T00:40:42.563040+0000","last_clean":"2024-08-09T00:40:42.563040+0000","last_became_active":"2024-08-08T23:48:38.070205+0000","last_became_peered":"2024-08-08T23:48:38.070205+0000","last_unstale":"2024-08-09T00:40:42.563040+0000","last_undegraded":"2024-08-09T00:40:42.563040+0000","last_fullsized":"2024-08-09T00:40:42.563040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:42.562784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.562784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:16.829344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'26","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.262213+0000","last_change":"2024-08-09T00:40:44.262213+0000","last_active":"2024-08-09T00:40:44.262213+0000","last_peered":"2024-08-09T00:40:44.262213+0000","last_clean":"2024-08-09T00:40:44.262213+0000","last_became_active":"2024-08-08T23:44:47.414859+0000","last_became_peered":"2024-08-08T23:44:47.414859+0000","last_unstale":"2024-08-09T00:40:44.262213+0000","last_undegraded":"2024-08-09T00:40:44.262213+0000","last_fullsized":"2024-08-09T00:40:44.262213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-08-09T00:40:44.261956+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.261956+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:37.462204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:31.568698+0000","last_change":"2024-08-09T00:41:31.568812+0000","last_active":"2024-08-09T00:41:31.568698+0000","last_peered":"2024-08-09T00:41:31.568698+0000","last_clean":"2024-08-09T00:41:31.568698+0000","last_became_active":"2024-08-09T00:04:29.859692+0000","last_became_peered":"2024-08-09T00:04:29.859692+0000","last_unstale":"2024-08-09T00:41:31.568698+0000","last_undegraded":"2024-08-09T00:41:31.568698+0000","last_fullsized":"2024-08-09T00:41:31.568698+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:31.568467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:31.568467+0000","last_clean_scrub_stamp":"2024-08-09T00:41:31.568467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:21:55.784188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.105810+0000","last_change":"2024-08-09T00:41:20.105868+0000","last_active":"2024-08-09T00:41:20.105810+0000","last_peered":"2024-08-09T00:41:20.105810+0000","last_clean":"2024-08-09T00:41:20.105810+0000","last_became_active":"2024-08-08T23:48:42.112066+0000","last_became_peered":"2024-08-08T23:48:42.112066+0000","last_unstale":"2024-08-09T00:41:20.105810+0000","last_undegraded":"2024-08-09T00:41:20.105810+0000","last_fullsized":"2024-08-09T00:41:20.105810+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:41:20.105618+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:41:20.105618+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.105618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:00.785561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.595802+0000","last_change":"2024-08-09T00:40:41.595802+0000","last_active":"2024-08-09T00:40:41.595802+0000","last_peered":"2024-08-09T00:40:41.595802+0000","last_clean":"2024-08-09T00:40:41.595802+0000","last_became_active":"2024-08-08T23:48:38.073183+0000","last_became_peered":"2024-08-08T23:48:38.073183+0000","last_unstale":"2024-08-09T00:40:41.595802+0000","last_undegraded":"2024-08-09T00:40:41.595802+0000","last_fullsized":"2024-08-09T00:40:41.595802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:41.595540+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.595540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:08:00.572160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'34","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:35.906989+0000","last_change":"2024-08-09T00:40:35.906989+0000","last_active":"2024-08-09T00:40:35.906989+0000","last_peered":"2024-08-09T00:40:35.906989+0000","last_clean":"2024-08-09T00:40:35.906989+0000","last_became_active":"2024-08-08T23:44:47.395989+0000","last_became_peered":"2024-08-08T23:44:47.395989+0000","last_unstale":"2024-08-09T00:40:35.906989+0000","last_undegraded":"2024-08-09T00:40:35.906989+0000","last_fullsized":"2024-08-09T00:40:35.906989+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:40:35.906730+0000","last_clean_scrub_stamp":"2024-08-09T00:40:35.906730+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:03:23.261597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:30.540507+0000","last_change":"2024-08-09T00:41:30.540574+0000","last_active":"2024-08-09T00:41:30.540507+0000","last_peered":"2024-08-09T00:41:30.540507+0000","last_clean":"2024-08-09T00:41:30.540507+0000","last_became_active":"2024-08-09T00:04:29.851410+0000","last_became_peered":"2024-08-09T00:04:29.851410+0000","last_unstale":"2024-08-09T00:41:30.540507+0000","last_undegraded":"2024-08-09T00:41:30.540507+0000","last_fullsized":"2024-08-09T00:41:30.540507+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:30.540289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:30.540289+0000","last_clean_scrub_stamp":"2024-08-09T00:41:30.540289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:53:15.479053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.063238+0000","last_change":"2024-08-09T00:41:09.063328+0000","last_active":"2024-08-09T00:41:09.063238+0000","last_peered":"2024-08-09T00:41:09.063238+0000","last_clean":"2024-08-09T00:41:09.063238+0000","last_became_active":"2024-08-08T23:48:42.100632+0000","last_became_peered":"2024-08-08T23:48:42.100632+0000","last_unstale":"2024-08-09T00:41:09.063238+0000","last_undegraded":"2024-08-09T00:41:09.063238+0000","last_fullsized":"2024-08-09T00:41:09.063238+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:09.062923+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.062923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:16:05.039859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.691491+0000","last_change":"2024-08-09T00:40:41.691491+0000","last_active":"2024-08-09T00:40:41.691491+0000","last_peered":"2024-08-09T00:40:41.691491+0000","last_clean":"2024-08-09T00:40:41.691491+0000","last_became_active":"2024-08-08T23:48:38.092329+0000","last_became_peered":"2024-08-08T23:48:38.092329+0000","last_unstale":"2024-08-09T00:40:41.691491+0000","last_undegraded":"2024-08-09T00:40:41.691491+0000","last_fullsized":"2024-08-09T00:40:41.691491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:41.691090+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.691090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:04:50.076445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'16","reported_seq":113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.899972+0000","last_change":"2024-08-09T00:40:38.899972+0000","last_active":"2024-08-09T00:40:38.899972+0000","last_peered":"2024-08-09T00:40:38.899972+0000","last_clean":"2024-08-09T00:40:38.899972+0000","last_became_active":"2024-08-08T23:44:47.405322+0000","last_became_peered":"2024-08-08T23:44:47.405322+0000","last_unstale":"2024-08-09T00:40:38.899972+0000","last_undegraded":"2024-08-09T00:40:38.899972+0000","last_fullsized":"2024-08-09T00:40:38.899972+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-08-09T00:40:38.899571+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.899571+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:43:03.546409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.697082+0000","last_change":"2024-08-09T00:40:56.697187+0000","last_active":"2024-08-09T00:40:56.697082+0000","last_peered":"2024-08-09T00:40:56.697082+0000","last_clean":"2024-08-09T00:40:56.697082+0000","last_became_active":"2024-08-09T00:04:29.875409+0000","last_became_peered":"2024-08-09T00:04:29.875409+0000","last_unstale":"2024-08-09T00:40:56.697082+0000","last_undegraded":"2024-08-09T00:40:56.697082+0000","last_fullsized":"2024-08-09T00:40:56.697082+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:56.696850+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.696850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:28:39.200712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.309045+0000","last_change":"2024-08-09T00:41:20.309112+0000","last_active":"2024-08-09T00:41:20.309045+0000","last_peered":"2024-08-09T00:41:20.309045+0000","last_clean":"2024-08-09T00:41:20.309045+0000","last_became_active":"2024-08-08T23:48:42.102582+0000","last_became_peered":"2024-08-08T23:48:42.102582+0000","last_unstale":"2024-08-09T00:41:20.309045+0000","last_undegraded":"2024-08-09T00:41:20.309045+0000","last_fullsized":"2024-08-09T00:41:20.309045+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:20.308852+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:20.308852+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.308852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:33:26.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.889285+0000","last_change":"2024-08-09T00:40:39.889285+0000","last_active":"2024-08-09T00:40:39.889285+0000","last_peered":"2024-08-09T00:40:39.889285+0000","last_clean":"2024-08-09T00:40:39.889285+0000","last_became_active":"2024-08-08T23:48:38.074455+0000","last_became_peered":"2024-08-08T23:48:38.074455+0000","last_unstale":"2024-08-09T00:40:39.889285+0000","last_undegraded":"2024-08-09T00:40:39.889285+0000","last_fullsized":"2024-08-09T00:40:39.889285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-08-09T00:40:39.889006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.889006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:35:10.545546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'76","reported_seq":308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.502863+0000","last_change":"2024-08-09T00:40:49.502863+0000","last_active":"2024-08-09T00:40:49.502863+0000","last_peered":"2024-08-09T00:40:49.502863+0000","last_clean":"2024-08-09T00:40:49.502863+0000","last_became_active":"2024-08-08T23:44:47.392352+0000","last_became_peered":"2024-08-08T23:44:47.392352+0000","last_unstale":"2024-08-09T00:40:49.502863+0000","last_undegraded":"2024-08-09T00:40:49.502863+0000","last_fullsized":"2024-08-09T00:40:49.502863+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:49.502595+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.502595+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:44:42.439163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":338,"num_write":118,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2970,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'160","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.746254+0000","last_change":"2024-08-09T00:41:23.746355+0000","last_active":"2024-08-09T00:41:23.746254+0000","last_peered":"2024-08-09T00:41:23.746254+0000","last_clean":"2024-08-09T00:41:23.746254+0000","last_became_active":"2024-08-08T23:28:24.800159+0000","last_became_peered":"2024-08-08T23:28:24.800159+0000","last_unstale":"2024-08-09T00:41:23.746254+0000","last_undegraded":"2024-08-09T00:41:23.746254+0000","last_fullsized":"2024-08-09T00:41:23.746254+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:23.746032+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:23.746032+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.746032+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:24.195653+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850193,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":340,"num_read_kb":12258,"num_write":951,"num_write_kb":26476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'234","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.203061+0000","last_change":"2024-08-09T00:40:55.203061+0000","last_active":"2024-08-09T00:40:55.203061+0000","last_peered":"2024-08-09T00:40:55.203061+0000","last_clean":"2024-08-09T00:40:55.203061+0000","last_became_active":"2024-08-08T23:28:26.778255+0000","last_became_peered":"2024-08-08T23:28:26.778255+0000","last_unstale":"2024-08-09T00:40:55.203061+0000","last_undegraded":"2024-08-09T00:40:55.203061+0000","last_fullsized":"2024-08-09T00:40:55.203061+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:55.202784+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.202784+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:24:48.362184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":733,"num_write":362,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'191","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.952180+0000","last_change":"2024-08-09T00:41:08.952180+0000","last_active":"2024-08-09T00:41:08.952180+0000","last_peered":"2024-08-09T00:41:08.952180+0000","last_clean":"2024-08-09T00:41:08.952180+0000","last_became_active":"2024-08-08T23:28:24.771463+0000","last_became_peered":"2024-08-08T23:28:24.771463+0000","last_unstale":"2024-08-09T00:41:08.952180+0000","last_undegraded":"2024-08-09T00:41:08.952180+0000","last_fullsized":"2024-08-09T00:41:08.952180+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-08-09T00:41:08.951911+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.951911+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:39.305150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":3384,"num_write":904,"num_write_kb":37330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'235","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.617024+0000","last_change":"2024-08-09T00:41:05.617090+0000","last_active":"2024-08-09T00:41:05.617024+0000","last_peered":"2024-08-09T00:41:05.617024+0000","last_clean":"2024-08-09T00:41:05.617024+0000","last_became_active":"2024-08-08T23:28:26.776153+0000","last_became_peered":"2024-08-08T23:28:26.776153+0000","last_unstale":"2024-08-09T00:41:05.617024+0000","last_undegraded":"2024-08-09T00:41:05.617024+0000","last_fullsized":"2024-08-09T00:41:05.617024+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'235","last_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_deep_scrub":"268'235","last_deep_scrub_stamp":"2024-08-09T00:41:05.616835+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.616835+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:52:10.896240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":731,"num_write":350,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":527,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'216","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.565748+0000","last_change":"2024-08-09T00:41:19.565748+0000","last_active":"2024-08-09T00:41:19.565748+0000","last_peered":"2024-08-09T00:41:19.565748+0000","last_clean":"2024-08-09T00:41:19.565748+0000","last_became_active":"2024-08-08T23:28:24.766995+0000","last_became_peered":"2024-08-08T23:28:24.766995+0000","last_unstale":"2024-08-09T00:41:19.565748+0000","last_undegraded":"2024-08-09T00:41:19.565748+0000","last_fullsized":"2024-08-09T00:41:19.565748+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-08-09T00:41:19.565327+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-08-09T00:41:19.565327+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.565327+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:24:05.617684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":22668,"num_write":1178,"num_write_kb":36449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'320","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.114112+0000","last_change":"2024-08-09T00:41:05.114174+0000","last_active":"2024-08-09T00:41:05.114112+0000","last_peered":"2024-08-09T00:41:05.114112+0000","last_clean":"2024-08-09T00:41:05.114112+0000","last_became_active":"2024-08-08T23:28:26.763199+0000","last_became_peered":"2024-08-08T23:28:26.763199+0000","last_unstale":"2024-08-09T00:41:05.114112+0000","last_undegraded":"2024-08-09T00:41:05.114112+0000","last_fullsized":"2024-08-09T00:41:05.114112+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-08-09T00:41:05.113918+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.113918+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:33:20.516143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1322,"num_read_kb":1108,"num_write":510,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'200","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.116081+0000","last_change":"2024-08-09T00:41:01.116200+0000","last_active":"2024-08-09T00:41:01.116081+0000","last_peered":"2024-08-09T00:41:01.116081+0000","last_clean":"2024-08-09T00:41:01.116081+0000","last_became_active":"2024-08-08T23:28:24.818496+0000","last_became_peered":"2024-08-08T23:28:24.818496+0000","last_unstale":"2024-08-09T00:41:01.116081+0000","last_undegraded":"2024-08-09T00:41:01.116081+0000","last_fullsized":"2024-08-09T00:41:01.116081+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:01.115878+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.115878+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:35.058861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568643,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":448,"num_read_kb":38040,"num_write":1155,"num_write_kb":31014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'82","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.488980+0000","last_change":"2024-08-09T00:41:15.489041+0000","last_active":"2024-08-09T00:41:15.488980+0000","last_peered":"2024-08-09T00:41:15.488980+0000","last_clean":"2024-08-09T00:41:15.488980+0000","last_became_active":"2024-08-08T23:28:26.758127+0000","last_became_peered":"2024-08-08T23:28:26.758127+0000","last_unstale":"2024-08-09T00:41:15.488980+0000","last_undegraded":"2024-08-09T00:41:15.488980+0000","last_fullsized":"2024-08-09T00:41:15.488980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'82","last_scrub_stamp":"2024-08-09T00:41:15.488754+0000","last_deep_scrub":"268'82","last_deep_scrub_stamp":"2024-08-09T00:41:15.488754+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.488754+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:48.690230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":270,"num_write":115,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'215","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.766664+0000","last_change":"2024-08-09T00:40:39.766664+0000","last_active":"2024-08-09T00:40:39.766664+0000","last_peered":"2024-08-09T00:40:39.766664+0000","last_clean":"2024-08-09T00:40:39.766664+0000","last_became_active":"2024-08-08T23:29:01.887867+0000","last_became_peered":"2024-08-08T23:29:01.887867+0000","last_unstale":"2024-08-09T00:40:39.766664+0000","last_undegraded":"2024-08-09T00:40:39.766664+0000","last_fullsized":"2024-08-09T00:40:39.766664+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-08-09T00:40:39.766288+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.766288+0000","objects_scrubbed":10,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:26:32.617815+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8746313,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":21778,"num_write":1217,"num_write_kb":39476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"268'126","reported_seq":754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.141948+0000","last_change":"2024-08-09T00:41:05.142012+0000","last_active":"2024-08-09T00:41:05.141948+0000","last_peered":"2024-08-09T00:41:05.141948+0000","last_clean":"2024-08-09T00:41:05.141948+0000","last_became_active":"2024-08-08T23:28:26.767845+0000","last_became_peered":"2024-08-08T23:28:26.767845+0000","last_unstale":"2024-08-09T00:41:05.141948+0000","last_undegraded":"2024-08-09T00:41:05.141948+0000","last_fullsized":"2024-08-09T00:41:05.141948+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:41:05.141756+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.141756+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:39:03.113824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":543,"num_read_kb":451,"num_write":193,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'189","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.095124+0000","last_change":"2024-08-09T00:41:07.095339+0000","last_active":"2024-08-09T00:41:07.095124+0000","last_peered":"2024-08-09T00:41:07.095124+0000","last_clean":"2024-08-09T00:41:07.095124+0000","last_became_active":"2024-08-08T23:28:24.815119+0000","last_became_peered":"2024-08-08T23:28:24.815119+0000","last_unstale":"2024-08-09T00:41:07.095124+0000","last_undegraded":"2024-08-09T00:41:07.095124+0000","last_fullsized":"2024-08-09T00:41:07.095124+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.094845+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.094845+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:36:35.837560+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49415,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":54098,"num_write":1119,"num_write_kb":36340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'112","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.309373+0000","last_change":"2024-08-09T00:41:15.309373+0000","last_active":"2024-08-09T00:41:15.309373+0000","last_peered":"2024-08-09T00:41:15.309373+0000","last_clean":"2024-08-09T00:41:15.309373+0000","last_became_active":"2024-08-08T23:28:26.758296+0000","last_became_peered":"2024-08-08T23:28:26.758296+0000","last_unstale":"2024-08-09T00:41:15.309373+0000","last_undegraded":"2024-08-09T00:41:15.309373+0000","last_fullsized":"2024-08-09T00:41:15.309373+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:41:15.309122+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:41:15.309122+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.309122+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:31:25.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":384,"num_write":158,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'197","reported_seq":855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.743514+0000","last_change":"2024-08-09T00:41:21.743606+0000","last_active":"2024-08-09T00:41:21.743514+0000","last_peered":"2024-08-09T00:41:21.743514+0000","last_clean":"2024-08-09T00:41:21.743514+0000","last_became_active":"2024-08-08T23:28:24.794400+0000","last_became_peered":"2024-08-08T23:28:24.794400+0000","last_unstale":"2024-08-09T00:41:21.743514+0000","last_undegraded":"2024-08-09T00:41:21.743514+0000","last_fullsized":"2024-08-09T00:41:21.743514+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'197","last_scrub_stamp":"2024-08-09T00:41:21.743305+0000","last_deep_scrub":"268'197","last_deep_scrub_stamp":"2024-08-09T00:41:21.743305+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.743305+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:45:02.031739+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743987,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":11259,"num_write":1113,"num_write_kb":34414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'107","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.180343+0000","last_change":"2024-08-09T00:40:57.180343+0000","last_active":"2024-08-09T00:40:57.180343+0000","last_peered":"2024-08-09T00:40:57.180343+0000","last_clean":"2024-08-09T00:40:57.180343+0000","last_became_active":"2024-08-08T23:28:26.776291+0000","last_became_peered":"2024-08-08T23:28:26.776291+0000","last_unstale":"2024-08-09T00:40:57.180343+0000","last_undegraded":"2024-08-09T00:40:57.180343+0000","last_fullsized":"2024-08-09T00:40:57.180343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'107","last_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_deep_scrub":"268'107","last_deep_scrub_stamp":"2024-08-09T00:40:57.180097+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.180097+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:33:50.782470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":388,"num_write":164,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'155","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.503781+0000","last_change":"2024-08-09T00:41:25.503877+0000","last_active":"2024-08-09T00:41:25.503781+0000","last_peered":"2024-08-09T00:41:25.503781+0000","last_clean":"2024-08-09T00:41:25.503781+0000","last_became_active":"2024-08-08T23:28:24.787538+0000","last_became_peered":"2024-08-08T23:28:24.787538+0000","last_unstale":"2024-08-09T00:41:25.503781+0000","last_undegraded":"2024-08-09T00:41:25.503781+0000","last_fullsized":"2024-08-09T00:41:25.503781+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-08-09T00:41:25.503580+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-08-09T00:41:25.503580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.503580+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:29:11.318212+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":32780,"num_write":887,"num_write_kb":26830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'209","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.112559+0000","last_change":"2024-08-09T00:40:59.112559+0000","last_active":"2024-08-09T00:40:59.112559+0000","last_peered":"2024-08-09T00:40:59.112559+0000","last_clean":"2024-08-09T00:40:59.112559+0000","last_became_active":"2024-08-08T23:28:26.768270+0000","last_became_peered":"2024-08-08T23:28:26.768270+0000","last_unstale":"2024-08-09T00:40:59.112559+0000","last_undegraded":"2024-08-09T00:40:59.112559+0000","last_fullsized":"2024-08-09T00:40:59.112559+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:59.112286+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.112286+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.598671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":883,"num_read_kb":714,"num_write":338,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":263,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'34","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.101640+0000","last_change":"2024-08-09T00:41:03.101708+0000","last_active":"2024-08-09T00:41:03.101640+0000","last_peered":"2024-08-09T00:41:03.101640+0000","last_clean":"2024-08-09T00:41:03.101640+0000","last_became_active":"2024-08-08T23:28:26.763161+0000","last_became_peered":"2024-08-08T23:28:26.763161+0000","last_unstale":"2024-08-09T00:41:03.101640+0000","last_undegraded":"2024-08-09T00:41:03.101640+0000","last_fullsized":"2024-08-09T00:41:03.101640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-08-09T00:41:03.101426+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.101426+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:31:13.790151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":149,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'172","reported_seq":791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.608773+0000","last_change":"2024-08-09T00:41:13.608870+0000","last_active":"2024-08-09T00:41:13.608773+0000","last_peered":"2024-08-09T00:41:13.608773+0000","last_clean":"2024-08-09T00:41:13.608773+0000","last_became_active":"2024-08-08T23:28:24.815564+0000","last_became_peered":"2024-08-08T23:28:24.815564+0000","last_unstale":"2024-08-09T00:41:13.608773+0000","last_undegraded":"2024-08-09T00:41:13.608773+0000","last_fullsized":"2024-08-09T00:41:13.608773+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-08-09T00:41:13.608571+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-08-09T00:41:13.608571+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.608571+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:52:10.191297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":8171,"num_write":1047,"num_write_kb":20637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'92","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.633161+0000","last_change":"2024-08-09T00:41:03.633221+0000","last_active":"2024-08-09T00:41:03.633161+0000","last_peered":"2024-08-09T00:41:03.633161+0000","last_clean":"2024-08-09T00:41:03.633161+0000","last_became_active":"2024-08-08T23:28:26.782473+0000","last_became_peered":"2024-08-08T23:28:26.782473+0000","last_unstale":"2024-08-09T00:41:03.633161+0000","last_undegraded":"2024-08-09T00:41:03.633161+0000","last_fullsized":"2024-08-09T00:41:03.633161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-08-09T00:41:03.632964+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.632964+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:20:37.391665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":133,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'198","reported_seq":803,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.231893+0000","last_change":"2024-08-09T00:40:46.231893+0000","last_active":"2024-08-09T00:40:46.231893+0000","last_peered":"2024-08-09T00:40:46.231893+0000","last_clean":"2024-08-09T00:40:46.231893+0000","last_became_active":"2024-08-08T23:29:01.887305+0000","last_became_peered":"2024-08-08T23:29:01.887305+0000","last_unstale":"2024-08-09T00:40:46.231893+0000","last_undegraded":"2024-08-09T00:40:46.231893+0000","last_fullsized":"2024-08-09T00:40:46.231893+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:40:46.231597+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.231597+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:55.781502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":6729,"num_write":999,"num_write_kb":37290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'351","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.201532+0000","last_change":"2024-08-09T00:40:54.201532+0000","last_active":"2024-08-09T00:40:54.201532+0000","last_peered":"2024-08-09T00:40:54.201532+0000","last_clean":"2024-08-09T00:40:54.201532+0000","last_became_active":"2024-08-08T23:28:26.787471+0000","last_became_peered":"2024-08-08T23:28:26.787471+0000","last_unstale":"2024-08-09T00:40:54.201532+0000","last_undegraded":"2024-08-09T00:40:54.201532+0000","last_fullsized":"2024-08-09T00:40:54.201532+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-08-09T00:40:54.201267+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.201267+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:12.747587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1349,"num_write":573,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'246","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.180957+0000","last_change":"2024-08-09T00:41:04.181040+0000","last_active":"2024-08-09T00:41:04.180957+0000","last_peered":"2024-08-09T00:41:04.180957+0000","last_clean":"2024-08-09T00:41:04.180957+0000","last_became_active":"2024-08-08T23:28:24.818149+0000","last_became_peered":"2024-08-08T23:28:24.818149+0000","last_unstale":"2024-08-09T00:41:04.180957+0000","last_undegraded":"2024-08-09T00:41:04.180957+0000","last_fullsized":"2024-08-09T00:41:04.180957+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-08-09T00:41:04.180754+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.180754+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:04:49.717911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":13197,"num_write":1122,"num_write_kb":41564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'22","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.113760+0000","last_change":"2024-08-09T00:40:58.113824+0000","last_active":"2024-08-09T00:40:58.113760+0000","last_peered":"2024-08-09T00:40:58.113760+0000","last_clean":"2024-08-09T00:40:58.113760+0000","last_became_active":"2024-08-08T23:28:26.767609+0000","last_became_peered":"2024-08-08T23:28:26.767609+0000","last_unstale":"2024-08-09T00:40:58.113760+0000","last_undegraded":"2024-08-09T00:40:58.113760+0000","last_fullsized":"2024-08-09T00:40:58.113760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-08-09T00:40:58.113559+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.113559+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:11:08.699949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'176","reported_seq":779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.219376+0000","last_change":"2024-08-09T00:40:40.219376+0000","last_active":"2024-08-09T00:40:40.219376+0000","last_peered":"2024-08-09T00:40:40.219376+0000","last_clean":"2024-08-09T00:40:40.219376+0000","last_became_active":"2024-08-08T23:29:01.580327+0000","last_became_peered":"2024-08-08T23:29:01.580327+0000","last_unstale":"2024-08-09T00:40:40.219376+0000","last_undegraded":"2024-08-09T00:40:40.219376+0000","last_fullsized":"2024-08-09T00:40:40.219376+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-08-09T00:40:40.219095+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.219095+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:19:19.550329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":29619,"num_write":952,"num_write_kb":35344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"268'258","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.112836+0000","last_change":"2024-08-09T00:41:01.112901+0000","last_active":"2024-08-09T00:41:01.112836+0000","last_peered":"2024-08-09T00:41:01.112836+0000","last_clean":"2024-08-09T00:41:01.112836+0000","last_became_active":"2024-08-08T23:28:26.770819+0000","last_became_peered":"2024-08-08T23:28:26.770819+0000","last_unstale":"2024-08-09T00:41:01.112836+0000","last_undegraded":"2024-08-09T00:41:01.112836+0000","last_fullsized":"2024-08-09T00:41:01.112836+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:41:01.112641+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.112641+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:21:24.506004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1053,"num_read_kb":835,"num_write":410,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'166","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.429876+0000","last_change":"2024-08-09T00:41:22.429993+0000","last_active":"2024-08-09T00:41:22.429876+0000","last_peered":"2024-08-09T00:41:22.429876+0000","last_clean":"2024-08-09T00:41:22.429876+0000","last_became_active":"2024-08-08T23:28:24.754109+0000","last_became_peered":"2024-08-08T23:28:24.754109+0000","last_unstale":"2024-08-09T00:41:22.429876+0000","last_undegraded":"2024-08-09T00:41:22.429876+0000","last_fullsized":"2024-08-09T00:41:22.429876+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:41:22.429666+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:41:22.429666+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.429666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:26:51.824803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146116,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":37287,"num_write":965,"num_write_kb":20530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'110","reported_seq":710,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.001404+0000","last_change":"2024-08-09T00:41:01.001568+0000","last_active":"2024-08-09T00:41:01.001404+0000","last_peered":"2024-08-09T00:41:01.001404+0000","last_clean":"2024-08-09T00:41:01.001404+0000","last_became_active":"2024-08-08T23:28:26.764719+0000","last_became_peered":"2024-08-08T23:28:26.764719+0000","last_unstale":"2024-08-09T00:41:01.001404+0000","last_undegraded":"2024-08-09T00:41:01.001404+0000","last_fullsized":"2024-08-09T00:41:01.001404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:01.001176+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.001176+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:30:05.967079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":371,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'222","reported_seq":856,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.526088+0000","last_change":"2024-08-09T00:41:20.526160+0000","last_active":"2024-08-09T00:41:20.526088+0000","last_peered":"2024-08-09T00:41:20.526088+0000","last_clean":"2024-08-09T00:41:20.526088+0000","last_became_active":"2024-08-08T23:28:24.771514+0000","last_became_peered":"2024-08-08T23:28:24.771514+0000","last_unstale":"2024-08-09T00:41:20.526088+0000","last_undegraded":"2024-08-09T00:41:20.526088+0000","last_fullsized":"2024-08-09T00:41:20.526088+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'222","last_scrub_stamp":"2024-08-09T00:41:20.525883+0000","last_deep_scrub":"268'222","last_deep_scrub_stamp":"2024-08-09T00:41:20.525883+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.525883+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:11.546286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":428,"num_read_kb":738,"num_write":1172,"num_write_kb":26162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'110","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.001523+0000","last_change":"2024-08-09T00:40:41.001523+0000","last_active":"2024-08-09T00:40:41.001523+0000","last_peered":"2024-08-09T00:40:41.001523+0000","last_clean":"2024-08-09T00:40:41.001523+0000","last_became_active":"2024-08-08T23:28:34.831245+0000","last_became_peered":"2024-08-08T23:28:34.831245+0000","last_unstale":"2024-08-09T00:40:41.001523+0000","last_undegraded":"2024-08-09T00:40:41.001523+0000","last_fullsized":"2024-08-09T00:40:41.001523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:40:41.001229+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.001229+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:58:15.431511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":115,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'125","reported_seq":701,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.262175+0000","last_change":"2024-08-09T00:40:42.262175+0000","last_active":"2024-08-09T00:40:42.262175+0000","last_peered":"2024-08-09T00:40:42.262175+0000","last_clean":"2024-08-09T00:40:42.262175+0000","last_became_active":"2024-08-08T23:29:01.588017+0000","last_became_peered":"2024-08-08T23:29:01.588017+0000","last_unstale":"2024-08-09T00:40:42.262175+0000","last_undegraded":"2024-08-09T00:40:42.262175+0000","last_fullsized":"2024-08-09T00:40:42.262175+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:42.261780+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.261780+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:38:47.848829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":403,"num_write":191,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"268'178","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.553323+0000","last_change":"2024-08-09T00:40:50.553409+0000","last_active":"2024-08-09T00:40:50.553323+0000","last_peered":"2024-08-09T00:40:50.553323+0000","last_clean":"2024-08-09T00:40:50.553323+0000","last_became_active":"2024-08-08T23:29:01.581789+0000","last_became_peered":"2024-08-08T23:29:01.581789+0000","last_unstale":"2024-08-09T00:40:50.553323+0000","last_undegraded":"2024-08-09T00:40:50.553323+0000","last_fullsized":"2024-08-09T00:40:50.553323+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:40:50.553124+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.553124+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:04.843417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":22191,"num_write":1038,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.031946+0000","last_change":"2024-08-09T00:41:04.031999+0000","last_active":"2024-08-09T00:41:04.031946+0000","last_peered":"2024-08-09T00:41:04.031946+0000","last_clean":"2024-08-09T00:41:04.031946+0000","last_became_active":"2024-08-08T23:28:28.770941+0000","last_became_peered":"2024-08-08T23:28:28.770941+0000","last_unstale":"2024-08-09T00:41:04.031946+0000","last_undegraded":"2024-08-09T00:41:04.031946+0000","last_fullsized":"2024-08-09T00:41:04.031946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.031745+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.031745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:42:48.346071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'226","reported_seq":868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.529553+0000","last_change":"2024-08-09T00:41:16.529635+0000","last_active":"2024-08-09T00:41:16.529553+0000","last_peered":"2024-08-09T00:41:16.529553+0000","last_clean":"2024-08-09T00:41:16.529553+0000","last_became_active":"2024-08-08T23:28:30.788292+0000","last_became_peered":"2024-08-08T23:28:30.788292+0000","last_unstale":"2024-08-09T00:41:16.529553+0000","last_undegraded":"2024-08-09T00:41:16.529553+0000","last_fullsized":"2024-08-09T00:41:16.529553+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-08-09T00:41:16.529355+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-08-09T00:41:16.529355+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.529355+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:40:00.253593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":290,"num_write":170,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.721552+0000","last_change":"2024-08-09T00:40:55.721552+0000","last_active":"2024-08-09T00:40:55.721552+0000","last_peered":"2024-08-09T00:40:55.721552+0000","last_clean":"2024-08-09T00:40:55.721552+0000","last_became_active":"2024-08-08T23:28:32.817015+0000","last_became_peered":"2024-08-08T23:28:32.817015+0000","last_unstale":"2024-08-09T00:40:55.721552+0000","last_undegraded":"2024-08-09T00:40:55.721552+0000","last_fullsized":"2024-08-09T00:40:55.721552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.721289+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.721289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:38:12.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2401","reported_seq":4294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.236142+0000","last_change":"2024-08-09T00:40:43.236142+0000","last_active":"2024-08-09T00:40:43.236142+0000","last_peered":"2024-08-09T00:40:43.236142+0000","last_clean":"2024-08-09T00:40:43.236142+0000","last_became_active":"2024-08-08T23:28:34.823846+0000","last_became_peered":"2024-08-08T23:28:34.823846+0000","last_unstale":"2024-08-09T00:40:43.236142+0000","last_undegraded":"2024-08-09T00:40:43.236142+0000","last_fullsized":"2024-08-09T00:40:43.236142+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2401","last_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_deep_scrub":"268'2401","last_deep_scrub_stamp":"2024-08-09T00:40:43.235885+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.235885+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":2300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:26:55.409086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6058,"num_read_kb":6048,"num_write":4793,"num_write_kb":1766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'139","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.137766+0000","last_change":"2024-08-09T00:41:00.137831+0000","last_active":"2024-08-09T00:41:00.137766+0000","last_peered":"2024-08-09T00:41:00.137766+0000","last_clean":"2024-08-09T00:41:00.137766+0000","last_became_active":"2024-08-08T23:28:26.790709+0000","last_became_peered":"2024-08-08T23:28:26.790709+0000","last_unstale":"2024-08-09T00:41:00.137766+0000","last_undegraded":"2024-08-09T00:41:00.137766+0000","last_fullsized":"2024-08-09T00:41:00.137766+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:41:00.137580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.137580+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:41:44.917221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":558,"num_read_kb":447,"num_write":205,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'184","reported_seq":814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.518319+0000","last_change":"2024-08-09T00:41:23.518437+0000","last_active":"2024-08-09T00:41:23.518319+0000","last_peered":"2024-08-09T00:41:23.518319+0000","last_clean":"2024-08-09T00:41:23.518319+0000","last_became_active":"2024-08-08T23:28:24.800706+0000","last_became_peered":"2024-08-08T23:28:24.800706+0000","last_unstale":"2024-08-09T00:41:23.518319+0000","last_undegraded":"2024-08-09T00:41:23.518319+0000","last_fullsized":"2024-08-09T00:41:23.518319+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:23.518119+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:23.518119+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.518119+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:02.433878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311673,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":392,"num_read_kb":16280,"num_write":970,"num_write_kb":43326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.464070+0000","last_change":"2024-08-09T00:41:15.464126+0000","last_active":"2024-08-09T00:41:15.464070+0000","last_peered":"2024-08-09T00:41:15.464070+0000","last_clean":"2024-08-09T00:41:15.464070+0000","last_became_active":"2024-08-08T23:28:28.782867+0000","last_became_peered":"2024-08-08T23:28:28.782867+0000","last_unstale":"2024-08-09T00:41:15.464070+0000","last_undegraded":"2024-08-09T00:41:15.464070+0000","last_fullsized":"2024-08-09T00:41:15.464070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:15.463866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:15.463866+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.463866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:14.987905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'113","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.352126+0000","last_change":"2024-08-09T00:41:16.352214+0000","last_active":"2024-08-09T00:41:16.352126+0000","last_peered":"2024-08-09T00:41:16.352126+0000","last_clean":"2024-08-09T00:41:16.352126+0000","last_became_active":"2024-08-08T23:28:30.785356+0000","last_became_peered":"2024-08-08T23:28:30.785356+0000","last_unstale":"2024-08-09T00:41:16.352126+0000","last_undegraded":"2024-08-09T00:41:16.352126+0000","last_fullsized":"2024-08-09T00:41:16.352126+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'113","last_scrub_stamp":"2024-08-09T00:41:16.351910+0000","last_deep_scrub":"268'113","last_deep_scrub_stamp":"2024-08-09T00:41:16.351910+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.351910+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:25:38.221455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.057708+0000","last_change":"2024-08-09T00:40:44.057708+0000","last_active":"2024-08-09T00:40:44.057708+0000","last_peered":"2024-08-09T00:40:44.057708+0000","last_clean":"2024-08-09T00:40:44.057708+0000","last_became_active":"2024-08-08T23:28:32.826093+0000","last_became_peered":"2024-08-08T23:28:32.826093+0000","last_unstale":"2024-08-09T00:40:44.057708+0000","last_undegraded":"2024-08-09T00:40:44.057708+0000","last_fullsized":"2024-08-09T00:40:44.057708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.057369+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.057369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:46:45.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'140","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.618287+0000","last_change":"2024-08-09T00:40:50.618287+0000","last_active":"2024-08-09T00:40:50.618287+0000","last_peered":"2024-08-09T00:40:50.618287+0000","last_clean":"2024-08-09T00:40:50.618287+0000","last_became_active":"2024-08-08T23:28:34.835438+0000","last_became_peered":"2024-08-08T23:28:34.835438+0000","last_unstale":"2024-08-09T00:40:50.618287+0000","last_undegraded":"2024-08-09T00:40:50.618287+0000","last_fullsized":"2024-08-09T00:40:50.618287+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-08-09T00:40:50.618030+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.618030+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:55:01.456614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":143,"num_read_kb":137,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'125","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.444558+0000","last_change":"2024-08-09T00:41:13.444620+0000","last_active":"2024-08-09T00:41:13.444558+0000","last_peered":"2024-08-09T00:41:13.444558+0000","last_clean":"2024-08-09T00:41:13.444558+0000","last_became_active":"2024-08-08T23:28:26.764325+0000","last_became_peered":"2024-08-08T23:28:26.764325+0000","last_unstale":"2024-08-09T00:41:13.444558+0000","last_undegraded":"2024-08-09T00:41:13.444558+0000","last_fullsized":"2024-08-09T00:41:13.444558+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:41:13.444362+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:41:13.444362+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.444362+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:54:55.143156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":379,"num_write":176,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'232","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.696623+0000","last_change":"2024-08-09T00:41:22.696834+0000","last_active":"2024-08-09T00:41:22.696623+0000","last_peered":"2024-08-09T00:41:22.696623+0000","last_clean":"2024-08-09T00:41:22.696623+0000","last_became_active":"2024-08-08T23:28:24.796036+0000","last_became_peered":"2024-08-08T23:28:24.796036+0000","last_unstale":"2024-08-09T00:41:22.696623+0000","last_undegraded":"2024-08-09T00:41:22.696623+0000","last_fullsized":"2024-08-09T00:41:22.696623+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'232","last_scrub_stamp":"2024-08-09T00:41:22.696391+0000","last_deep_scrub":"268'232","last_deep_scrub_stamp":"2024-08-09T00:41:22.696391+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.696391+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:12:09.465742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":26858,"num_write":1144,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.437862+0000","last_change":"2024-08-09T00:41:11.437915+0000","last_active":"2024-08-09T00:41:11.437862+0000","last_peered":"2024-08-09T00:41:11.437862+0000","last_clean":"2024-08-09T00:41:11.437862+0000","last_became_active":"2024-08-08T23:28:28.770669+0000","last_became_peered":"2024-08-08T23:28:28.770669+0000","last_unstale":"2024-08-09T00:41:11.437862+0000","last_undegraded":"2024-08-09T00:41:11.437862+0000","last_fullsized":"2024-08-09T00:41:11.437862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:11.437657+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.437657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:15:41.178098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'154","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.250412+0000","last_change":"2024-08-09T00:40:43.250412+0000","last_active":"2024-08-09T00:40:43.250412+0000","last_peered":"2024-08-09T00:40:43.250412+0000","last_clean":"2024-08-09T00:40:43.250412+0000","last_became_active":"2024-08-08T23:28:30.778730+0000","last_became_peered":"2024-08-08T23:28:30.778730+0000","last_unstale":"2024-08-09T00:40:43.250412+0000","last_undegraded":"2024-08-09T00:40:43.250412+0000","last_fullsized":"2024-08-09T00:40:43.250412+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:43.250137+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.250137+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:11:26.394703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":186,"num_read_kb":179,"num_write":126,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'514","reported_seq":2629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.623510+0000","last_change":"2024-08-09T00:40:59.623510+0000","last_active":"2024-08-09T00:40:59.623510+0000","last_peered":"2024-08-09T00:40:59.623510+0000","last_clean":"2024-08-09T00:40:59.623510+0000","last_became_active":"2024-08-08T23:28:32.808180+0000","last_became_peered":"2024-08-08T23:28:32.808180+0000","last_unstale":"2024-08-09T00:40:59.623510+0000","last_undegraded":"2024-08-09T00:40:59.623510+0000","last_fullsized":"2024-08-09T00:40:59.623510+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'514","last_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_deep_scrub":"268'514","last_deep_scrub_stamp":"2024-08-09T00:40:59.623248+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.623248+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:14:49.685761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'205","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.032946+0000","last_change":"2024-08-09T00:40:43.032946+0000","last_active":"2024-08-09T00:40:43.032946+0000","last_peered":"2024-08-09T00:40:43.032946+0000","last_clean":"2024-08-09T00:40:43.032946+0000","last_became_active":"2024-08-08T23:28:34.809218+0000","last_became_peered":"2024-08-08T23:28:34.809218+0000","last_unstale":"2024-08-09T00:40:43.032946+0000","last_undegraded":"2024-08-09T00:40:43.032946+0000","last_fullsized":"2024-08-09T00:40:43.032946+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:40:43.032703+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.032703+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:50:32.934858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":555,"num_write":447,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'198","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.400322+0000","last_change":"2024-08-09T00:41:05.400388+0000","last_active":"2024-08-09T00:41:05.400322+0000","last_peered":"2024-08-09T00:41:05.400322+0000","last_clean":"2024-08-09T00:41:05.400322+0000","last_became_active":"2024-08-08T23:28:26.775790+0000","last_became_peered":"2024-08-08T23:28:26.775790+0000","last_unstale":"2024-08-09T00:41:05.400322+0000","last_undegraded":"2024-08-09T00:41:05.400322+0000","last_fullsized":"2024-08-09T00:41:05.400322+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.400130+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.400130+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:27:16.014784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":776,"num_read_kb":610,"num_write":296,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'184","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.246023+0000","last_change":"2024-08-09T00:41:01.246106+0000","last_active":"2024-08-09T00:41:01.246023+0000","last_peered":"2024-08-09T00:41:01.246023+0000","last_clean":"2024-08-09T00:41:01.246023+0000","last_became_active":"2024-08-08T23:28:24.781183+0000","last_became_peered":"2024-08-08T23:28:24.781183+0000","last_unstale":"2024-08-09T00:41:01.246023+0000","last_undegraded":"2024-08-09T00:41:01.246023+0000","last_fullsized":"2024-08-09T00:41:01.246023+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:01.245827+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.245827+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:25.571962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":349,"num_read_kb":11144,"num_write":998,"num_write_kb":23383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.046179+0000","last_change":"2024-08-09T00:41:08.046237+0000","last_active":"2024-08-09T00:41:08.046179+0000","last_peered":"2024-08-09T00:41:08.046179+0000","last_clean":"2024-08-09T00:41:08.046179+0000","last_became_active":"2024-08-08T23:28:28.771847+0000","last_became_peered":"2024-08-08T23:28:28.771847+0000","last_unstale":"2024-08-09T00:41:08.046179+0000","last_undegraded":"2024-08-09T00:41:08.046179+0000","last_fullsized":"2024-08-09T00:41:08.046179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.045971+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.045971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:20.972107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'152","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.805504+0000","last_change":"2024-08-09T00:41:26.805584+0000","last_active":"2024-08-09T00:41:26.805504+0000","last_peered":"2024-08-09T00:41:26.805504+0000","last_clean":"2024-08-09T00:41:26.805504+0000","last_became_active":"2024-08-08T23:28:31.043714+0000","last_became_peered":"2024-08-08T23:28:31.043714+0000","last_unstale":"2024-08-09T00:41:26.805504+0000","last_undegraded":"2024-08-09T00:41:26.805504+0000","last_fullsized":"2024-08-09T00:41:26.805504+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-08-09T00:41:26.805285+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-08-09T00:41:26.805285+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.805285+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:29:35.369476+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":269,"num_write":106,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'525","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.330769+0000","last_change":"2024-08-09T00:40:53.330769+0000","last_active":"2024-08-09T00:40:53.330769+0000","last_peered":"2024-08-09T00:40:53.330769+0000","last_clean":"2024-08-09T00:40:53.330769+0000","last_became_active":"2024-08-08T23:28:32.807476+0000","last_became_peered":"2024-08-08T23:28:32.807476+0000","last_unstale":"2024-08-09T00:40:53.330769+0000","last_undegraded":"2024-08-09T00:40:53.330769+0000","last_fullsized":"2024-08-09T00:40:53.330769+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:53.330522+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.330522+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:25:02.062195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'210","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.080669+0000","last_change":"2024-08-09T00:41:02.080730+0000","last_active":"2024-08-09T00:41:02.080669+0000","last_peered":"2024-08-09T00:41:02.080669+0000","last_clean":"2024-08-09T00:41:02.080669+0000","last_became_active":"2024-08-08T23:28:26.792938+0000","last_became_peered":"2024-08-08T23:28:26.792938+0000","last_unstale":"2024-08-09T00:41:02.080669+0000","last_undegraded":"2024-08-09T00:41:02.080669+0000","last_fullsized":"2024-08-09T00:41:02.080669+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'210","last_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_deep_scrub":"268'210","last_deep_scrub_stamp":"2024-08-09T00:41:02.080481+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.080481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:38:44.354454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":639,"num_write":320,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'202","reported_seq":874,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.667022+0000","last_change":"2024-08-09T00:41:15.667089+0000","last_active":"2024-08-09T00:41:15.667022+0000","last_peered":"2024-08-09T00:41:15.667022+0000","last_clean":"2024-08-09T00:41:15.667022+0000","last_became_active":"2024-08-08T23:28:24.812352+0000","last_became_peered":"2024-08-08T23:28:24.812352+0000","last_unstale":"2024-08-09T00:41:15.667022+0000","last_undegraded":"2024-08-09T00:41:15.667022+0000","last_fullsized":"2024-08-09T00:41:15.667022+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-08-09T00:41:15.666822+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-08-09T00:41:15.666822+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.666822+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:32:12.674600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":38000,"num_write":1175,"num_write_kb":17107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.612386+0000","last_change":"2024-08-09T00:41:04.612442+0000","last_active":"2024-08-09T00:41:04.612386+0000","last_peered":"2024-08-09T00:41:04.612386+0000","last_clean":"2024-08-09T00:41:04.612386+0000","last_became_active":"2024-08-08T23:28:28.784623+0000","last_became_peered":"2024-08-08T23:28:28.784623+0000","last_unstale":"2024-08-09T00:41:04.612386+0000","last_undegraded":"2024-08-09T00:41:04.612386+0000","last_fullsized":"2024-08-09T00:41:04.612386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.612184+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.612184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:19.806143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'276","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.227188+0000","last_change":"2024-08-09T00:40:47.227392+0000","last_active":"2024-08-09T00:40:47.227188+0000","last_peered":"2024-08-09T00:40:47.227188+0000","last_clean":"2024-08-09T00:40:47.227188+0000","last_became_active":"2024-08-08T23:28:31.042750+0000","last_became_peered":"2024-08-08T23:28:31.042750+0000","last_unstale":"2024-08-09T00:40:47.227188+0000","last_undegraded":"2024-08-09T00:40:47.227188+0000","last_fullsized":"2024-08-09T00:40:47.227188+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'276","last_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_deep_scrub":"268'276","last_deep_scrub_stamp":"2024-08-09T00:40:47.226937+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.226937+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:03:10.282050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":369,"num_read_kb":429,"num_write":224,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.784054+0000","last_change":"2024-08-09T00:40:59.784105+0000","last_active":"2024-08-09T00:40:59.784054+0000","last_peered":"2024-08-09T00:40:59.784054+0000","last_clean":"2024-08-09T00:40:59.784054+0000","last_became_active":"2024-08-08T23:28:32.804595+0000","last_became_peered":"2024-08-08T23:28:32.804595+0000","last_unstale":"2024-08-09T00:40:59.784054+0000","last_undegraded":"2024-08-09T00:40:59.784054+0000","last_fullsized":"2024-08-09T00:40:59.784054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.783866+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.783866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:32.556424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'554","reported_seq":1381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:37.235454+0000","last_change":"2024-08-09T00:40:37.235454+0000","last_active":"2024-08-09T00:40:37.235454+0000","last_peered":"2024-08-09T00:40:37.235454+0000","last_clean":"2024-08-09T00:40:37.235454+0000","last_became_active":"2024-08-08T23:28:34.839517+0000","last_became_peered":"2024-08-08T23:28:34.839517+0000","last_unstale":"2024-08-09T00:40:37.235454+0000","last_undegraded":"2024-08-09T00:40:37.235454+0000","last_fullsized":"2024-08-09T00:40:37.235454+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'554","last_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_deep_scrub":"268'554","last_deep_scrub_stamp":"2024-08-09T00:40:37.235172+0000","last_clean_scrub_stamp":"2024-08-09T00:40:37.235172+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:51.183078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1275,"num_read_kb":1270,"num_write":1142,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'4316","reported_seq":4952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.272456+0000","last_change":"2024-08-09T00:41:12.272517+0000","last_active":"2024-08-09T00:41:12.272456+0000","last_peered":"2024-08-09T00:41:12.272456+0000","last_clean":"2024-08-09T00:41:12.272456+0000","last_became_active":"2024-08-08T23:28:26.753590+0000","last_became_peered":"2024-08-08T23:28:26.753590+0000","last_unstale":"2024-08-09T00:41:12.272456+0000","last_undegraded":"2024-08-09T00:41:12.272456+0000","last_fullsized":"2024-08-09T00:41:12.272456+0000","mapping_epoch":27,"log_start":"268'4300","ondisk_log_start":"268'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4316","last_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_deep_scrub":"268'4316","last_deep_scrub_stamp":"2024-08-09T00:41:12.272273+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.272273+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.931506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15226,"num_read_kb":12291,"num_write":6516,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'233","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.668573+0000","last_change":"2024-08-09T00:41:17.668678+0000","last_active":"2024-08-09T00:41:17.668573+0000","last_peered":"2024-08-09T00:41:17.668573+0000","last_clean":"2024-08-09T00:41:17.668573+0000","last_became_active":"2024-08-08T23:28:24.806606+0000","last_became_peered":"2024-08-08T23:28:24.806606+0000","last_unstale":"2024-08-09T00:41:17.668573+0000","last_undegraded":"2024-08-09T00:41:17.668573+0000","last_fullsized":"2024-08-09T00:41:17.668573+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:41:17.668369+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:41:17.668369+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.668369+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:04.570917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1254,"num_read_kb":40415,"num_write":1272,"num_write_kb":44878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.181967+0000","last_change":"2024-08-09T00:40:53.182021+0000","last_active":"2024-08-09T00:40:53.181967+0000","last_peered":"2024-08-09T00:40:53.181967+0000","last_clean":"2024-08-09T00:40:53.181967+0000","last_became_active":"2024-08-08T23:28:28.771743+0000","last_became_peered":"2024-08-08T23:28:28.771743+0000","last_unstale":"2024-08-09T00:40:53.181967+0000","last_undegraded":"2024-08-09T00:40:53.181967+0000","last_fullsized":"2024-08-09T00:40:53.181967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.181758+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.181758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:41:27.166441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'151","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.423729+0000","last_change":"2024-08-09T00:41:17.423805+0000","last_active":"2024-08-09T00:41:17.423729+0000","last_peered":"2024-08-09T00:41:17.423729+0000","last_clean":"2024-08-09T00:41:17.423729+0000","last_became_active":"2024-08-08T23:28:30.782806+0000","last_became_peered":"2024-08-08T23:28:30.782806+0000","last_unstale":"2024-08-09T00:41:17.423729+0000","last_undegraded":"2024-08-09T00:41:17.423729+0000","last_fullsized":"2024-08-09T00:41:17.423729+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-08-09T00:41:17.423542+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-08-09T00:41:17.423542+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.423542+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:16:21.114570+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5295,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":256,"num_write":102,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.323741+0000","last_change":"2024-08-09T00:40:58.323795+0000","last_active":"2024-08-09T00:40:58.323741+0000","last_peered":"2024-08-09T00:40:58.323741+0000","last_clean":"2024-08-09T00:40:58.323741+0000","last_became_active":"2024-08-08T23:28:32.799218+0000","last_became_peered":"2024-08-08T23:28:32.799218+0000","last_unstale":"2024-08-09T00:40:58.323741+0000","last_undegraded":"2024-08-09T00:40:58.323741+0000","last_fullsized":"2024-08-09T00:40:58.323741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.323537+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.323537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:26:08.678263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'96","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.048389+0000","last_change":"2024-08-09T00:40:54.048389+0000","last_active":"2024-08-09T00:40:54.048389+0000","last_peered":"2024-08-09T00:40:54.048389+0000","last_clean":"2024-08-09T00:40:54.048389+0000","last_became_active":"2024-08-08T23:28:34.828245+0000","last_became_peered":"2024-08-08T23:28:34.828245+0000","last_unstale":"2024-08-09T00:40:54.048389+0000","last_undegraded":"2024-08-09T00:40:54.048389+0000","last_fullsized":"2024-08-09T00:40:54.048389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-08-09T00:40:54.048139+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.048139+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:06.586071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":98,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'227","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.085887+0000","last_change":"2024-08-09T00:40:55.085952+0000","last_active":"2024-08-09T00:40:55.085887+0000","last_peered":"2024-08-09T00:40:55.085887+0000","last_clean":"2024-08-09T00:40:55.085887+0000","last_became_active":"2024-08-08T23:28:26.773885+0000","last_became_peered":"2024-08-08T23:28:26.773885+0000","last_unstale":"2024-08-09T00:40:55.085887+0000","last_undegraded":"2024-08-09T00:40:55.085887+0000","last_fullsized":"2024-08-09T00:40:55.085887+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:55.085694+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.085694+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:46:56.426782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":871,"num_read_kb":686,"num_write":336,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'160","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.612481+0000","last_change":"2024-08-09T00:41:11.612660+0000","last_active":"2024-08-09T00:41:11.612481+0000","last_peered":"2024-08-09T00:41:11.612481+0000","last_clean":"2024-08-09T00:41:11.612481+0000","last_became_active":"2024-08-08T23:28:24.822341+0000","last_became_peered":"2024-08-08T23:28:24.822341+0000","last_unstale":"2024-08-09T00:41:11.612481+0000","last_undegraded":"2024-08-09T00:41:11.612481+0000","last_fullsized":"2024-08-09T00:41:11.612481+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:11.612149+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.612149+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:12:01.762322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317190,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":142181,"num_write":944,"num_write_kb":21442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.214568+0000","last_change":"2024-08-09T00:40:51.214679+0000","last_active":"2024-08-09T00:40:51.214568+0000","last_peered":"2024-08-09T00:40:51.214568+0000","last_clean":"2024-08-09T00:40:51.214568+0000","last_became_active":"2024-08-08T23:28:28.774474+0000","last_became_peered":"2024-08-08T23:28:28.774474+0000","last_unstale":"2024-08-09T00:40:51.214568+0000","last_undegraded":"2024-08-09T00:40:51.214568+0000","last_fullsized":"2024-08-09T00:40:51.214568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:51.214333+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.214333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:45:12.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'220","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.628479+0000","last_change":"2024-08-09T00:41:14.628557+0000","last_active":"2024-08-09T00:41:14.628479+0000","last_peered":"2024-08-09T00:41:14.628479+0000","last_clean":"2024-08-09T00:41:14.628479+0000","last_became_active":"2024-08-08T23:28:30.781154+0000","last_became_peered":"2024-08-08T23:28:30.781154+0000","last_unstale":"2024-08-09T00:41:14.628479+0000","last_undegraded":"2024-08-09T00:41:14.628479+0000","last_fullsized":"2024-08-09T00:41:14.628479+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'220","last_scrub_stamp":"2024-08-09T00:41:14.628292+0000","last_deep_scrub":"268'220","last_deep_scrub_stamp":"2024-08-09T00:41:14.628292+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.628292+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:03:57.553638+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":290,"num_read_kb":376,"num_write":174,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'509","reported_seq":4406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.601435+0000","last_change":"2024-08-09T00:40:57.601465+0000","last_active":"2024-08-09T00:40:57.601435+0000","last_peered":"2024-08-09T00:40:57.601435+0000","last_clean":"2024-08-09T00:40:57.601435+0000","last_became_active":"2024-08-08T23:28:32.821134+0000","last_became_peered":"2024-08-08T23:28:32.821134+0000","last_unstale":"2024-08-09T00:40:57.601435+0000","last_undegraded":"2024-08-09T00:40:57.601435+0000","last_fullsized":"2024-08-09T00:40:57.601435+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'509","last_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_deep_scrub":"268'509","last_deep_scrub_stamp":"2024-08-09T00:40:57.601327+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.601327+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:05:46.941619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'112","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.643203+0000","last_change":"2024-08-09T00:40:47.643278+0000","last_active":"2024-08-09T00:40:47.643203+0000","last_peered":"2024-08-09T00:40:47.643203+0000","last_clean":"2024-08-09T00:40:47.643203+0000","last_became_active":"2024-08-08T23:28:34.836537+0000","last_became_peered":"2024-08-08T23:28:34.836537+0000","last_unstale":"2024-08-09T00:40:47.643203+0000","last_undegraded":"2024-08-09T00:40:47.643203+0000","last_fullsized":"2024-08-09T00:40:47.643203+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:40:47.643006+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.643006+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:42.442342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":249,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'111","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.557711+0000","last_change":"2024-08-09T00:41:17.557829+0000","last_active":"2024-08-09T00:41:17.557711+0000","last_peered":"2024-08-09T00:41:17.557711+0000","last_clean":"2024-08-09T00:41:17.557711+0000","last_became_active":"2024-08-08T23:28:26.756150+0000","last_became_peered":"2024-08-08T23:28:26.756150+0000","last_unstale":"2024-08-09T00:41:17.557711+0000","last_undegraded":"2024-08-09T00:41:17.557711+0000","last_fullsized":"2024-08-09T00:41:17.557711+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-08-09T00:41:17.557428+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-08-09T00:41:17.557428+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.557428+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:39:51.254540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":397,"num_write":157,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'251","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.076928+0000","last_change":"2024-08-09T00:41:03.077035+0000","last_active":"2024-08-09T00:41:03.076928+0000","last_peered":"2024-08-09T00:41:03.076928+0000","last_clean":"2024-08-09T00:41:03.076928+0000","last_became_active":"2024-08-08T23:28:24.818375+0000","last_became_peered":"2024-08-08T23:28:24.818375+0000","last_unstale":"2024-08-09T00:41:03.076928+0000","last_undegraded":"2024-08-09T00:41:03.076928+0000","last_fullsized":"2024-08-09T00:41:03.076928+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-08-09T00:41:03.076723+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.076723+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:34:28.543793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":20334,"num_write":1169,"num_write_kb":48496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"268'4","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.236924+0000","last_change":"2024-08-09T00:40:47.236992+0000","last_active":"2024-08-09T00:40:47.236924+0000","last_peered":"2024-08-09T00:40:47.236924+0000","last_clean":"2024-08-09T00:40:47.236924+0000","last_became_active":"2024-08-08T23:28:28.779176+0000","last_became_peered":"2024-08-08T23:28:28.779176+0000","last_unstale":"2024-08-09T00:40:47.236924+0000","last_undegraded":"2024-08-09T00:40:47.236924+0000","last_fullsized":"2024-08-09T00:40:47.236924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:40:47.236732+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.236732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:54.921678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":486,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'259","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.485689+0000","last_change":"2024-08-09T00:41:14.485837+0000","last_active":"2024-08-09T00:41:14.485689+0000","last_peered":"2024-08-09T00:41:14.485689+0000","last_clean":"2024-08-09T00:41:14.485689+0000","last_became_active":"2024-08-08T23:28:30.788156+0000","last_became_peered":"2024-08-08T23:28:30.788156+0000","last_unstale":"2024-08-09T00:41:14.485689+0000","last_undegraded":"2024-08-09T00:41:14.485689+0000","last_fullsized":"2024-08-09T00:41:14.485689+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'259","last_scrub_stamp":"2024-08-09T00:41:14.485409+0000","last_deep_scrub":"268'259","last_deep_scrub_stamp":"2024-08-09T00:41:14.485409+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.485409+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:01:09.094447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41629,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":365,"num_read_kb":626,"num_write":204,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.251368+0000","last_change":"2024-08-09T00:40:38.251420+0000","last_active":"2024-08-09T00:40:38.251368+0000","last_peered":"2024-08-09T00:40:38.251368+0000","last_clean":"2024-08-09T00:40:38.251368+0000","last_became_active":"2024-08-08T23:28:32.807594+0000","last_became_peered":"2024-08-08T23:28:32.807594+0000","last_unstale":"2024-08-09T00:40:38.251368+0000","last_undegraded":"2024-08-09T00:40:38.251368+0000","last_fullsized":"2024-08-09T00:40:38.251368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:38.251160+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.251160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:52:01.992409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'103","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.716990+0000","last_change":"2024-08-09T00:40:44.717155+0000","last_active":"2024-08-09T00:40:44.716990+0000","last_peered":"2024-08-09T00:40:44.716990+0000","last_clean":"2024-08-09T00:40:44.716990+0000","last_became_active":"2024-08-08T23:28:34.832896+0000","last_became_peered":"2024-08-08T23:28:34.832896+0000","last_unstale":"2024-08-09T00:40:44.716990+0000","last_undegraded":"2024-08-09T00:40:44.716990+0000","last_fullsized":"2024-08-09T00:40:44.716990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-08-09T00:40:44.716722+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.716722+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.554310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":111,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'326","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.298441+0000","last_change":"2024-08-09T00:41:14.298501+0000","last_active":"2024-08-09T00:41:14.298441+0000","last_peered":"2024-08-09T00:41:14.298441+0000","last_clean":"2024-08-09T00:41:14.298441+0000","last_became_active":"2024-08-08T23:28:26.758995+0000","last_became_peered":"2024-08-08T23:28:26.758995+0000","last_unstale":"2024-08-09T00:41:14.298441+0000","last_undegraded":"2024-08-09T00:41:14.298441+0000","last_fullsized":"2024-08-09T00:41:14.298441+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'326","last_scrub_stamp":"2024-08-09T00:41:14.298245+0000","last_deep_scrub":"268'326","last_deep_scrub_stamp":"2024-08-09T00:41:14.298245+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.298245+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:39:53.762309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1442,"num_read_kb":1169,"num_write":619,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'169","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.205826+0000","last_change":"2024-08-09T00:40:52.205935+0000","last_active":"2024-08-09T00:40:52.205826+0000","last_peered":"2024-08-09T00:40:52.205826+0000","last_clean":"2024-08-09T00:40:52.205826+0000","last_became_active":"2024-08-08T23:30:01.783093+0000","last_became_peered":"2024-08-08T23:30:01.783093+0000","last_unstale":"2024-08-09T00:40:52.205826+0000","last_undegraded":"2024-08-09T00:40:52.205826+0000","last_fullsized":"2024-08-09T00:40:52.205826+0000","mapping_epoch":40,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'169","last_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_deep_scrub":"268'169","last_deep_scrub_stamp":"2024-08-09T00:40:52.205600+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.205600+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:28:53.896377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055036,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":365,"num_read_kb":5320,"num_write":980,"num_write_kb":21939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.203522+0000","last_change":"2024-08-09T00:40:45.203576+0000","last_active":"2024-08-09T00:40:45.203522+0000","last_peered":"2024-08-09T00:40:45.203522+0000","last_clean":"2024-08-09T00:40:45.203522+0000","last_became_active":"2024-08-08T23:28:28.779700+0000","last_became_peered":"2024-08-08T23:28:28.779700+0000","last_unstale":"2024-08-09T00:40:45.203522+0000","last_undegraded":"2024-08-09T00:40:45.203522+0000","last_fullsized":"2024-08-09T00:40:45.203522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.203322+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.203322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:04:32.071267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'181","reported_seq":799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.169556+0000","last_change":"2024-08-09T00:41:06.169635+0000","last_active":"2024-08-09T00:41:06.169556+0000","last_peered":"2024-08-09T00:41:06.169556+0000","last_clean":"2024-08-09T00:41:06.169556+0000","last_became_active":"2024-08-08T23:28:30.783639+0000","last_became_peered":"2024-08-08T23:28:30.783639+0000","last_unstale":"2024-08-09T00:41:06.169556+0000","last_undegraded":"2024-08-09T00:41:06.169556+0000","last_fullsized":"2024-08-09T00:41:06.169556+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-08-09T00:41:06.169361+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.169361+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:50:46.582796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8780,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":256,"num_read_kb":313,"num_write":192,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15128,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.587144+0000","last_change":"2024-08-09T00:40:54.587207+0000","last_active":"2024-08-09T00:40:54.587144+0000","last_peered":"2024-08-09T00:40:54.587144+0000","last_clean":"2024-08-09T00:40:54.587144+0000","last_became_active":"2024-08-08T23:28:32.824920+0000","last_became_peered":"2024-08-08T23:28:32.824920+0000","last_unstale":"2024-08-09T00:40:54.587144+0000","last_undegraded":"2024-08-09T00:40:54.587144+0000","last_fullsized":"2024-08-09T00:40:54.587144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.586925+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:08:32.403866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'138","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.387779+0000","last_change":"2024-08-09T00:40:45.387779+0000","last_active":"2024-08-09T00:40:45.387779+0000","last_peered":"2024-08-09T00:40:45.387779+0000","last_clean":"2024-08-09T00:40:45.387779+0000","last_became_active":"2024-08-08T23:28:34.835599+0000","last_became_peered":"2024-08-08T23:28:34.835599+0000","last_unstale":"2024-08-09T00:40:45.387779+0000","last_undegraded":"2024-08-09T00:40:45.387779+0000","last_fullsized":"2024-08-09T00:40:45.387779+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-08-09T00:40:45.387511+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.387511+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:00:18.812396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":183,"num_write":322,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'186","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.998987+0000","last_change":"2024-08-09T00:40:58.999056+0000","last_active":"2024-08-09T00:40:58.998987+0000","last_peered":"2024-08-09T00:40:58.998987+0000","last_clean":"2024-08-09T00:40:58.998987+0000","last_became_active":"2024-08-08T23:28:26.767200+0000","last_became_peered":"2024-08-08T23:28:26.767200+0000","last_unstale":"2024-08-09T00:40:58.998987+0000","last_undegraded":"2024-08-09T00:40:58.998987+0000","last_fullsized":"2024-08-09T00:40:58.998987+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'186","last_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_deep_scrub":"268'186","last_deep_scrub_stamp":"2024-08-09T00:40:58.998783+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.998783+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:06:38.911931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":626,"num_write":281,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'205","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.221223+0000","last_change":"2024-08-09T00:41:00.221455+0000","last_active":"2024-08-09T00:41:00.221223+0000","last_peered":"2024-08-09T00:41:00.221223+0000","last_clean":"2024-08-09T00:41:00.221223+0000","last_became_active":"2024-08-08T23:28:24.766620+0000","last_became_peered":"2024-08-08T23:28:24.766620+0000","last_unstale":"2024-08-09T00:41:00.221223+0000","last_undegraded":"2024-08-09T00:41:00.221223+0000","last_fullsized":"2024-08-09T00:41:00.221223+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:00.220981+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.220981+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:30:00.213193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":34331,"num_write":1087,"num_write_kb":37896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.794304+0000","last_change":"2024-08-09T00:40:49.794358+0000","last_active":"2024-08-09T00:40:49.794304+0000","last_peered":"2024-08-09T00:40:49.794304+0000","last_clean":"2024-08-09T00:40:49.794304+0000","last_became_active":"2024-08-08T23:28:28.776364+0000","last_became_peered":"2024-08-08T23:28:28.776364+0000","last_unstale":"2024-08-09T00:40:49.794304+0000","last_undegraded":"2024-08-09T00:40:49.794304+0000","last_fullsized":"2024-08-09T00:40:49.794304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.794107+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.794107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:38:44.283341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'204","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.244661+0000","last_change":"2024-08-09T00:40:41.244661+0000","last_active":"2024-08-09T00:40:41.244661+0000","last_peered":"2024-08-09T00:40:41.244661+0000","last_clean":"2024-08-09T00:40:41.244661+0000","last_became_active":"2024-08-08T23:28:30.782945+0000","last_became_peered":"2024-08-08T23:28:30.782945+0000","last_unstale":"2024-08-09T00:40:41.244661+0000","last_undegraded":"2024-08-09T00:40:41.244661+0000","last_fullsized":"2024-08-09T00:40:41.244661+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'204","last_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_deep_scrub":"268'204","last_deep_scrub_stamp":"2024-08-09T00:40:41.244364+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.244364+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:04:23.051092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14461,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":384,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'493","reported_seq":2267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.206039+0000","last_change":"2024-08-09T00:40:39.206104+0000","last_active":"2024-08-09T00:40:39.206039+0000","last_peered":"2024-08-09T00:40:39.206039+0000","last_clean":"2024-08-09T00:40:39.206039+0000","last_became_active":"2024-08-08T23:28:32.805594+0000","last_became_peered":"2024-08-08T23:28:32.805594+0000","last_unstale":"2024-08-09T00:40:39.206039+0000","last_undegraded":"2024-08-09T00:40:39.206039+0000","last_fullsized":"2024-08-09T00:40:39.206039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'493","last_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_deep_scrub":"268'493","last_deep_scrub_stamp":"2024-08-09T00:40:39.205835+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.205835+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:20:27.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'124","reported_seq":643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.732680+0000","last_change":"2024-08-09T00:40:43.732680+0000","last_active":"2024-08-09T00:40:43.732680+0000","last_peered":"2024-08-09T00:40:43.732680+0000","last_clean":"2024-08-09T00:40:43.732680+0000","last_became_active":"2024-08-08T23:28:34.836075+0000","last_became_peered":"2024-08-08T23:28:34.836075+0000","last_unstale":"2024-08-09T00:40:43.732680+0000","last_undegraded":"2024-08-09T00:40:43.732680+0000","last_fullsized":"2024-08-09T00:40:43.732680+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-08-09T00:40:43.732377+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.732377+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:05:57.582089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":109,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'197","reported_seq":787,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.989260+0000","last_change":"2024-08-09T00:40:53.989319+0000","last_active":"2024-08-09T00:40:53.989260+0000","last_peered":"2024-08-09T00:40:53.989260+0000","last_clean":"2024-08-09T00:40:53.989260+0000","last_became_active":"2024-08-08T23:28:26.778636+0000","last_became_peered":"2024-08-08T23:28:26.778636+0000","last_unstale":"2024-08-09T00:40:53.989260+0000","last_undegraded":"2024-08-09T00:40:53.989260+0000","last_fullsized":"2024-08-09T00:40:53.989260+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'197","last_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_deep_scrub":"268'197","last_deep_scrub_stamp":"2024-08-09T00:40:53.989031+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.989031+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:30.597692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":789,"num_read_kb":609,"num_write":349,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'205","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.230060+0000","last_change":"2024-08-09T00:41:09.230142+0000","last_active":"2024-08-09T00:41:09.230060+0000","last_peered":"2024-08-09T00:41:09.230060+0000","last_clean":"2024-08-09T00:41:09.230060+0000","last_became_active":"2024-08-08T23:28:24.789274+0000","last_became_peered":"2024-08-08T23:28:24.789274+0000","last_unstale":"2024-08-09T00:41:09.230060+0000","last_undegraded":"2024-08-09T00:41:09.230060+0000","last_fullsized":"2024-08-09T00:41:09.230060+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:09.229867+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.229867+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:53:34.348554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":23703,"num_write":1091,"num_write_kb":31974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.199719+0000","last_change":"2024-08-09T00:41:18.199796+0000","last_active":"2024-08-09T00:41:18.199719+0000","last_peered":"2024-08-09T00:41:18.199719+0000","last_clean":"2024-08-09T00:41:18.199719+0000","last_became_active":"2024-08-08T23:28:28.775449+0000","last_became_peered":"2024-08-08T23:28:28.775449+0000","last_unstale":"2024-08-09T00:41:18.199719+0000","last_undegraded":"2024-08-09T00:41:18.199719+0000","last_fullsized":"2024-08-09T00:41:18.199719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-08-09T00:41:18.199530+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-08-09T00:41:18.199530+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.199530+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:48:03.616448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":638,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'110","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.302700+0000","last_change":"2024-08-09T00:41:00.302779+0000","last_active":"2024-08-09T00:41:00.302700+0000","last_peered":"2024-08-09T00:41:00.302700+0000","last_clean":"2024-08-09T00:41:00.302700+0000","last_became_active":"2024-08-08T23:28:31.047316+0000","last_became_peered":"2024-08-08T23:28:31.047316+0000","last_unstale":"2024-08-09T00:41:00.302700+0000","last_undegraded":"2024-08-09T00:41:00.302700+0000","last_fullsized":"2024-08-09T00:41:00.302700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-08-09T00:41:00.302528+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.302528+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:36.655301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'500","reported_seq":2270,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.915039+0000","last_change":"2024-08-09T00:40:41.915107+0000","last_active":"2024-08-09T00:40:41.915039+0000","last_peered":"2024-08-09T00:40:41.915039+0000","last_clean":"2024-08-09T00:40:41.915039+0000","last_became_active":"2024-08-08T23:28:32.813438+0000","last_became_peered":"2024-08-08T23:28:32.813438+0000","last_unstale":"2024-08-09T00:40:41.915039+0000","last_undegraded":"2024-08-09T00:40:41.915039+0000","last_fullsized":"2024-08-09T00:40:41.915039+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:41.914818+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.914818+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:01:19.244826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'118","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.954144+0000","last_change":"2024-08-09T00:40:39.954144+0000","last_active":"2024-08-09T00:40:39.954144+0000","last_peered":"2024-08-09T00:40:39.954144+0000","last_clean":"2024-08-09T00:40:39.954144+0000","last_became_active":"2024-08-08T23:28:34.831638+0000","last_became_peered":"2024-08-08T23:28:34.831638+0000","last_unstale":"2024-08-09T00:40:39.954144+0000","last_undegraded":"2024-08-09T00:40:39.954144+0000","last_fullsized":"2024-08-09T00:40:39.954144+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:39.953890+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.953890+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:35:41.399127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":95,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'462","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.925537+0000","last_change":"2024-08-09T00:41:10.925665+0000","last_active":"2024-08-09T00:41:10.925537+0000","last_peered":"2024-08-09T00:41:10.925537+0000","last_clean":"2024-08-09T00:41:10.925537+0000","last_became_active":"2024-08-08T23:28:26.761791+0000","last_became_peered":"2024-08-08T23:28:26.761791+0000","last_unstale":"2024-08-09T00:41:10.925537+0000","last_undegraded":"2024-08-09T00:41:10.925537+0000","last_fullsized":"2024-08-09T00:41:10.925537+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-08-09T00:41:10.925280+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.925280+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:54:19.284724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1799,"num_read_kb":1425,"num_write":693,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'181","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:27.479868+0000","last_change":"2024-08-09T00:41:27.479963+0000","last_active":"2024-08-09T00:41:27.479868+0000","last_peered":"2024-08-09T00:41:27.479868+0000","last_clean":"2024-08-09T00:41:27.479868+0000","last_became_active":"2024-08-08T23:28:24.793159+0000","last_became_peered":"2024-08-08T23:28:24.793159+0000","last_unstale":"2024-08-09T00:41:27.479868+0000","last_undegraded":"2024-08-09T00:41:27.479868+0000","last_fullsized":"2024-08-09T00:41:27.479868+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'181","last_scrub_stamp":"2024-08-09T00:41:27.479664+0000","last_deep_scrub":"268'181","last_deep_scrub_stamp":"2024-08-09T00:41:27.479664+0000","last_clean_scrub_stamp":"2024-08-09T00:41:27.479664+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:16:21.169759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":4543,"num_write":1045,"num_write_kb":23713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.129849+0000","last_change":"2024-08-09T00:41:04.129954+0000","last_active":"2024-08-09T00:41:04.129849+0000","last_peered":"2024-08-09T00:41:04.129849+0000","last_clean":"2024-08-09T00:41:04.129849+0000","last_became_active":"2024-08-08T23:28:28.778021+0000","last_became_peered":"2024-08-08T23:28:28.778021+0000","last_unstale":"2024-08-09T00:41:04.129849+0000","last_undegraded":"2024-08-09T00:41:04.129849+0000","last_fullsized":"2024-08-09T00:41:04.129849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.129554+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.129554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:54:45.978812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'311","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.290776+0000","last_change":"2024-08-09T00:40:50.290869+0000","last_active":"2024-08-09T00:40:50.290776+0000","last_peered":"2024-08-09T00:40:50.290776+0000","last_clean":"2024-08-09T00:40:50.290776+0000","last_became_active":"2024-08-08T23:28:30.775922+0000","last_became_peered":"2024-08-08T23:28:30.775922+0000","last_unstale":"2024-08-09T00:40:50.290776+0000","last_undegraded":"2024-08-09T00:40:50.290776+0000","last_fullsized":"2024-08-09T00:40:50.290776+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-08-09T00:40:50.290582+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.290582+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:57.971956+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4645,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":996,"num_read_kb":1052,"num_write":1534,"num_write_kb":1360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455368,"num_omap_keys":1106,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.917979+0000","last_change":"2024-08-09T00:40:45.918031+0000","last_active":"2024-08-09T00:40:45.917979+0000","last_peered":"2024-08-09T00:40:45.917979+0000","last_clean":"2024-08-09T00:40:45.917979+0000","last_became_active":"2024-08-08T23:28:32.820727+0000","last_became_peered":"2024-08-08T23:28:32.820727+0000","last_unstale":"2024-08-09T00:40:45.917979+0000","last_undegraded":"2024-08-09T00:40:45.917979+0000","last_fullsized":"2024-08-09T00:40:45.917979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.917777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.917777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:46:24.483454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'106","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.933187+0000","last_change":"2024-08-09T00:41:11.933187+0000","last_active":"2024-08-09T00:41:11.933187+0000","last_peered":"2024-08-09T00:41:11.933187+0000","last_clean":"2024-08-09T00:41:11.933187+0000","last_became_active":"2024-08-08T23:28:34.821818+0000","last_became_peered":"2024-08-08T23:28:34.821818+0000","last_unstale":"2024-08-09T00:41:11.933187+0000","last_undegraded":"2024-08-09T00:41:11.933187+0000","last_fullsized":"2024-08-09T00:41:11.933187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'106","last_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_deep_scrub":"268'106","last_deep_scrub_stamp":"2024-08-09T00:41:11.932938+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.932938+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:03:35.742761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":229,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'170","reported_seq":810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.934023+0000","last_change":"2024-08-09T00:40:50.934023+0000","last_active":"2024-08-09T00:40:50.934023+0000","last_peered":"2024-08-09T00:40:50.934023+0000","last_clean":"2024-08-09T00:40:50.934023+0000","last_became_active":"2024-08-08T23:28:26.782104+0000","last_became_peered":"2024-08-08T23:28:26.782104+0000","last_unstale":"2024-08-09T00:40:50.934023+0000","last_undegraded":"2024-08-09T00:40:50.934023+0000","last_fullsized":"2024-08-09T00:40:50.934023+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'170","last_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_deep_scrub":"268'170","last_deep_scrub_stamp":"2024-08-09T00:40:50.933771+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.933771+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:53:51.224009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":703,"num_read_kb":565,"num_write":253,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'163","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.679838+0000","last_change":"2024-08-09T00:41:18.679915+0000","last_active":"2024-08-09T00:41:18.679838+0000","last_peered":"2024-08-09T00:41:18.679838+0000","last_clean":"2024-08-09T00:41:18.679838+0000","last_became_active":"2024-08-08T23:28:10.063656+0000","last_became_peered":"2024-08-08T23:28:10.063656+0000","last_unstale":"2024-08-09T00:41:18.679838+0000","last_undegraded":"2024-08-09T00:41:18.679838+0000","last_fullsized":"2024-08-09T00:41:18.679838+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-08-09T00:41:18.679647+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-08-09T00:41:18.679647+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.679647+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:57:36.387779+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.107390+0000","last_change":"2024-08-09T00:41:10.107390+0000","last_active":"2024-08-09T00:41:10.107390+0000","last_peered":"2024-08-09T00:41:10.107390+0000","last_clean":"2024-08-09T00:41:10.107390+0000","last_became_active":"2024-08-08T23:28:14.788551+0000","last_became_peered":"2024-08-08T23:28:14.788551+0000","last_unstale":"2024-08-09T00:41:10.107390+0000","last_undegraded":"2024-08-09T00:41:10.107390+0000","last_fullsized":"2024-08-09T00:41:10.107390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:41:10.107011+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.107011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:17.872841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00074356800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'173","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.439898+0000","last_change":"2024-08-09T00:41:20.439898+0000","last_active":"2024-08-09T00:41:20.439898+0000","last_peered":"2024-08-09T00:41:20.439898+0000","last_clean":"2024-08-09T00:41:20.439898+0000","last_became_active":"2024-08-08T23:28:24.807421+0000","last_became_peered":"2024-08-08T23:28:24.807421+0000","last_unstale":"2024-08-09T00:41:20.439898+0000","last_undegraded":"2024-08-09T00:41:20.439898+0000","last_fullsized":"2024-08-09T00:41:20.439898+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'173","last_scrub_stamp":"2024-08-09T00:41:20.439472+0000","last_deep_scrub":"268'173","last_deep_scrub_stamp":"2024-08-09T00:41:20.439472+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.439472+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:17.526348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":19880,"num_write":949,"num_write_kb":16396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.569554+0000","last_change":"2024-08-09T00:41:06.569554+0000","last_active":"2024-08-09T00:41:06.569554+0000","last_peered":"2024-08-09T00:41:06.569554+0000","last_clean":"2024-08-09T00:41:06.569554+0000","last_became_active":"2024-08-08T23:28:28.784310+0000","last_became_peered":"2024-08-08T23:28:28.784310+0000","last_unstale":"2024-08-09T00:41:06.569554+0000","last_undegraded":"2024-08-09T00:41:06.569554+0000","last_fullsized":"2024-08-09T00:41:06.569554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.569203+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.569203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:21:04.865756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'338","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276959+0000","last_change":"2024-08-09T00:40:49.277114+0000","last_active":"2024-08-09T00:40:49.276959+0000","last_peered":"2024-08-09T00:40:49.276959+0000","last_clean":"2024-08-09T00:40:49.276959+0000","last_became_active":"2024-08-08T23:28:30.787443+0000","last_became_peered":"2024-08-08T23:28:30.787443+0000","last_unstale":"2024-08-09T00:40:49.276959+0000","last_undegraded":"2024-08-09T00:40:49.276959+0000","last_fullsized":"2024-08-09T00:40:49.276959+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-08-09T00:40:49.276690+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.276690+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:18:38.872577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":648,"num_read_kb":915,"num_write":594,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94900,"num_omap_keys":244,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.558455+0000","last_change":"2024-08-09T00:40:58.558566+0000","last_active":"2024-08-09T00:40:58.558455+0000","last_peered":"2024-08-09T00:40:58.558455+0000","last_clean":"2024-08-09T00:40:58.558455+0000","last_became_active":"2024-08-08T23:28:32.820913+0000","last_became_peered":"2024-08-08T23:28:32.820913+0000","last_unstale":"2024-08-09T00:40:58.558455+0000","last_undegraded":"2024-08-09T00:40:58.558455+0000","last_fullsized":"2024-08-09T00:40:58.558455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.558180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.558180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:05:29.719057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'208","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.967571+0000","last_change":"2024-08-09T00:40:51.967654+0000","last_active":"2024-08-09T00:40:51.967571+0000","last_peered":"2024-08-09T00:40:51.967571+0000","last_clean":"2024-08-09T00:40:51.967571+0000","last_became_active":"2024-08-08T23:28:34.826625+0000","last_became_peered":"2024-08-08T23:28:34.826625+0000","last_unstale":"2024-08-09T00:40:51.967571+0000","last_undegraded":"2024-08-09T00:40:51.967571+0000","last_fullsized":"2024-08-09T00:40:51.967571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:40:51.967362+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.967362+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:19:16.020869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":410,"num_read_kb":407,"num_write":428,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'189","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.502099+0000","last_change":"2024-08-09T00:41:07.502233+0000","last_active":"2024-08-09T00:41:07.502099+0000","last_peered":"2024-08-09T00:41:07.502099+0000","last_clean":"2024-08-09T00:41:07.502099+0000","last_became_active":"2024-08-08T23:28:26.773629+0000","last_became_peered":"2024-08-08T23:28:26.773629+0000","last_unstale":"2024-08-09T00:41:07.502099+0000","last_undegraded":"2024-08-09T00:41:07.502099+0000","last_fullsized":"2024-08-09T00:41:07.502099+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:07.501849+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.501849+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:29:58.986880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":579,"num_write":301,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.713717+0000","last_change":"2024-08-09T00:41:19.713772+0000","last_active":"2024-08-09T00:41:19.713717+0000","last_peered":"2024-08-09T00:41:19.713717+0000","last_clean":"2024-08-09T00:41:19.713717+0000","last_became_active":"2024-08-08T23:28:14.789784+0000","last_became_peered":"2024-08-08T23:28:14.789784+0000","last_unstale":"2024-08-09T00:41:19.713717+0000","last_undegraded":"2024-08-09T00:41:19.713717+0000","last_fullsized":"2024-08-09T00:41:19.713717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:19.713516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:19.713516+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.713516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:54.949292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073531699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'203","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.597277+0000","last_change":"2024-08-09T00:41:18.597277+0000","last_active":"2024-08-09T00:41:18.597277+0000","last_peered":"2024-08-09T00:41:18.597277+0000","last_clean":"2024-08-09T00:41:18.597277+0000","last_became_active":"2024-08-08T23:28:24.765738+0000","last_became_peered":"2024-08-08T23:28:24.765738+0000","last_unstale":"2024-08-09T00:41:18.597277+0000","last_undegraded":"2024-08-09T00:41:18.597277+0000","last_fullsized":"2024-08-09T00:41:18.597277+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-08-09T00:41:18.596993+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-08-09T00:41:18.596993+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.596993+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:04:41.844385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":17063,"num_write":1110,"num_write_kb":43307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.082039+0000","last_change":"2024-08-09T00:41:06.082096+0000","last_active":"2024-08-09T00:41:06.082039+0000","last_peered":"2024-08-09T00:41:06.082039+0000","last_clean":"2024-08-09T00:41:06.082039+0000","last_became_active":"2024-08-08T23:28:28.770997+0000","last_became_peered":"2024-08-08T23:28:28.770997+0000","last_unstale":"2024-08-09T00:41:06.082039+0000","last_undegraded":"2024-08-09T00:41:06.082039+0000","last_fullsized":"2024-08-09T00:41:06.082039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.081818+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.081818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:57:09.834674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'701","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.822263+0000","last_change":"2024-08-09T00:40:51.822263+0000","last_active":"2024-08-09T00:40:51.822263+0000","last_peered":"2024-08-09T00:40:51.822263+0000","last_clean":"2024-08-09T00:40:51.822263+0000","last_became_active":"2024-08-08T23:28:30.773635+0000","last_became_peered":"2024-08-08T23:28:30.773635+0000","last_unstale":"2024-08-09T00:40:51.822263+0000","last_undegraded":"2024-08-09T00:40:51.822263+0000","last_fullsized":"2024-08-09T00:40:51.822263+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'701","last_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_deep_scrub":"268'701","last_deep_scrub_stamp":"2024-08-09T00:40:51.821968+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.821968+0000","objects_scrubbed":12,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:22:09.857257+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33400,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1006,"num_read_kb":1225,"num_write":322,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5370,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.635028+0000","last_change":"2024-08-09T00:40:58.635028+0000","last_active":"2024-08-09T00:40:58.635028+0000","last_peered":"2024-08-09T00:40:58.635028+0000","last_clean":"2024-08-09T00:40:58.635028+0000","last_became_active":"2024-08-08T23:28:32.808665+0000","last_became_peered":"2024-08-08T23:28:32.808665+0000","last_unstale":"2024-08-09T00:40:58.635028+0000","last_undegraded":"2024-08-09T00:40:58.635028+0000","last_fullsized":"2024-08-09T00:40:58.635028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.634757+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.634757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:48:18.077124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'131","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.756535+0000","last_change":"2024-08-09T00:40:46.756610+0000","last_active":"2024-08-09T00:40:46.756535+0000","last_peered":"2024-08-09T00:40:46.756535+0000","last_clean":"2024-08-09T00:40:46.756535+0000","last_became_active":"2024-08-08T23:28:34.824298+0000","last_became_peered":"2024-08-08T23:28:34.824298+0000","last_unstale":"2024-08-09T00:40:46.756535+0000","last_undegraded":"2024-08-09T00:40:46.756535+0000","last_fullsized":"2024-08-09T00:40:46.756535+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:46.756345+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.756345+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:00:48.329420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'76","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.844729+0000","last_change":"2024-08-09T00:40:54.844797+0000","last_active":"2024-08-09T00:40:54.844729+0000","last_peered":"2024-08-09T00:40:54.844729+0000","last_clean":"2024-08-09T00:40:54.844729+0000","last_became_active":"2024-08-08T23:28:26.776952+0000","last_became_peered":"2024-08-08T23:28:26.776952+0000","last_unstale":"2024-08-09T00:40:54.844729+0000","last_undegraded":"2024-08-09T00:40:54.844729+0000","last_fullsized":"2024-08-09T00:40:54.844729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'76","last_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_deep_scrub":"268'76","last_deep_scrub_stamp":"2024-08-09T00:40:54.844530+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.844530+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:32:53.737686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":268,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.162874+0000","last_change":"2024-08-09T00:40:54.162874+0000","last_active":"2024-08-09T00:40:54.162874+0000","last_peered":"2024-08-09T00:40:54.162874+0000","last_clean":"2024-08-09T00:40:54.162874+0000","last_became_active":"2024-08-08T23:28:14.791884+0000","last_became_peered":"2024-08-08T23:28:14.791884+0000","last_unstale":"2024-08-09T00:40:54.162874+0000","last_undegraded":"2024-08-09T00:40:54.162874+0000","last_fullsized":"2024-08-09T00:40:54.162874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.162620+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.162620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:55:31.612873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097108000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'159","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.859274+0000","last_change":"2024-08-09T00:41:05.859381+0000","last_active":"2024-08-09T00:41:05.859274+0000","last_peered":"2024-08-09T00:41:05.859274+0000","last_clean":"2024-08-09T00:41:05.859274+0000","last_became_active":"2024-08-08T23:28:24.757198+0000","last_became_peered":"2024-08-08T23:28:24.757198+0000","last_unstale":"2024-08-09T00:41:05.859274+0000","last_undegraded":"2024-08-09T00:41:05.859274+0000","last_fullsized":"2024-08-09T00:41:05.859274+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-08-09T00:41:05.859043+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.859043+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:19:18.467769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5883424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":29266,"num_write":862,"num_write_kb":36874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.201294+0000","last_change":"2024-08-09T00:40:49.201356+0000","last_active":"2024-08-09T00:40:49.201294+0000","last_peered":"2024-08-09T00:40:49.201294+0000","last_clean":"2024-08-09T00:40:49.201294+0000","last_became_active":"2024-08-08T23:28:28.775609+0000","last_became_peered":"2024-08-08T23:28:28.775609+0000","last_unstale":"2024-08-09T00:40:49.201294+0000","last_undegraded":"2024-08-09T00:40:49.201294+0000","last_fullsized":"2024-08-09T00:40:49.201294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:49.201098+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.201098+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:49:48.803444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1687,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.637052+0000","last_change":"2024-08-09T00:41:01.637052+0000","last_active":"2024-08-09T00:41:01.637052+0000","last_peered":"2024-08-09T00:41:01.637052+0000","last_clean":"2024-08-09T00:41:01.637052+0000","last_became_active":"2024-08-08T23:28:31.048445+0000","last_became_peered":"2024-08-08T23:28:31.048445+0000","last_unstale":"2024-08-09T00:41:01.637052+0000","last_undegraded":"2024-08-09T00:41:01.637052+0000","last_fullsized":"2024-08-09T00:41:01.637052+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-08-09T00:41:01.636779+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.636779+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:15.604735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":235,"num_read_kb":225,"num_write":185,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5136,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.615396+0000","last_change":"2024-08-09T00:40:53.615396+0000","last_active":"2024-08-09T00:40:53.615396+0000","last_peered":"2024-08-09T00:40:53.615396+0000","last_clean":"2024-08-09T00:40:53.615396+0000","last_became_active":"2024-08-08T23:28:32.824951+0000","last_became_peered":"2024-08-08T23:28:32.824951+0000","last_unstale":"2024-08-09T00:40:53.615396+0000","last_undegraded":"2024-08-09T00:40:53.615396+0000","last_fullsized":"2024-08-09T00:40:53.615396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.615125+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.615125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:52.741451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'279","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.246939+0000","last_change":"2024-08-09T00:40:48.247034+0000","last_active":"2024-08-09T00:40:48.246939+0000","last_peered":"2024-08-09T00:40:48.246939+0000","last_clean":"2024-08-09T00:40:48.246939+0000","last_became_active":"2024-08-08T23:28:34.829674+0000","last_became_peered":"2024-08-08T23:28:34.829674+0000","last_unstale":"2024-08-09T00:40:48.246939+0000","last_undegraded":"2024-08-09T00:40:48.246939+0000","last_fullsized":"2024-08-09T00:40:48.246939+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-08-09T00:40:48.246734+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.246734+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:27:27.053825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":542,"num_read_kb":557,"num_write":636,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'178","reported_seq":817,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.784216+0000","last_change":"2024-08-09T00:41:02.784216+0000","last_active":"2024-08-09T00:41:02.784216+0000","last_peered":"2024-08-09T00:41:02.784216+0000","last_clean":"2024-08-09T00:41:02.784216+0000","last_became_active":"2024-08-08T23:28:26.761845+0000","last_became_peered":"2024-08-08T23:28:26.761845+0000","last_unstale":"2024-08-09T00:41:02.784216+0000","last_undegraded":"2024-08-09T00:41:02.784216+0000","last_fullsized":"2024-08-09T00:41:02.784216+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-08-09T00:41:02.783953+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.783953+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:12:19.727649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":709,"num_read_kb":577,"num_write":262,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.152649+0000","last_change":"2024-08-09T00:41:11.152649+0000","last_active":"2024-08-09T00:41:11.152649+0000","last_peered":"2024-08-09T00:41:11.152649+0000","last_clean":"2024-08-09T00:41:11.152649+0000","last_became_active":"2024-08-08T23:28:14.790049+0000","last_became_peered":"2024-08-08T23:28:14.790049+0000","last_unstale":"2024-08-09T00:41:11.152649+0000","last_undegraded":"2024-08-09T00:41:11.152649+0000","last_fullsized":"2024-08-09T00:41:11.152649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-08-09T00:41:11.152393+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.152393+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:25:27.137706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023764559999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'200","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.205756+0000","last_change":"2024-08-09T00:41:08.205756+0000","last_active":"2024-08-09T00:41:08.205756+0000","last_peered":"2024-08-09T00:41:08.205756+0000","last_clean":"2024-08-09T00:41:08.205756+0000","last_became_active":"2024-08-08T23:28:24.758976+0000","last_became_peered":"2024-08-08T23:28:24.758976+0000","last_unstale":"2024-08-09T00:41:08.205756+0000","last_undegraded":"2024-08-09T00:41:08.205756+0000","last_fullsized":"2024-08-09T00:41:08.205756+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:08.205439+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.205439+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:55.271838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":7644,"num_write":1044,"num_write_kb":38046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.521794+0000","last_change":"2024-08-09T00:41:04.521794+0000","last_active":"2024-08-09T00:41:04.521794+0000","last_peered":"2024-08-09T00:41:04.521794+0000","last_clean":"2024-08-09T00:41:04.521794+0000","last_became_active":"2024-08-08T23:28:28.777606+0000","last_became_peered":"2024-08-08T23:28:28.777606+0000","last_unstale":"2024-08-09T00:41:04.521794+0000","last_undegraded":"2024-08-09T00:41:04.521794+0000","last_fullsized":"2024-08-09T00:41:04.521794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.521542+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.521542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:51:09.829297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'162","reported_seq":750,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:19.423903+0000","last_change":"2024-08-09T00:41:19.423976+0000","last_active":"2024-08-09T00:41:19.423903+0000","last_peered":"2024-08-09T00:41:19.423903+0000","last_clean":"2024-08-09T00:41:19.423903+0000","last_became_active":"2024-08-08T23:28:30.791915+0000","last_became_peered":"2024-08-08T23:28:30.791915+0000","last_unstale":"2024-08-09T00:41:19.423903+0000","last_undegraded":"2024-08-09T00:41:19.423903+0000","last_fullsized":"2024-08-09T00:41:19.423903+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'162","last_scrub_stamp":"2024-08-09T00:41:19.423715+0000","last_deep_scrub":"268'162","last_deep_scrub_stamp":"2024-08-09T00:41:19.423715+0000","last_clean_scrub_stamp":"2024-08-09T00:41:19.423715+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:31:51.585794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":138,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1542,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.890179+0000","last_change":"2024-08-09T00:40:49.890232+0000","last_active":"2024-08-09T00:40:49.890179+0000","last_peered":"2024-08-09T00:40:49.890179+0000","last_clean":"2024-08-09T00:40:49.890179+0000","last_became_active":"2024-08-08T23:28:32.830544+0000","last_became_peered":"2024-08-08T23:28:32.830544+0000","last_unstale":"2024-08-09T00:40:49.890179+0000","last_undegraded":"2024-08-09T00:40:49.890179+0000","last_fullsized":"2024-08-09T00:40:49.890179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:49.889984+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.889984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:59:45.090932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'114","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.232361+0000","last_change":"2024-08-09T00:40:38.232557+0000","last_active":"2024-08-09T00:40:38.232361+0000","last_peered":"2024-08-09T00:40:38.232361+0000","last_clean":"2024-08-09T00:40:38.232361+0000","last_became_active":"2024-08-08T23:28:34.832957+0000","last_became_peered":"2024-08-08T23:28:34.832957+0000","last_unstale":"2024-08-09T00:40:38.232361+0000","last_undegraded":"2024-08-09T00:40:38.232361+0000","last_fullsized":"2024-08-09T00:40:38.232361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-08-09T00:40:38.232120+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.232120+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:43:00.159201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":142,"num_write":283,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'156","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.776705+0000","last_change":"2024-08-09T00:40:52.776705+0000","last_active":"2024-08-09T00:40:52.776705+0000","last_peered":"2024-08-09T00:40:52.776705+0000","last_clean":"2024-08-09T00:40:52.776705+0000","last_became_active":"2024-08-08T23:28:26.777064+0000","last_became_peered":"2024-08-08T23:28:26.777064+0000","last_unstale":"2024-08-09T00:40:52.776705+0000","last_undegraded":"2024-08-09T00:40:52.776705+0000","last_fullsized":"2024-08-09T00:40:52.776705+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'156","last_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_deep_scrub":"268'156","last_deep_scrub_stamp":"2024-08-09T00:40:52.776448+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.776448+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:40:11.985569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":495,"num_write":248,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'228","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.140445+0000","last_change":"2024-08-09T00:41:13.140445+0000","last_active":"2024-08-09T00:41:13.140445+0000","last_peered":"2024-08-09T00:41:13.140445+0000","last_clean":"2024-08-09T00:41:13.140445+0000","last_became_active":"2024-08-08T23:28:24.788258+0000","last_became_peered":"2024-08-08T23:28:24.788258+0000","last_unstale":"2024-08-09T00:41:13.140445+0000","last_undegraded":"2024-08-09T00:41:13.140445+0000","last_fullsized":"2024-08-09T00:41:13.140445+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'228","last_scrub_stamp":"2024-08-09T00:41:13.140140+0000","last_deep_scrub":"268'228","last_deep_scrub_stamp":"2024-08-09T00:41:13.140140+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.140140+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:10.870347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":62351,"num_write":1160,"num_write_kb":34255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":548,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.839872+0000","last_change":"2024-08-09T00:41:04.839872+0000","last_active":"2024-08-09T00:41:04.839872+0000","last_peered":"2024-08-09T00:41:04.839872+0000","last_clean":"2024-08-09T00:41:04.839872+0000","last_became_active":"2024-08-08T23:28:14.792180+0000","last_became_peered":"2024-08-08T23:28:14.792180+0000","last_unstale":"2024-08-09T00:41:04.839872+0000","last_undegraded":"2024-08-09T00:41:04.839872+0000","last_fullsized":"2024-08-09T00:41:04.839872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:04.839580+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.839580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:09:08.753071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086664299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.493196+0000","last_change":"2024-08-09T00:41:06.493196+0000","last_active":"2024-08-09T00:41:06.493196+0000","last_peered":"2024-08-09T00:41:06.493196+0000","last_clean":"2024-08-09T00:41:06.493196+0000","last_became_active":"2024-08-08T23:28:28.782819+0000","last_became_peered":"2024-08-08T23:28:28.782819+0000","last_unstale":"2024-08-09T00:41:06.493196+0000","last_undegraded":"2024-08-09T00:41:06.493196+0000","last_fullsized":"2024-08-09T00:41:06.493196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:06.492951+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.492951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:59:56.992035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'321","reported_seq":1036,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.453248+0000","last_change":"2024-08-09T00:41:12.453343+0000","last_active":"2024-08-09T00:41:12.453248+0000","last_peered":"2024-08-09T00:41:12.453248+0000","last_clean":"2024-08-09T00:41:12.453248+0000","last_became_active":"2024-08-08T23:28:30.782616+0000","last_became_peered":"2024-08-08T23:28:30.782616+0000","last_unstale":"2024-08-09T00:41:12.453248+0000","last_undegraded":"2024-08-09T00:41:12.453248+0000","last_fullsized":"2024-08-09T00:41:12.453248+0000","mapping_epoch":31,"log_start":"268'301","ondisk_log_start":"268'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-08-09T00:41:12.453049+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.453049+0000","objects_scrubbed":11,"log_size":20,"log_dups_size":301,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:44:21.298253+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29428,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":452,"num_read_kb":629,"num_write":258,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3642,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.097347+0000","last_change":"2024-08-09T00:40:45.097347+0000","last_active":"2024-08-09T00:40:45.097347+0000","last_peered":"2024-08-09T00:40:45.097347+0000","last_clean":"2024-08-09T00:40:45.097347+0000","last_became_active":"2024-08-08T23:28:32.813290+0000","last_became_peered":"2024-08-08T23:28:32.813290+0000","last_unstale":"2024-08-09T00:40:45.097347+0000","last_undegraded":"2024-08-09T00:40:45.097347+0000","last_fullsized":"2024-08-09T00:40:45.097347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.097011+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.097011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:27:33.586520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'120","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.618159+0000","last_change":"2024-08-09T00:40:46.618231+0000","last_active":"2024-08-09T00:40:46.618159+0000","last_peered":"2024-08-09T00:40:46.618159+0000","last_clean":"2024-08-09T00:40:46.618159+0000","last_became_active":"2024-08-08T23:28:34.837385+0000","last_became_peered":"2024-08-08T23:28:34.837385+0000","last_unstale":"2024-08-09T00:40:46.618159+0000","last_undegraded":"2024-08-09T00:40:46.618159+0000","last_fullsized":"2024-08-09T00:40:46.618159+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:40:46.617950+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.617950+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:34.403990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":278,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'157","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.589812+0000","last_change":"2024-08-09T00:41:02.589812+0000","last_active":"2024-08-09T00:41:02.589812+0000","last_peered":"2024-08-09T00:41:02.589812+0000","last_clean":"2024-08-09T00:41:02.589812+0000","last_became_active":"2024-08-08T23:28:26.779615+0000","last_became_peered":"2024-08-08T23:28:26.779615+0000","last_unstale":"2024-08-09T00:41:02.589812+0000","last_undegraded":"2024-08-09T00:41:02.589812+0000","last_fullsized":"2024-08-09T00:41:02.589812+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-08-09T00:41:02.589518+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.589518+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:51:33.421207+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":496,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7572,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'317","reported_seq":1120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.931087+0000","last_change":"2024-08-09T00:41:07.931087+0000","last_active":"2024-08-09T00:41:07.931087+0000","last_peered":"2024-08-09T00:41:07.931087+0000","last_clean":"2024-08-09T00:41:07.931087+0000","last_became_active":"2024-08-08T23:28:24.763905+0000","last_became_peered":"2024-08-08T23:28:24.763905+0000","last_unstale":"2024-08-09T00:41:07.931087+0000","last_undegraded":"2024-08-09T00:41:07.931087+0000","last_fullsized":"2024-08-09T00:41:07.931087+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-08-09T00:41:07.930771+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.930771+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:13:51.581165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1025,"num_read_kb":185751,"num_write":1335,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:20.719419+0000","last_change":"2024-08-09T00:41:20.719419+0000","last_active":"2024-08-09T00:41:20.719419+0000","last_peered":"2024-08-09T00:41:20.719419+0000","last_clean":"2024-08-09T00:41:20.719419+0000","last_became_active":"2024-08-08T23:28:14.794693+0000","last_became_peered":"2024-08-08T23:28:14.794693+0000","last_unstale":"2024-08-09T00:41:20.719419+0000","last_undegraded":"2024-08-09T00:41:20.719419+0000","last_fullsized":"2024-08-09T00:41:20.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:20.719173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:20.719173+0000","last_clean_scrub_stamp":"2024-08-09T00:41:20.719173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:41:30.544614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00072958400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.926892+0000","last_change":"2024-08-09T00:40:48.926892+0000","last_active":"2024-08-09T00:40:48.926892+0000","last_peered":"2024-08-09T00:40:48.926892+0000","last_clean":"2024-08-09T00:40:48.926892+0000","last_became_active":"2024-08-08T23:28:28.778818+0000","last_became_peered":"2024-08-08T23:28:28.778818+0000","last_unstale":"2024-08-09T00:40:48.926892+0000","last_undegraded":"2024-08-09T00:40:48.926892+0000","last_fullsized":"2024-08-09T00:40:48.926892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:48.926628+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.926628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:36:47.294692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'230","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.892073+0000","last_change":"2024-08-09T00:40:55.892073+0000","last_active":"2024-08-09T00:40:55.892073+0000","last_peered":"2024-08-09T00:40:55.892073+0000","last_clean":"2024-08-09T00:40:55.892073+0000","last_became_active":"2024-08-08T23:28:31.041627+0000","last_became_peered":"2024-08-08T23:28:31.041627+0000","last_unstale":"2024-08-09T00:40:55.892073+0000","last_undegraded":"2024-08-09T00:40:55.892073+0000","last_fullsized":"2024-08-09T00:40:55.892073+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'230","last_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_deep_scrub":"268'230","last_deep_scrub_stamp":"2024-08-09T00:40:55.891948+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.891948+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:13:05.302427+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":296,"num_read_kb":288,"num_write":236,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3366,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'528","reported_seq":4411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.223881+0000","last_change":"2024-08-09T00:40:46.223881+0000","last_active":"2024-08-09T00:40:46.223881+0000","last_peered":"2024-08-09T00:40:46.223881+0000","last_clean":"2024-08-09T00:40:46.223881+0000","last_became_active":"2024-08-08T23:28:32.815178+0000","last_became_peered":"2024-08-08T23:28:32.815178+0000","last_unstale":"2024-08-09T00:40:46.223881+0000","last_undegraded":"2024-08-09T00:40:46.223881+0000","last_fullsized":"2024-08-09T00:40:46.223881+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'528","last_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_deep_scrub":"268'528","last_deep_scrub_stamp":"2024-08-09T00:40:46.223619+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.223619+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:52.863127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'168","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.276198+0000","last_change":"2024-08-09T00:40:49.276198+0000","last_active":"2024-08-09T00:40:49.276198+0000","last_peered":"2024-08-09T00:40:49.276198+0000","last_clean":"2024-08-09T00:40:49.276198+0000","last_became_active":"2024-08-08T23:28:34.829322+0000","last_became_peered":"2024-08-08T23:28:34.829322+0000","last_unstale":"2024-08-09T00:40:49.276198+0000","last_undegraded":"2024-08-09T00:40:49.276198+0000","last_fullsized":"2024-08-09T00:40:49.276198+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:49.275905+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.275905+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:05:14.189142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":85,"num_write":352,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'120","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.409983+0000","last_change":"2024-08-09T00:41:07.410041+0000","last_active":"2024-08-09T00:41:07.409983+0000","last_peered":"2024-08-09T00:41:07.409983+0000","last_clean":"2024-08-09T00:41:07.409983+0000","last_became_active":"2024-08-08T23:28:26.776499+0000","last_became_peered":"2024-08-08T23:28:26.776499+0000","last_unstale":"2024-08-09T00:41:07.409983+0000","last_undegraded":"2024-08-09T00:41:07.409983+0000","last_fullsized":"2024-08-09T00:41:07.409983+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-08-09T00:41:07.409796+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.409796+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:41:27.775222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":358,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'273","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:28.525977+0000","last_change":"2024-08-09T00:41:28.526093+0000","last_active":"2024-08-09T00:41:28.525977+0000","last_peered":"2024-08-09T00:41:28.525977+0000","last_clean":"2024-08-09T00:41:28.525977+0000","last_became_active":"2024-08-08T23:28:24.806564+0000","last_became_peered":"2024-08-08T23:28:24.806564+0000","last_unstale":"2024-08-09T00:41:28.525977+0000","last_undegraded":"2024-08-09T00:41:28.525977+0000","last_fullsized":"2024-08-09T00:41:28.525977+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-08-09T00:41:28.525755+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-08-09T00:41:28.525755+0000","last_clean_scrub_stamp":"2024-08-09T00:41:28.525755+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:50:59.294149+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311694,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1095,"num_read_kb":6569,"num_write":1298,"num_write_kb":23177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.812643+0000","last_change":"2024-08-09T00:41:03.812701+0000","last_active":"2024-08-09T00:41:03.812643+0000","last_peered":"2024-08-09T00:41:03.812643+0000","last_clean":"2024-08-09T00:41:03.812643+0000","last_became_active":"2024-08-08T23:28:14.784844+0000","last_became_peered":"2024-08-08T23:28:14.784844+0000","last_unstale":"2024-08-09T00:41:03.812643+0000","last_undegraded":"2024-08-09T00:41:03.812643+0000","last_fullsized":"2024-08-09T00:41:03.812643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:03.812444+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.812444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:52:09.482944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098812500000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.037254+0000","last_change":"2024-08-09T00:40:58.037254+0000","last_active":"2024-08-09T00:40:58.037254+0000","last_peered":"2024-08-09T00:40:58.037254+0000","last_clean":"2024-08-09T00:40:58.037254+0000","last_became_active":"2024-08-08T23:28:28.775981+0000","last_became_peered":"2024-08-08T23:28:28.775981+0000","last_unstale":"2024-08-09T00:40:58.037254+0000","last_undegraded":"2024-08-09T00:40:58.037254+0000","last_fullsized":"2024-08-09T00:40:58.037254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.036981+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.036981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:31.277998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'154","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.047234+0000","last_change":"2024-08-09T00:40:49.047234+0000","last_active":"2024-08-09T00:40:49.047234+0000","last_peered":"2024-08-09T00:40:49.047234+0000","last_clean":"2024-08-09T00:40:49.047234+0000","last_became_active":"2024-08-08T23:28:30.788936+0000","last_became_peered":"2024-08-08T23:28:30.788936+0000","last_unstale":"2024-08-09T00:40:49.047234+0000","last_undegraded":"2024-08-09T00:40:49.047234+0000","last_fullsized":"2024-08-09T00:40:49.047234+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-08-09T00:40:49.046957+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.046957+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:48:46.019855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":170,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'525","reported_seq":2309,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.360829+0000","last_change":"2024-08-09T00:40:56.360829+0000","last_active":"2024-08-09T00:40:56.360829+0000","last_peered":"2024-08-09T00:40:56.360829+0000","last_clean":"2024-08-09T00:40:56.360829+0000","last_became_active":"2024-08-08T23:28:32.807627+0000","last_became_peered":"2024-08-08T23:28:32.807627+0000","last_unstale":"2024-08-09T00:40:56.360829+0000","last_undegraded":"2024-08-09T00:40:56.360829+0000","last_fullsized":"2024-08-09T00:40:56.360829+0000","mapping_epoch":33,"log_start":"268'500","ondisk_log_start":"268'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-08-09T00:40:56.360575+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.360575+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:37:54.817387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'240","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.635026+0000","last_change":"2024-08-09T00:40:51.635097+0000","last_active":"2024-08-09T00:40:51.635026+0000","last_peered":"2024-08-09T00:40:51.635026+0000","last_clean":"2024-08-09T00:40:51.635026+0000","last_became_active":"2024-08-08T23:28:34.832190+0000","last_became_peered":"2024-08-08T23:28:34.832190+0000","last_unstale":"2024-08-09T00:40:51.635026+0000","last_undegraded":"2024-08-09T00:40:51.635026+0000","last_fullsized":"2024-08-09T00:40:51.635026+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'240","last_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_deep_scrub":"268'240","last_deep_scrub_stamp":"2024-08-09T00:40:51.634826+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.634826+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:14:56.897177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":508,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'234","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.024702+0000","last_change":"2024-08-09T00:40:57.024702+0000","last_active":"2024-08-09T00:40:57.024702+0000","last_peered":"2024-08-09T00:40:57.024702+0000","last_clean":"2024-08-09T00:40:57.024702+0000","last_became_active":"2024-08-08T23:28:26.769984+0000","last_became_peered":"2024-08-08T23:28:26.769984+0000","last_unstale":"2024-08-09T00:40:57.024702+0000","last_undegraded":"2024-08-09T00:40:57.024702+0000","last_fullsized":"2024-08-09T00:40:57.024702+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-08-09T00:40:57.024418+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.024418+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:23:31.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1051,"num_read_kb":866,"num_write":420,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'219","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.222329+0000","last_change":"2024-08-09T00:40:48.222507+0000","last_active":"2024-08-09T00:40:48.222329+0000","last_peered":"2024-08-09T00:40:48.222329+0000","last_clean":"2024-08-09T00:40:48.222329+0000","last_became_active":"2024-08-08T23:29:01.887356+0000","last_became_peered":"2024-08-08T23:29:01.887356+0000","last_unstale":"2024-08-09T00:40:48.222329+0000","last_undegraded":"2024-08-09T00:40:48.222329+0000","last_fullsized":"2024-08-09T00:40:48.222329+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'219","last_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_deep_scrub":"268'219","last_deep_scrub_stamp":"2024-08-09T00:40:48.222109+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.222109+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:39:43.098443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37546,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":443,"num_read_kb":66311,"num_write":1073,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.171339+0000","last_change":"2024-08-09T00:40:58.171400+0000","last_active":"2024-08-09T00:40:58.171339+0000","last_peered":"2024-08-09T00:40:58.171339+0000","last_clean":"2024-08-09T00:40:58.171339+0000","last_became_active":"2024-08-08T23:28:14.787570+0000","last_became_peered":"2024-08-08T23:28:14.787570+0000","last_unstale":"2024-08-09T00:40:58.171339+0000","last_undegraded":"2024-08-09T00:40:58.171339+0000","last_fullsized":"2024-08-09T00:40:58.171339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:58.171154+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.171154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:48:38.726495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092417300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"268'5","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.469324+0000","last_change":"2024-08-09T00:41:09.469388+0000","last_active":"2024-08-09T00:41:09.469324+0000","last_peered":"2024-08-09T00:41:09.469324+0000","last_clean":"2024-08-09T00:41:09.469324+0000","last_became_active":"2024-08-08T23:28:28.770678+0000","last_became_peered":"2024-08-08T23:28:28.770678+0000","last_unstale":"2024-08-09T00:41:09.469324+0000","last_undegraded":"2024-08-09T00:41:09.469324+0000","last_fullsized":"2024-08-09T00:41:09.469324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-08-09T00:41:09.469138+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.469138+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:46.425806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":797,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'359","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.645972+0000","last_change":"2024-08-09T00:41:16.645972+0000","last_active":"2024-08-09T00:41:16.645972+0000","last_peered":"2024-08-09T00:41:16.645972+0000","last_clean":"2024-08-09T00:41:16.645972+0000","last_became_active":"2024-08-08T23:28:31.043588+0000","last_became_peered":"2024-08-08T23:28:31.043588+0000","last_unstale":"2024-08-09T00:41:16.645972+0000","last_undegraded":"2024-08-09T00:41:16.645972+0000","last_fullsized":"2024-08-09T00:41:16.645972+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-08-09T00:41:16.645692+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-08-09T00:41:16.645692+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.645692+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:28:30.136571+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24443,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":527,"num_read_kb":707,"num_write":276,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.353437+0000","last_change":"2024-08-09T00:40:57.353437+0000","last_active":"2024-08-09T00:40:57.353437+0000","last_peered":"2024-08-09T00:40:57.353437+0000","last_clean":"2024-08-09T00:40:57.353437+0000","last_became_active":"2024-08-08T23:28:32.804000+0000","last_became_peered":"2024-08-08T23:28:32.804000+0000","last_unstale":"2024-08-09T00:40:57.353437+0000","last_undegraded":"2024-08-09T00:40:57.353437+0000","last_fullsized":"2024-08-09T00:40:57.353437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.353192+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.353192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:53:43.153069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'127","reported_seq":629,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.236617+0000","last_change":"2024-08-09T00:40:42.236705+0000","last_active":"2024-08-09T00:40:42.236617+0000","last_peered":"2024-08-09T00:40:42.236617+0000","last_clean":"2024-08-09T00:40:42.236617+0000","last_became_active":"2024-08-08T23:28:34.829393+0000","last_became_peered":"2024-08-08T23:28:34.829393+0000","last_unstale":"2024-08-09T00:40:42.236617+0000","last_undegraded":"2024-08-09T00:40:42.236617+0000","last_fullsized":"2024-08-09T00:40:42.236617+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:40:42.236387+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.236387+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:25:28.423291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'141","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:49.636334+0000","last_change":"2024-08-09T00:40:49.636334+0000","last_active":"2024-08-09T00:40:49.636334+0000","last_peered":"2024-08-09T00:40:49.636334+0000","last_clean":"2024-08-09T00:40:49.636334+0000","last_became_active":"2024-08-08T23:28:34.835689+0000","last_became_peered":"2024-08-08T23:28:34.835689+0000","last_unstale":"2024-08-09T00:40:49.636334+0000","last_undegraded":"2024-08-09T00:40:49.636334+0000","last_fullsized":"2024-08-09T00:40:49.636334+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:40:49.636047+0000","last_clean_scrub_stamp":"2024-08-09T00:40:49.636047+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:31:23.809790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":196,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'168","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.009785+0000","last_change":"2024-08-09T00:40:55.009848+0000","last_active":"2024-08-09T00:40:55.009785+0000","last_peered":"2024-08-09T00:40:55.009785+0000","last_clean":"2024-08-09T00:40:55.009785+0000","last_became_active":"2024-08-08T23:28:26.776002+0000","last_became_peered":"2024-08-08T23:28:26.776002+0000","last_unstale":"2024-08-09T00:40:55.009785+0000","last_undegraded":"2024-08-09T00:40:55.009785+0000","last_fullsized":"2024-08-09T00:40:55.009785+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-08-09T00:40:55.009572+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.009572+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:15:01.862198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":702,"num_read_kb":582,"num_write":275,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'229","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.272699+0000","last_change":"2024-08-09T00:41:10.272825+0000","last_active":"2024-08-09T00:41:10.272699+0000","last_peered":"2024-08-09T00:41:10.272699+0000","last_clean":"2024-08-09T00:41:10.272699+0000","last_became_active":"2024-08-08T23:28:24.798100+0000","last_became_peered":"2024-08-08T23:28:24.798100+0000","last_unstale":"2024-08-09T00:41:10.272699+0000","last_undegraded":"2024-08-09T00:41:10.272699+0000","last_fullsized":"2024-08-09T00:41:10.272699+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'229","last_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_deep_scrub":"268'229","last_deep_scrub_stamp":"2024-08-09T00:41:10.272502+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.272502+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:34:49.338640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":23490,"num_write":1170,"num_write_kb":39590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.838789+0000","last_change":"2024-08-09T00:40:50.838789+0000","last_active":"2024-08-09T00:40:50.838789+0000","last_peered":"2024-08-09T00:40:50.838789+0000","last_clean":"2024-08-09T00:40:50.838789+0000","last_became_active":"2024-08-08T23:28:28.758405+0000","last_became_peered":"2024-08-08T23:28:28.758405+0000","last_unstale":"2024-08-09T00:40:50.838789+0000","last_undegraded":"2024-08-09T00:40:50.838789+0000","last_fullsized":"2024-08-09T00:40:50.838789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:50.838517+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.838517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:22:43.037726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'171","reported_seq":792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:29.570689+0000","last_change":"2024-08-09T00:41:29.570774+0000","last_active":"2024-08-09T00:41:29.570689+0000","last_peered":"2024-08-09T00:41:29.570689+0000","last_clean":"2024-08-09T00:41:29.570689+0000","last_became_active":"2024-08-08T23:28:30.792022+0000","last_became_peered":"2024-08-08T23:28:30.792022+0000","last_unstale":"2024-08-09T00:41:29.570689+0000","last_undegraded":"2024-08-09T00:41:29.570689+0000","last_fullsized":"2024-08-09T00:41:29.570689+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:41:29.570475+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:41:29.570475+0000","last_clean_scrub_stamp":"2024-08-09T00:41:29.570475+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:19:06.668610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":265,"num_write":116,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.311465+0000","last_change":"2024-08-09T00:40:54.311516+0000","last_active":"2024-08-09T00:40:54.311465+0000","last_peered":"2024-08-09T00:40:54.311465+0000","last_clean":"2024-08-09T00:40:54.311465+0000","last_became_active":"2024-08-08T23:28:32.807726+0000","last_became_peered":"2024-08-08T23:28:32.807726+0000","last_unstale":"2024-08-09T00:40:54.311465+0000","last_undegraded":"2024-08-09T00:40:54.311465+0000","last_fullsized":"2024-08-09T00:40:54.311465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:54.311271+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.311271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:13:18.035747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'118","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.310577+0000","last_change":"2024-08-09T00:40:52.310577+0000","last_active":"2024-08-09T00:40:52.310577+0000","last_peered":"2024-08-09T00:40:52.310577+0000","last_clean":"2024-08-09T00:40:52.310577+0000","last_became_active":"2024-08-08T23:28:34.827879+0000","last_became_peered":"2024-08-08T23:28:34.827879+0000","last_unstale":"2024-08-09T00:40:52.310577+0000","last_undegraded":"2024-08-09T00:40:52.310577+0000","last_fullsized":"2024-08-09T00:40:52.310577+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-08-09T00:40:52.310328+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.310328+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:58:03.731104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":122,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'77","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.900163+0000","last_change":"2024-08-09T00:40:56.900283+0000","last_active":"2024-08-09T00:40:56.900163+0000","last_peered":"2024-08-09T00:40:56.900163+0000","last_clean":"2024-08-09T00:40:56.900163+0000","last_became_active":"2024-08-08T23:28:26.775570+0000","last_became_peered":"2024-08-08T23:28:26.775570+0000","last_unstale":"2024-08-09T00:40:56.900163+0000","last_undegraded":"2024-08-09T00:40:56.900163+0000","last_fullsized":"2024-08-09T00:40:56.900163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-08-09T00:40:56.899845+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.899845+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:37:06.513441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":257,"num_write":116,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'183","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.774647+0000","last_change":"2024-08-09T00:41:25.774729+0000","last_active":"2024-08-09T00:41:25.774647+0000","last_peered":"2024-08-09T00:41:25.774647+0000","last_clean":"2024-08-09T00:41:25.774647+0000","last_became_active":"2024-08-08T23:28:24.806730+0000","last_became_peered":"2024-08-08T23:28:24.806730+0000","last_unstale":"2024-08-09T00:41:25.774647+0000","last_undegraded":"2024-08-09T00:41:25.774647+0000","last_fullsized":"2024-08-09T00:41:25.774647+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'183","last_scrub_stamp":"2024-08-09T00:41:25.774445+0000","last_deep_scrub":"268'183","last_deep_scrub_stamp":"2024-08-09T00:41:25.774445+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.774445+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:27:56.689587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661190,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":16787,"num_write":983,"num_write_kb":45353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.434981+0000","last_change":"2024-08-09T00:41:13.435039+0000","last_active":"2024-08-09T00:41:13.434981+0000","last_peered":"2024-08-09T00:41:13.434981+0000","last_clean":"2024-08-09T00:41:13.434981+0000","last_became_active":"2024-08-08T23:28:28.774292+0000","last_became_peered":"2024-08-08T23:28:28.774292+0000","last_unstale":"2024-08-09T00:41:13.434981+0000","last_undegraded":"2024-08-09T00:41:13.434981+0000","last_fullsized":"2024-08-09T00:41:13.434981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:13.434758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:13.434758+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.434758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:10:14.208717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'57","reported_seq":585,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.502540+0000","last_change":"2024-08-09T00:41:10.502610+0000","last_active":"2024-08-09T00:41:10.502540+0000","last_peered":"2024-08-09T00:41:10.502540+0000","last_clean":"2024-08-09T00:41:10.502540+0000","last_became_active":"2024-08-08T23:28:30.780642+0000","last_became_peered":"2024-08-08T23:28:30.780642+0000","last_unstale":"2024-08-09T00:41:10.502540+0000","last_undegraded":"2024-08-09T00:41:10.502540+0000","last_fullsized":"2024-08-09T00:41:10.502540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'57","last_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_deep_scrub":"268'57","last_deep_scrub_stamp":"2024-08-09T00:41:10.502327+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.502327+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:08:11.822426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.648110+0000","last_change":"2024-08-09T00:40:57.648162+0000","last_active":"2024-08-09T00:40:57.648110+0000","last_peered":"2024-08-09T00:40:57.648110+0000","last_clean":"2024-08-09T00:40:57.648110+0000","last_became_active":"2024-08-08T23:28:32.810258+0000","last_became_peered":"2024-08-08T23:28:32.810258+0000","last_unstale":"2024-08-09T00:40:57.648110+0000","last_undegraded":"2024-08-09T00:40:57.648110+0000","last_fullsized":"2024-08-09T00:40:57.648110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.647902+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.647902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:51:11.434378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'189","reported_seq":733,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.596320+0000","last_change":"2024-08-09T00:40:45.596320+0000","last_active":"2024-08-09T00:40:45.596320+0000","last_peered":"2024-08-09T00:40:45.596320+0000","last_clean":"2024-08-09T00:40:45.596320+0000","last_became_active":"2024-08-08T23:28:34.840505+0000","last_became_peered":"2024-08-08T23:28:34.840505+0000","last_unstale":"2024-08-09T00:40:45.596320+0000","last_undegraded":"2024-08-09T00:40:45.596320+0000","last_fullsized":"2024-08-09T00:40:45.596320+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:40:45.595931+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.595931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:42:19.396170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":297,"num_write":414,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'165","reported_seq":789,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.418868+0000","last_change":"2024-08-09T00:41:06.418930+0000","last_active":"2024-08-09T00:41:06.418868+0000","last_peered":"2024-08-09T00:41:06.418868+0000","last_clean":"2024-08-09T00:41:06.418868+0000","last_became_active":"2024-08-08T23:28:26.775852+0000","last_became_peered":"2024-08-08T23:28:26.775852+0000","last_unstale":"2024-08-09T00:41:06.418868+0000","last_undegraded":"2024-08-09T00:41:06.418868+0000","last_fullsized":"2024-08-09T00:41:06.418868+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-08-09T00:41:06.418680+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.418680+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:29.040678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":530,"num_write":258,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'202","reported_seq":854,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.175679+0000","last_change":"2024-08-09T00:41:16.175778+0000","last_active":"2024-08-09T00:41:16.175679+0000","last_peered":"2024-08-09T00:41:16.175679+0000","last_clean":"2024-08-09T00:41:16.175679+0000","last_became_active":"2024-08-08T23:28:24.811893+0000","last_became_peered":"2024-08-08T23:28:24.811893+0000","last_unstale":"2024-08-09T00:41:16.175679+0000","last_undegraded":"2024-08-09T00:41:16.175679+0000","last_fullsized":"2024-08-09T00:41:16.175679+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-08-09T00:41:16.175456+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-08-09T00:41:16.175456+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.175456+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:29:29.832621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110897,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":499,"num_read_kb":9686,"num_write":1123,"num_write_kb":42122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.661101+0000","last_change":"2024-08-09T00:41:02.661162+0000","last_active":"2024-08-09T00:41:02.661101+0000","last_peered":"2024-08-09T00:41:02.661101+0000","last_clean":"2024-08-09T00:41:02.661101+0000","last_became_active":"2024-08-08T23:28:28.780330+0000","last_became_peered":"2024-08-08T23:28:28.780330+0000","last_unstale":"2024-08-09T00:41:02.661101+0000","last_undegraded":"2024-08-09T00:41:02.661101+0000","last_fullsized":"2024-08-09T00:41:02.661101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.660881+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.660881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:10.460272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'205","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.352259+0000","last_change":"2024-08-09T00:41:02.352342+0000","last_active":"2024-08-09T00:41:02.352259+0000","last_peered":"2024-08-09T00:41:02.352259+0000","last_clean":"2024-08-09T00:41:02.352259+0000","last_became_active":"2024-08-08T23:28:30.793042+0000","last_became_peered":"2024-08-08T23:28:30.793042+0000","last_unstale":"2024-08-09T00:41:02.352259+0000","last_undegraded":"2024-08-09T00:41:02.352259+0000","last_fullsized":"2024-08-09T00:41:02.352259+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'205","last_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_deep_scrub":"268'205","last_deep_scrub_stamp":"2024-08-09T00:41:02.352069+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.352069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:05:47.940433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":367,"num_write":158,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.887230+0000","last_change":"2024-08-09T00:40:47.887323+0000","last_active":"2024-08-09T00:40:47.887230+0000","last_peered":"2024-08-09T00:40:47.887230+0000","last_clean":"2024-08-09T00:40:47.887230+0000","last_became_active":"2024-08-08T23:28:32.828246+0000","last_became_peered":"2024-08-08T23:28:32.828246+0000","last_unstale":"2024-08-09T00:40:47.887230+0000","last_undegraded":"2024-08-09T00:40:47.887230+0000","last_fullsized":"2024-08-09T00:40:47.887230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.886949+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.886949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:40:37.660989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'115","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:41.262602+0000","last_change":"2024-08-09T00:40:41.262602+0000","last_active":"2024-08-09T00:40:41.262602+0000","last_peered":"2024-08-09T00:40:41.262602+0000","last_clean":"2024-08-09T00:40:41.262602+0000","last_became_active":"2024-08-08T23:28:34.829629+0000","last_became_peered":"2024-08-08T23:28:34.829629+0000","last_unstale":"2024-08-09T00:40:41.262602+0000","last_undegraded":"2024-08-09T00:40:41.262602+0000","last_fullsized":"2024-08-09T00:40:41.262602+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-08-09T00:40:41.262339+0000","last_clean_scrub_stamp":"2024-08-09T00:40:41.262339+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:46:01.693522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":283,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'372","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:16.425681+0000","last_change":"2024-08-09T00:41:16.425805+0000","last_active":"2024-08-09T00:41:16.425681+0000","last_peered":"2024-08-09T00:41:16.425681+0000","last_clean":"2024-08-09T00:41:16.425681+0000","last_became_active":"2024-08-08T23:28:26.752910+0000","last_became_peered":"2024-08-08T23:28:26.752910+0000","last_unstale":"2024-08-09T00:41:16.425681+0000","last_undegraded":"2024-08-09T00:41:16.425681+0000","last_fullsized":"2024-08-09T00:41:16.425681+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-08-09T00:41:16.425422+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-08-09T00:41:16.425422+0000","last_clean_scrub_stamp":"2024-08-09T00:41:16.425422+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:45.886954+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1562,"num_read_kb":1302,"num_write":557,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25751,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'167","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:25.539724+0000","last_change":"2024-08-09T00:41:25.539918+0000","last_active":"2024-08-09T00:41:25.539724+0000","last_peered":"2024-08-09T00:41:25.539724+0000","last_clean":"2024-08-09T00:41:25.539724+0000","last_became_active":"2024-08-08T23:28:24.807957+0000","last_became_peered":"2024-08-08T23:28:24.807957+0000","last_unstale":"2024-08-09T00:41:25.539724+0000","last_undegraded":"2024-08-09T00:41:25.539724+0000","last_fullsized":"2024-08-09T00:41:25.539724+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'167","last_scrub_stamp":"2024-08-09T00:41:25.539472+0000","last_deep_scrub":"268'167","last_deep_scrub_stamp":"2024-08-09T00:41:25.539472+0000","last_clean_scrub_stamp":"2024-08-09T00:41:25.539472+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:15:00.311078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":317,"num_read_kb":1399,"num_write":881,"num_write_kb":21594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.890394+0000","last_change":"2024-08-09T00:40:44.890394+0000","last_active":"2024-08-09T00:40:44.890394+0000","last_peered":"2024-08-09T00:40:44.890394+0000","last_clean":"2024-08-09T00:40:44.890394+0000","last_became_active":"2024-08-08T23:28:28.780982+0000","last_became_peered":"2024-08-08T23:28:28.780982+0000","last_unstale":"2024-08-09T00:40:44.890394+0000","last_undegraded":"2024-08-09T00:40:44.890394+0000","last_fullsized":"2024-08-09T00:40:44.890394+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:44.890149+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.890149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:41.092600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'141","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.646816+0000","last_change":"2024-08-09T00:41:12.646898+0000","last_active":"2024-08-09T00:41:12.646816+0000","last_peered":"2024-08-09T00:41:12.646816+0000","last_clean":"2024-08-09T00:41:12.646816+0000","last_became_active":"2024-08-08T23:28:30.779926+0000","last_became_peered":"2024-08-08T23:28:30.779926+0000","last_unstale":"2024-08-09T00:41:12.646816+0000","last_undegraded":"2024-08-09T00:41:12.646816+0000","last_fullsized":"2024-08-09T00:41:12.646816+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-08-09T00:41:12.646589+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.646589+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:37:54.847960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":239,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.614977+0000","last_change":"2024-08-09T00:40:55.615035+0000","last_active":"2024-08-09T00:40:55.614977+0000","last_peered":"2024-08-09T00:40:55.614977+0000","last_clean":"2024-08-09T00:40:55.614977+0000","last_became_active":"2024-08-08T23:28:32.824840+0000","last_became_peered":"2024-08-08T23:28:32.824840+0000","last_unstale":"2024-08-09T00:40:55.614977+0000","last_undegraded":"2024-08-09T00:40:55.614977+0000","last_fullsized":"2024-08-09T00:40:55.614977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:55.614759+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.614759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:33:17.357689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'144","reported_seq":743,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.009760+0000","last_change":"2024-08-09T00:40:53.009760+0000","last_active":"2024-08-09T00:40:53.009760+0000","last_peered":"2024-08-09T00:40:53.009760+0000","last_clean":"2024-08-09T00:40:53.009760+0000","last_became_active":"2024-08-08T23:28:26.770065+0000","last_became_peered":"2024-08-08T23:28:26.770065+0000","last_unstale":"2024-08-09T00:40:53.009760+0000","last_undegraded":"2024-08-09T00:40:53.009760+0000","last_fullsized":"2024-08-09T00:40:53.009760+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-08-09T00:40:53.009497+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.009497+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:20:39.267801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":553,"num_read_kb":442,"num_write":216,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'160","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:23.451824+0000","last_change":"2024-08-09T00:41:23.451912+0000","last_active":"2024-08-09T00:41:23.451824+0000","last_peered":"2024-08-09T00:41:23.451824+0000","last_clean":"2024-08-09T00:41:23.451824+0000","last_became_active":"2024-08-08T23:28:24.773367+0000","last_became_peered":"2024-08-08T23:28:24.773367+0000","last_unstale":"2024-08-09T00:41:23.451824+0000","last_undegraded":"2024-08-09T00:41:23.451824+0000","last_fullsized":"2024-08-09T00:41:23.451824+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'160","last_scrub_stamp":"2024-08-09T00:41:23.451628+0000","last_deep_scrub":"268'160","last_deep_scrub_stamp":"2024-08-09T00:41:23.451628+0000","last_clean_scrub_stamp":"2024-08-09T00:41:23.451628+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:05:23.967285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540766,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":18716,"num_write":872,"num_write_kb":21971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.503559+0000","last_change":"2024-08-09T00:41:08.503665+0000","last_active":"2024-08-09T00:41:08.503559+0000","last_peered":"2024-08-09T00:41:08.503559+0000","last_clean":"2024-08-09T00:41:08.503559+0000","last_became_active":"2024-08-08T23:28:28.783162+0000","last_became_peered":"2024-08-08T23:28:28.783162+0000","last_unstale":"2024-08-09T00:41:08.503559+0000","last_undegraded":"2024-08-09T00:41:08.503559+0000","last_fullsized":"2024-08-09T00:41:08.503559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.503276+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.503276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:53:07.754186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'227","reported_seq":891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.827005+0000","last_change":"2024-08-09T00:40:53.827005+0000","last_active":"2024-08-09T00:40:53.827005+0000","last_peered":"2024-08-09T00:40:53.827005+0000","last_clean":"2024-08-09T00:40:53.827005+0000","last_became_active":"2024-08-08T23:28:30.779399+0000","last_became_peered":"2024-08-08T23:28:30.779399+0000","last_unstale":"2024-08-09T00:40:53.827005+0000","last_undegraded":"2024-08-09T00:40:53.827005+0000","last_fullsized":"2024-08-09T00:40:53.827005+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-08-09T00:40:53.826785+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.826785+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:20:32.238202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17674,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":347,"num_read_kb":513,"num_write":222,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22936,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:45.257255+0000","last_change":"2024-08-09T00:40:45.257255+0000","last_active":"2024-08-09T00:40:45.257255+0000","last_peered":"2024-08-09T00:40:45.257255+0000","last_clean":"2024-08-09T00:40:45.257255+0000","last_became_active":"2024-08-08T23:28:32.818583+0000","last_became_peered":"2024-08-08T23:28:32.818583+0000","last_unstale":"2024-08-09T00:40:45.257255+0000","last_undegraded":"2024-08-09T00:40:45.257255+0000","last_fullsized":"2024-08-09T00:40:45.257255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:45.256887+0000","last_clean_scrub_stamp":"2024-08-09T00:40:45.256887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.726347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'166","reported_seq":698,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.339701+0000","last_change":"2024-08-09T00:40:46.339701+0000","last_active":"2024-08-09T00:40:46.339701+0000","last_peered":"2024-08-09T00:40:46.339701+0000","last_clean":"2024-08-09T00:40:46.339701+0000","last_became_active":"2024-08-08T23:28:34.829741+0000","last_became_peered":"2024-08-08T23:28:34.829741+0000","last_unstale":"2024-08-09T00:40:46.339701+0000","last_undegraded":"2024-08-09T00:40:46.339701+0000","last_fullsized":"2024-08-09T00:40:46.339701+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-08-09T00:40:46.339303+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.339303+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:42:17.653047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":203,"num_write":374,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'200","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.565127+0000","last_change":"2024-08-09T00:41:03.565307+0000","last_active":"2024-08-09T00:41:03.565127+0000","last_peered":"2024-08-09T00:41:03.565127+0000","last_clean":"2024-08-09T00:41:03.565127+0000","last_became_active":"2024-08-08T23:28:26.776366+0000","last_became_peered":"2024-08-08T23:28:26.776366+0000","last_unstale":"2024-08-09T00:41:03.565127+0000","last_undegraded":"2024-08-09T00:41:03.565127+0000","last_fullsized":"2024-08-09T00:41:03.565127+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:03.564859+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.564859+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:40:42.536359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":592,"num_write":317,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'284","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:40.725010+0000","last_change":"2024-08-09T00:40:40.725010+0000","last_active":"2024-08-09T00:40:40.725010+0000","last_peered":"2024-08-09T00:40:40.725010+0000","last_clean":"2024-08-09T00:40:40.725010+0000","last_became_active":"2024-08-08T23:29:01.887975+0000","last_became_peered":"2024-08-08T23:29:01.887975+0000","last_unstale":"2024-08-09T00:40:40.725010+0000","last_undegraded":"2024-08-09T00:40:40.725010+0000","last_fullsized":"2024-08-09T00:40:40.725010+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-08-09T00:40:40.724693+0000","last_clean_scrub_stamp":"2024-08-09T00:40:40.724693+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:36:21.253956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":69125,"num_write":1347,"num_write_kb":31475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:46.890625+0000","last_change":"2024-08-09T00:40:46.890625+0000","last_active":"2024-08-09T00:40:46.890625+0000","last_peered":"2024-08-09T00:40:46.890625+0000","last_clean":"2024-08-09T00:40:46.890625+0000","last_became_active":"2024-08-08T23:28:28.779243+0000","last_became_peered":"2024-08-08T23:28:28.779243+0000","last_unstale":"2024-08-09T00:40:46.890625+0000","last_undegraded":"2024-08-09T00:40:46.890625+0000","last_fullsized":"2024-08-09T00:40:46.890625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:46.890298+0000","last_clean_scrub_stamp":"2024-08-09T00:40:46.890298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:04:42.778225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'206","reported_seq":824,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.581112+0000","last_change":"2024-08-09T00:41:10.581199+0000","last_active":"2024-08-09T00:41:10.581112+0000","last_peered":"2024-08-09T00:41:10.581112+0000","last_clean":"2024-08-09T00:41:10.581112+0000","last_became_active":"2024-08-08T23:28:30.774844+0000","last_became_peered":"2024-08-08T23:28:30.774844+0000","last_unstale":"2024-08-09T00:41:10.581112+0000","last_undegraded":"2024-08-09T00:41:10.581112+0000","last_fullsized":"2024-08-09T00:41:10.581112+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-08-09T00:41:10.580894+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.580894+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:21:00.947265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":267,"num_read_kb":315,"num_write":170,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10932,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.793837+0000","last_change":"2024-08-09T00:41:01.793837+0000","last_active":"2024-08-09T00:41:01.793837+0000","last_peered":"2024-08-09T00:41:01.793837+0000","last_clean":"2024-08-09T00:41:01.793837+0000","last_became_active":"2024-08-08T23:28:32.809213+0000","last_became_peered":"2024-08-08T23:28:32.809213+0000","last_unstale":"2024-08-09T00:41:01.793837+0000","last_undegraded":"2024-08-09T00:41:01.793837+0000","last_fullsized":"2024-08-09T00:41:01.793837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.793483+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.793483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:30:08.479888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'188","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.120576+0000","last_change":"2024-08-09T00:40:56.120576+0000","last_active":"2024-08-09T00:40:56.120576+0000","last_peered":"2024-08-09T00:40:56.120576+0000","last_clean":"2024-08-09T00:40:56.120576+0000","last_became_active":"2024-08-08T23:28:34.835614+0000","last_became_peered":"2024-08-08T23:28:34.835614+0000","last_unstale":"2024-08-09T00:40:56.120576+0000","last_undegraded":"2024-08-09T00:40:56.120576+0000","last_fullsized":"2024-08-09T00:40:56.120576+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:40:56.120294+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.120294+0000","objects_scrubbed":10,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:09:47.202816+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3075,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":283,"num_read_kb":310,"num_write":509,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1000,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'4118","reported_seq":4742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:18.397040+0000","last_change":"2024-08-09T00:41:18.397065+0000","last_active":"2024-08-09T00:41:18.397040+0000","last_peered":"2024-08-09T00:41:18.397040+0000","last_clean":"2024-08-09T00:41:18.397040+0000","last_became_active":"2024-08-08T23:28:26.747925+0000","last_became_peered":"2024-08-08T23:28:26.747925+0000","last_unstale":"2024-08-09T00:41:18.397040+0000","last_undegraded":"2024-08-09T00:41:18.397040+0000","last_fullsized":"2024-08-09T00:41:18.397040+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4118","last_scrub_stamp":"2024-08-09T00:41:18.396971+0000","last_deep_scrub":"268'4118","last_deep_scrub_stamp":"2024-08-09T00:41:18.396971+0000","last_clean_scrub_stamp":"2024-08-09T00:41:18.396971+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":3000,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:51:25.594140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14508,"num_read_kb":11751,"num_write":6170,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'213","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.230094+0000","last_change":"2024-08-09T00:40:50.230251+0000","last_active":"2024-08-09T00:40:50.230094+0000","last_peered":"2024-08-09T00:40:50.230094+0000","last_clean":"2024-08-09T00:40:50.230094+0000","last_became_active":"2024-08-08T23:30:01.780536+0000","last_became_peered":"2024-08-08T23:30:01.780536+0000","last_unstale":"2024-08-09T00:40:50.230094+0000","last_undegraded":"2024-08-09T00:40:50.230094+0000","last_fullsized":"2024-08-09T00:40:50.230094+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-08-09T00:40:50.229893+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.229893+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:48:43.519276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":59906,"num_write":1092,"num_write_kb":35094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.049221+0000","last_change":"2024-08-09T00:41:02.049221+0000","last_active":"2024-08-09T00:41:02.049221+0000","last_peered":"2024-08-09T00:41:02.049221+0000","last_clean":"2024-08-09T00:41:02.049221+0000","last_became_active":"2024-08-08T23:28:28.777655+0000","last_became_peered":"2024-08-08T23:28:28.777655+0000","last_unstale":"2024-08-09T00:41:02.049221+0000","last_undegraded":"2024-08-09T00:41:02.049221+0000","last_fullsized":"2024-08-09T00:41:02.049221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:02.048973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.048973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:40:26.776047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'175","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.309831+0000","last_change":"2024-08-09T00:41:01.309831+0000","last_active":"2024-08-09T00:41:01.309831+0000","last_peered":"2024-08-09T00:41:01.309831+0000","last_clean":"2024-08-09T00:41:01.309831+0000","last_became_active":"2024-08-08T23:28:31.042137+0000","last_became_peered":"2024-08-08T23:28:31.042137+0000","last_unstale":"2024-08-09T00:41:01.309831+0000","last_undegraded":"2024-08-09T00:41:01.309831+0000","last_fullsized":"2024-08-09T00:41:01.309831+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-08-09T00:41:01.309443+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.309443+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:43:19.119093+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":299,"num_write":124,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.854076+0000","last_change":"2024-08-09T00:40:57.854204+0000","last_active":"2024-08-09T00:40:57.854076+0000","last_peered":"2024-08-09T00:40:57.854076+0000","last_clean":"2024-08-09T00:40:57.854076+0000","last_became_active":"2024-08-08T23:28:32.801567+0000","last_became_peered":"2024-08-08T23:28:32.801567+0000","last_unstale":"2024-08-09T00:40:57.854076+0000","last_undegraded":"2024-08-09T00:40:57.854076+0000","last_fullsized":"2024-08-09T00:40:57.854076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:57.853840+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.853840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:19:44.705587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'171","reported_seq":704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:39.231644+0000","last_change":"2024-08-09T00:40:39.231644+0000","last_active":"2024-08-09T00:40:39.231644+0000","last_peered":"2024-08-09T00:40:39.231644+0000","last_clean":"2024-08-09T00:40:39.231644+0000","last_became_active":"2024-08-08T23:28:34.830080+0000","last_became_peered":"2024-08-08T23:28:34.830080+0000","last_unstale":"2024-08-09T00:40:39.231644+0000","last_undegraded":"2024-08-09T00:40:39.231644+0000","last_fullsized":"2024-08-09T00:40:39.231644+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'171","last_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_deep_scrub":"268'171","last_deep_scrub_stamp":"2024-08-09T00:40:39.231346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:39.231346+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:32:12.225013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":192,"num_write":301,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'179","reported_seq":812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.081101+0000","last_change":"2024-08-09T00:41:00.081164+0000","last_active":"2024-08-09T00:41:00.081101+0000","last_peered":"2024-08-09T00:41:00.081101+0000","last_clean":"2024-08-09T00:41:00.081101+0000","last_became_active":"2024-08-08T23:28:26.769287+0000","last_became_peered":"2024-08-08T23:28:26.769287+0000","last_unstale":"2024-08-09T00:41:00.081101+0000","last_undegraded":"2024-08-09T00:41:00.081101+0000","last_fullsized":"2024-08-09T00:41:00.081101+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-08-09T00:41:00.080907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.080907+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:25:56.975527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":719,"num_read_kb":592,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'174","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.511903+0000","last_change":"2024-08-09T00:41:21.512096+0000","last_active":"2024-08-09T00:41:21.511903+0000","last_peered":"2024-08-09T00:41:21.511903+0000","last_clean":"2024-08-09T00:41:21.511903+0000","last_became_active":"2024-08-08T23:28:24.792656+0000","last_became_peered":"2024-08-08T23:28:24.792656+0000","last_unstale":"2024-08-09T00:41:21.511903+0000","last_undegraded":"2024-08-09T00:41:21.511903+0000","last_fullsized":"2024-08-09T00:41:21.511903+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-08-09T00:41:21.511672+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-08-09T00:41:21.511672+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.511672+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:23:33.156663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":472,"num_read_kb":4608,"num_write":1010,"num_write_kb":22960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.781111+0000","last_change":"2024-08-09T00:40:47.781111+0000","last_active":"2024-08-09T00:40:47.781111+0000","last_peered":"2024-08-09T00:40:47.781111+0000","last_clean":"2024-08-09T00:40:47.781111+0000","last_became_active":"2024-08-08T23:28:28.776213+0000","last_became_peered":"2024-08-08T23:28:28.776213+0000","last_unstale":"2024-08-09T00:40:47.781111+0000","last_undegraded":"2024-08-09T00:40:47.781111+0000","last_fullsized":"2024-08-09T00:40:47.781111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.780862+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.780862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:00:19.491613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'125","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.081649+0000","last_change":"2024-08-09T00:40:48.081744+0000","last_active":"2024-08-09T00:40:48.081649+0000","last_peered":"2024-08-09T00:40:48.081649+0000","last_clean":"2024-08-09T00:40:48.081649+0000","last_became_active":"2024-08-08T23:28:31.043332+0000","last_became_peered":"2024-08-08T23:28:31.043332+0000","last_unstale":"2024-08-09T00:40:48.081649+0000","last_undegraded":"2024-08-09T00:40:48.081649+0000","last_fullsized":"2024-08-09T00:40:48.081649+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:40:48.081431+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.081431+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:41:20.399083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1648,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'500","reported_seq":2385,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:43.928684+0000","last_change":"2024-08-09T00:40:43.928684+0000","last_active":"2024-08-09T00:40:43.928684+0000","last_peered":"2024-08-09T00:40:43.928684+0000","last_clean":"2024-08-09T00:40:43.928684+0000","last_became_active":"2024-08-08T23:28:32.817197+0000","last_became_peered":"2024-08-08T23:28:32.817197+0000","last_unstale":"2024-08-09T00:40:43.928684+0000","last_undegraded":"2024-08-09T00:40:43.928684+0000","last_fullsized":"2024-08-09T00:40:43.928684+0000","mapping_epoch":33,"log_start":"265'400","ondisk_log_start":"265'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-08-09T00:40:43.928424+0000","last_clean_scrub_stamp":"2024-08-09T00:40:43.928424+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:09:10.523694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'126","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:54.672780+0000","last_change":"2024-08-09T00:40:54.672780+0000","last_active":"2024-08-09T00:40:54.672780+0000","last_peered":"2024-08-09T00:40:54.672780+0000","last_clean":"2024-08-09T00:40:54.672780+0000","last_became_active":"2024-08-08T23:28:34.824123+0000","last_became_peered":"2024-08-08T23:28:34.824123+0000","last_unstale":"2024-08-09T00:40:54.672780+0000","last_undegraded":"2024-08-09T00:40:54.672780+0000","last_fullsized":"2024-08-09T00:40:54.672780+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-08-09T00:40:54.672506+0000","last_clean_scrub_stamp":"2024-08-09T00:40:54.672506+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:21:26.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'174","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:13.259011+0000","last_change":"2024-08-09T00:41:13.259073+0000","last_active":"2024-08-09T00:41:13.259011+0000","last_peered":"2024-08-09T00:41:13.259011+0000","last_clean":"2024-08-09T00:41:13.259011+0000","last_became_active":"2024-08-08T23:28:26.758849+0000","last_became_peered":"2024-08-08T23:28:26.758849+0000","last_unstale":"2024-08-09T00:41:13.259011+0000","last_undegraded":"2024-08-09T00:41:13.259011+0000","last_fullsized":"2024-08-09T00:41:13.259011+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-08-09T00:41:13.258816+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-08-09T00:41:13.258816+0000","last_clean_scrub_stamp":"2024-08-09T00:41:13.258816+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:31:02.126802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":532,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'193","reported_seq":823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.140413+0000","last_change":"2024-08-09T00:40:59.140519+0000","last_active":"2024-08-09T00:40:59.140413+0000","last_peered":"2024-08-09T00:40:59.140413+0000","last_clean":"2024-08-09T00:40:59.140413+0000","last_became_active":"2024-08-08T23:28:24.819154+0000","last_became_peered":"2024-08-08T23:28:24.819154+0000","last_unstale":"2024-08-09T00:40:59.140413+0000","last_undegraded":"2024-08-09T00:40:59.140413+0000","last_fullsized":"2024-08-09T00:40:59.140413+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-08-09T00:40:59.140216+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.140216+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:09:17.562745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755945,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":50563,"num_write":1098,"num_write_kb":19857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.518613+0000","last_change":"2024-08-09T00:41:08.518669+0000","last_active":"2024-08-09T00:41:08.518613+0000","last_peered":"2024-08-09T00:41:08.518613+0000","last_clean":"2024-08-09T00:41:08.518613+0000","last_became_active":"2024-08-08T23:28:28.789351+0000","last_became_peered":"2024-08-08T23:28:28.789351+0000","last_unstale":"2024-08-09T00:41:08.518613+0000","last_undegraded":"2024-08-09T00:41:08.518613+0000","last_fullsized":"2024-08-09T00:41:08.518613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:08.518412+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.518412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:19:26.350798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'253","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.298522+0000","last_change":"2024-08-09T00:40:51.298522+0000","last_active":"2024-08-09T00:40:51.298522+0000","last_peered":"2024-08-09T00:40:51.298522+0000","last_clean":"2024-08-09T00:40:51.298522+0000","last_became_active":"2024-08-08T23:28:30.775276+0000","last_became_peered":"2024-08-08T23:28:30.775276+0000","last_unstale":"2024-08-09T00:40:51.298522+0000","last_undegraded":"2024-08-09T00:40:51.298522+0000","last_fullsized":"2024-08-09T00:40:51.298522+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-08-09T00:40:51.298232+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.298232+0000","objects_scrubbed":11,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:06:39.882351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10001,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":440,"num_write":200,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:01.608126+0000","last_change":"2024-08-09T00:41:01.608126+0000","last_active":"2024-08-09T00:41:01.608126+0000","last_peered":"2024-08-09T00:41:01.608126+0000","last_clean":"2024-08-09T00:41:01.608126+0000","last_became_active":"2024-08-08T23:28:32.820019+0000","last_became_peered":"2024-08-08T23:28:32.820019+0000","last_unstale":"2024-08-09T00:41:01.608126+0000","last_undegraded":"2024-08-09T00:41:01.608126+0000","last_fullsized":"2024-08-09T00:41:01.608126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:41:01.607865+0000","last_clean_scrub_stamp":"2024-08-09T00:41:01.607865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:12:52.168443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'122","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.594729+0000","last_change":"2024-08-09T00:40:51.594729+0000","last_active":"2024-08-09T00:40:51.594729+0000","last_peered":"2024-08-09T00:40:51.594729+0000","last_clean":"2024-08-09T00:40:51.594729+0000","last_became_active":"2024-08-08T23:28:34.839494+0000","last_became_peered":"2024-08-08T23:28:34.839494+0000","last_unstale":"2024-08-09T00:40:51.594729+0000","last_undegraded":"2024-08-09T00:40:51.594729+0000","last_fullsized":"2024-08-09T00:40:51.594729+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-08-09T00:40:51.594473+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.594473+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:02:11.845593+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":191,"num_write":292,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'180","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.242586+0000","last_change":"2024-08-09T00:41:11.242704+0000","last_active":"2024-08-09T00:41:11.242586+0000","last_peered":"2024-08-09T00:41:11.242586+0000","last_clean":"2024-08-09T00:41:11.242586+0000","last_became_active":"2024-08-08T23:28:26.750198+0000","last_became_peered":"2024-08-08T23:28:26.750198+0000","last_unstale":"2024-08-09T00:41:11.242586+0000","last_undegraded":"2024-08-09T00:41:11.242586+0000","last_fullsized":"2024-08-09T00:41:11.242586+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'180","last_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_deep_scrub":"268'180","last_deep_scrub_stamp":"2024-08-09T00:41:11.242344+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.242344+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:40:24.429124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":762,"num_read_kb":622,"num_write":269,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'198","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.069128+0000","last_change":"2024-08-09T00:41:05.069265+0000","last_active":"2024-08-09T00:41:05.069128+0000","last_peered":"2024-08-09T00:41:05.069128+0000","last_clean":"2024-08-09T00:41:05.069128+0000","last_became_active":"2024-08-08T23:28:24.817544+0000","last_became_peered":"2024-08-08T23:28:24.817544+0000","last_unstale":"2024-08-09T00:41:05.069128+0000","last_undegraded":"2024-08-09T00:41:05.069128+0000","last_fullsized":"2024-08-09T00:41:05.069128+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-08-09T00:41:05.068927+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.068927+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:34:56.248742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":62745,"num_write":1020,"num_write_kb":22723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.230548+0000","last_change":"2024-08-09T00:40:53.230548+0000","last_active":"2024-08-09T00:40:53.230548+0000","last_peered":"2024-08-09T00:40:53.230548+0000","last_clean":"2024-08-09T00:40:53.230548+0000","last_became_active":"2024-08-08T23:28:28.776217+0000","last_became_peered":"2024-08-08T23:28:28.776217+0000","last_unstale":"2024-08-09T00:40:53.230548+0000","last_undegraded":"2024-08-09T00:40:53.230548+0000","last_fullsized":"2024-08-09T00:40:53.230548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:53.230299+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.230299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:40:57.894338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'151","reported_seq":754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.521612+0000","last_change":"2024-08-09T00:41:26.521763+0000","last_active":"2024-08-09T00:41:26.521612+0000","last_peered":"2024-08-09T00:41:26.521612+0000","last_clean":"2024-08-09T00:41:26.521612+0000","last_became_active":"2024-08-08T23:28:30.789737+0000","last_became_peered":"2024-08-08T23:28:30.789737+0000","last_unstale":"2024-08-09T00:41:26.521612+0000","last_undegraded":"2024-08-09T00:41:26.521612+0000","last_fullsized":"2024-08-09T00:41:26.521612+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'151","last_scrub_stamp":"2024-08-09T00:41:26.521391+0000","last_deep_scrub":"268'151","last_deep_scrub_stamp":"2024-08-09T00:41:26.521391+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.521391+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:17:12.442199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":272,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.898098+0000","last_change":"2024-08-09T00:40:42.898098+0000","last_active":"2024-08-09T00:40:42.898098+0000","last_peered":"2024-08-09T00:40:42.898098+0000","last_clean":"2024-08-09T00:40:42.898098+0000","last_became_active":"2024-08-08T23:28:32.812979+0000","last_became_peered":"2024-08-08T23:28:32.812979+0000","last_unstale":"2024-08-09T00:40:42.898098+0000","last_undegraded":"2024-08-09T00:40:42.898098+0000","last_fullsized":"2024-08-09T00:40:42.898098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:42.897858+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.897858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:26:14.996595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'139","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:50.308062+0000","last_change":"2024-08-09T00:40:50.308062+0000","last_active":"2024-08-09T00:40:50.308062+0000","last_peered":"2024-08-09T00:40:50.308062+0000","last_clean":"2024-08-09T00:40:50.308062+0000","last_became_active":"2024-08-08T23:28:34.829287+0000","last_became_peered":"2024-08-08T23:28:34.829287+0000","last_unstale":"2024-08-09T00:40:50.308062+0000","last_undegraded":"2024-08-09T00:40:50.308062+0000","last_fullsized":"2024-08-09T00:40:50.308062+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-08-09T00:40:50.307777+0000","last_clean_scrub_stamp":"2024-08-09T00:40:50.307777+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:13:23.329056+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":228,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'112","reported_seq":775,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:10.467022+0000","last_change":"2024-08-09T00:41:10.467022+0000","last_active":"2024-08-09T00:41:10.467022+0000","last_peered":"2024-08-09T00:41:10.467022+0000","last_clean":"2024-08-09T00:41:10.467022+0000","last_became_active":"2024-08-08T23:28:26.760979+0000","last_became_peered":"2024-08-08T23:28:26.760979+0000","last_unstale":"2024-08-09T00:41:10.467022+0000","last_undegraded":"2024-08-09T00:41:10.467022+0000","last_fullsized":"2024-08-09T00:41:10.467022+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-08-09T00:41:10.466733+0000","last_clean_scrub_stamp":"2024-08-09T00:41:10.466733+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:22:15.220734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":431,"num_write":154,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'266","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:26.462725+0000","last_change":"2024-08-09T00:41:26.462878+0000","last_active":"2024-08-09T00:41:26.462725+0000","last_peered":"2024-08-09T00:41:26.462725+0000","last_clean":"2024-08-09T00:41:26.462725+0000","last_became_active":"2024-08-08T23:28:24.792645+0000","last_became_peered":"2024-08-08T23:28:24.792645+0000","last_unstale":"2024-08-09T00:41:26.462725+0000","last_undegraded":"2024-08-09T00:41:26.462725+0000","last_fullsized":"2024-08-09T00:41:26.462725+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'266","last_scrub_stamp":"2024-08-09T00:41:26.462496+0000","last_deep_scrub":"268'266","last_deep_scrub_stamp":"2024-08-09T00:41:26.462496+0000","last_clean_scrub_stamp":"2024-08-09T00:41:26.462496+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:37:41.483775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":32625,"num_write":1559,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.988585+0000","last_change":"2024-08-09T00:40:59.988585+0000","last_active":"2024-08-09T00:40:59.988585+0000","last_peered":"2024-08-09T00:40:59.988585+0000","last_clean":"2024-08-09T00:40:59.988585+0000","last_became_active":"2024-08-08T23:28:28.777436+0000","last_became_peered":"2024-08-08T23:28:28.777436+0000","last_unstale":"2024-08-09T00:40:59.988585+0000","last_undegraded":"2024-08-09T00:40:59.988585+0000","last_fullsized":"2024-08-09T00:40:59.988585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.988336+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.988336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:23:42.997335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'127","reported_seq":722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:04.386302+0000","last_change":"2024-08-09T00:41:04.386371+0000","last_active":"2024-08-09T00:41:04.386302+0000","last_peered":"2024-08-09T00:41:04.386302+0000","last_clean":"2024-08-09T00:41:04.386302+0000","last_became_active":"2024-08-08T23:28:30.792122+0000","last_became_peered":"2024-08-08T23:28:30.792122+0000","last_unstale":"2024-08-09T00:41:04.386302+0000","last_undegraded":"2024-08-09T00:41:04.386302+0000","last_fullsized":"2024-08-09T00:41:04.386302+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-08-09T00:41:04.386118+0000","last_clean_scrub_stamp":"2024-08-09T00:41:04.386118+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:45:47.085465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":219,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:47.105495+0000","last_change":"2024-08-09T00:40:47.105495+0000","last_active":"2024-08-09T00:40:47.105495+0000","last_peered":"2024-08-09T00:40:47.105495+0000","last_clean":"2024-08-09T00:40:47.105495+0000","last_became_active":"2024-08-08T23:28:32.811516+0000","last_became_peered":"2024-08-08T23:28:32.811516+0000","last_unstale":"2024-08-09T00:40:47.105495+0000","last_undegraded":"2024-08-09T00:40:47.105495+0000","last_fullsized":"2024-08-09T00:40:47.105495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:47.105221+0000","last_clean_scrub_stamp":"2024-08-09T00:40:47.105221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:33:39.031153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'148","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.651222+0000","last_change":"2024-08-09T00:40:53.651222+0000","last_active":"2024-08-09T00:40:53.651222+0000","last_peered":"2024-08-09T00:40:53.651222+0000","last_clean":"2024-08-09T00:40:53.651222+0000","last_became_active":"2024-08-08T23:28:34.835293+0000","last_became_peered":"2024-08-08T23:28:34.835293+0000","last_unstale":"2024-08-09T00:40:53.651222+0000","last_undegraded":"2024-08-09T00:40:53.651222+0000","last_fullsized":"2024-08-09T00:40:53.651222+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:53.650953+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.650953+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:07:30.584762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":353,"num_read_kb":349,"num_write":359,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":200,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'4116","reported_seq":4760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.022603+0000","last_change":"2024-08-09T00:40:56.022603+0000","last_active":"2024-08-09T00:40:56.022603+0000","last_peered":"2024-08-09T00:40:56.022603+0000","last_clean":"2024-08-09T00:40:56.022603+0000","last_became_active":"2024-08-08T23:28:26.780447+0000","last_became_peered":"2024-08-08T23:28:26.780447+0000","last_unstale":"2024-08-09T00:40:56.022603+0000","last_undegraded":"2024-08-09T00:40:56.022603+0000","last_fullsized":"2024-08-09T00:40:56.022603+0000","mapping_epoch":27,"log_start":"268'4100","ondisk_log_start":"268'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4116","last_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_deep_scrub":"268'4116","last_deep_scrub_stamp":"2024-08-09T00:40:56.022341+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.022341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":3000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T10:22:33.702715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14494,"num_read_kb":11758,"num_write":6177,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'159","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.557770+0000","last_change":"2024-08-09T00:41:24.557865+0000","last_active":"2024-08-09T00:41:24.557770+0000","last_peered":"2024-08-09T00:41:24.557770+0000","last_clean":"2024-08-09T00:41:24.557770+0000","last_became_active":"2024-08-08T23:28:24.807961+0000","last_became_peered":"2024-08-08T23:28:24.807961+0000","last_unstale":"2024-08-09T00:41:24.557770+0000","last_undegraded":"2024-08-09T00:41:24.557770+0000","last_fullsized":"2024-08-09T00:41:24.557770+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-08-09T00:41:24.557573+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-08-09T00:41:24.557573+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.557573+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:43:40.743229+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4272291,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":403,"num_read_kb":16350,"num_write":847,"num_write_kb":25150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:48.815755+0000","last_change":"2024-08-09T00:40:48.815755+0000","last_active":"2024-08-09T00:40:48.815755+0000","last_peered":"2024-08-09T00:40:48.815755+0000","last_clean":"2024-08-09T00:40:48.815755+0000","last_became_active":"2024-08-08T23:28:28.758586+0000","last_became_peered":"2024-08-08T23:28:28.758586+0000","last_unstale":"2024-08-09T00:40:48.815755+0000","last_undegraded":"2024-08-09T00:40:48.815755+0000","last_fullsized":"2024-08-09T00:40:48.815755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-08-09T00:40:48.815323+0000","last_clean_scrub_stamp":"2024-08-09T00:40:48.815323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:03:20.269004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'200","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:51.035765+0000","last_change":"2024-08-09T00:40:51.035765+0000","last_active":"2024-08-09T00:40:51.035765+0000","last_peered":"2024-08-09T00:40:51.035765+0000","last_clean":"2024-08-09T00:40:51.035765+0000","last_became_active":"2024-08-08T23:28:30.785019+0000","last_became_peered":"2024-08-08T23:28:30.785019+0000","last_unstale":"2024-08-09T00:40:51.035765+0000","last_undegraded":"2024-08-09T00:40:51.035765+0000","last_fullsized":"2024-08-09T00:40:51.035765+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:40:51.035329+0000","last_clean_scrub_stamp":"2024-08-09T00:40:51.035329+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:12:44.986718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":261,"num_read_kb":353,"num_write":152,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.582286+0000","last_change":"2024-08-09T00:40:59.582286+0000","last_active":"2024-08-09T00:40:59.582286+0000","last_peered":"2024-08-09T00:40:59.582286+0000","last_clean":"2024-08-09T00:40:59.582286+0000","last_became_active":"2024-08-08T23:28:32.820327+0000","last_became_peered":"2024-08-08T23:28:32.820327+0000","last_unstale":"2024-08-09T00:40:59.582286+0000","last_undegraded":"2024-08-09T00:40:59.582286+0000","last_fullsized":"2024-08-09T00:40:59.582286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-09T00:40:59.581921+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.581921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:44:07.548390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'143","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:38.960067+0000","last_change":"2024-08-09T00:40:38.960067+0000","last_active":"2024-08-09T00:40:38.960067+0000","last_peered":"2024-08-09T00:40:38.960067+0000","last_clean":"2024-08-09T00:40:38.960067+0000","last_became_active":"2024-08-08T23:28:34.831900+0000","last_became_peered":"2024-08-08T23:28:34.831900+0000","last_unstale":"2024-08-09T00:40:38.960067+0000","last_undegraded":"2024-08-09T00:40:38.960067+0000","last_fullsized":"2024-08-09T00:40:38.960067+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-08-09T00:40:38.959801+0000","last_clean_scrub_stamp":"2024-08-09T00:40:38.959801+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:42:09.065450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":363,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'226","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:00.823607+0000","last_change":"2024-08-09T00:41:00.823673+0000","last_active":"2024-08-09T00:41:00.823607+0000","last_peered":"2024-08-09T00:41:00.823607+0000","last_clean":"2024-08-09T00:41:00.823607+0000","last_became_active":"2024-08-08T23:28:26.768929+0000","last_became_peered":"2024-08-08T23:28:26.768929+0000","last_unstale":"2024-08-09T00:41:00.823607+0000","last_undegraded":"2024-08-09T00:41:00.823607+0000","last_fullsized":"2024-08-09T00:41:00.823607+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'226","last_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_deep_scrub":"268'226","last_deep_scrub_stamp":"2024-08-09T00:41:00.823423+0000","last_clean_scrub_stamp":"2024-08-09T00:41:00.823423+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:23:01.815453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":919,"num_read_kb":718,"num_write":370,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'212","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:03.210660+0000","last_change":"2024-08-09T00:41:03.210660+0000","last_active":"2024-08-09T00:41:03.210660+0000","last_peered":"2024-08-09T00:41:03.210660+0000","last_clean":"2024-08-09T00:41:03.210660+0000","last_became_active":"2024-08-08T23:28:24.801803+0000","last_became_peered":"2024-08-08T23:28:24.801803+0000","last_unstale":"2024-08-09T00:41:03.210660+0000","last_undegraded":"2024-08-09T00:41:03.210660+0000","last_fullsized":"2024-08-09T00:41:03.210660+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'212","last_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_deep_scrub":"268'212","last_deep_scrub_stamp":"2024-08-09T00:41:03.210345+0000","last_clean_scrub_stamp":"2024-08-09T00:41:03.210345+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:29:21.028021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170402,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":16985,"num_write":1184,"num_write_kb":36823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'148","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:36.251126+0000","last_change":"2024-08-09T00:40:36.251196+0000","last_active":"2024-08-09T00:40:36.251126+0000","last_peered":"2024-08-09T00:40:36.251126+0000","last_clean":"2024-08-09T00:40:36.251126+0000","last_became_active":"2024-08-08T23:29:01.583624+0000","last_became_peered":"2024-08-08T23:29:01.583624+0000","last_unstale":"2024-08-09T00:40:36.251126+0000","last_undegraded":"2024-08-09T00:40:36.251126+0000","last_fullsized":"2024-08-09T00:40:36.251126+0000","mapping_epoch":38,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-08-09T00:40:36.250936+0000","last_clean_scrub_stamp":"2024-08-09T00:40:36.250936+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:05:42.591313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":637,"num_read_kb":512,"num_write":222,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"268'209","reported_seq":865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.138828+0000","last_change":"2024-08-09T00:40:56.138828+0000","last_active":"2024-08-09T00:40:56.138828+0000","last_peered":"2024-08-09T00:40:56.138828+0000","last_clean":"2024-08-09T00:40:56.138828+0000","last_became_active":"2024-08-08T23:28:24.787334+0000","last_became_peered":"2024-08-08T23:28:24.787334+0000","last_unstale":"2024-08-09T00:40:56.138828+0000","last_undegraded":"2024-08-09T00:40:56.138828+0000","last_fullsized":"2024-08-09T00:40:56.138828+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'209","last_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_deep_scrub":"268'209","last_deep_scrub_stamp":"2024-08-09T00:40:56.138509+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.138509+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:50:17.475723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906586,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":27391,"num_write":1081,"num_write_kb":39920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'131","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:56.212561+0000","last_change":"2024-08-09T00:40:56.212627+0000","last_active":"2024-08-09T00:40:56.212561+0000","last_peered":"2024-08-09T00:40:56.212561+0000","last_clean":"2024-08-09T00:40:56.212561+0000","last_became_active":"2024-08-08T23:28:26.788734+0000","last_became_peered":"2024-08-08T23:28:26.788734+0000","last_unstale":"2024-08-09T00:40:56.212561+0000","last_undegraded":"2024-08-09T00:40:56.212561+0000","last_fullsized":"2024-08-09T00:40:56.212561+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-08-09T00:40:56.212357+0000","last_clean_scrub_stamp":"2024-08-09T00:40:56.212357+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:04.512212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":447,"num_write":221,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'208","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:15.139595+0000","last_change":"2024-08-09T00:41:15.139595+0000","last_active":"2024-08-09T00:41:15.139595+0000","last_peered":"2024-08-09T00:41:15.139595+0000","last_clean":"2024-08-09T00:41:15.139595+0000","last_became_active":"2024-08-08T23:28:24.795766+0000","last_became_peered":"2024-08-08T23:28:24.795766+0000","last_unstale":"2024-08-09T00:41:15.139595+0000","last_undegraded":"2024-08-09T00:41:15.139595+0000","last_fullsized":"2024-08-09T00:41:15.139595+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:41:15.139316+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:41:15.139316+0000","last_clean_scrub_stamp":"2024-08-09T00:41:15.139316+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:54:36.800032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":17234,"num_write":1189,"num_write_kb":28043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'70","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.835828+0000","last_change":"2024-08-09T00:40:58.835895+0000","last_active":"2024-08-09T00:40:58.835828+0000","last_peered":"2024-08-09T00:40:58.835828+0000","last_clean":"2024-08-09T00:40:58.835828+0000","last_became_active":"2024-08-08T23:28:26.774774+0000","last_became_peered":"2024-08-08T23:28:26.774774+0000","last_unstale":"2024-08-09T00:40:58.835828+0000","last_undegraded":"2024-08-09T00:40:58.835828+0000","last_fullsized":"2024-08-09T00:40:58.835828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'70","last_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_deep_scrub":"268'70","last_deep_scrub_stamp":"2024-08-09T00:40:58.835621+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.835621+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:55:34.064444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":304,"num_read_kb":250,"num_write":107,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'258","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:44.234546+0000","last_change":"2024-08-09T00:40:44.234632+0000","last_active":"2024-08-09T00:40:44.234546+0000","last_peered":"2024-08-09T00:40:44.234546+0000","last_clean":"2024-08-09T00:40:44.234546+0000","last_became_active":"2024-08-08T23:29:01.884865+0000","last_became_peered":"2024-08-08T23:29:01.884865+0000","last_unstale":"2024-08-09T00:40:44.234546+0000","last_undegraded":"2024-08-09T00:40:44.234546+0000","last_fullsized":"2024-08-09T00:40:44.234546+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'258","last_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_deep_scrub":"268'258","last_deep_scrub_stamp":"2024-08-09T00:40:44.234346+0000","last_clean_scrub_stamp":"2024-08-09T00:40:44.234346+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:44:03.157959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":548,"num_read_kb":58241,"num_write":1241,"num_write_kb":44002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"268'130","reported_seq":720,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:08.443305+0000","last_change":"2024-08-09T00:41:08.443305+0000","last_active":"2024-08-09T00:41:08.443305+0000","last_peered":"2024-08-09T00:41:08.443305+0000","last_clean":"2024-08-09T00:41:08.443305+0000","last_became_active":"2024-08-08T23:28:26.775638+0000","last_became_peered":"2024-08-08T23:28:26.775638+0000","last_unstale":"2024-08-09T00:41:08.443305+0000","last_undegraded":"2024-08-09T00:41:08.443305+0000","last_fullsized":"2024-08-09T00:41:08.443305+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-08-09T00:41:08.442893+0000","last_clean_scrub_stamp":"2024-08-09T00:41:08.442893+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:32:52.226288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":398,"num_write":185,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'208","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.489043+0000","last_change":"2024-08-09T00:41:24.489124+0000","last_active":"2024-08-09T00:41:24.489043+0000","last_peered":"2024-08-09T00:41:24.489043+0000","last_clean":"2024-08-09T00:41:24.489043+0000","last_became_active":"2024-08-08T23:28:24.773551+0000","last_became_peered":"2024-08-08T23:28:24.773551+0000","last_unstale":"2024-08-09T00:41:24.489043+0000","last_undegraded":"2024-08-09T00:41:24.489043+0000","last_fullsized":"2024-08-09T00:41:24.489043+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'208","last_scrub_stamp":"2024-08-09T00:41:24.488851+0000","last_deep_scrub":"268'208","last_deep_scrub_stamp":"2024-08-09T00:41:24.488851+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.488851+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T00:54:27.461712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":406,"num_read_kb":7859,"num_write":1109,"num_write_kb":26904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'436","reported_seq":1222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:52.066374+0000","last_change":"2024-08-09T00:40:52.066374+0000","last_active":"2024-08-09T00:40:52.066374+0000","last_peered":"2024-08-09T00:40:52.066374+0000","last_clean":"2024-08-09T00:40:52.066374+0000","last_became_active":"2024-08-08T23:28:26.778831+0000","last_became_peered":"2024-08-08T23:28:26.778831+0000","last_unstale":"2024-08-09T00:40:52.066374+0000","last_undegraded":"2024-08-09T00:40:52.066374+0000","last_fullsized":"2024-08-09T00:40:52.066374+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-08-09T00:40:52.066127+0000","last_clean_scrub_stamp":"2024-08-09T00:40:52.066127+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:09:51.014077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1871,"num_read_kb":1563,"num_write":782,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'239","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:06.916506+0000","last_change":"2024-08-09T00:41:06.916652+0000","last_active":"2024-08-09T00:41:06.916506+0000","last_peered":"2024-08-09T00:41:06.916506+0000","last_clean":"2024-08-09T00:41:06.916506+0000","last_became_active":"2024-08-08T23:28:24.758571+0000","last_became_peered":"2024-08-08T23:28:24.758571+0000","last_unstale":"2024-08-09T00:41:06.916506+0000","last_undegraded":"2024-08-09T00:41:06.916506+0000","last_fullsized":"2024-08-09T00:41:06.916506+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'239","last_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_deep_scrub":"268'239","last_deep_scrub_stamp":"2024-08-09T00:41:06.916270+0000","last_clean_scrub_stamp":"2024-08-09T00:41:06.916270+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:05:47.293252+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4141181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":673,"num_read_kb":20658,"num_write":1118,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'44","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.469253+0000","last_change":"2024-08-09T00:41:14.469253+0000","last_active":"2024-08-09T00:41:14.469253+0000","last_peered":"2024-08-09T00:41:14.469253+0000","last_clean":"2024-08-09T00:41:14.469253+0000","last_became_active":"2024-08-08T23:28:26.753602+0000","last_became_peered":"2024-08-08T23:28:26.753602+0000","last_unstale":"2024-08-09T00:41:14.469253+0000","last_undegraded":"2024-08-09T00:41:14.469253+0000","last_fullsized":"2024-08-09T00:41:14.469253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-08-09T00:41:14.469006+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-08-09T00:41:14.469006+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.469006+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:47:27.702181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":145,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'200","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:02.259004+0000","last_change":"2024-08-09T00:41:02.259178+0000","last_active":"2024-08-09T00:41:02.259004+0000","last_peered":"2024-08-09T00:41:02.259004+0000","last_clean":"2024-08-09T00:41:02.259004+0000","last_became_active":"2024-08-08T23:28:24.794206+0000","last_became_peered":"2024-08-08T23:28:24.794206+0000","last_unstale":"2024-08-09T00:41:02.259004+0000","last_undegraded":"2024-08-09T00:41:02.259004+0000","last_fullsized":"2024-08-09T00:41:02.259004+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'200","last_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_deep_scrub":"268'200","last_deep_scrub_stamp":"2024-08-09T00:41:02.258807+0000","last_clean_scrub_stamp":"2024-08-09T00:41:02.258807+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:14:06.788691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":364,"num_read_kb":32922,"num_write":1098,"num_write_kb":42342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'233","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.141350+0000","last_change":"2024-08-09T00:40:57.141350+0000","last_active":"2024-08-09T00:40:57.141350+0000","last_peered":"2024-08-09T00:40:57.141350+0000","last_clean":"2024-08-09T00:40:57.141350+0000","last_became_active":"2024-08-08T23:28:26.769698+0000","last_became_peered":"2024-08-08T23:28:26.769698+0000","last_unstale":"2024-08-09T00:40:57.141350+0000","last_undegraded":"2024-08-09T00:40:57.141350+0000","last_fullsized":"2024-08-09T00:40:57.141350+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:40:57.140970+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.140970+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:49:09.384475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":969,"num_read_kb":782,"num_write":365,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'255","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:42.689648+0000","last_change":"2024-08-09T00:40:42.689791+0000","last_active":"2024-08-09T00:40:42.689648+0000","last_peered":"2024-08-09T00:40:42.689648+0000","last_clean":"2024-08-09T00:40:42.689648+0000","last_became_active":"2024-08-08T23:29:01.887496+0000","last_became_peered":"2024-08-08T23:29:01.887496+0000","last_unstale":"2024-08-09T00:40:42.689648+0000","last_undegraded":"2024-08-09T00:40:42.689648+0000","last_fullsized":"2024-08-09T00:40:42.689648+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'255","last_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_deep_scrub":"268'255","last_deep_scrub_stamp":"2024-08-09T00:40:42.689455+0000","last_clean_scrub_stamp":"2024-08-09T00:40:42.689455+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:26:59.280632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":18739,"num_write":1245,"num_write_kb":24588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"268'188","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:05.482175+0000","last_change":"2024-08-09T00:41:05.482316+0000","last_active":"2024-08-09T00:41:05.482175+0000","last_peered":"2024-08-09T00:41:05.482175+0000","last_clean":"2024-08-09T00:41:05.482175+0000","last_became_active":"2024-08-08T23:28:26.774373+0000","last_became_peered":"2024-08-08T23:28:26.774373+0000","last_unstale":"2024-08-09T00:41:05.482175+0000","last_undegraded":"2024-08-09T00:41:05.482175+0000","last_fullsized":"2024-08-09T00:41:05.482175+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'188","last_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_deep_scrub":"268'188","last_deep_scrub_stamp":"2024-08-09T00:41:05.481959+0000","last_clean_scrub_stamp":"2024-08-09T00:41:05.481959+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T12:37:25.905559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":767,"num_read_kb":620,"num_write":284,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'189","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.107206+0000","last_change":"2024-08-09T00:41:12.107374+0000","last_active":"2024-08-09T00:41:12.107206+0000","last_peered":"2024-08-09T00:41:12.107206+0000","last_clean":"2024-08-09T00:41:12.107206+0000","last_became_active":"2024-08-08T23:28:24.787900+0000","last_became_peered":"2024-08-08T23:28:24.787900+0000","last_unstale":"2024-08-09T00:41:12.107206+0000","last_undegraded":"2024-08-09T00:41:12.107206+0000","last_fullsized":"2024-08-09T00:41:12.107206+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'189","last_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_deep_scrub":"268'189","last_deep_scrub_stamp":"2024-08-09T00:41:12.106973+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.106973+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:28:34.387579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917966,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":400,"num_read_kb":34111,"num_write":1045,"num_write_kb":30188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'82","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.194385+0000","last_change":"2024-08-09T00:41:07.194448+0000","last_active":"2024-08-09T00:41:07.194385+0000","last_peered":"2024-08-09T00:41:07.194385+0000","last_clean":"2024-08-09T00:41:07.194385+0000","last_became_active":"2024-08-08T23:28:26.762894+0000","last_became_peered":"2024-08-08T23:28:26.762894+0000","last_unstale":"2024-08-09T00:41:07.194385+0000","last_undegraded":"2024-08-09T00:41:07.194385+0000","last_fullsized":"2024-08-09T00:41:07.194385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'82","last_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_deep_scrub":"268'82","last_deep_scrub_stamp":"2024-08-09T00:41:07.194191+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.194191+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:54:41.141377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":312,"num_read_kb":257,"num_write":110,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'206","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:21.414465+0000","last_change":"2024-08-09T00:41:21.414578+0000","last_active":"2024-08-09T00:41:21.414465+0000","last_peered":"2024-08-09T00:41:21.414465+0000","last_clean":"2024-08-09T00:41:21.414465+0000","last_became_active":"2024-08-08T23:28:24.753945+0000","last_became_peered":"2024-08-08T23:28:24.753945+0000","last_unstale":"2024-08-09T00:41:21.414465+0000","last_undegraded":"2024-08-09T00:41:21.414465+0000","last_fullsized":"2024-08-09T00:41:21.414465+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-08-09T00:41:21.414253+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-08-09T00:41:21.414253+0000","last_clean_scrub_stamp":"2024-08-09T00:41:21.414253+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:10:47.721636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":96889,"num_write":1101,"num_write_kb":45831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'66","reported_seq":650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:57.089279+0000","last_change":"2024-08-09T00:40:57.089342+0000","last_active":"2024-08-09T00:40:57.089279+0000","last_peered":"2024-08-09T00:40:57.089279+0000","last_clean":"2024-08-09T00:40:57.089279+0000","last_became_active":"2024-08-08T23:28:26.766369+0000","last_became_peered":"2024-08-08T23:28:26.766369+0000","last_unstale":"2024-08-09T00:40:57.089279+0000","last_undegraded":"2024-08-09T00:40:57.089279+0000","last_fullsized":"2024-08-09T00:40:57.089279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'66","last_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_deep_scrub":"268'66","last_deep_scrub_stamp":"2024-08-09T00:40:57.089084+0000","last_clean_scrub_stamp":"2024-08-09T00:40:57.089084+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:49:47.534069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":238,"num_write":95,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'184","reported_seq":835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:17.182399+0000","last_change":"2024-08-09T00:41:17.182489+0000","last_active":"2024-08-09T00:41:17.182399+0000","last_peered":"2024-08-09T00:41:17.182399+0000","last_clean":"2024-08-09T00:41:17.182399+0000","last_became_active":"2024-08-08T23:28:24.814041+0000","last_became_peered":"2024-08-08T23:28:24.814041+0000","last_unstale":"2024-08-09T00:41:17.182399+0000","last_undegraded":"2024-08-09T00:41:17.182399+0000","last_fullsized":"2024-08-09T00:41:17.182399+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'184","last_scrub_stamp":"2024-08-09T00:41:17.182206+0000","last_deep_scrub":"268'184","last_deep_scrub_stamp":"2024-08-09T00:41:17.182206+0000","last_clean_scrub_stamp":"2024-08-09T00:41:17.182206+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T04:48:11.839395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":443,"num_read_kb":71209,"num_write":978,"num_write_kb":30319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'111","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:53.029644+0000","last_change":"2024-08-09T00:40:53.029715+0000","last_active":"2024-08-09T00:40:53.029644+0000","last_peered":"2024-08-09T00:40:53.029644+0000","last_clean":"2024-08-09T00:40:53.029644+0000","last_became_active":"2024-08-08T23:28:26.778044+0000","last_became_peered":"2024-08-08T23:28:26.778044+0000","last_unstale":"2024-08-09T00:40:53.029644+0000","last_undegraded":"2024-08-09T00:40:53.029644+0000","last_fullsized":"2024-08-09T00:40:53.029644+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-08-09T00:40:53.029406+0000","last_clean_scrub_stamp":"2024-08-09T00:40:53.029406+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:28:02.108228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":374,"num_write":169,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'175","reported_seq":800,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:22.526651+0000","last_change":"2024-08-09T00:41:22.526728+0000","last_active":"2024-08-09T00:41:22.526651+0000","last_peered":"2024-08-09T00:41:22.526651+0000","last_clean":"2024-08-09T00:41:22.526651+0000","last_became_active":"2024-08-08T23:28:24.793836+0000","last_became_peered":"2024-08-08T23:28:24.793836+0000","last_unstale":"2024-08-09T00:41:22.526651+0000","last_undegraded":"2024-08-09T00:41:22.526651+0000","last_fullsized":"2024-08-09T00:41:22.526651+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-08-09T00:41:22.526459+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-08-09T00:41:22.526459+0000","last_clean_scrub_stamp":"2024-08-09T00:41:22.526459+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:00:29.954028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":31431,"num_write":995,"num_write_kb":28771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'211","reported_seq":858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.566407+0000","last_change":"2024-08-09T00:41:09.566466+0000","last_active":"2024-08-09T00:41:09.566407+0000","last_peered":"2024-08-09T00:41:09.566407+0000","last_clean":"2024-08-09T00:41:09.566407+0000","last_became_active":"2024-08-08T23:28:26.775062+0000","last_became_peered":"2024-08-08T23:28:26.775062+0000","last_unstale":"2024-08-09T00:41:09.566407+0000","last_undegraded":"2024-08-09T00:41:09.566407+0000","last_fullsized":"2024-08-09T00:41:09.566407+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-08-09T00:41:09.566215+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.566215+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T11:38:01.849623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":847,"num_read_kb":685,"num_write":332,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'231","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:59.186379+0000","last_change":"2024-08-09T00:40:59.186465+0000","last_active":"2024-08-09T00:40:59.186379+0000","last_peered":"2024-08-09T00:40:59.186379+0000","last_clean":"2024-08-09T00:40:59.186379+0000","last_became_active":"2024-08-08T23:28:24.762228+0000","last_became_peered":"2024-08-08T23:28:24.762228+0000","last_unstale":"2024-08-09T00:40:59.186379+0000","last_undegraded":"2024-08-09T00:40:59.186379+0000","last_fullsized":"2024-08-09T00:40:59.186379+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-08-09T00:40:59.186180+0000","last_clean_scrub_stamp":"2024-08-09T00:40:59.186180+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T08:23:22.480994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":70204,"num_write":1298,"num_write_kb":31069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'125","reported_seq":736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.467575+0000","last_change":"2024-08-09T00:41:09.467702+0000","last_active":"2024-08-09T00:41:09.467575+0000","last_peered":"2024-08-09T00:41:09.467575+0000","last_clean":"2024-08-09T00:41:09.467575+0000","last_became_active":"2024-08-08T23:28:26.766576+0000","last_became_peered":"2024-08-08T23:28:26.766576+0000","last_unstale":"2024-08-09T00:41:09.467575+0000","last_undegraded":"2024-08-09T00:41:09.467575+0000","last_fullsized":"2024-08-09T00:41:09.467575+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-08-09T00:41:09.467287+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.467287+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T02:36:21.257904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":412,"num_write":195,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'214","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:24.748354+0000","last_change":"2024-08-09T00:41:24.748456+0000","last_active":"2024-08-09T00:41:24.748354+0000","last_peered":"2024-08-09T00:41:24.748354+0000","last_clean":"2024-08-09T00:41:24.748354+0000","last_became_active":"2024-08-08T23:28:24.800843+0000","last_became_peered":"2024-08-08T23:28:24.800843+0000","last_unstale":"2024-08-09T00:41:24.748354+0000","last_undegraded":"2024-08-09T00:41:24.748354+0000","last_fullsized":"2024-08-09T00:41:24.748354+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'214","last_scrub_stamp":"2024-08-09T00:41:24.748133+0000","last_deep_scrub":"268'214","last_deep_scrub_stamp":"2024-08-09T00:41:24.748133+0000","last_clean_scrub_stamp":"2024-08-09T00:41:24.748133+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T05:26:14.276247+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":54938,"num_write":1149,"num_write_kb":35209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'100","reported_seq":708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:12.449184+0000","last_change":"2024-08-09T00:41:12.449298+0000","last_active":"2024-08-09T00:41:12.449184+0000","last_peered":"2024-08-09T00:41:12.449184+0000","last_clean":"2024-08-09T00:41:12.449184+0000","last_became_active":"2024-08-08T23:28:26.753866+0000","last_became_peered":"2024-08-08T23:28:26.753866+0000","last_unstale":"2024-08-09T00:41:12.449184+0000","last_undegraded":"2024-08-09T00:41:12.449184+0000","last_fullsized":"2024-08-09T00:41:12.449184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-08-09T00:41:12.448907+0000","last_clean_scrub_stamp":"2024-08-09T00:41:12.448907+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:16:29.102323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":337,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'161","reported_seq":801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:55.163620+0000","last_change":"2024-08-09T00:40:55.163789+0000","last_active":"2024-08-09T00:40:55.163620+0000","last_peered":"2024-08-09T00:40:55.163620+0000","last_clean":"2024-08-09T00:40:55.163620+0000","last_became_active":"2024-08-08T23:28:24.763112+0000","last_became_peered":"2024-08-08T23:28:24.763112+0000","last_unstale":"2024-08-09T00:40:55.163620+0000","last_undegraded":"2024-08-09T00:40:55.163620+0000","last_fullsized":"2024-08-09T00:40:55.163620+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'161","last_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_deep_scrub":"268'161","last_deep_scrub_stamp":"2024-08-09T00:40:55.163304+0000","last_clean_scrub_stamp":"2024-08-09T00:40:55.163304+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T01:06:36.656935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029153,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":19124,"num_write":939,"num_write_kb":25701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'69","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:07.542965+0000","last_change":"2024-08-09T00:41:07.543024+0000","last_active":"2024-08-09T00:41:07.542965+0000","last_peered":"2024-08-09T00:41:07.542965+0000","last_clean":"2024-08-09T00:41:07.542965+0000","last_became_active":"2024-08-08T23:28:26.782150+0000","last_became_peered":"2024-08-08T23:28:26.782150+0000","last_unstale":"2024-08-09T00:41:07.542965+0000","last_undegraded":"2024-08-09T00:41:07.542965+0000","last_fullsized":"2024-08-09T00:41:07.542965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-08-09T00:41:07.542773+0000","last_clean_scrub_stamp":"2024-08-09T00:41:07.542773+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:53:09.581153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":260,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'233","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.070027+0000","last_change":"2024-08-09T00:41:09.070186+0000","last_active":"2024-08-09T00:41:09.070027+0000","last_peered":"2024-08-09T00:41:09.070027+0000","last_clean":"2024-08-09T00:41:09.070027+0000","last_became_active":"2024-08-08T23:28:24.814556+0000","last_became_peered":"2024-08-08T23:28:24.814556+0000","last_unstale":"2024-08-09T00:41:09.070027+0000","last_undegraded":"2024-08-09T00:41:09.070027+0000","last_fullsized":"2024-08-09T00:41:09.070027+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'233","last_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_deep_scrub":"268'233","last_deep_scrub_stamp":"2024-08-09T00:41:09.069721+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.069721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:01:13.191209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":89533,"num_write":1169,"num_write_kb":41553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'222","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:14.170136+0000","last_change":"2024-08-09T00:41:14.170225+0000","last_active":"2024-08-09T00:41:14.170136+0000","last_peered":"2024-08-09T00:41:14.170136+0000","last_clean":"2024-08-09T00:41:14.170136+0000","last_became_active":"2024-08-08T23:28:24.789435+0000","last_became_peered":"2024-08-08T23:28:24.789435+0000","last_unstale":"2024-08-09T00:41:14.170136+0000","last_undegraded":"2024-08-09T00:41:14.170136+0000","last_fullsized":"2024-08-09T00:41:14.170136+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'222","last_scrub_stamp":"2024-08-09T00:41:14.169935+0000","last_deep_scrub":"268'222","last_deep_scrub_stamp":"2024-08-09T00:41:14.169935+0000","last_clean_scrub_stamp":"2024-08-09T00:41:14.169935+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T06:44:51.060883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055020,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":157320,"num_write":1033,"num_write_kb":43599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'236","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:11.484453+0000","last_change":"2024-08-09T00:41:11.484453+0000","last_active":"2024-08-09T00:41:11.484453+0000","last_peered":"2024-08-09T00:41:11.484453+0000","last_clean":"2024-08-09T00:41:11.484453+0000","last_became_active":"2024-08-08T23:28:26.765691+0000","last_became_peered":"2024-08-08T23:28:26.765691+0000","last_unstale":"2024-08-09T00:41:11.484453+0000","last_undegraded":"2024-08-09T00:41:11.484453+0000","last_fullsized":"2024-08-09T00:41:11.484453+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-08-09T00:41:11.484163+0000","last_clean_scrub_stamp":"2024-08-09T00:41:11.484163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T07:06:01.629340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":982,"num_read_kb":831,"num_write":390,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'185","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:41:09.975381+0000","last_change":"2024-08-09T00:41:09.975629+0000","last_active":"2024-08-09T00:41:09.975381+0000","last_peered":"2024-08-09T00:41:09.975381+0000","last_clean":"2024-08-09T00:41:09.975381+0000","last_became_active":"2024-08-08T23:28:24.776453+0000","last_became_peered":"2024-08-08T23:28:24.776453+0000","last_unstale":"2024-08-09T00:41:09.975381+0000","last_undegraded":"2024-08-09T00:41:09.975381+0000","last_fullsized":"2024-08-09T00:41:09.975381+0000","mapping_epoch":25,"log_start":"268'100","ondisk_log_start":"268'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-08-09T00:41:09.975107+0000","last_clean_scrub_stamp":"2024-08-09T00:41:09.975107+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T09:57:02.479753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":17056,"num_write":1042,"num_write_kb":18549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'163","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-08-09T00:40:58.144029+0000","last_change":"2024-08-09T00:40:58.144087+0000","last_active":"2024-08-09T00:40:58.144029+0000","last_peered":"2024-08-09T00:40:58.144029+0000","last_clean":"2024-08-09T00:40:58.144029+0000","last_became_active":"2024-08-08T23:28:26.790104+0000","last_became_peered":"2024-08-08T23:28:26.790104+0000","last_unstale":"2024-08-09T00:40:58.144029+0000","last_undegraded":"2024-08-09T00:40:58.144029+0000","last_fullsized":"2024-08-09T00:40:58.144029+0000","mapping_epoch":27,"log_start":"268'100","ondisk_log_start":"268'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-08-09T00:40:58.143843+0000","last_clean_scrub_stamp":"2024-08-09T00:40:58.143843+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-10T03:12:59.634585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":540,"num_write":242,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5492,"num_read_kb":3901,"num_write":2046,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6218,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":19903,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":13260,"num_read_kb":13059,"num_write":15986,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4197,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":39806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1760,"ondisk_log_size":1760,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":494,"ondisk_log_size":494,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314750,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":9845,"num_read_kb":12223,"num_write":6853,"num_write_kb":2887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":620468,"num_omap_keys":1518,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1819,"ondisk_log_size":1819,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1613,"num_read_kb":1921,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":86993,"num_read_kb":70553,"num_write":35134,"num_write_kb":17716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44622,"num_omap_keys":181,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3468,"ondisk_log_size":3468,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":88031934,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":32363,"num_read_kb":2279985,"num_write":69541,"num_write_kb":2057300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134025216,"data_stored":134025216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4276,"ondisk_log_size":4276,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":194734,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":183422,"num_write":192,"num_write_kb":141424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575739,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246792,"kb_used_data":21248,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125048,"statfs":{"total":96636764160,"available":96384049152,"internally_reserved":0,"allocated":21757952,"data_stored":19593835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575737,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284076,"kb_used_data":22436,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94087764,"statfs":{"total":96636764160,"available":96345870336,"internally_reserved":0,"allocated":22974464,"data_stored":20860820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575739,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107176,"kb_used_data":17760,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264664,"statfs":{"total":96636764160,"available":96527015936,"internally_reserved":0,"allocated":18186240,"data_stored":16015430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575737,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110208,"kb_used_data":20728,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94261632,"statfs":{"total":96636764160,"available":96523911168,"internally_reserved":0,"allocated":21225472,"data_stored":19169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575737,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235232,"kb_used_data":23576,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94136608,"statfs":{"total":96636764160,"available":96395886592,"internally_reserved":0,"allocated":24141824,"data_stored":22000945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575737,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105888,"kb_used_data":20632,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265952,"statfs":{"total":96636764160,"available":96528334848,"internally_reserved":0,"allocated":21127168,"data_stored":19032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575740,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145128,"kb_used_data":19616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94226712,"statfs":{"total":96636764160,"available":96488153088,"internally_reserved":0,"allocated":20086784,"data_stored":17965451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575737,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236592,"kb_used_data":20776,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94135248,"statfs":{"total":96636764160,"available":96394493952,"internally_reserved":0,"allocated":21274624,"data_stored":19114679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16203776,"data_stored":16203776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15646720,"data_stored":15646720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16715776,"data_stored":16715776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19681280,"data_stored":19681280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16855040,"data_stored":16855040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13697024,"data_stored":13697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18542592,"data_stored":18542592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":16683008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":6830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-09T00:41:59.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-09T00:41:59.691 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-09T00:41:59.691 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-09T00:41:59.691 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-09T00:41:59.691 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:05.793 INFO:tasks.ceph.osd.0:Stopped 2024-08-09T00:42:05.794 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-09T00:42:05.794 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:05.886 INFO:tasks.ceph.osd.1:Stopped 2024-08-09T00:42:05.887 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-09T00:42:05.887 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:05.963 INFO:tasks.ceph.osd.2:Stopped 2024-08-09T00:42:05.963 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-09T00:42:05.963 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:06.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-08-09T00:42:12.065 INFO:tasks.ceph.osd.3:Stopped 2024-08-09T00:42:12.066 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-09T00:42:12.066 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:12.167 INFO:tasks.ceph.osd.4:Stopped 2024-08-09T00:42:12.168 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-09T00:42:12.168 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:12.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-08-09T00:42:12.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-08-09T00:42:18.269 INFO:tasks.ceph.osd.5:Stopped 2024-08-09T00:42:18.270 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-09T00:42:18.270 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:18.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-08-09T00:42:18.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-08-09T00:42:24.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-08-09T00:42:24.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-08-09T00:42:24.372 INFO:tasks.ceph.osd.6:Stopped 2024-08-09T00:42:24.373 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-09T00:42:24.373 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.467 INFO:tasks.ceph.osd.7:Stopped 2024-08-09T00:42:24.467 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-09T00:42:24.468 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-09T00:42:24.468 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.511 INFO:tasks.ceph.mgr.y:Stopped 2024-08-09T00:42:24.511 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-09T00:42:24.512 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.542 INFO:tasks.ceph.mgr.x:Stopped 2024-08-09T00:42:24.543 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-09T00:42:24.543 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-09T00:42:24.543 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.573 INFO:tasks.ceph.mon.a:Stopped 2024-08-09T00:42:24.574 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-09T00:42:24.574 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.644 INFO:tasks.ceph.mon.c:Stopped 2024-08-09T00:42:24.644 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-09T00:42:24.644 INFO:teuthology.orchestra.run:waiting for 300 2024-08-09T00:42:24.673 INFO:tasks.ceph.mon.b:Stopped 2024-08-09T00:42:24.673 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-09T00:42:24.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-08-09T00:42:24.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-09T00:42:24.701 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-09T00:42:25.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-09T00:42:25.005 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-09T00:42:25.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-09T00:42:25.223 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-09T00:42:25.402 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi083.front.sepia.ceph.com 2024-08-09T00:42:25.402 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-09T00:42:25.596 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-09T00:42:25.596 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-09T00:42:25.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-09T00:42:25.951 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-09T00:42:26.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-09T00:42:26.175 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-09T00:42:26.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-08-09T00:42:26.391 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-09T00:42:26.577 INFO:tasks.ceph:Archiving mon data... 2024-08-09T00:42:26.579 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/data/mon.a.tgz 2024-08-09T00:42:26.579 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-08-09T00:42:26.585 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.hoAnRmXldp 2024-08-09T00:42:26.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hoAnRmXldp 2024-08-09T00:42:26.776 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.hoAnRmXldp 2024-08-09T00:42:26.836 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.hoAnRmXldp is 552KB 2024-08-09T00:42:26.899 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.hoAnRmXldp 2024-08-09T00:42:26.905 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/data/mon.c.tgz 2024-08-09T00:42:26.905 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-08-09T00:42:26.953 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.Z1T7UdXoUj 2024-08-09T00:42:26.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Z1T7UdXoUj 2024-08-09T00:42:27.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.Z1T7UdXoUj 2024-08-09T00:42:27.214 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.Z1T7UdXoUj is 579KB 2024-08-09T00:42:27.279 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.Z1T7UdXoUj 2024-08-09T00:42:27.285 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/data/mon.b.tgz 2024-08-09T00:42:27.285 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-08-09T00:42:27.291 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.V4Txpo1zmL 2024-08-09T00:42:27.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.V4Txpo1zmL 2024-08-09T00:42:27.491 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.V4Txpo1zmL 2024-08-09T00:42:27.552 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.V4Txpo1zmL is 578KB 2024-08-09T00:42:27.614 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.V4Txpo1zmL 2024-08-09T00:42:27.619 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-09T00:42:27.619 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-09T00:42:27.621 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-09T00:42:27.749 DEBUG:tasks.ceph:valgrind exception message: valgrind error: MismatchedFree operator delete[](void*, unsigned long) MonClient::get_monmap_and_config() 2024-08-09T00:42:27.755 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-09T00:42:27.756 INFO:tasks.ceph:Archiving crash dumps... 2024-08-09T00:42:27.761 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi083/crash 2024-08-09T00:42:27.761 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-09T00:42:27.775 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi196/crash 2024-08-09T00:42:27.776 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-09T00:42:27.812 INFO:tasks.ceph:Compressing logs... 2024-08-09T00:42:27.813 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-09T00:42:27.827 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-09T00:42:27.852 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-08-09T00:42:27.853 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134360.log 2024-08-09T00:42:27.853 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-08-09T00:42:27.854 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110277.log 2024-08-09T00:42:27.854 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63592.log 2024-08-09T00:42:27.854 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134360.log.gz 2024-08-09T00:42:27.855 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.110277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117869.log 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.110277.log.gz 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.63592.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.135048.log 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.117869.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 84.7% 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63592.log.gz 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.135048.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.117869.log.gz 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135048.log.gz 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2024-08-09T00:42:27.856 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78983.log 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47435.log: /var/log/ceph/ceph-client.admin.43255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104355.log 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.78983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122652.log 2024-08-09T00:42:27.860 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78983.log.gz 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.104355.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104355.log.gz 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.122652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73083.log 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57126.log 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.73083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87244.log 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.73083.log.gz 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.57126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32794.log 2024-08-09T00:42:27.861 INFO:teuthology.orchestra.run.smithi083.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.122652.log.gz 2024-08-09T00:42:27.862 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.87244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32513.log 2024-08-09T00:42:27.862 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87244.log.gz 2024-08-09T00:42:27.862 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2024-08-09T00:42:27.862 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32794.log.gz 2024-08-09T00:42:27.866 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32090.log 2024-08-09T00:42:27.866 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32513.log.gz 2024-08-09T00:42:27.866 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2024-08-09T00:42:27.866 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104945.log 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84884.log 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32090.log.gz 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.104945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108507.log 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.104945.log.gz 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.84884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95504.log 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.84884.log.gz 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.108507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-08-09T00:42:27.867 INFO:teuthology.orchestra.run.smithi083.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.108507.log.gz 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.95504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95504.log.gz 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.40845.log: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32305.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32889.log 2024-08-09T00:42:27.868 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-08-09T00:42:27.869 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz 2024-08-09T00:42:27.869 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.32889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112737.log 2024-08-09T00:42:27.869 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59069.log 2024-08-09T00:42:27.869 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9%/var/log/ceph/ceph-client.admin.112737.log: -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-08-09T00:42:27.877 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134516.log 2024-08-09T00:42:27.877 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112737.log.gz/var/log/ceph/ceph-client.admin.59069.log: 2024-08-09T00:42:27.877 INFO:teuthology.orchestra.run.smithi083.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.32889.log.gz 2024-08-09T00:42:27.877 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99044.log 2024-08-09T00:42:27.877 INFO:teuthology.orchestra.run.smithi083.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.57126.log.gz 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106715.log 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134516.log.gz 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.99044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77213.log 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99044.log.gz 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.106715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134646.log 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106715.log.gz 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr: 90.1%/var/log/ceph/ceph-client.admin.77213.log: -- replaced with /var/log/ceph/ceph-client.admin.59069.log.gz 2024-08-09T00:42:27.878 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134959.log 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.77213.log.gz 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133767.log 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134646.log.gz 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134854.log 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134959.log.gz 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.133767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119769.log 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134854.log.gz 2024-08-09T00:42:27.879 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134724.log 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132102.log 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.119769.log: /var/log/ceph/ceph-client.admin.134724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134386.log 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.134724.log.gz 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119769.log.gz 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.132102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66836.log 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.132102.log.gz 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.133767.log.gz 2024-08-09T00:42:27.880 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41460.log 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134386.log.gz 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134776.log 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.66836.log: /var/log/ceph/ceph-client.admin.41460.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.66836.log.gz 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41460.log.gzgzip 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66245.log 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134776.log.gz 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.66245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68848.log 2024-08-09T00:42:27.881 INFO:teuthology.orchestra.run.smithi083.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.66245.log.gz 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128562.log 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.68848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129742.log 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90784.log 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.128562.log: /var/log/ceph/ceph-client.0.129742.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.128562.log.gz 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107305.log 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.129742.log.gz 2024-08-09T00:42:27.882 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.90784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90784.log.gz 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74853.log 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.107305.log: /var/log/ceph/ceph-client.admin.44485.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.107305.log.gz 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.68848.log.gz 2024-08-09T00:42:27.883 INFO:teuthology.orchestra.run.smithi083.stderr: 85.7%/var/log/ceph/ceph-client.admin.74853.log: -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2024-08-09T00:42:27.894 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92554.log 2024-08-09T00:42:27.894 INFO:teuthology.orchestra.run.smithi083.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.74853.log.gz 2024-08-09T00:42:27.894 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-08-09T00:42:27.894 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134438.log 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32720.log 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.92554.log: /var/log/ceph/ceph-client.admin.134438.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134438.log.gz 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92554.log.gz 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126202.log 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32720.log.gz 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65063.log 2024-08-09T00:42:27.895 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.126202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32278.log 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.126202.log.gz 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.65063.log: /var/log/ceph/ceph-client.admin.32278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135072.log 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.65063.log.gz 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32278.log.gz 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133170.log 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-08-09T00:42:27.896 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.135072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52230.log 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135072.log.gz 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.133170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68069.log 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.133170.log.gz 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72493.log 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52230.log.gz 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.68069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33479.log 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.68069.log.gz/var/log/ceph/ceph-client.admin.72493.log: 2024-08-09T00:42:27.897 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35824.log 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr: 86.4%/var/log/ceph/ceph-client.0.33479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32304.log 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72493.log.gz 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.33479.log.gz 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.35824.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.35824.log.gz 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110892.log 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32304.log.gz 2024-08-09T00:42:27.898 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90194.log 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.110892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134542.log 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110892.log.gz 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.90194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80753.log 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32094.log 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.90194.log.gz 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134542.log.gz 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.80753.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80753.log.gz 2024-08-09T00:42:27.899 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86064.log 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60359.log 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32094.log.gz 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.86064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101404.log 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.86064.log.gz 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68718.log 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.60359.log: /var/log/ceph/ceph-client.admin.101404.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101404.log.gz 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32097.log 2024-08-09T00:42:27.900 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.68718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55205.log 2024-08-09T00:42:27.901 INFO:teuthology.orchestra.run.smithi083.stderr: 49.7% -- replaced with /var/log/ceph/ceph-client.admin.68718.log.gz 2024-08-09T00:42:27.907 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26595.log 2024-08-09T00:42:27.907 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26731.log 2024-08-09T00:42:27.907 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26595.log.gz 2024-08-09T00:42:27.909 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26683.log 2024-08-09T00:42:27.909 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26731.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-09T00:42:27.909 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26731.log.gz 2024-08-09T00:42:27.909 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26683.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-09T00:42:27.909 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26683.log.gz 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26707.log 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26755.log 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26707.log.gz 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26779.log/var/log/ceph/ceph-client.admin.26755.log: 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26755.log.gz 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-09T00:42:27.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26779.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26779.log.gz 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26659.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.26659.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26659.log.gz 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26635.log 2024-08-09T00:42:27.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-09T00:42:27.912 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26635.log.gz 2024-08-09T00:42:27.912 INFO:teuthology.orchestra.run.smithi196.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-09T00:42:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-08-09T00:42:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32097.log: /var/log/ceph/ceph-client.admin.55205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32097.log.gz 2024-08-09T00:42:27.929 INFO:teuthology.orchestra.run.smithi083.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.55205.log.gz 2024-08-09T00:42:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32866.log 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50435.log 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.31972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69438.log 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32866.log.gz 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50435.log: 80.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123842.log 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.69438.log: 80.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32018.log 2024-08-09T00:42:27.930 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.0.69438.log.gz 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.123842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134750.log 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.123842.log.gz 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32018.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32018.log.gz 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134750.log.gz 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54687.log 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91374.log 2024-08-09T00:42:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49845.log: /var/log/ceph/ceph-client.admin.54687.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.54687.log.gz 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110917.log 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94914.log 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.91374.log: /var/log/ceph/ceph-client.admin.110917.log: 82.0% 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz -- replaced with /var/log/ceph/ceph-client.admin.91374.log.gz 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.110917.log.gz 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121536.log 2024-08-09T00:42:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.94914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32770.log 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94914.log.gz/var/log/ceph/ceph-client.admin.121536.log: 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126792.log 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64474.log 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32770.log: 0.0% 92.5% -- replaced with /var/log/ceph/ceph-client.admin.121536.log.gz 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32770.log.gz 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.126792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111507.log 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.126792.log.gz 2024-08-09T00:42:27.933 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102584.log 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.64474.log.gz 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.111507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77803.log 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81344.log 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111507.log.gz 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.102584.log: /var/log/ceph/ceph-client.admin.77803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124432.log 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.77803.log.gz 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.81344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-08-09T00:42:27.934 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.81344.log.gz 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.124432.log: 80.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134828.log 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.0.124432.log.gz 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37769.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.102584.log.gz 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112687.log 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr: 83.1%/var/log/ceph/ceph-client.admin.134828.log: -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86654.log 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134828.log.gz 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.112687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115407.log 2024-08-09T00:42:27.935 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112687.log.gz/var/log/ceph/ceph-client.admin.86654.log: 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45665.log 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.115407.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.86654.log.gz 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134620.log 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45665.log: /var/log/ceph/ceph-client.admin.134620.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.115407.log.gz 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134620.log.gz 80.7% -- replaced with /var/log/ceph/ceph-client.admin.45665.log.gz 2024-08-09T00:42:27.936 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83114.log 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32098.log 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.83114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56480.log 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83114.log.gz 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32098.log.gz 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71903.log 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.56480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109097.log 2024-08-09T00:42:27.937 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.71903.log: 86.0% 81.3% -- replaced with /var/log/ceph/ceph-client.admin.56480.log.gz -- replaced with /var/log/ceph/ceph-client.admin.71903.log.gz 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.109097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120947.log 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.109097.log.gz 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.31864.log: 95.2% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60359.log.gz 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-08-09T00:42:27.938 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.120947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54118.log 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32284.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.120947.log.gz 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107917.log 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54118.log: 58.1% -- replaced with /var/log/ceph/ceph-client.admin.54118.log.gz 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.107917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89014.log 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.107917.log.gz/var/log/ceph/ceph-client.admin.38371.log: 2024-08-09T00:42:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51615.log 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.89014.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89014.log.gz 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32096.log 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74263.log 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.51615.log.gz 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70723.log 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32096.log.gz 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-08-09T00:42:27.940 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.74263.log: /var/log/ceph/ceph-client.admin.70723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67479.log 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.74263.log.gz 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.70723.log.gz 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32694.log 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.67479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134906.log 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.67479.log.gz 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32694.log.gz 2024-08-09T00:42:27.941 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-09T00:42:27.942 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134568.log 2024-08-09T00:42:27.942 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134906.log.gz 2024-08-09T00:42:27.942 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-08-09T00:42:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93144.log 2024-08-09T00:42:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73673.log 2024-08-09T00:42:27.955 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134568.log.gz 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5/var/log/ceph/ceph-client.admin.93144.log: --verbose -- /var/log/ceph/ceph-client.0.127382.log 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.93144.log.gz 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.73673.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.73673.log.gz 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99634.log 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.127382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54572.log 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.127382.log.gz 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.99634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-08-09T00:42:27.956 INFO:teuthology.orchestra.run.smithi083.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.99634.log.gz 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54572.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94324.log 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54572.log.gz 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134802.log 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.94324.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94324.log.gz 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62296.log 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-08-09T00:42:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134802.log: 0.0%/var/log/ceph/ceph-client.admin.62296.log: -- replaced with /var/log/ceph/ceph-client.admin.134802.log.gz 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84294.log 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62296.log.gz 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31924.log 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113917.log 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.84294.log: /var/log/ceph/ceph-client.admin.31924.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84294.log.gz 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31924.log.gz 2024-08-09T00:42:27.958 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127972.log 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134880.log 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.113917.log: /var/log/ceph/ceph-client.0.127972.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113917.log.gz 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.127972.log.gz 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79573.log 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89604.log 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134880.log.gz 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.79573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123241.log 2024-08-09T00:42:27.959 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.89604.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.79573.log.gz 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.89604.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120358.log 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118458.log 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.123241.log: /var/log/ceph/ceph-client.admin.120358.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.123241.log.gz 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.120358.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76033.log 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-09T00:42:27.960 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.118458.log: /var/log/ceph/ceph-client.admin.76033.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.118458.log.gz 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.76033.log.gz 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21778.log 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112097.log 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.tmp-client.admin.21778.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21778.log.gz 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109687.log 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.112097.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.112097.log.gz 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32746.log 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.109687.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.109687.log.gz 2024-08-09T00:42:27.961 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130332.log 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32746.log.gz 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26745.log 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.130332.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.130332.log.gz 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45075.log 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.26745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26745.log.gz 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.45075.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.45075.log.gz 2024-08-09T00:42:27.962 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31949.log 2024-08-09T00:42:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-08-09T00:42:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117280.log 2024-08-09T00:42:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.31949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31949.log.gz 2024-08-09T00:42:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log 2024-08-09T00:42:27.963 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.117280.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.117280.log.gz 2024-08-09T00:42:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32842.log 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.40255.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.40255.log.gz 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82524.log 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32842.log.gz 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.82524.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82524.log.gz 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80163.log 2024-08-09T00:42:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49795.log: 93.6% 0.0% -- replaced with /var/log/ceph/ceph.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54616.log 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.80163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32818.log 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.80163.log.gz/var/log/ceph/ceph-client.admin.54616.log: 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112712.log 2024-08-09T00:42:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32818.log: /var/log/ceph/ceph-mon.c.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32818.log.gz 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32500.log 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.112712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112712.log.gz 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32291.log 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32500.log.gz 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61649.log 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32291.log.gz 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42075.log 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.61649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61649.log.gz 2024-08-09T00:42:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101994.log 2024-08-09T00:42:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.42075.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.42075.log.gz 2024-08-09T00:42:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-08-09T00:42:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.101994.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101994.log.gz 2024-08-09T00:42:27.974 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110867.log 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134412.log 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.110867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110867.log.gz 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70133.log 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134412.log.gz 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26871.log 2024-08-09T00:42:27.975 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.70133.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.70133.log.gz 2024-08-09T00:42:27.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134672.log 2024-08-09T00:42:27.976 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.26871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26871.log.gz 2024-08-09T00:42:27.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62941.log 2024-08-09T00:42:27.976 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134672.log.gz 2024-08-09T00:42:27.976 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2024-08-09T00:42:27.978 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.62941.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.62941.log.gz 2024-08-09T00:42:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85474.log 2024-08-09T00:42:27.993 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.55828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34656.log 2024-08-09T00:42:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.85474.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.85474.log.gz 2024-08-09T00:42:27.996 INFO:teuthology.orchestra.run.smithi083.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2024-08-09T00:42:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-08-09T00:42:27.998 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.34656.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34656.log.gz 2024-08-09T00:42:27.998 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-08-09T00:42:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz 2024-08-09T00:42:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105535.log 2024-08-09T00:42:28.010 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51025.log 2024-08-09T00:42:28.011 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.105535.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.105535.log.gz 2024-08-09T00:42:28.025 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34066.log 2024-08-09T00:42:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51025.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.51025.log.gz 2024-08-09T00:42:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-09T00:42:28.027 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.34066.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.34066.log.gz 2024-08-09T00:42:28.041 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134594.log 2024-08-09T00:42:28.045 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-09T00:42:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71313.log 2024-08-09T00:42:28.062 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134594.log.gz 2024-08-09T00:42:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55239.log 2024-08-09T00:42:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.71313.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.71313.log.gz 2024-08-09T00:42:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-08-09T00:42:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.55239.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.55239.log.gz 2024-08-09T00:42:28.086 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59714.log 2024-08-09T00:42:28.086 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.41485.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-08-09T00:42:28.093 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115996.log 2024-08-09T00:42:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.59714.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59714.log.gz 2024-08-09T00:42:28.101 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134464.log 2024-08-09T00:42:28.102 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.115996.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.115996.log.gz 2024-08-09T00:42:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61004.log 2024-08-09T00:42:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134464.log.gz 2024-08-09T00:42:28.117 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31992.log 2024-08-09T00:42:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.61004.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.61004.log.gz 2024-08-09T00:42:28.125 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48025.log 2024-08-09T00:42:28.126 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.31992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31992.log.gz 2024-08-09T00:42:28.127 INFO:teuthology.orchestra.run.smithi083.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-08-09T00:42:28.128 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125612.log 2024-08-09T00:42:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48025.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.48025.log.gz 2024-08-09T00:42:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-08-09T00:42:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.125612.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.125612.log.gz 2024-08-09T00:42:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-08-09T00:42:28.131 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-08-09T00:42:28.131 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2024-08-09T00:42:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46845.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-08-09T00:42:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-08-09T00:42:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49205.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2024-08-09T00:42:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54639.log 2024-08-09T00:42:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-08-09T00:42:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54333.log 2024-08-09T00:42:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54639.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-08-09T00:42:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54333.log: 55.4% -- replaced with /var/log/ceph/ceph-client.admin.54333.log.gz 2024-08-09T00:42:28.151 INFO:teuthology.orchestra.run.smithi083.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54639.log.gz 2024-08-09T00:42:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48615.log 2024-08-09T00:42:28.152 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 94.6% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-08-09T00:42:28.153 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100814.log 2024-08-09T00:42:28.154 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48615.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.48615.log.gz 2024-08-09T00:42:28.154 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93734.log 2024-08-09T00:42:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.100814.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.100814.log.gz 2024-08-09T00:42:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97274.log 2024-08-09T00:42:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.93734.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93734.log.gz 2024-08-09T00:42:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96094.log 2024-08-09T00:42:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.97274.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.97274.log.gz 2024-08-09T00:42:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134490.log 2024-08-09T00:42:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.96094.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96094.log.gz 2024-08-09T00:42:28.159 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76623.log 2024-08-09T00:42:28.159 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134490.log.gz 2024-08-09T00:42:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57778.log 2024-08-09T00:42:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.76623.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76623.log.gz 2024-08-09T00:42:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119047.log 2024-08-09T00:42:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.57778.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.57778.log.gz 2024-08-09T00:42:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75443.log 2024-08-09T00:42:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.119047.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.119047.log.gz 2024-08-09T00:42:28.168 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26598.log 2024-08-09T00:42:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.75443.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.75443.log.gz 2024-08-09T00:42:28.169 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65655.log 2024-08-09T00:42:28.170 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.26598.log: 29.1% -- replaced with /var/log/ceph/ceph-client.admin.26598.log.gz 2024-08-09T00:42:28.170 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96684.log 2024-08-09T00:42:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.65655.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.65655.log.gz 2024-08-09T00:42:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107895.log 2024-08-09T00:42:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.96684.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96684.log.gz 2024-08-09T00:42:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2024-08-09T00:42:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.107895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107895.log.gz 2024-08-09T00:42:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130922.log 2024-08-09T00:42:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.53435.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2024-08-09T00:42:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134933.log 2024-08-09T00:42:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.130922.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.130922.log.gz 2024-08-09T00:42:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83704.log 2024-08-09T00:42:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134933.log.gz 2024-08-09T00:42:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36408.log 2024-08-09T00:42:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.83704.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.83704.log.gz 2024-08-09T00:42:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32093.log 2024-08-09T00:42:28.180 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.36408.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36408.log.gz 2024-08-09T00:42:28.180 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32289.log 2024-08-09T00:42:28.181 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32093.log.gz 2024-08-09T00:42:28.181 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125022.log 2024-08-09T00:42:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32289.log.gz 2024-08-09T00:42:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-08-09T00:42:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.125022.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.125022.log.gz 2024-08-09T00:42:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32486.log 2024-08-09T00:42:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-08-09T00:42:28.184 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88424.log 2024-08-09T00:42:28.185 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32486.log.gz 2024-08-09T00:42:28.185 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87834.log 2024-08-09T00:42:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.88424.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.88424.log.gz 2024-08-09T00:42:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100224.log 2024-08-09T00:42:28.188 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.87834.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.87834.log.gz 2024-08-09T00:42:28.188 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114814.log 2024-08-09T00:42:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.100224.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.100224.log.gz 2024-08-09T00:42:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2024-08-09T00:42:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.114814.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.114814.log.gz 2024-08-09T00:42:28.191 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103174.log 2024-08-09T00:42:28.191 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39075.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2024-08-09T00:42:28.192 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32514.log 2024-08-09T00:42:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.103174.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103174.log.gz 2024-08-09T00:42:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2024-08-09T00:42:28.194 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32514.log.gz 2024-08-09T00:42:28.194 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39665.log 2024-08-09T00:42:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52845.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2024-08-09T00:42:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129152.log 2024-08-09T00:42:28.196 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39665.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.39665.log.gz 2024-08-09T00:42:28.196 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55180.log 2024-08-09T00:42:28.197 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.129152.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.129152.log.gz 2024-08-09T00:42:28.198 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134698.log 2024-08-09T00:42:28.198 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.55180.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.55180.log.gz 2024-08-09T00:42:28.199 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58423.log 2024-08-09T00:42:28.199 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134698.log.gz 2024-08-09T00:42:28.200 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2024-08-09T00:42:28.205 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.58423.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58423.log.gz 2024-08-09T00:42:28.205 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78393.log 2024-08-09T00:42:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52255.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2024-08-09T00:42:28.207 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67427.log 2024-08-09T00:42:28.207 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.78393.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.78393.log.gz 2024-08-09T00:42:28.208 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35240.log 2024-08-09T00:42:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.67427.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.67427.log.gz 2024-08-09T00:42:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81934.log 2024-08-09T00:42:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.35240.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.35240.log.gz 2024-08-09T00:42:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98454.log 2024-08-09T00:42:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.81934.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.81934.log.gz 2024-08-09T00:42:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103765.log 2024-08-09T00:42:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.98454.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98454.log.gz 2024-08-09T00:42:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106125.log 2024-08-09T00:42:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.103765.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.103765.log.gz 2024-08-09T00:42:28.219 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-08-09T00:42:28.219 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.106125.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.106125.log.gz 2024-08-09T00:42:28.219 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113327.log 2024-08-09T00:42:28.219 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.43870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-08-09T00:42:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131512.log 2024-08-09T00:42:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.113327.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113327.log.gz 2024-08-09T00:42:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54404.log 2024-08-09T00:42:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.131512.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.131512.log.gz 2024-08-09T00:42:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97864.log 2024-08-09T00:42:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54404.log: 46.6% -- replaced with /var/log/ceph/ceph-client.admin.54404.log.gz 2024-08-09T00:42:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91964.log 2024-08-09T00:42:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.97864.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97864.log.gz 2024-08-09T00:42:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32089.log 2024-08-09T00:42:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.91964.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.91964.log.gz 2024-08-09T00:42:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2024-08-09T00:42:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32089.log.gz 2024-08-09T00:42:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.46255.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2024-08-09T00:42:28.365 INFO:teuthology.orchestra.run.smithi196.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-09T00:42:29.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-08-09T00:42:29.209 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-09T00:42:29.390 INFO:teuthology.orchestra.run.smithi196.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-09T00:42:30.940 INFO:teuthology.orchestra.run.smithi083.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-08-09T00:42:31.229 INFO:teuthology.orchestra.run.smithi083.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-09T00:42:34.492 INFO:teuthology.orchestra.run.smithi083.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-09T00:42:36.245 INFO:teuthology.orchestra.run.smithi196.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-09T00:42:36.538 INFO:teuthology.orchestra.run.smithi196.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-09T00:42:36.689 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-09T00:42:36.695 INFO:teuthology.orchestra.run.smithi083.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-09T00:42:38.260 INFO:teuthology.orchestra.run.smithi196.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-09T00:42:38.262 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-08-09T00:42:38.262 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m10.396s 2024-08-09T00:42:38.262 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m36.840s 2024-08-09T00:42:38.263 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m1.353s 2024-08-09T00:42:39.232 INFO:teuthology.orchestra.run.smithi083.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-09T00:42:43.332 INFO:teuthology.orchestra.run.smithi083.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-09T00:42:43.333 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-08-09T00:42:43.333 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m15.505s 2024-08-09T00:42:43.333 INFO:teuthology.orchestra.run.smithi083.stderr:user 0m48.584s 2024-08-09T00:42:43.334 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m1.834s 2024-08-09T00:42:43.335 INFO:tasks.ceph:Archiving logs... 2024-08-09T00:42:43.336 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi083/log 2024-08-09T00:42:43.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-09T00:42:49.139 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi196/log 2024-08-09T00:42:49.140 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-09T00:42:53.760 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: MismatchedFree operator delete[](void*, unsigned long) MonClient::get_monmap_and_config() 2024-08-09T00:42:53.774 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-09T00:42:53.785 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_43b88056bcf6a0548bdd2d0502e56290cbae52df/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0a88632b45f25ae38493667c7dbd155f6e59b499/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: MismatchedFree operator delete[](void*, unsigned long) MonClient::get_monmap_and_config() 2024-08-09T00:42:53.788 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-09T00:42:53.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-09T00:42:53.805 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-09T00:42:53.868 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-09T00:42:53.878 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-09T00:42:53.879 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-09T00:42:53.881 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-09T00:42:53.896 INFO:teuthology.orchestra.run.smithi083.stdout: remote refid st t when poll reach delay offset jitter 2024-08-09T00:42:53.896 INFO:teuthology.orchestra.run.smithi083.stdout:============================================================================== 2024-08-09T00:42:53.896 INFO:teuthology.orchestra.run.smithi083.stdout:*hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.087 -2.499 0.311 2024-08-09T00:42:53.896 INFO:teuthology.orchestra.run.smithi083.stdout:+hv02.front.sepi 96.245.170.99 3 u 16 64 377 0.090 -0.260 0.151 2024-08-09T00:42:53.897 INFO:teuthology.orchestra.run.smithi083.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.093 -1.913 0.180 2024-08-09T00:42:53.897 INFO:teuthology.orchestra.run.smithi083.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-09T00:42:53.897 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-08-09T00:42:53.897 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-08-09T00:42:53.898 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 67.205.162.81 3 u 65 64 377 0.118 -2.746 0.200 2024-08-09T00:42:53.898 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 96.245.170.99 3 u 54 64 377 0.110 -0.417 0.428 2024-08-09T00:42:53.898 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.109 -2.472 0.270 2024-08-09T00:42:53.898 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-09T00:42:53.899 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-09T00:42:53.909 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-09T00:42:53.910 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-09T00:42:53.921 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-09T00:42:53.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-09T00:42:53.944 INFO:teuthology.task.internal:Duration was 5118.140839 seconds 2024-08-09T00:42:53.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-09T00:42:53.954 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-09T00:42:53.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-09T00:42:53.957 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-09T00:42:53.994 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-09T00:42:53.994 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-08-09T00:42:53.994 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-09T00:42:54.051 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-08-09T00:42:54.051 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-09T00:42:54.062 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-09T00:42:54.062 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-09T00:42:54.095 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-09T00:42:54.129 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-09T00:42:54.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-09T00:42:54.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-09T00:42:54.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-09T00:42:54.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-09T00:42:54.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-09T00:42:54.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-09T00:42:54.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-09T00:42:54.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-09T00:42:54.331 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-09T00:42:54.340 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-08-09T00:42:54.354 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-08-09T00:42:54.416 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-09T00:42:54.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-09T00:42:54.421 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-09T00:42:54.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-09T00:42:54.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-09T00:42:54.476 INFO:teuthology.task.internal:Transferring archived files... 2024-08-09T00:42:54.477 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi083 2024-08-09T00:42:54.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-09T00:42:54.500 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-08-08_23:01:55-rgw-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7844499/remote/smithi196 2024-08-09T00:42:54.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-09T00:42:54.527 INFO:teuthology.task.internal:Removing archive directory... 2024-08-09T00:42:54.528 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-09T00:42:54.539 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-09T00:42:54.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-09T00:42:54.587 INFO:teuthology.task.internal:Not uploading archives. 2024-08-09T00:42:54.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-09T00:42:54.599 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-09T00:42:54.599 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-09T00:42:54.602 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-09T00:42:54.606 INFO:teuthology.orchestra.run.smithi083.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 9 00:42 /home/ubuntu/cephtest 2024-08-09T00:42:54.620 INFO:teuthology.orchestra.run.smithi196.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 9 00:42 /home/ubuntu/cephtest 2024-08-09T00:42:54.621 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-09T00:42:54.634 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-09T00:42:54.647 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: MismatchedFree operator delete[](void*, unsigned long) MonClient::get_monmap_and_config() 2024-08-09T00:42:54.651 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 5118.140838623047 failure_reason: 'Command failed (s3 tests against rgw) on smithi083 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=eb118e183b994bbc870d1d72a3db68f5 status: fail success: false 2024-08-09T00:42:54.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-09T00:42:54.728 INFO:teuthology.run:FAIL